Use arrow keys to move through composition. Use the space to hide this message and start the audio. Reload the page to generate a variation on the piece. Tested in Chrome and Safari on a Mac.

This is Not a Machine Learning

Machine learning is huge today. Blogs with new techniques related to modeling, composition and visualization emerge daily. It’s wild that such complex human outcomes can be emulated with the statistical models of machine learning and so-called neural networks.

They succeed where deductive logic fails us. What’s the formula for recognizing handwriting, or for composing music? By induction, examining lots and lots of similar examples—sometimes with human supervision and sometimes without—neural networks come up with successful predictions and classifications. A machine that learns from example, without explicit instructions, has incredible implications. I suppose that is why so many are concerned that it might lead to our end.

But, using the term “neural network” implicitly claims that these statistical models function like the brain or human intelligence. While that may be the stated goal of AI researchers, really, that’s begging the question. The computer “neuron” is a metaphor. We can call it that because it does some things with results that are human-like and have configurations that are somewhat neuron-like. But there is only a loose relationship between the computer model and the brain. The inner workings of both kinds of neurons are still mysterious. Training a network is not the same as learning.

Really, are we concerned with modeling the human brain or are we honing statistical principles? These divergent goals should be identified appropriately. And, the implications of neural nets becoming artificially intelligent, really intelligent, seems a little extreme.

I have had the opportunity to evaluate machine learning libraries and paradigms, as well as an amazing array of sample material that tends to accompany them. From large text corpora and image catalogs, to bodies of recorded audio material, almost any data set large enough (and somewhat homogeneous) can be seen as material from which we can train a model. We are only beginning to feed the world to these machines. Who can predict what successes lie ahead?

In terms of creative output though, my concern is that we will continue to move into a realm where the statistical representation is what we deem acceptable. How do you chose the movies you watch on Netflix? The music you listen to on Spotify? I mean, its cool that we can generate more Mozart statistically, but really, who cares? The interesting thing is Mozart, not the machine that can emulate or select his music.

This observation extends to much of the aesthetic of the new internet. It is often driven by statistics. Where is the risk? Machine learning is great for selection, but who is in charge of mutation and deduction? The instant you recognize that the machine can predict your tell, you will have no choice but to change it. Sure the intelligent machine might kill you, but that is at least a few decades away.

Until that time, we must continue to create the “sample” material for future intelligent networks to “learn” from. This is a risk each of us must make. It means transforming, contextualizing or editorializing the common vernacular and insulting the herd. Oops. Making creative work is a key component of how we relate to each other. Being human means building and challenging a model. This piece is inspired by research and application of various forms of machine learning but it is definitely not a machine learning. There is no way to vote up preferred random selections or vote down the often times this piece produces some combination that is not so pleasing.

All this said, in regards to the science, this critique is only semantic. I look forward to following the incredible work of those who are advancing the field. This audio/visual presentation is a meditation on the thinking expressed here.

David Karam, August 10, 2015 with some extra special help from Steve Hartzog.

Made using three.js and Tone.js — view the source.