Pixel Music
by Andrei Antonescu
Turns a photograph's pixels into pitch, velocity and note length
Apr 10, 202366 minWatch on YouTube ↗
Jade demos the newest music apps as they land.Subscribe and see them first ↗
Jump to
- 22:30Loading a photo and opening the grid size up to the whole image
- 26:27Traversal directions: left to right, top down, and a shrinking square
- 28:09Image traversal timing, from a bar per step down to a sixteenth
- 29:16Recording a finger-drawn pattern over the top, quantised or not
- 35:08The model page, mapping pitch, velocity and duration to colour or brightness
- 40:58Sending each photo page out to a different instrument as MIDI
What it does
A sequencer that reads a photograph as a grid of pixels and plays it as notes. A playhead crosses the image left to right, top down or in a shrinking square, and each pixel sets pitch, velocity and note length, mapped from average RGB, luminance, hue or saturation. Grid size, key, scale and note rate sit on top of that. Several photos run at once, each page with its own instrument and its own MIDI destination.
In the demo
Jade plays a piece built from photos of channel regulars, then starts fresh with one image, working through grid size, traversal direction and the mapping page so each change is audible. She crops a photo so only part of it plays, toggles single pixels off, records a finger-drawn loop over the top, then drives Speldosa and a saxophone from separate pages in AUM.
Worth knowing
There are only two built-in sounds, so most of the work here goes out as MIDI to other instruments. Dark photos crowd the notes into a narrow range, which Jade runs into more than once.
More sequencers and generative tools
All sequencers and generative tools →
48 minAmbient Architect
Lewis Le Val$9.99
Generative MIDI composer that drives eight instruments you already own
33 minKalimba: Pocket Synth
Ruben Terron RodriguezFree, $3.99 unlock
Touch strip kalimba with pluck, sustain and wavetable engines
23 minRock Drum Machine
LumbeatFree, $22.99 unlock
Rock session drummer with grunge banks and live pads, now AUv3
33 minRiffer 4
AudioModern$12.99
MIDI riff generator with five engines and a full note editor