Jade Starr Music

Pixel Music

by Andrei Antonescu

Turns a photograph's pixels into pitch, velocity and note length

Apr 10, 202366 minWatch on YouTube ↗

Jade demos the newest music apps as they land.Subscribe and see them first ↗

Jump to

  1. 22:30Loading a photo and opening the grid size up to the whole image
  2. 26:27Traversal directions: left to right, top down, and a shrinking square
  3. 28:09Image traversal timing, from a bar per step down to a sixteenth
  4. 29:16Recording a finger-drawn pattern over the top, quantised or not
  5. 35:08The model page, mapping pitch, velocity and duration to colour or brightness
  6. 40:58Sending each photo page out to a different instrument as MIDI

What it does

A sequencer that reads a photograph as a grid of pixels and plays it as notes. A playhead crosses the image left to right, top down or in a shrinking square, and each pixel sets pitch, velocity and note length, mapped from average RGB, luminance, hue or saturation. Grid size, key, scale and note rate sit on top of that. Several photos run at once, each page with its own instrument and its own MIDI destination.

In the demo

Jade plays a piece built from photos of channel regulars, then starts fresh with one image, working through grid size, traversal direction and the mapping page so each change is audible. She crops a photo so only part of it plays, toggles single pixels off, records a finger-drawn loop over the top, then drives Speldosa and a saxophone from separate pages in AUM.

Worth knowing

There are only two built-in sounds, so most of the work here goes out as MIDI to other instruments. Dark photos crowd the notes into a narrow range, which Jade runs into more than once.

All sequencers and generative tools →
48 min

Ambient Architect

Lewis Le Val$9.99

Generative MIDI composer that drives eight instruments you already own

MIDISequenceriOSiPadOS
33 min

Kalimba: Pocket Synth

Ruben Terron RodriguezFree, $3.99 unlock

Touch strip kalimba with pluck, sustain and wavetable engines

InstrumentSynthSequencerLooperMIDIiOSiPadOS
23 min

Rock Drum Machine

LumbeatFree, $22.99 unlock

Rock session drummer with grunge banks and live pads, now AUv3

DrumsSequencerMIDIiOSiPadOSmacOS
33 min

Riffer 4

AudioModern$12.99

MIDI riff generator with five engines and a full note editor

SequencerMIDIiPadOS