MusiKraken

What it does

A construction kit for MIDI controllers. Modules are dropped into a scene and patched together. Inputs include a keyboard, chord pad, touchpad, face and mouth tracking, TrueDepth distance, hand, finger and body tracking, color tracking, motion sensors, AirPods head motion, game controllers, microphone and Apple Watch. Outputs go to a hosted Audio Unit, a built in synth, or MIDI over Bluetooth, Wi-Fi or Core MIDI. Between them sit a chord splitter, transposer, arpeggiator, LFO and value to MIDI converters that map any input to any CC.

In the demo

Jade patches a keyboard into a synth, then splits chords across three mono cellos on separate channels and transposes each. She drives a theremin patch with body tracking, plays notes by opening her mouth while her left eye sends modulation, and links an iPad to Logic over IDAM to record three tracks at once.

Worth knowing

Several inputs depend on the hardware, so the face and TrueDepth modules appear only on devices that have the camera. It sends control data rather than making sound of its own, and building a rig takes patient patching.