An open-source motion instrument: shake, tilt and rotate an iPhone or iPad to play percussion, a continuous Theremin, or CHIMERA's physical vocal synth. Includes an AUv3 MIDI processor and a Mac bridge for wireless MIDI and local sound.
Development beta. Shaker feel and texture are being tuned on physical hardware. This is not a finished release. iOS and Apple Silicon macOS have engineering builds; Android and Windows apps are planned, not delivered. The AUv3 is MIDI-only and requires a compatible instrument/host route.
Simulator fixture showing the native CHIMERA anatomy; synthetic motion, not a physical device acceptance test.
Open the Motion web demo — no install or account. Starts on the real CHIMERA WASM voice with live 3D anatomy. Synths include Theremin, Velvet, Glass, Orbit and Reed. The Shaker uses audio-clock XYZ grain contacts and 32 complete recorded rattles; the display shows the same particles. Feedback and native beta access requests are available in the demo. Enable motion on a supported phone, or use touch/mouse controls. Browser latency and sensor behavior still need physical acceptance; this demo has no native Mac link or AUv3 hosting. Web source and build instructions are in WebMotion.
- Shaker: loose XYZ grains inside a box, circle or oval; adjustable dimensions, grain size and count. Contact-local pulses show collisions. Continuous measured shaking effort drives overlapping recorded grains, without beat quantization.
- Tambourine, Maraca, Cabasa and Hand Drum: directional or rotational gestures drive percussion.
- Classic Theremin: continuous X pitch, Y vowel/formant colour, with pause/resume.
- CHIMERA: Jameson Hodge's native physical vocal model; X pitch, Y OO–AH–EE and Z effort. Its actual 3D anatomical head replaces the motion dots, follows the native articulators, and supports drag rotation.
Phone sound runs locally. The network sends musical events and controls, never audio. The Mac bridge advertises via Bonjour and exposes a CoreMIDI source. The separate Mac listening tool renders the received instrument.
Requires Xcode with the iOS SDK, XcodeGen, Rust 1.88.0 and Bun. Install tools from their official distributions, then:
rustup toolchain install 1.88.0
rustup +1.88.0 target add aarch64-apple-darwin aarch64-apple-ios aarch64-apple-ios-sim
scripts/build_chimera_native.sh
bun install --cwd Renderer/Chimera --frozen-lockfile
bun run --cwd Renderer/Chimera build
swift test --package-path Packages/MotionCore
xcodegen generate
xcodebuild -project KaizenMotion.xcodeproj -scheme KaizenMotion \
-configuration Debug -destination 'generic/platform=iOS Simulator' \
ARCHS=arm64 CODE_SIGNING_ALLOWED=NO buildOpen the generated Xcode project to install on your own phone. Select your development team for both targets and use bundle identifiers registered to that team. Signing accounts, provisioning profiles, generated native binaries and private device/session logs are not part of the repository. Intel simulator and Mac binaries are not currently packaged by the native build script.
swift run --package-path Packages/MotionCore KaizenMotionBridge
# In a second terminal:
swift run --package-path Packages/MotionCore KaizenMotionListen --built-in --low-latencyOn the phone, open the output status panel, find the Mac on the same local network and select it. This engineering transport has no authenticated pairing; use it on a trusted local network. The listening tool has no app window. --output-name 'Device Name' selects another Mac audio output.
App,SharedPlatform,SharedUI: native Swift app, sensing, networking and interface.Extension: AUv3 MIDI processor.Packages/MotionCore: gesture analysis, MIDI protocol, tests, bridge and listening tool.Packages/MotionCore/Sources/MotionToneDSP: bounded real-time C percussion and Classic Theremin.Packages/MotionChimeraNative: native Rust adapter and pinned upstream vocal engine.Renderer/Chimera: pinned upstream 3D drawing code and local Three.js bundle builder. No browser audio engine or remote assets.Assets: editable Blender controls, render scripts and attributed recorded shaker sources.portable: standalone C audio boundary and C++ ABI check. This is groundwork for other platforms, not an Android/Windows app.
The initial public snapshot passes 65 Swift tests, two Rust real-time/audio tests, and an arm64 iOS simulator/device archive build. The 3D head has been visually checked in the simulator using explicitly synthetic motion. These checks do not establish physical playing feel, named DAW compatibility or acceptance on other platforms.
cargo +1.88.0 test --manifest-path Packages/MotionChimeraNative/Cargo.toml
cmake -S portable -B build/portable -DCMAKE_BUILD_TYPE=Release
cmake --build build/portable
ctest --test-dir build/portable --output-on-failureMotion's original source and project-created assets are MIT licensed; see LICENSE. Third-party components retain their own licenses. The Kaizen names and logos are not a trademark grant.
- CHIMERA by Jameson Hodge, MIT, pinned at
dd68078730126c50cd119b18b3889e414c4f4528. Its license is retained beside the native engine and renderer. - Three.js, MIT, version 0.186.1; license bundled in
App/Resources/ChimeraHead/THREE-LICENSE.txt. - Recorded shaker sources by el_boss, Sadiquecat and Joseph SARDIN are CC0. Exact sources, hashes and excerpt provenance are in
Assets/Audio/Shaker/sources.jsonandbank.json. - Rust dependency license texts are in
LICENSES. Upstream licenses take precedence for their components.
Issues and contributions are welcome. For sound/gesture bugs include the device, selected instrument, motion performed and whether the issue affects phone sound, Mac sound or MIDI. Never include signing credentials or provisioning profiles.
