Skip to content
Ljómi Systems
All products
In development

VisionMIDI Live

Any scene, turned into music

YOLOv11 object detection converts any video feed into music in real time. The system maps each detected object to a note on a configurable virtual piano overlay, and tracks objects between frames so the output holds together as they move through the scene.

Get in Touch Our Services
VisionMIDI Live overlaying a note grid on a street scene, with tracked detection boxes labelled person and car with confidence values.
VisionMIDI Live on a street scene: the virtual piano overlay, tracked detection boxes and their confidence values.

Availability

VisionMIDI Live is not available to buy or download yet, and there is no demo recording of it running. What follows is a description of the system as built. Get in touch if you want to see it or know when it ships.

How it works

  • YOLOv11 object detection

    YOLOv11 handles the real-time object detection. It identifies and tracks several objects at once, in urban, natural or staged scenes.

  • Dynamic musical translation

    Each detected object maps to a note on a configurable virtual piano overlay. Position, size and movement all feed the output, so the music follows how the scene is laid out and how it moves.

  • Intelligent tracking

    The tracker holds onto objects across frames, so the output stays consistent as they move, overlap, or briefly leave the frame. No jarring note drops or resets.

  • Universal scene compatibility

    Works with any scene: traffic, bird flight, wildlife, dance, pedestrian flow, or abstract visual compositions. If it moves, it makes music.

Technical specs: what it needs, what it emits

Input
Live camera or video file
Detection
YOLOv11 real-time
Objects tracked
Multiple simultaneous
Output
MIDI notes
Overlay
Configurable virtual piano
Scenes
Universal compatibility
Latency
Real-time
Platform
macOS

Where it earns its place

  • Urban sound installations that turn traffic and pedestrian movement into music

  • Natural rhythm capture: bird flight paths, wildlife movement, water flow

  • Live performance installations where dancers or performers generate the soundtrack

  • Generative art and music projects using found footage or live streams

  • Theatre and stage productions where the scoring follows the scene

Interested inVisionMIDI Live?

We’d love to walk you through the system, answer questions, or discuss how it fits your workflow.

Get in Touch