Interactive Sound & Video

The Room Listens.
The Room Responds.

Live audio-visual systems that react to movement, presence, gesture, depth, and data — in real time, every time.

What It Is

Sound and image as living systems

Interactive sound and video means an audio-visual environment that does not play back — it performs. Every visual frame and every sonic moment is generated fresh, shaped by the inputs arriving from the space around it.

Someone walks into a beam of light. The bass frequency shifts. A particle field erupts from their silhouette and drifts across the projection surface. Two people move toward each other and a harmonic builds between them. One person freezes — and the system holds its breath.

These are not effects. They are behaviours — designed, composed, and tuned until the system has a quality of aliveness that audiences feel before they understand.

"We design behaviours, not playback. The system has to feel alive — responsive enough that people test it, and surprising enough that they keep coming back."

The core pipeline connects sensing to synthesis. Depth cameras read the spatial volume. Motion analysis extracts meaning: position, velocity, direction, gesture. That data drives visual and audio synthesis engines that generate output in real time — never the same twice.

The result is a closed loop: the audience shapes the system, and the system shapes the audience's next move.

Inputs & Sensing

What drives the system

Any signal can become an input. These are the most common ways we read the world in real time.

🫁
Presence & Proximity
Simply being in the space is enough. Depth cameras detect bodies, estimate distance, and track position continuously — no wearables, no touchscreens, no instruction required.
🤸
Movement & Gesture
Velocity, direction, rhythm, and shape of movement all become controllable parameters. A slow sweep generates one response; a sudden burst generates another.
📏
Depth & Spatial Data
Depth cameras provide full 3D spatial maps of a scene. This allows volumetric interaction — working with the z-axis, not just the 2D silhouette.
🎙️
Sound & Voice
Microphones and audio analysis feed amplitude, pitch, rhythm, and spectral content into the visual engine — or trigger structural changes in the audio itself.
📡
External Data
Environmental sensors, live network data, scientific instruments, APIs. Any data stream can be mapped to visual or sonic parameters — giving the installation a connection to the wider world.
👥
Collective Behaviour
Multiple participants interacting simultaneously create emergent patterns — the system responds to the group, not just the individual, surfacing collective dynamics as aesthetic phenomena.

Outputs & Synthesis

What the system generates

🎥
Generative Video
Real-time visual synthesis — particle systems, fluid simulations, geometric forms, abstract imagery, and data-driven graphics — rendered live and output to projectors or screens at any resolution. Visuals that have never existed before and will never exist again in quite that form.
🎧
Generative Audio
Synthesised sound, granular audio processing, spatial audio placement, and live signal processing — all mapped to the same input data that drives the visuals. Sound and image share a nervous system, making the relationship feel physical and coherent rather than layered.
🔦
Projection & Light
Output to single or multiple projectors, including projection mapping onto complex architectural surfaces. Programmable lighting integrated with the real-time system — so the entire space responds, not just the screen.
🌐
Networked Systems
Multi-machine setups for large-scale installations — distributed rendering, synchronised playback across multiple outputs, and live remote monitoring. Scalable from a single-room installation to a multi-venue deployment.

The Workflow

Built for real-time performance

Colluzions uses professional real-time visual and audio programming environments — node-based, modular workflows designed for live performance and installation. This approach allows rapid iteration during development and live adjustment during the installation itself.

Systems are built to be robust and fail-gracefully in live environments. Every installation goes through thorough testing — behavioural tuning, stress testing with live audiences, and operational handover where required.

We can provide full technical operation, training for in-house teams, or remote monitoring depending on the project's needs.

Talk About Your Project
🧩

Modular Architecture

Systems are built from composable, reusable components. Complex behaviours emerge from simple, well-defined modules.

⚙️

Live Parameter Control

Every behavioural parameter can be adjusted in real time during the installation — adapting to different spaces, audiences, and conditions.

🛡️

Reliable in Production

Designed for continuous operation. Watchdog processes, graceful error handling, and minimal-intervention setups for unattended or semi-attended deployments.