NEO HYPERION
A generative soundscape where live audio drives a breathing visual instrument — every performance renders a world that will never repeat.
Challenge
Audio visualisation collapses into cliché the moment it becomes literal. Bars, rings and pulses read as decoration. The problem was to make sound legible as an environment — something that has terrain and weather rather than a waveform.
Idea
Decompose the signal into frequency bands and assign each band a physical consequence instead of a graphic. Bass displaces geometry, mid-range drives light temperature, transients trigger fracture, and silence is not empty — it becomes fog, drift and cooling.
Experience
The visitor steers a camera path through terrain that is being generated by whatever is playing. Because the mapping is physical rather than decorative, the same track twice never produces the same route: the system remembers energy over time, so the world carries the history of the performance.
Design Direction
Almost monochrome. Colour is earned by intensity, never applied for variety, so a loud passage is the only thing in the frame that is allowed to be bright. Motion easing is deliberately slow against fast audio to keep the piece cinematic instead of frantic.
Technology
- Web Audio API with FFT band decomposition and temporal smoothing
- Custom GLSL vertex displacement and emissive shading
- GPU particle systems driven by transient detection
- Deterministic seeding so a session can be replayed exactly
Process
- Signal studies — mapping frequency bands to physical consequences
- Shader prototyping against recorded reference tracks
- Latency tuning so visual response reads as instantaneous
- Fallback mode for devices without audio permission or WebGL2
Outcome
A system that behaves like an instrument rather than a plugin: it can be performed, it rewards restraint in the source material, and it degrades into a still, atmospheric state instead of breaking when the audio stops.
Deliverables
- Generative audio engine
- Audio-reactive shaders
- Live visuals system
- Interactive web experience
Live Experience / Prototype
This project is not publicly hosted. A walkthrough can be arranged on request.
Building what shouldn't exist yet.
Next
What should exist next?
Have an idea that doesn't fit the usual brief?