Axis Communications, a pioneer in network video, has unveiled an experiment called The Object Detection Orchestra - the world’s first musical performance played entirely on AI-powered video surveillance cameras and speakers.
Designed to push the boundaries of how video surveillance can be applied beyond traditional security, the initiative demonstrates how advanced analytics can transform cameras into unconventional instruments.
Cameras with AI-based analytics
Axis created a system that reads everyday objects such as tennis balls, coffee cups, and fire extinguishers
Pairing high-performance cameras with AI-based analytics, Axis created a system that reads everyday objects such as tennis balls, coffee cups, and fire extinguishers as musical cues.
As a chosen item moves across a camera’s field of view, different zones trigger different notes, turning a surveillance camera into a fully functional musical instrument.
Range of advanced solutions
Experienced software engineer at Axis Communications, Ghaith Sankari, explains: "With this experiment, we wanted to challenge what is possible with our video surveillance cameras and AI-based analytics when it comes to detecting custom objects and triggering actions in real time."
Ghaith Sankari adds, "We made an orchestra. But our customers can use the same cutting-edge technology to create a broad range of advanced solutions tailored to their needs."
Traditional strings and horns
The performance is a reimagining of Richard Strauss’s ‘Also Sprach Zarathustra’, made iconic in 2001
The performance is a reimagining of Richard Strauss’s ‘Also Sprach Zarathustra’, made iconic in 2001: A Space Odyssey.
Instead of traditional strings and horns, this version uses the movement of objects as cues: "We could have used any objects really. What you train the cameras and analytics to detect is totally up to you. For example, we have customers who use this technology to automatically spot design flaws or production errors," says Ghaith Sankari.
Creative challenges
Swedish Music Producer, Jonas Quant, known for his work with Kylie Minogue, No Doubt, and Hurts, composed the piece: “What fascinated me was treating object detection itself as a new kind of instrument."
He states, "Since we’re not using a keyboard, this experiment posed creative challenges like teaching musicians how to play an invisible instrument in thin air."
AI-powered analytics and network video solutions
While playful, The Object Detection Orchestra is more than a novelty. It acts as a proof of concept, showcasing how Axis advanced AI-powered analytics and network video solutions can be trained to identify almost anything and trigger real-time actions.
The same technology is already enabling smarter automation, supporting smart cities, and shaping future machine interactions - and taking video surveillance far beyond security.
