ARVJ - See The Music

ARKit, Unity3D


ARVJ is a mobile augmented reality app that catches all the sound from real world and visualizes it layered on top of the real world. I wanted to create a portable VJ so that people can enjoy sound visualization anywhere and anytime. 


Visual aspect of music listening experience is crucial. It will elevate the whole experience. Visual parts will make audiences more concentrate to the music. Also, it keep visual sensory from dispersing and will deliver the emotions and feelings to the crowd. This makes the moment more impressive and memorable. That is why famous DJs and musicians are using visualization like lightings and graphic videos in the show.


However, this is very expensive, many buskers will not be able to afford music visualization. I see musicians on the streets, subways and in the park everyday in the New York City. I love listening to their music and it is very impressive how their music spectrum is so broad. I thought it would be awesome to visualize their music in real-time. That is why I came up with this project idea. 

Screen Shot 2018-04-08 at 3.22.43 AM.png
Screen Shot 2018-04-08 at 3.25.40 AM.png

The app is getting sound input (street music) from the physical world and generates animated imagery based on audio components. The colorful abstract sphere-shaped object will react to the sound’s amplitude and frequency that surrounds the user. Some parts of the object will change its color, some parts will move, rotate or bounce.