• visit gskinner.com

gskinner blog

Visit gskinner.com

News and views on the world of interactive media from the gskinner team

Recent Posts

  • FlutterFlow Vignettes Technical Dive, Part 1
  • Pushing the boundaries of what’s possible with FlutterFlow
  • Flutter: iOS Home Widgets Deep Dive
  • Overlapping Worlds of Product Design and Architecture
  • Flutter Vignettes updated to Dart 3.x

Archives

March 3, 2011January 16, 2018 by Grant Skinner

Music Visualizer in HTML5 / JS with Source Code

It’s no secret that I like building music visualizers, or that I’ve been playing with HTML5 a fair amount lately. Given that, I thought I’d combine the two interests, and build a music visualizer using JS, the canvas & audio elements in HTML5, and the EaselJS framework.

-->
  • Apollo, HTML, Javascript, Source Code, Tools
  • 42 Comments

It’s no secret that I like building music visualizers, or that I’ve been playing with HTML5 a fair amount lately. Given that, I thought I’d combine the two interests, and build a music visualizer using JS, the canvas & audio elements in HTML5, and the EaselJS framework.

The primary challenge was that Javascript doesn’t have any built in mechanism for accessing the volume of a playing audio tag. To address this I wrote a little AIR application that will read an MP3 file using Sound.extract() and export peak volume data as a text or JPG image file. I then wrote a JS class called VolumeData.js that reads in these files and provides access to the data via a simple interface (ex. myVolumeData.getVolume(time) ).

With those pieces in place and tested, I started putting together a demo of it in action using EaselJS. Two of the newest features were compositeOperation support (which let me approximate an “add” blend mode), and the drawPolyStar method, both of which I used to excess.

I think the end result is pretty cool, though it requires a fairly modern system, and will still melt your CPU – I was intentionally pushing things hard to try to find the performance limit. It requires an up to date browser to run.

I built two variations: Star Field and Atomic. Occasionally dynamic audio loading seems to break on certain browsers, just reload if it gets stuck on “loading music”.

If you’re interested in building your own music visualizers in HTML5/ Javascript, you can download the demo source, VolumeData.js class (MIT licensed) and VolumeData AIR application here. Also, be sure to check out the latest version of EaselJS (we just released v0.3.2 today).

Please let me know if you build anything cool with the code. I’d love to see it.

Post navigation

Grant Skinner

The "g" in gskinner. Also the "skinner".

@gskinner

If you enjoyed this, you might like these articles…

Source Code: Spectrum Ring Music Visualizer, Colorgasm Music Visualizer, AS3: Music Visualization Demos with computeSpectrum, Introduction to the Flash CC HTML5 Canvas Document

42 Comments

  1. Og2t March 3, 2011 at 10:43am

    Great stuff Grant. I liked the pixel matrix (2 pixels for blue makes perfect sense as it’s always darken on its own). Need to try EaselJS soon.

  2. viaria March 3, 2011 at 11:20am

    nice but 7fps.

  3. Blacktiger March 3, 2011 at 11:51am

    What is that song? I know I’ve heard it somewhere before.

  4. hoitybeaver March 3, 2011 at 12:55pm

    you should try using flash, the frame rate will be much better and it will work on any browser

  5. Evan March 3, 2011 at 2:13pm

    Awesome Grant! I’m a huge fan of music visualizers as well. I prefer the Atomic version, it’s a little more interesting I think, and more props on the song choice, perfect song for it. So does the peak volume directly relate to the effect, or is it the slope of the change in peak? It seems to react to change more than just volume, well, at the louder parts it stays pretty large too though. great fun!

  6. Grant Skinner March 3, 2011 at 2:23pm

    Evan – it uses a combination of momentary volume, delta volume (over 0.2s), and average volume (also over 0.2s). Momentary volume provides an obvious tie into the music, delta let’s you react to change, and average gives you a nicely smoothed value to work with for effects that you don’t want twitching too much.

  7. Evan March 3, 2011 at 2:27pm

    thanks Grant, that makes great sense, you’re too smart.

    btw – I remembered where I’d heard that track: Inception

  8. dekz March 3, 2011 at 9:58pm

    @hoitybeaver that would defeat the entire process

  9. random March 3, 2011 at 10:45pm

    Nice to see this happening!

  10. Tahir Ahmed March 3, 2011 at 11:57pm

    Man! you are good with Visualizations.

  11. Matita March 4, 2011 at 2:48am

    You’re great as always!
    It would be interesting to compare performances with the same application done in Actionscript

  12. mediapathic March 4, 2011 at 4:39am

    I like the unintentional inverse correlation between epicness and framerate. Keeping an eye on the fps meter was like

    “twentysixtwentyfivethirtytwentysix NIIIIINE FRAMES PER SEEEEEECOND twentytwotwentysix…”

    I kid of course. It’s very impressive work, and looks great. As a VJ, I can’t wait till we can use this on arbitrary incoming audiostreams in realtime…

  13. Pablo Cabana March 4, 2011 at 10:32am

    Nice work!!
    Have you seen this?
    http://lab.simurai.com/ui/zen-player/

    It works even on my iphone 3gs with 4.2.1 ios

  14. Wolgor March 6, 2011 at 2:01pm

    Nice! But in my Opera 11.01 I can hear the music but instead of the visualization I can only see a black box. The error console logs this error every tick:

    Uncaught exception: TypeError: Cannot convert ‘volumeData’ to object

    Error thrown at line 158, column 1 in tick() in http://easeljs.com/demos/MusicVisualizer/index.html:
    var vol = volumeData.getVolume(t);
    called from line 31, column 7 in () in http://easeljs.com/demos/MusicVisualizer/easel.js:
    j==null||b&&i||j.tick==null||j.tick(a)

  15. Aristophrenia March 9, 2011 at 5:25am

    Grant – you really have jumped ship at the wrong time – here I am playing with molehill – new sound effects, new bezier system and huge, etc, etc in flash 11 – and here you are reverting back to what is essentially one step up from animated ascii scripts of the 90’s…?

    Just sayin……each to their own though.

    p.s.

    Really didn’t work in firefox, ok in chrome (20fps).

  16. Grant Skinner March 9, 2011 at 5:33am

    Aristophrenia – I don’t limit myself to looking at technology platforms as ships to jump onto or off of, I look at them as tools, where I can be happily building things and playing with many of them at the same time. Different tools have different strengths and serve different markets, limiting yourself to one is myopic. Have fun, and learn as much as you can.

  17. Hassan Elousami March 9, 2011 at 6:12pm

    True, this is also the right time to learn and get used to the new technologies while they are in their infancy. Funny though to see how different browsers deal with the rendering. If you run one of the visualizations in two browsers simultaneously, you will be using all your cpu. In Firefox 4 beta, memory just goes through the roof.. no hardware acceleration I guess 🙂

  18. chris March 21, 2011 at 1:44am

    I see this library being picked-up by adobe, plugins are to hard to maintain why not let the browser vender’s do the handwork and you build great IDE’s imo.

  19. Colin Sullivan March 21, 2011 at 1:57pm

    There are experimental open APIs for accessing raw audio data, including Mozilla’s Audio Data API and a (chromium group?) W3C Web Audio API. The W3C Audio Incubator Group page has many more links to experimental HTML5 audio data examples.

  20. mr wayann March 26, 2011 at 12:27pm

    Nice visualizer! imo one of the most impressive examples with html5 js at the moment…

  21. Mike Stuart March 28, 2011 at 11:53am

    Grant – good to see you’re still as busy as ever. I saw you speak at Flash Forward NYC. I also am a fan of visualizers and was floored when I tried someone’s iPad for the first time and saw – “No Visualizer in iTunes???”
    Cool stuff, I look forward to catching up on your site.
    ~Mike

  22. Hamranhansenhansen April 3, 2011 at 3:18am

    > you should try using flash, the frame rate will be much better
    > and it will work on any browser

    This one comment explains everything that is wrong with the FlashPlayer Plug-in. It is *not* universal, it does *not* work in any browser, but some people just will not accept that. The only thing that is universal is HTML. FlashPlayer is only included with Windows PC’s, and the latest trend in FlashPlayer is disabling it to prolong battery life or enhance security. Click-to-Flash won a design award last year. The IE6-IE8 users you are catering to with FlashPlayer are also the ones whose companies have disabled FlashPlayer for security reasons.

    For the record, I viewed this music visualizer in Safari 5 on a MacBook Air that does not have FlashPlayer. Worked beautifully. Also, for the record, I’ve been a Flash developer since 1997. Flash peaked in 2005 and died in 2007. Since then, Adobe has been promising that it will rise from the dead “next year.” Get over it!

  23. moses gunesch April 6, 2011 at 2:07pm

    Fantastic! Looks really nice. Looking forward to seeing more Flash creativity bleed into the new (old) world of HTML! 🙂

  24. devu May 1, 2011 at 3:46pm

    Hi Grant Skinner

    This is time for rant from very loyal follower of you from many years.
    You have been great inspiration for many flash community members. You’ve done great contribution to Flash community without doubt. Now I blame you. You jumping in HTML5 world supporting Apple void words and showing to many of your followers new direction. If Flash will die someday you are going to be responsible for this even more than SJ. Instead of putting your effort in rewriting Flash greatest invention DisplayList and porting it to HTML5 canvas (patent still partially belongs to Apple) you should make exactly the same thing in order to port Molehill 3D for 2D content. This is what we expecting from you. We all know, that Adobe implementation is not perfect in many places but a lot of Flash evangelist and enthusiasts make all this good things happened in the past. Pushed Adobe to improve things. Your steps now doing more damage into flash community that you can even possibly imagine or you are not aware of. I have removed your blog from my blogroll list and hope more flash developers especially flash evangelist will do the same thing. You are clearly working against Flash Platform. I don’t know is being famous is your priority over being loyal to platform thanks to you became famous is more important to you.

    You already know how weak JS and Canvas implementation is compare to AS3, so it is not about being performance lover. My heat is bleeding.

  25. chrm May 24, 2011 at 4:47am

    @devu +1, but

    I have an idea:

    MXML-AS3(Flex) should be have the native support by any browser as like as HTML-JS. (Posted on LinkedIn)

    my comments:
    In this case, it (Flex) will get a new impetus + HTML dev look to the side Flash + Flash to stay up(more) as the trend.

    I know we has to close FlashPlayer today, but many of developers want to be have it, may be as OpenSource.

    My question: What do you think about?

    P.S. I collect the opinions of experts.
    Being not engaged by Apple, Adobe, MS, Google, etc, I am expressing my own interests.

  26. Ted June 9, 2011 at 1:08am

    The AIR app in the sources zip will not install on XP. Error message suggests contacting the author. Possible to repackage or provide source to rebuild?

  27. karl August 22, 2011 at 10:53am

    Hey,

    Cool demo. I’m working for Opera. And right the visualizer doesn’t work in Opera 11.50 and Opera 12 at least. There is an easy fix to make it work.

    In http://easeljs.com/demos/MusicVisualizer/VolumeData.js

    var instanceofImage = false; 
 try { instanceofImage = data instanceof HTMLImageElement; } 
 catch(e) { instanceofImage = data instanceof Image; } 
 ... 
 } else if (instanceofImage) {

    var instanceofImage = false; try { instanceofImage = data instanceof HTMLImageElement; } catch(e) { instanceofImage = data instanceof Image; } ... } else if (instanceofImage) {

  28. crackruckles September 10, 2011 at 5:42am

    I loved this, and it was great to see that my frame rate never went below 20fps the entire time, so great job.

  29. Joe October 30, 2011 at 7:24am

    @devu
    what the heck is wrong with you? lol

  30. Rohit November 19, 2011 at 1:58am

    Hey, What could be the solution for creating a music playlist with visualizations? and what can be solution for live stream music?

  31. Christian December 18, 2011 at 4:51pm

    No matter what you do, you never seize to amaze me! Keep it going.

  32. Chris Turley January 26, 2012 at 5:11am

    Hello Grant, I hope everything is fine with you. I don’t know how I stubbled on to your page but, I didnt! I love “star Field and Atomic” so much, love you add your html code to my site. I am new to web building myself. making a code for myself that would be as dynamic as your is isn’t possible at this time that I really need to have something like this. Let me tell you a little something about my site, http://exstreamjamsradio I am creating is a new kind of social site and online station. This site is where people like yourself can come and enjoy themselves with music being played in the background. This site I was originally made with (php) however, to be honest, me and php don’t get along.(lol) So now I am creating a new site with something I know a little more about (HTML)(javascript). Currently, I am building this new site (which promises to be mind blowing), One that I think would really bring knew people to my station.
    So, instead of uploading music to it it will monitor the ip and port that I would you could set in the coding.

    Back to your Atomic visualization. The first question is could it be resized so that I can use it and place it wherever, I choose too? Whith the fact that myself, Is a dj on this site, Could it be used for the visualization to be streamed to it? Last but not least, would I have permission from you to use the exacted coding on my site? If I would have permission. I would advertise you as one of my links on your site with specail thanks?

    One more statment and question, the new site of which I am creating has a brick background to it; if I was to send you the photo that I’m using as the background, could you implament that photo and the same background?

    Thank you for your time in this matter and hope I will hear back from you soon. Please email me at my [email protected] not twitter.

  33. Dan Owen February 9, 2012 at 12:24pm

    Gorgeous! Thank you.

  34. David Lawrence March 15, 2012 at 7:11pm

    Awesome job! Running on an i3 2100 with intel integrated graphics I’m getting no glitches at all. Looks like you’ll have to push the boundaries again 😀

  35. AlexGermanHTML March 20, 2012 at 3:04pm

    for some reason, when I try this demo, the visual turn grey and everything disappears, but the song keeps playing. what’s my problem?

  36. Finiderire April 14, 2012 at 6:00pm

    This is totally cool but we need more and be able to play our own music

  37. Confidant May 18, 2012 at 11:14am

    Clicking the demo links just takes me to the createjs site.

  38. JacobSyndeo July 6, 2012 at 6:27pm

    I’d like to try this out, but the demo links redirect from http://easeljs.com/demos/MusicVisualizer/index.html to http://www.createjs.com/#!/EaselJS, and the demo is nowhere to be found. 🙁

  39. Kim Jensen July 23, 2012 at 11:42am

    I absolutely love the idea behind this, but provided that the sole purpose of the AIR app is to extract (semi)-precise data, saving in a lossy format like JPEG seems to be a bad idea. The nature of the JPEG format would seem to degrade the volume/pixel data. Why not use PNG or at least allow for it as an option?

  40. sam April 28, 2013 at 1:05pm

    I’m unable to add audio files through volumedata.air for some reason, can give steps how to do it? So that I can correct myself if I’m doing a mistake..

    And is it possible to make this visualizer work on a radio stream?

    Thanks in advance 🙂

  41. d December 23, 2013 at 3:03am

    hi this is RAD

  42. dvd_nasa September 18, 2014 at 2:40am

    I download your source code, but when i use another music file, it not working! Why and how to use with another music file!

Comments are closed.

©2023 gskinner