When we joined artists and coders at Google San Francisco last week to talk about the future of the web, the consensus was clear: it’s time to truly unleash our creativity. Beneath our browsers is a robust engine waiting to break free. It’s more than a place to consume media and speedread viral headlines – it’s a platform to heighten our senses and challenge our minds.
// JavaScript
Want to tweak, distort, and transform your sound with Leap Motion and electric guitar? This week on Developer Labs, Nicolás Earnshaw talks about designing musical interfaces and his experiments with a touchless modulating app that uses the Leap Motion Controller to track a guitar head. Plus, check out Isaac Cohen’s latest talk on art, nature, […]
I’m Isaac, and I’m an experience engineer at Leap Motion. I work exploring a newly discovered relationship with our hands. I’m intensely interested in communing with digital nature, and the tools that I use are Three.js, Web Audio API, and most of all, Leap Motion. Most of what I have done can be found at cabbibo.com where I have been working on constructing my own personal Ice Kingdom.
This week, we’ve explored the creative process that went into building my Leap Motion guitar app, along with some thoughts about mapping and visual feedback. My app was built quickly as a proof of concept, making use of several existing free frameworks, and could certainly be improved. In the last of my guitar app series, we’ll take a look at how I brought these frameworks together, along with one final variation – a theremin-like synthesizer.
The toughest part of my Leap Motion guitar project was the nature of the mapping – deciding what does what. To get started, I decided to approach the problem from a design perspective. As in any design task, there are many correct answers, and yet also a lot more wrong answers lurking in the deep. […]
There’s a space between an electronic musical instrument and the sound it creates where almost anything is possible. With the right technologies, you can tweak, distort, and transform your performative input to create whole new soundscapes on the other side. In this three-part series, I’d like to talk about the amazing possibilities of using the Leap Motion Controller for musical expression, and show how musicians can add new dimensions to their sound.
What does music look like? What happens when you reach into a fractal? Explore these questions on Developer Labs with Isaac Cohen, and stay tuned for his livestreamed SFHTML5 talk on Thursday. Plus, a great guide to waving through colors with a Philips Hue bulb. Also this week, we have a real-time projection mapping robot, […]
Drawing his inspiration from music, mathematics, and the infinite possibilities of space and nature, Leap Motion experience engineer Isaac Cohen likes to push the limits of the web. At last October’s HTML5 DevConf, Isaac showed how we can rethink web design beyond current interfaces and reimagine what the Internet might look like in the future.
The process of instilling wonder has always fascinated me. It’s such an indescribable emotion, but so fervent and real. Attempting to make a person feel wonder is a marvelous quest.
In this post, I’d like to examine a project I worked on, called The Universe of Sound. It’s something that I’ve been working on for quite some time, and although it probably isn’t as cool as I hope to make it sound, I am proud of it, mostly because of how much of my life it consumed.