Get updates on the future of VR/AR:

  FILTERS:      Art & Design      Education      Explorations      Gaming      Hardware      Medical      Music      Orion      Unity      Unreal      UX Design      VR/AR   

Imagery, video, text – whatever its form, ephemeral media is a thrill to experience because it’s forever fleeting. Teeming with the threat that if you look away, even for a second, you could miss it entirely. With his completely improvised performances, Russian-based musician Anton Maskeliade brings this elusive principle into the genres of electronica and contemporary pop. Using his whole body, he creates new soundscapes on the spot with 3D MIDI controllers and bit-crushed drum machines. Never the same song twice.

Read More ›

Are you ready to use your hands to fly to the moon and play among the stars? Elon Musk and the engineers at SpaceX aren’t the only ones using Leap Motion technology to explore other worlds. With these 11 space-inspired apps available in the Airspace Store or on the web, you can learn about the universe, travel the galaxy, or jump into your starship to shoot down bad guys.

Read More ›

From immersive universes to innovative first-person shooters, we’ve heard from thousands of gamers worldwide about unique gameplay possibilities for the Leap Motion Controller. Soon, you’ll be able to find both in a single game – and the prologue will be available exclusively as an app for Leap Motion. Based on the darkly humorous comics series, Blue Estate for the PC is an upcoming first-person shooter with killer atmosphere.

Read More ›

This week, we hit the 100-app milestone with 4 new Windows titles in the Airspace Store. With the apps in today’s blog post, you can master the art of catching flies and building towers, or take control of your PC by gesturing or simply pointing.

Read More ›

Hi,

Today’s newsletter features some highlights from the first-ever official Leap Developers Meetup in San Francisco. We also have the first confirmed use of the Leap Motion Controller under sterile operating conditions for human surgery, an inside look at our community teams, and how Elon Musk and SpaceX are using 3D interaction to design rocket parts.

Read More ›

Last week, Leap Motion held their first developer meetup at the popular 111 Minna Gallery in San Francisco. The event marked the beginning of an ongoing monthly series that gives our team a chance to have face-to-face time with developers in the local community.

We recently released v1.0 of our developer SDK, so we thought it would be a great opportunity for our colleagues in the engineering and product teams to provide some insights about the post-launch landscape and the road ahead.

Event Kickoff

The evening kicked off a little after 6:30pm, with a long line outside the doors and developers waiting to get in. With over 100 people attending, the energy in the room was high. We started the meetup with an open bar, Patxi’s pizzas, and a chance for developers and the Leap Motion team to connect and chat.

As the pizza boxes emptied, we ushered everyone in to hear from our engineering team. The panel consisted of David Holz, CTO and co-founder; Raffi Bedikian and Kevin Horowitz, both members of our Software Team; Isaac Cohen, creative research; and Dan Peterson, Director of Product. A quick show of hands revealed a fairly even mix of developers, with roughly half already familiar with the SDK and a fairly even split between web developers and native app developers.

image
AirHarp and AirBeats developer Adam Somers has a beer with Avi Dabir, Director of Developer Relations.

David’s Vision for the Future

David Holz introduced the session, diving deep into the fundamental vision behind a technology that has the potential to bring humans and technology closer – bridging many of the familiar intuitive physical world interactions with the digital space.

As technology has evolved, the interface has been abstracted away to the point where interaction is completely detached from the action we’re trying to achieve. David envisions a future where everyone – young and old, tech nerds and noobs alike – will be able to intuitively understand the technology they’re interacting with, just as easily and instinctively as picking up a coffee mug.

image
The experience of manipulating 3D objects with your hands goes to a whole new level when coupled with the Oculus Rift VR headset.

Scrolling Interface and Airspace

David’s talk segued into a sneak preview of some of our team’s ongoing projectsIsaac presented his demo showing how a scrolling interface might look for a Leap Motion app. He explained some of the intricacies behind several of his experimental approaches. Because this is a completely new way of interacting with technology, he argued, there are no rules. This presents both a challenge and great opportunity for ambitious developers who want to help pioneer these new design patterns for future developers.

Dan followed up to explain a little bit about Airspace, including what Leap Motion is doing to improve the platform from its initial version. In the future, Dan said, the plan is to bring web apps into the Airspace Store, adding more currencies and localizations for the roughly 113 countries that received Leap Motion Controllers, and lowering the friction for getting involved with a paid app – possibly by allowing brief trial periods before download and purchase.

Demo Stations

Leap Motion-Controlled Robotic Arm

Yu-Jang demonstrated his robotic arm with multiple degrees of freedom. The arm runs using servos driven by Arduino boards. The arm uses a custom-built inverse kinematics engine to mimic the movement of the user’s hand, and the claw opens and closes as the user pinches their fingers together.

image
Yu-Jang watches as his robotic arm is taken for a test drive.

Oculus Rift + Leap Motion

Gerald Terveen has been developing software for both the Leap Motion Controller and the Oculus Rift since very early days. His game Licht also provides full 3D Oculus VR support, and is available in Airspace. Gerald showed off some simple Oculus + Leap Motion demos that allowed the user to manipulate the virtual environment around them by manipulating 3D objects in the virtual world.

image
Licht developer Gerald Terveen (right) demonstrates a few of his experiments combining the Leap Motion with the Oculus Rift VR headset.

Leap Dragon

Creative researcher Isaac Cohen showed off some of the more obscure interactions he’s been experimenting with using the JavaScript API. Leap Dragon, which we’ve featured before on Developer Labs, is a cross between a music visualizer and a game of snake. The user controls the 3D sound snake down a rotating tunnel collecting audio samples to add into the currently playing track. Isaac is a regular contributor to Developer Labs. See more of his work here.

Facebook Photo Viewer

Adam Skubel demonstrated his Facebook photo viewer which provided a chance for attendees to see how we may be viewing rich content in the near future. Adam’s app uses an adapted tap technique that he explains in his post on Developer Labs.

Unity3D Integrations

Pohung Chen has been creating a selection of Unity3D examples for our community that highlight some of the new and innovative interaction methods made possible with the Leap Motion Controller. The examples included grabbing and throwing objects, two-handed flying techniques, and Jedi-style Force control. Pohung is a regular contributor to Developer Labs. See more of his work here.

Our meetup on Sept. 3 in San Francisco was the first in what will be an ongoing series of monthly meetups for our developer community. To register for next month’s event on October 23, check out our Meetup page.

Musicians around the world are experimenting with new ways to perform their songs using Leap Motion. The Geco MIDI app has been particularly popular in Airspace, and we’ve seen lots of amazing videos showing how musicians are using Leap Motion in their work.

Here are 6 songs from artists based in Israel, the United Kingdom, Iowa, Australia, and Berlin. They’re using the Leap Motion Controller to open a new dimension of responsiveness and flow. If you’re exploring Leap Motion with your music too, we would love to hear from you.

Read More ›

Working with thousands of highly talented and creative people is an essential part of what makes us tick. Our Developer Relations and Developer Program teams work with the Leap Motion developer community to provide support and knowledge about our platform, and with individual developers to help bring their apps to the world. Meet Avi and Kiwi – two key people on our community teams.

image

What does the developer community mean for Leap Motion?

Kiwi: Developers are the lifeblood of Leap Motion. Without a strong community of talented developers sharing in this vision and making great software, we couldn’t exist. It’s a tightly coupled ecosystem – our technology combined with great software from developers around the world.

How does your team work with Leap Motion developers?

Kiwi: Our goal is to ensure a healthy, growing, and engaged developer community, and it’s my job to make sure developers get all the help they need to get their apps into Airspace. I’m always on the lookout for developers with great ideas, great apps, or who just want to be active in the community.

Avi: Our team works directly with individual developers. What I like about the community is that it gives the opportunity for anybody to rise to the top. Sometimes these smaller guys/girls from the community get really hot – they’ll build something cool, post it on YouTube, and if they could use our support, we’ll contact them. We’re willing to with work with devs to help wherever we can. We match great brands with great developers, to see what they can create together.

image

What gets you excited about working at Leap Motion?

Kiwi: It’s great to be part of such a talented group of people. I strongly feel we have an opportunity to change the world and the way we think about computing and technology in general. I feel fortunate to have the opportunity to be a part of that vision.

Avi: There’s something new every day – we’re laying the tracks and driving the train at the same time. This is something that’s never been done before, and we have the chance to plant our flag. A lot of the developers look to us for best practices, and it’s pretty awesome to have that impact. It’s also about seeing what developers create – they surprise you. We give them the tools, but they take it to a whole new level.

Avinash “Avi” Dabir (@bringmedabir) is the Director of Developer Relations at Leap Motion. Michael “Kiwi” Sutherland (@kiwi) is the Developer Program Manager. To join future developer community events, join our Meetup group, Leap Motion Developers.

Elon Musk and SpaceX want to take humanity to other planets. To help make that dream a reality, the real-life inspiration for Robert Downey Jr.’s Iron Man has been using the Leap Motion Controller to design a rocket part prototype using hand gestures. It’s a truly new experience for the pioneering company, bringing together cutting-edge aerospace engineering with our Leap Motion Controller.

Musk tweeted about SpaceX’s touchless design system on August 23, and it quickly went viral:

image

image

By integrating the Leap Motion Controller with their CAD platform, SpaceX engineers can manipulate virtual rocket parts with a high degree of nuance and control. It allows them to dive into virtual models and see them in new ways. From design to prototype, the component can be printed in titanium in a matter of days at SpaceX headquarters.

image

Founded by Musk in 2002, SpaceX designs, manufacturers, and launches advanced rockets and spacecraft. They’ve already become the first private company to return a spacecraft from low-Earth orbit and resupply the International Space Station. With their Falcon Heavy rocket, they soon hope to send a crewed spacecraft on lunar orbiting missions.

But their true giant leap for mankind, enabling human settlements on other planets, is a dream decades in the making. Meeting this challenge means nothing less than bringing science fiction to life – playing with engineering and design concepts to create something new. By exploring touch-free interaction with CAD and the Leap Motion Controller, SpaceX takes another first step towards that giant leap.

This week in Airspace, take to the skies in a hang glider or run your hands through a peaceful pool of water. In the new browser-based game HelloRun, you can fly through the winding corridors of a spaceship. Plus, we’ve made it easier for you to discover the latest apps in the Airspace Store with our What’s New category.

Read More ›