Get updates on the future of VR/AR:

  FILTERS:      Art & Design      Education      Explorations      Gaming      Hardware      IoT      Medical      Music      Orion      Unity      Unreal      UX Design      VR/AR   

// Internet of Things

When the Leap Motion Controller made its rounds at our office a couple of years ago, it’s safe to say we were blown away. For me at least, it was something from the future. I was able to physically interact with my computer, moving an object on the screen with the motion of my hands. And that was amazing.

Fast-forward two years, and we’ve found that PubNub has a place in the Internet of Things… a big place. To put it simply, PubNub streams data bidirectionally to control and monitor connected IoT devices. PubNub is a glue that holds any number of connected devices together – making it easy to rapidly build and scale real-time IoT, mobile, and web apps by providing the data stream infrastructure, connections, and key building blocks that developers need for real-time interactivity.

With that in mind, two of our evangelists had the idea to combine the power of Leap Motion with the brains of a Raspberry Pi to create motion-controlled servos. In a nutshell, the application enables a user to control servos using motions from their hands and fingers. Whatever motion their hand makes, the servo mirrors it. And even cooler, because we used PubNub to connect the Leap Motion to the Raspberry Pi, we can control our servos from anywhere on Earth.

Virtual reality and the Internet of Things are fundamentally different in many ways, but they share a common goal – bringing digital experiences into the 3D world. And whether that world is a space full of physical objects, or a parallel universe of our own creation, the best 3D interfaces are the ones that have the power to become part of the environment.

For hardware hackers, boards like Arduino and Raspberry Pi are the essential building blocks that let them mix and mash things together. But while these devices don’t have the processing power to run our core tracking software, there are many ways to bridge hand tracking input on your computer with the Internet of Things.

In this post, we’ll look at a couple of platforms that can get you started right away, along with some other open source examples. This is by no means an exhaustive list – Arduino’s website features hundreds of connective possibilities, from different communication protocols to software integrations. Whether you connect your board directly to your computer, or send signals over wifi, there’s always a way to hack it.

Following my tutorial on controlling the Sphero using the Leap Motion, I thought I would keep on converting my Node.js projects to Cylon.js and work on controlling an AR.Drone with Leap Motion.

One of the most powerful things about the Leap Motion platform is its ability to tie into just about any creative platform. That’s why we created a Platform Integrations & Libraries showcase where you can discover the latest wrappers, plugins, and integrations.

Cylon.js is a JavaScript framework for robotics, physical computing, and the Internet of Things (IoT) that makes it easy to network 36 different platforms (and counting). On our Developer Gallery, you can find example projects to help you get started with wirelessly controlled Arduino boards and Parrot AR.Drones. Recently, we got in touch with Ron Evans, the creator of Cylon.js and other open source robotics frameworks, about the emerging IoT revolution.

While truly smart digital assistants are still on the horizon, recent advances in voice recognition and control technologies are taking us closer to sci-fi dreams like Iron Man’s AI JARVIS or Her’s Samantha.

The Internet of Things is different things to different people. In recent posts on Leap Motion’s Developer Labs, we’ve seen how the Leap Motion device can open up new interaction models in smart environments. To exist within the Internet of Things – to network with other devices in a smart ecosystem on a machine-to-machine (M2M) […]

It’s time to fully embrace a change in the way we think about technology and how we use it in our day-to-day lives. The gadgets, the APIs, and the common ground for connecting them all together in diverse and incredible ways exist right now. Leap Motion is just one part of rediscovering how we can […]

Happy holidays! In the spirit of the season, rediscover wonder and unwrap the Universe of Sound on Developer Labs. Plus, reach into touchless interaction with the Internet of Things and think about 3D app design with Lotus creator Eddie Lee. This week’s newsletter also features outdoor Christmas lights with Leap Motion color control, an Arduino-driven laser […]

At SmartThings, we think a lot about the way we interact with the everyday objects around us. We integrated Leap Motion interaction with our open platform to unlock a new world of possibilities in which home automation devices didn’t just respond automatically to our preferences and presence, but also to our hand movements.