Working in Silicon Valley, I’ve come to realize that everything that seems futuristic was actually on the drawing board a startling number of years in the past. Technology is like a flash in the darkness – long nights building towards an instant when suddenly everything is different. That’s why I think all of us work in technology, and why we at Leap Motion are always very much living in the future.
Technology is like a flash in the darkness – long nights building towards an instant when suddenly everything is different Click To TweetI come from the future now to tell you a bit about what’s just over the horizon. Today I’m going to be talking about the Leap Motion Mobile Platform. This is a combination of software and hardware we’ve made specifically for untethered, battery-powered virtual and augmented reality devices, many of which will run off the same types of processors already used in smartphones around the globe.
The challenges to build a tracking platform in this space have been immense. We needed to build a whole new Leap Motion sensor with higher performance and much lower power. We needed to make the most sophisticated hand tracking software in the world run at nearly 10 times the speed all while making it smoother and more accurate than ever before.
At the same time, we wanted to address the biggest request from the VR community, which is field of view. While our PC peripheral remains unrivaled at 140×120 degrees, we’ve found in virtual reality there is reason to go even further. So we’ve built our next-generation system with the absolute maximum field of view that a single sensor can support on a VR headset, which is 180×180 degrees.
Last, we’ve built a reference system on top of the Gear VR that we’re shipping to headset makers around the world to show how this all comes together into a single cohesive product. Starting this month, we’ll be demoing this system at major VR events with an enhanced version of our Interaction Engine and flagship Blocks demo.
This is the beginning of an important shift towards mobile and ubiquitous wearable displays that will eventually be as easy and casual to use as a pair of glasses. The ultimate result of which will be the merging of our digital and physical realities.
It is difficult to express how much we appreciate this news. Go guys, do it, and we will implement the illusion of touching a virtual object with it!
We really appreciate that. That is why when selecting on which tracking technology basing our haptics system, Leap Motion was the only logic choice. As soon as the dev kit with qualcomm is out, our technology will just pop in naturally. Next time I’ll pop in the Silicon Vally, I’ll stop by to let you try it.
This is a super news! Congrats guys! Leap with Mobile headset will be huge, especially if vendors will start integrating it built-in in the headsets.
Field of view is cool, but how about maximum distance?
Also, what’s the resolution / precision at a distance. As long as it is sub-centimeter at an arm’s length it isn’t too bad, but stuff like virtual instruments would do better with sub-millimeter
It’s capable of very high precision, but too early to provide specifics at this point.
Maximum distance is significantly beyond arm length.
Guys, you’re so kind to have answered all my questions! I have added your answers inside my blog post about your news https://skarredghost.wordpress.com/2016/12/05/leap-motion-goes-mobile/ . You’re epic!
Given that one sometimes want to make gestures outside one’s own field of view, will you try to address synchronizing multiple sensors (including stationary ones), so that people can move arbitrarily, even literally with flailing arms, and get everything registered by the sensors?
Way down the road — generation 3 VR/AR — we will likely see constellations of sensors, all over our reality glasses 😉 But as mentioned in another comment, it’s too early for multiple sensors on current mobile chipsets.
I am quite interested in the concept of ancillary sensors (e.g. proximity, temperature, pressure) each with their own micro-controller (Arduino, ESP8266, etc) being able to interact with several Leaps. Low power, cheap peripherals augmenting the big machine.
When I read the title “mobile” I thought it will be possible to use it standalone and route events to a consuming app.
Tying it to VR won’t help exploring new forms of use of the Leap Motion
That’s nice, and don’t even close the door to VR. I’m experimenting with a small Win10 worn computer streaming hand data to a PC where the VR app actually runs, aiming at a wireless, PC-based, immersive setup.
So, you LM wizards could consider to extend such new mobile setup with the possibility to plug a (sort of) wi-fi dongle to use it independently of the smart VR headset you probably targeted it at.
It sounds so great, and it is the natural evolution for the Leap Motion right now! The challenges is huge, more related to power consumption, but all is being evolve too! I will be waiting for… more news and for it
[…] a post written on its blog, Leap Motion has made a huge announcement: Leap Motion will go […]
And… what about Daydream integration?
We want to make magical experiences possible and that happens when our tech basically becomes an invisible part of the overall design — a more human natural experience. So our goal with this release is to show what a fully integrated product can look like. We’ll have more to say about specific SDK support, integrations, etc. when we get closer to a full release.
Ok, thanks!
[…] société a annoncé qu’elle va apporter sa technologie de suivi de la main vers le mobile, ce qui signifie que vous […]
This sounds great! I love you guys!
Congratulations! I was just talking about this on LinkedIn. I was hoping your platform would
merge with the VR world. This is awesome!
[…] Leap Motion, makers of the popular USB motion sensor for Apple and PC, announced today in a blog post that they are working on a new software/hardware platform called Leap Motion Mobile. […]
Questions:
-Now that this one consumes less will it be possible to use multiple devices?
-Do we have color on this one? like dragonfly? please say yes 😀
-Will a new dongle available for smartphone testing? or only on HMD mode?
-Should we expect positional tracking with this headset like MS one?
-Will it be VR only? no AR?
-Will it work under the same SDK?
-Will this new embeded HW have its own CPU? or it will depend on the external HW? like the current one?
1. Anything is possible with time and engineering effort, but multiple sensors would seriously overtax even today’s high-end mobile chipsets
2. While the Leap Motion Vision Platform is more advanced than Dragonfly, it doesn’t have RGB passthrough. Augmented reality is a little further down our roadmap.
3. This is embedded technology — we don’t have plans for a new standalone peripheral.
4. Inside-out positional tracking is obviously a holy grail in mobile and AIO VR right now. The Mobile Platform is just one component of an upcoming generation of mobile and AIO headsets and it’s too early to talk reliably about what their capabilities will be.
5. Yes, see #2. AR represents an entire set of engineering challenges, most of which are out of our hands (pun intended).
6. We will have an Android SDK for developers.
7. It leans into the processor in the phone (mobile VR) or headset (AIO).
Oh, I am sad because I want to use RGB passthrough…
Will it revive in 3rd generation HMD era?
Absolutely! AR is on the horizon, just takes longer than VR.
Just wondering a few things
1. Is leap motion perhaps going to partner with dacuda for inside out tracking on mobile
2. Will/could someone please release the virtual desktop application that was made for Windows 8 that used dragonfly(but to my knowledge also worked with the normal leap motion) for download?!
And 3. When do you think leap motion will be wireless(and in the meantime do you know of any good wireless USB extenders/etc that I could use for the leap)
(1) We can’t comment on upcoming partnerships, though worth noting that we have partnered with Qualcomm, who has created their own inside-out tracking solution for mobile.
(2) Portions of the codebase for AR Screen have already been released publicly, but it would have to be rebuilt from the ground up and massively expanded. It was never designed to work with the normal controller, the assets it was built on have since changed, and it was a rough proof of concept from a weekend hackathon — not a finished demo.
(3) We have no plans to release a new peripheral, wireless or otherwise. Haven’t tested any wireless USB extenders, so buyer beware.
[…] Source: Leap Motion […]
[…] Source: Leap Motion […]
Thanks for doing the job Google, Apple, Microsoft, Samsung, Facebook, HTC etc…won’t do…for 4 years straight now!
And also you didn’t settle for “yeah but it doesn’t work well yet”, you release a real usable product that just keep on getting updated, iterated and better. Thanks for that.
[…] In a blog post, Leap Motion has announced their upcoming Leap Motion Mobile Platform. It’s unclear yet what specific platforms Leap Motion will come to, but The Verge got to test out the platform from its embedded state in a future Samsung Gear VR. CEO Michael Buckwald told the site that Leap Motion’s untethered hand-tracking for mobile just might be the “iPhone moment for VR.” That is, in making VR accessible for a wider audience and capable of mainstream adoption, beyond technology aficionados or avid game players. […]
[…] Plus d’informations : http://blog.leapmotion.com/mobile-platform/#more-6945 […]
[…] it by moving your hands and fingers through the air. Now the company has announced plans to bring its technology to mobile devices, bringing hand-tracking features to virtual reality headsets that rely on smartphones, like […]
How do I get my hands in one of this? I am a the founder of a indie studio of VR and would love to adapt/create amazing experiences for it! Check http://www.vrmonkey.com.br to see a little bit more about my studio.
Currently we’re only sharing reference designs with OEM partners, but stay tuned for updates. This technology will be embedded in different VR headsets 😀
Interested to hear the pros/cons versus Intel RealSense
Would be better than my current workaround with my Gear VR.
https://uploads.disquscdn.com/images/146519fc56b62926f7e7f3b74ab7c6351e2481fcf4282286d9338cf0966f0b1c.jpg
I’m curious about how you are doing this. Do you have a guide to getting setup?
Nick – very interested how you’ve integrated this with your Gear VR. Are you able / willing to share?
Likely a tethered solution: http://blog.leapmotion.com/vr-prototyping-less-100-leap-motion-vridge/
!!!
[…] via leapmotion […]
[…] Leap Motion ha estado trabajando para que tus interacciones con la realidad virtual sean lo más realistas posible, pero sólo estaba disponible para sistemas de escritorio o consolas. Ahora, la compañía ha ampliado su alcance a los dispositivos móviles con su nueva Plataforma Móvil, diseñada para “dispositivos sin tensión, alimentados por batería, virtuales y de realidad aumentada”. […]
[…] SOURCE: Leap Motion […]
[…] while making it smoother and more accurate than ever before,” Leap Motion’s, David Holz, says in a recent blog post. “While our PC peripheral remains unrivaled at 140×120 degrees, we’ve found in virtual reality […]
[…] źródło: Leap Motion […]
[…] expensive and low-end VR headsets are more prevalent in the market. Leap Motion is thus trying to bring that technology to the less expensive VR wearables, which CEO Michael Buckwald dubs as ‘iPhone moment for […]
[…] expensive and low-end VR headsets are more prevalent in the market. Leap Motion is thus trying to bring that technology to the less expensive VR wearables, which CEO Michael Buckwald dubs as ‘iPhone moment for […]
Looks awesome! When do you guys think that you will be releasing a developer/ consumer version? i would love to get my hands on it.
The timing of a release depends on our OEM partners; unfortunately can’t share more at this point.
Thanks, Is there anymore news about when this could be released to developers?
Not yet, but we’re working on it 😀
[…] SOURCELeap Motion […]
I see there are no plans to get development kits into the hands of software developers. Does that mean the device will be tightly integrated with the headset it’s built into and simply work right out of the box for users?
It will be tightly integrated into the headsets they’re built into. The first wave of headsets will be the devkits themselves.
Will the devkit headsets be available through Leap Motion or the hmd manufacturer?
Too early to tell.
Thanks for the info. I’ll keep an eye out for more updates.
Hey guys, where do I get one of these for development purposes?
Right now they’re only being sent to OEM partners as reference designs for the next generation of mobile and AIO headsets.
[…] que n’a logiquement pas manqué Samsung. La société asiatique va s’équiper de ce que le blog de l’entreprise qualifie de Leap Motion Mobile Platform, pour reprendre les termes exacts, et intègrera donc très […]
[…] новость! Ребята из компании Leap Motion в своем блоге официально анонсировали разработку Leap Motion Mobile Platform, […]
[…] blog.leapmotion.com + […]
[…] Leap Motion goes mobile […]
Can or will the cameras do marker detection so a piece of paper can be
used as a multi functional surface and you can interact with it using your hands?
Just thinking out loud.Either way and anyway sounds awsome.
It’s possible but would require working with the raw image data and developing your own algorithms for that.
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] week the company announced a brand new product. It will not be sold in stores. This new device is a hacked together […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] week the company announced a brand new product. It will not be sold in stores. This new device is a hacked together […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] week the company announced a brand new product. It will not be sold in stores. This new device is a hacked together […]
[…] Leap Motion via Android […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] week the company announced a brand new product. It will not be sold in stores. This new device is a hacked together […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] week the company announced a brand new product. It will not be sold in stores. This new device is a hacked together […]
[…] distant from a usually option. Just yesterday, for instance, a gestural interface company Leap Motion announced a small new sensor that could give any headset a ability to lane your hands in space, though […]
[…] 모바일 플랫폼은 우선 기어VR을 지원한다. 관련 내용은 이곳에서 확인할 수 […]
[…] week the company announced a brand new product. It will not be sold in stores. This new device is a hacked together […]
[…] VR headsets are extra prevalent available in the market. Leap Movement is thus attempting to bring that technology to the cheaper VR wearables, which CEO Michael Buckwald dubs as ‘iPhone second for […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] a tracking platform in this space have been immense,” Leap Motion CTO David Holz wrote in a blog entry, explaining the […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] また、leap Motionの公式ブログのコメント欄では開発チームが質問を受け付けており、新型にはRGBパススルーが搭載されないことや組み込み型のものには独自のCPUは搭載されず処理はスマホかヘッドセットのプロセッサに依存することなどが語られている。開発者向けの詳細な情報をチェックしたり開発チームに質問してみたい方は公式ブログをぜひチェックしてほしい。 […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] day is almost here, with Leap Motion’s chief technology officer David Holz revealing the Leap Motion Mobile Platform on the company’s blog. The improvements address the field of view, the ‘biggest request from the VR community’; the […]
[…] day is almost here, with Leap Motion’s chief technology officer David Holz revealing the Leap Motion Mobile Platform on the company’s blog. The improvements address the field of view, the ‘biggest request from the VR […]
[…] VR, ma con un marcato orientamento mobile. La sua soluzione Leap Motion Mobile Platform è stata annunciata sul sito Internet dell’azienda da parte del cofondatore David Holz: “Si tratta di una […]
[…] time ‘s almost right here, with Leap Motion’s significant technology officer David Holz revealing the Leap task mobile system about organization’s web site. The improvements address the world of view, the ‘biggest need through VR community’; todays […]
[…] the business announced a brand existing item. It won’t be provided for. This remarkable product is a hacked […]
[…] day is almost here, with Leap Motion’s chief technology officer David Holz revealing the Leap Motion Mobile Platform on the company’s blog. The improvements address the field of view, the ‘biggest request from the VR […]
[…] Leap Motion Blog & […]
[…] nos dicen en una de las respuestas de los comentarios del blog de la compañia, esta pretende que se incorpore la tecnología a los dispositivos móviles. Leap […]
[…] – Leap Motion, mobil platformlara geliyor. […]
[…] dazu bietet sowohl ein Artikel von Dominic Brennan als auch der Blogpost von David Holz im Leap-Motion-Blog. Orion wird zudem im folgenden Video […]
[…] dazu bietet sowohl ein Artikel von Dominic Brennan als auch der Blogpost von David Holz im Leap-Motion-Blog. Orion wird zudem im folgenden Video […]
[…] Source :MashableBlog de Leap Motion […]
How can i get this??
Where can i buy this??
Right now it’s a reference design that we’re sending out to OEMs. For updates, subscribe at developer.leapmotion.com/android.
Hi, My name is Yiyang, the co-founder of a LA based VR software company, currently we are working on our mobile VR project and seeking mobile hand gesture sensor that we can use for our software. I am very interested in the Leap motion mobile platform, and wondering if there is a way that I can get to know more information regarding the product. Please let me know and I am very appreciated it. Thank you.
Shoot me an email at acolgan@leapmotion.com and let me know what you have in mind.
Any updates on this? i haven’t heard anything since this post.
We’ve shown the reference design at SVVR and will be at lots of events in the new year 😀
[…] Technology is like a flash in the darkness – long nights building towards an instant when suddenly everything is different. Click To TweetLeap Motion goes mobile […]
[…] combination of software and hardware we’ve made specifically for untethered, battery-powered VR/AR devices. At its core is a new […]
[…] the best part was the excited reactions we saw from people trying our Mobile VR Platform for the first […]
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
[…] best when it’s both invisible and ubiquitous #FreeYourHands #MobileVR Click To TweetFrom the Mobile VR Platform that can be embedded into any headset, to our Interaction Engine that makes virtual worlds react […]
[…] Leap Motion Goes Mobile […]
https://www.gofundme.com/oculus-rift-cv1-headset this is isnt spam its for a real cause xxxxxx
Hi, I’m an indie Unity developer from India.
1) I wanted to ask how can leap motion be used with android?
2) I read some where that the leap daemon app is required to make any android app understand leap inputs. So where can I find the leap daemon apk ?
3) I have already tried the rift cat method but that is just streaming vive/oculus apps not android. Is my understanding correct and is there any other way around it ?
Our Android SDK is still in private development. Once it’s ready, we will make it available for development and demos.
Any idea on timeframe? Also working with Unity / Android, and would love to have Leap integration.
Hi, how to get hand on a dev kit with sdk for android , project to implement leapmotion on a mobile vr headset for B2b exhibition. We really need hand interaction.
Regards
Will I have to buy the whole headset or can I use my existing leap motion on a mount with some connector.
You would need to get a headset with this embedded in it.
Question: do we have to buy this know leap motion to work on mobile, or can we use our certain one with an update
It would involve getting a headset with it embedded.
Is there any further information regarding this? Should I consider the standard Leap motion for development?
We recommend using the Leap Motion Controller for prototyping ahead of the release of these new headsets.
So, i just got this for android pourposes, but for my surprise there is no available SDK, my question is, are you avandoning all plans for original leap hardware on android?
At this time, that seems to be the case. The controller places too high a demand on battery and processing power.
Hi, I went through the comments and I fully understand that you cannot provide any fixed release date so far, however, my question is if the new headset with embodied leap motion is going to be released in anytime this year? Approximated time frame would be greatly appreciated. Best regards
[…] far from the only option. Just yesterday, for instance, the gestural interface company Leap Motion announced a tiny new sensor that could give any headset the ability to track your hands in space, without […]
… [Trackback]
[…] Read More: blog.leapmotion.com/mobile-platform/ […]
[…] Leap Motion Blog & […]
What Happened to this guys?, Any news? I have been eagerly waiting to see something happening with this..
[…] the best part was the excited reactions we saw from people trying our Mobile VR Platform for the first […]
[…] combination of software and hardware we’ve made specifically for untethered, battery-powered VR/AR devices. At its core is a new […]
looking for andriod sdk,any update? release date for andriod sdk for leap controller