If your childhood was anything like mine, you spent an awful lot of time playing Super Mario Bros. and Super Mario World. And Super Mario Bros 3. And NOT Super Mario Bros 2 (because it was too frustrating and you were awful at the digging aspect of it). How much would you have paid to play all of these games with your eyes and just your eyes? How about $25? Because that’s how much it cost Brandyn White. The video below has it all, but here’s a recap.
Google Glass has pupil-tracking sensors, but it only accepts input from voice commands, touch and head movements. White wasn’t having that, so he took a 3D-printed webcam and inserted it into Google Glass.
With the camera, the pupil-tracking technology can then detect eye movement and use said movement as input. From there, it was easy enough for White to rig it up to Super Mario Bros. as a controller and play the game completely using his eye movement. There was a delay of about a second, but White say said it actually made it easier.
Consider how easily and how cheaply White modified Google Glass, it seems natural that Google itself could (and perhaps should) implement such features itself. Though it seems like it’d require a zen-like control over one’s eye-movement, it could be used in various useful ways. Imagine making a difficult recipe and being able to scroll through your computer using your eyes (since your hands, of course, are covered in onion juice).
Mostly, it could have enormous implications in gaming, just like Tobii, which has been used for eyeball-controlled StarCraft II. Aside from simply adding another dynamic to games by including an additional controller, it could improve the speed of gameplay. Your eyes, after all, move much more quickly than your hands.
Check out the video below (it’s about eight minutes, so be warned) to see everything White was able to do.