The future belongs to augmented reality projected through wearable
technology. An enhanced digital lifestyle and a device that tracks
gestures to capture the world around us sounds nothing less than
surreal. This Buzzle article lists out the applications of the
SixthSense Technology in various fields.
Application of the SixthSense technology
Interesting Piece of Trivia
Pranav
Mistry, the maker of SixthSense was inspired by futuristic movies like
Minority Report and Robocop while creating the device.
Prom-DressesCanadian
researcher and inventor Steve Mann created the first wearable computer
as a neck worn projecting device with camera system known as the
Telepointer in 1990 when he was a media lab student. He is thus regarded
as the Father of SixthSense Technology and also as the Father of
Wearable Computing. The first prototype of the SixthSense technology was
larger and heavier in size and hence caused hindrance in daily life
usability. Besides it stood steeped in price making it scarcely
available for commercial purpose.
Therefore Indian computer
scientist and inventor Pranav Mistry felt the need to improve the
existing technology and invent a futuristic device that would seamlessly
integrate the digital and physical world through gesture
identification, image capturing, processing, and manipulation.
About the Inventor
Computer
scientist and inventor Pranav Mistry hails from Palanpur, Gujarat,
India. While as a student he sort inspiration from futuristic sci-fi
movies and visions of a computer-free world, he furthered his quest to
introduce to the world a technology that would revolutionize the future.
He first tried out the idea of a simple sixth sense prototype on a
computer mouse by putting two rollers into one mouse and trying to
obtain data by guiding the movements of the mouse. The venture of two
rollers did not work out so he decided to improve the design by using
four rollers which eventually gave him the idea to integrate gesture
movements through fingers.
While being a PhD student in the Fluid
Interfaces Group at the MIT Media Lab, he designed the wearable
gestural interface known as the Wear Ur World (WuW) or SixthSense. He is
currently positioned as the Head of Think Tank Team and Director of
Research of Samsung Research America. He has been embellished with many
awards for his invention including Young Global Leader 2013 Award, by
World Economic Forum, 50 Most Creative People of the Year 2010, by
CREATIVITY 50, and INVENTION OF THE YEAR 2009 award, by Popular Science.
About the SixthSense Technology
The
prototype which is the blend of a computer and cell phone consists of a
pocket projector, a mirror, and a camera. The hardware components are
integrated into a pendant-like mobile wearable device connected to the
mobile computing device of the user. Colored magic marker caps (red,
blue, green and yellow) worn on the four fingers aide the camera to
identify the four fingers and discern the hand gestures through an
in-built software.
The webcam acts like a digital eye that
captures and distinguishes an object in view and courses the user's hand
gestures using computer-vision based techniques to transmit data to the
smartphone. The tiny LED projector projects visual information altering
surfaces, walls, and physical objects to be used as interfaces. The
usage of the mirror is important as a reflector as the projector swings
downwards from the neck. A Web-enabled smartphone processes the video
data by interpreting the hand gestures. The movements and arrangements
of the colored makers are translated into gestures that act as
interaction commands for the projected application interfaces.
The
in-built software program analyzes the video data viewed by the camera
and also tracks down the positioning of the colored markers by utilizing
single computer vision techniques. The user can command multiple hand
gestures and movements as long as they are visually identified and
differentiated by the system. This is possible because the 'SixthSense'
device supports multi-touch and multi-user interaction.
The
software distinguishes 3 kinds of gestures: Multitouch gestures -
Gestures that involve pinching and dragging, Freehand gestures - Free
hand movements to start the projection, and Iconic gestures - Creating
an image in the air.
Advantages
✏ Highly portable device that can be carried around due to its minuscule pocket-size.
✏ It costs only $350 which is quite cheap considering its technological application.
✏ Its main characteristic is that it acts as a connective instrument between the real and digital world.
✏ The user can gain access to high-speed data from any machine and from any corner of the world with just simple hand movements.
✏
The software that is used to render and analyze the data compiled by
the device is made open source. This facility enables other developers
to impart additional development to the system.
Disadvantages
✏
While capturing images from this small device the user might invade the
privacy of others without the person's consent, of course no one likes
to be clicked in the pictures of any random person.
✏ A deadly device
if it comes in the hands of criminals as it can gain access to any
information without being tagged or supervised as suspicious. Criminals
can use Open Source Intelligence to use public sources such as 'Facebook
Face' to extract personal information about anyone.
✏ Hackers can use it for their potential hacking targets.
✏ Malware and viruses can easily be installed in other systems through this device.
✏
The data projected is never private as it will displayed on a surface
for everyone to see. Also it can be viewed with clarity during the
nighttime as opposed to the daytime hence causing vision problems.
Applications
✏ Make Calls
It
allows the user to project the dial pad unto the palm as a virtual
keypad to make calls without the presence of an actual mobile device.
✏ Track Flight Updates
An
excellent on-the-go feature that allows you to check your flight
timings without logging into any of the related travel sites, the device
recognizes your boarding pass to project the required information
anytime anywhere.
✏ Navigate a Virtual Map
Stuck in traffic or
simply exploring uncharted territories and wishing you had a virtual
route plan, then don't worry this device allows the feature of
navigating through any map of choice with the simple gesture of your
thumb and index fingers. Zoom in or out and plan the map along any
surface with just the swipe of your fingers.
✏ Construct 3D Drawings
Architects,
graphic designers, and simply art enthusiasts can use this feature for
drawing, storing, shuffling, and resurfacing virtual pictures anywhere.
This feature allows the user to create pictures by tracking the index
fingertip movements.
✏ Time Management
Check time by gesturing a circle on your wrist and a virtual clock with the current timings will be displayed.
✏ Motion Camera
Capture
wonderful moments on the go with the device's gestural feature by
placing your fingers as a frame to captivate an image. These images can
be edited, shared, and stored without the additional use of a camera or
any other photo capturing device.
✏ Motion Newspapers
Stay
connected with the outside world through this device by creating and
reading virtual newspapers by projecting them on any surface, watch
streaming videos, and live news updates from anywhere.
✏ Bookish Knowledge
Book
lovers can enjoy a good read by getting to know the reviews of latest
books, analyzing ratings, jumping to any page while reading, and
browsing through additional information.
✏ Accumulate People Data
It
will be easier to stay in touch with people through this device as the
facial recognition technique of this technology allows the user to store
data about the people they meet daily, project their relevant
information anywhere, creates reminders or appointments with their
contacts, and gain additional access on their information. This feature
would be very helpful for business personnel's who meet clients on a
daily basis, it would help them to stay organized about their business
agendas.
✏ Product Knowledge
Boon to the shoppers who would
love to know a little extra about the products they pick off the
shelves. This device recognizes the objects that are being picked and
projects its related information onto any screen.
Prom-DressesThis
avant-garde technology attempts to improve itself in the coming years by
withdrawing the colored markers, incorporating projector in the mobile
device, allowing a flat surface to be used as a multi-touch user
interface, applying it for gaming and education purpose, adding 3D
gesture tracking, and making it available for disabled people.