SIXTH SENSE TECHNOLOGY
Abstract: ‘Sixth Sense’ is a wearable gesture interface that augments the physical
world around us with digital information and lets us use natural hand gestures
to interact with that information. Based on the principles of human
communication system in this sense, then made the design of digital hardware
systems similar work. Steve
Mann is considered as the father of Sixth Sense Technology who made wearable
computer in 1990. He implemented the Sixth Sense Technology as the neck worn
projector with a camera system. Then his work was carried forward by Pranav
Mistry (Ph.D student in the Fluid Interfaces Group at the MIT Media Lab) .
Sixth Sense Technology may change how we look at the world forever. Sure, it is
a system that projects information about what surrounds you over objects'
surfaces, but it's also much more. By using a camera and a tiny projector,
Sixth Sense sees what you see and visually augments any surfaces or objects we
are interacting with . The camera and the projector are coupled with a smart
phone which acts as the computer and connected to the Cloud, all the
information stored on the web . It project information onto surfaces, walls and
physical objects around us, and lets us interact with the projected information
through natural hand gestures, arm movements, or our interaction with the
object itself. This wearable gestural interface attempts to free information
from its confines by seamlessly integrating it with reality, and thus making
the entire world our computer.
SixthSense is a name for extra information supplied by a wearable computer, such as the device called "WuW" (Wear yoUr World) by Pranav Mistry et al., building on the concept of the Telepointer, a neckworn projector and camera combination first proposed and reduced to practice by MIT Media Lab student Steve Mann.[3][4]
Origin
of the "Sixth Sense" name
Sixth Sense technology (camera
combined with light source) was developed in 1997 (headworn) and 1998
(neckworn), but the Sixth Sense name for this work was first coined and
published in 2001. Mann referred to this wearable computing technology as
affording a "Synthetic Synesthesia of the Sixth Sense", i.e. the idea
that wearable computing and digital information can act as an additional (i.e.
sixth) sense.[5]
Ten years later, Pattie Maes (also with MIT Media Lab) also used the term "Sixth
Sense" in this same context, in her TED talk.
The
devices which are used in Sixth Sense Technology are:
1.
Camera. Coloured Marker.
2.
Mobile Component.
3.
Projector.
4.
Mirror.
2.1. Camera: It
captures the image of the object in view and tracks the user‗s hand
gesture. The camera recognizes individuals, images, pictures, gestures that
user makes with his hand. The camera then sends this data to a smart phone for
processing. Basically the camera forms a digital eye which connects to the
world of digital information.
2.4.
Projector:
The
information that is interpreted through the smartphone can be projected into
any surface. The projector projects the visual information enabling surfaces
and physical objects to be used as interfaces. The projector itself consists of
batteries which have 3 hours of battery life. A Tiny LED projector displays the
data sent from the smartphone on any surface in view-object, wall or person.
The downward facing projector projects the image on to a mirror.
2.2.
Coloured Marker: There
are colour markers placed at the tip of users fingers. Marking the user‗s fingers
with red, yellow, green and blue coloured tape helps the webcam to recognize
the hand gestures. The movements and arrangement of these markers are
interpreted into gestures that act as an interaction instruction for the
projected application interfaces.
2.5.
Mirror: The
usage of a mirror is important as the projector dangles pointing downward from
the neck. The mirror reflects the image on to a desire surface. Thus finally
the digital image is freed from its confines and placed in the physical world.
2.3. Mobile Component:
The Sixth Sense device consists of a web
enabled smartphone which process the data send by the camera. The smartphone
searches the web and interprets the hand gestures with the help of the coloured
markers placed at the finger tips. Basic processing works on computer vision
algorithms where approx. 50,000 lines of code
are used written in Symbian C++.
3.
WORKING The
Sixth Sense Technology works as follows:
1.
It captures the image of the object in view and tracks the user‗s hand
gestures.
2.
There are colour markers placed at the tip of user‗s fingers.
Marking the user‗s
fingers with red, yellow, green and blue coloured tape helps the webcam to
recognize the hand gestures. The movements and arrangement of these markers are
interpreted into gestures that act as an interaction instruction for the
projected application interfaces.
3.
The smartphone searches the web and interprets the hand gestures with the help
of the coloured markers placed at the finger tips.
4.
The information that is interpreted through the smartphone can be projected
into any surface.
5.
The mirror reflects the image on to a desired surface [1].
5.
ADVANTAGES
1.
Sixth Sense is a user friendly interface which integrates digital information
into the physical world and its objects, making the entire world your computer.
3.
It uses hand gestures to interact with digital information, supports
multi-touch and multi-user interaction.
4.
Data access directly from machine in real time. It is an open source and cost
effective and we can mind map the idea anywhere.
5.
It is gesture-controlled wearable computing device that feeds our relevant
information and turns any surface into an interactive display.
6.
It is portable and easy to carry as we can wear it in our neck.
7.
The device could be used by anyone without even a basic knowledge of a keyboard
or mouse. There is no need to carry a camera anymore.
8.
If we are going for a holiday, then from now on wards it will be easy to
capture photos by using mere fingers
6.
FUTURE ENHANCEMENTS
1.
To get rid of colour markers.
2.
To incorporate camera and projector inside mobile Computing device.
3.
Whenever we place pendant- style wearable device on table, it should allow us
to use the table as multi touch user interface.
4.
Applying this technology in various interest like gaming, education systems
etc.
5.
To have 3D gesture tracking.
6.
To make sixth sense work as fifth sense for disabled person. [2]
7.
CONCLUSIONS
1.
Sixth Sense is a wearable device that enables you to have the whole world of
digital information at your fingertips – literally!
2.
This sets information free and the whole world is your screen or personal
computer.
3.
It has been classified under the category ‗wearable
computing‗.
4.
The true power of Sixth Sense lies on its potential to connect the real world
with the Internet, and overlaying the information on the world itself.
5.
The key here is that Sixth Sense recognizes the objects around you, displaying
information automatically and letting you access it in any way you want, in the
simplest way possible.
6.
Clearly, this has the potential of becoming the ultimate
"transparent" user interface for accessing information about
everything around us. If they can get rid of the coloured finger caps and it
ever goes beyond the initial development phase, that is. But as it is now, it
may change the way we interact with the real world and truly give everyone
complete awareness of the environment around us .
Download link(pdf):
Comments
Post a Comment