REPORT ON SIXTH SENSE TECHNOLOGy
SIXTH SENSE 1.docx
(Size: 647.31 KB / Downloads: 103)
Every one of usare aware of the five basic senses – seeing, feeling, smelling, tasting and hearing. These senses have evolved through millions of years. Whenever we encounter a new object/experience our natural senses tries to analysis that experience and the information that is obtained is used to modify our interaction with the environment. But in this new age of technologies the most important information that helps one to make right decision is something that cannot be perceived and analysed by our natural senses. That information is the data in the digital form, and it is available to everyone through sources like internet. The sixth sense technology concept is an effort to connect this data in the digital world in to the real world.
Although miniaturized versions of computers help us to connect to the digital world even while we are travelling there aren’t any device as of now which gives a direct link between the digital world and our physical interaction with the real world. Usually the information’s are stored traditionally on a paper or a digital storage device. Sixth sense technology helps to bridge this gap between tangible and non-tangible world.Sixth Sensedevice is basically a wearable gestural interface that connects the physical world around us with digital information and lets us use natural hand gestures to interact with this information .The sixth sense technology was developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab.According to him the sixth sense technology has a Web 4.0 view of human and machine interactions.SixthSense integrates digital information into the physical world and its objects, making the entire world your computer. It can turn any surface into a touch-screen for computing, controlled by simple hand gestures. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs.It also supports multi user and multi touch provisions. Sixth Sense device is a mini-projector coupled with a camera and a cellphone—which acts as the computer and your connection to the Cloud, all the information stored on the web. The current prototype costs around $350. The Sixth Sense prototype is used to implement several applications that have shown the usefulness, viability and flexibility of the system.
'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that informationThe hardware components are coupled in a pendant like mobile wearable device.The SixthSense prototype is comprised of a pocket projector, a mirror,colord marker and a camera. The camera, mirror and projector is connected wirelessly to a blue tooth smart phone device that can easily fit into the user’s pocket.A software then processes the data that is collected by the capturing device and producesanalysis.The software that is used in sixth sense device is open source type.
It captures the image of the object in view and track the user’s hand gesture. The camera recognizes individuals, images, pictures, gestures that user makes with his hand. The camera then sends this data to a smart phone for processing. Basically the camera forms a digital eye which connects to the world of digital information.
There are colour markers placed at the tip of users finger. Marking the user’s fingers with red, yellow green and blue coloured tape helps the webcam to recognize the hand gestures.The movements and arrangement of these markers are interpreted into gestures that act as a interaction instruction for the projected application interfaces.
The SixthSense device consists of a web enabled smart phone which process the data send by the camera. The smart phone searches the web and interprets the hand gestures with help of the coloured markers placed at the finger tips.
The information that is interpreted through the smart phone can be projected into any surface. The projector projects the visual information enabling surfaces and physical objects to be used as interfaces. The projector itself consists of a battery which have 3 hours of battery life .A tiny LED projector displays the data sent from the smart phone on any surface in view- object, wall or person. The downward facing projector projects the image on to a mirror.
The augmented Reality is a visualization technology that allows the user to experience the virtual experience added over real world in real time. With the help of advanced AR technology the information about the surrounding real world of the user becomes interactive and digitally usable. Artificial information about the environment and the objects in it can be stored and retrieved as an information layer on top of the real world view. When we compare the spectrum between virtual reality, which creates immersive, computer-generated environments, and the real world, augmented reality is closer to the real world. Augmented reality adds graphics, sounds, haptic feedback and smell to the natural world as it exists. Both video games and cell phones are driving the development of augmented reality. Theaugmented systems will also superimpose graphics for every perspective available andtry adjust to every movement of the user's head and eyes.The three basic components of an augmented reality system are the head-mounted display, tracking system and mobile computer for the hardware. The main goal of this new technology is to merge these three components into a highly portable unit much like a combination of a high tech Walkman and an ordinary pair or eyeglasses.
It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. Gesture recognition technique basically focuses on the emotion recognition from the face and hand gesture recognition. Gender recognition technique enables humans to interact with computers in a more direct way without using any external interfacing devices. It can provide a much better alternative to text user interfaces and graphical user interface which requires the need of a keyboard or mouse to interact with the computer. Interfaces which solely depends on the gestures requires precise hand pose tracking. In the early versions of gesture recognition process special type of hand gloves which provide information about hand position orientation and flux of the fingers. In the SixthSense devices coloured bands are used for this purpose. Once hand pose has been captured the gestures can be recognised using different technique’s. Neural network approaches or statistical templates are the commonly used techniques used for the recognition purposes. This technique have an high accuracy usually showing accuracy of more than 95%. Time dependent neural network will also be used for real time recognition of the gestures.
Computer vision is the technology in which machines are able to interpret/extract necessary information from an image. Computer vision technology includes various fields like image processing, image analysis and machine vision. It includes certain aspect of artificial intelligence techniques like pattern recognition. The machines which implement computer vision techniques require image sensors which detect electromagnetic radiation which are usually in the form of ultraviolet rays or light rays. The computer vision find itself applicable in varies field of interest. One such field is bio medical image processing. It’s also used in autonomous vehicle like SUV’s. The computer vision technique basically includes four processes.
Radio Frequency Identification
Radio frequency identification systems transmit the identity of an object wirelessly, using radio magnetic waves. The main purpose of a radio frequency identification system is to enable the transfer of a data via a portable device. The portable device is commonly known as tag. The data send by the tag is received and processed by a reader according to the needs of the application. The data send by the tag contains various information’s identification or location of the information, or specifics about the product that has been tagged, for example price, colour, date of purchase, etc. This technology gained importance because of its ability to track moving object. A typical radio frequency tag consists of a microchip attached to a radio antenna which is mounted on a substrate. To retrieve the data from the tag a reader is needed. A typical radio frequency reader consists of two antennas that emit radio waves and at the same are capable of accepting the signals from the tag. The reader then passes the information that it has received to a computer device in digital form. The computer then interprets this digital data and processes it. Radio frequency identification techniques are widely used in the fields like asset tracking, supply chain management, manufacturing, payment systems etc. One of the major advantages of devices using radio frequency technology over other similar devices is that RFID devices need not be positioned precisely relative to the scanner. But till then there are certain areas of concern for this technology. Some problem related to this technology is tag collision and reader collision. Usually the reader collision occurs when the signals from two or more readers overlap, while tag collision occurs when many tags are present in a small area.
The sixth sense technology and devices are definitely the way forward. The sixth sense recognizes the objects around us and displays the information relating to those objects in a real time environment. The sixth sense technology allows the user to interact the information through hand gestures. This is a quiet efficient way compared to the text and graphic based user interface. It has the potential to form the transparent user interface for accessing the information around us. . Even though the sixth sense devices are currently in development stages and have not been used in large now, it’s quiet predictable that this technology have the potential to revolutionise the way in which we interacts with the digital world. As Mr. Pranav Mistry says “imagination of the human brain is the only thing that could limit the application of the sixth sense technology”