SIXTH SENSE TECHNOLOGY

It’s the beginning of a new era of technology where engineering will reach new milestones. Just like in the science fiction movies where display of computer screen appears on walls, commands are given by gestures, the smart digital environment which talks to us to do our work and so on, these all will be possible very soon. You imagine it and sixth sense technology will make it possible. Isn’t it futuristic? Now it’s time for sci-fi movie directors to think ahead because the technology shown in there fiction movies soon will become household stuff. Before few years back it was considered to be supernatural or tantalizing imagination. But now it has been made possible. Thanks to Pranav Mistry, a genius who introduced mankind to this futuristic technology.

What is sixth sense?

Sixth sense technology is a perception of augmented reality concept. Like senses enable us to perceive information about the environment in different ways it also aims at perceiving information. Sixth sense is in fact, about comprehending information more than our available senses. And today there is not just this physical world from where we get information but also the digital world which has become a part of our life. This digital world is now as important to us as this physical world. And with the internet the digital world can be expanded many times the physical world. God hasn’t given us sense to interact with the digital world so we have created them like smart phones, tablets, computers, laptops, net books, PDAs, music players, and others gadgets. These gadgets enable us to communicate with the digital world around us.

Sixth Sense is a wearable gestural interface that enhances the physical world around us with digital information and lets us use natural hand gestures to interact with that information. It is based on the concepts of augmented reality and has well implemented the perceptions of it. Sixth sense technology has integrated the real world objects with digital world. The fabulous 6th sense technology is a blend of many exquisite technologies. The thing which makes it magnificent is the marvelous integration of all those technologies and presents it into a single portable and economical product. It associates technologies like hand gesture recognition, image capturing, processing, and manipulation, etc. It superimposes the digital world on the real world.

But we’re humans and our physical body isn’t meant for digital world so we can’t interact directly to the digital world. For instance we press keys to dial a number; we type text to search it and so on. This means for an individual to communicate with the digital world he/she must learn it. We don’t communicate directly and efficiently to the digital world as we do with the real world. The sixth sense technology is all about interacting to the digital world in most efficient and direct way. Hence, it wouldn’t be wrong to conclude sixth sense technology as gateway between digital and real world.  Before Wear Ur World (WuW) came there were other methods like speech recognition software, touch recognition etc., which empowered us with direct interfacing.

This WuW or sixth sense device invented by Pranav Mistry is a prototype of next level of digital to real world interfacing. It comprises of a camera, a projector, a mobile cum computing device and colored sensors which are put on the fingers of a human being. The device efficiently senses the motion of the colored markers. Using them it provides us the freedom of directly interacting with the digital world. This technology enables people to interact in the digital world as if they are interacting in the real world.

Why choose sixth sense technology?

Humans take decisions after acquiring inputs from the senses. But the information we collect aren’t enough to result in the right decisions. But the information which could help making a good decision is largely available on internet. Although the information can be gathered by connecting devices like computers and mobiles but they are restricted to the screen and there is no direct interaction between the tangible physical world and intangible digital world. This sixth sense technology provides us with the freedom of interacting with the digital world with hand gestures. This technology has a wide application in the field of artificial intelligence. This methodology can aid in synthesis of bots that will be able to interact with humans.

How does sixth sense works?

The sixth sense technology uses different technologies like gesture recognition, image processing, etc. At present the commercial product isn’t launched but the prototype is prepared. The sixth sense prototype is made using very common and easily available equipments like pocket projector, a mirror, mobile components, color markers and a camera.

The projector projects visual images on a surface. This surface can be wall, table, book or even your hand. Thus, the entire world is available on your screen now. When user moves their hands to form different movements with colored markers on the finger tips, the camera captures these movements. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. Recognition is made using computer vision technique. These markers act as visual tracking fiducials. The software program processes this video stream data and interprets the movements into gestures. The gestures are different from one another and are assigned some commands. These gestures can act as input to application which is projected by the projector. Since, the projector is aligned downwards for compactness; therefore images would be formed at the user’s feet if mirror wasn’t used. The mirror reflects the image formed by the projector to front. The entire hardware is fabricated in the form of a pendent. The entire product cost around $ 350 and that also because of projector. It works very similar like a touch screen phone with entire world as the screen.

Evolution of Sixth Sense Technology

Steve Mann is considered as the father of Sixth Sense technology who made a wearable computer in 1990. He implemented the Sixth Sense technology as the neck worn projector with a camera system. He was a media lab student at that time. Then his work was carried forward by Pranav Mistry, an Indian research assistant in MIT Media Lab. He came up with exciting new applications from this technology. Sixth sense technology was developed at media labs in MIT and coined as Wear Ur World (WUW). The inventors have filed patent under the name Wear Ur World (WUW) in February 2010.

“Rather than waiting for that time to come, I want people to make their own system. Why not?,” Mistry says in an article on Rediff Business. “People will be able to make their own hardware. I will give them instructions how to make it. And also provide them key software…give them basic key software layers…they will be able to build their own applications. They will be able to modify base level and do anything”.

So it can be expected that the software will be open source and there will be a wide market of apps too.

Making Use of the Senses Everyone is aware of the five basic senses. However, in addition to these basic senses of mankind, there is one more sense, as well, and this is referred to as the sixth sense. This is the name of a technological wonder, which is very much related to the physical senses by means of which perception of something beyond the five senses is possible. In fact, the invention of this technology is expected to change the entire perception of the world. The device perceives what human eyes in general perceive, but in addition to that, it provides information in relation to the viewing object. In fact, the device has been designed in such a manner, so that it can easily project information on any surface. The Concept and the Construction The concept of this device is quite similar to that of a Telepointer, which is a kind of camera system. The Sixth Sense technology consists of a projector, a mirror, and a very small camera with a wearable device. The camera and the projector have been designed in such a manner, so that they can easily be connected to a mobile device. The main function of the projector is to use the walls and other physical objects as interface and project visual information. On the other hand, it is the task of the camera to recognize and track the gestures of the users with the help of different techniques that are largely based on computer vision. There is special software program, and the main function of the program is to video stream the captured data by the camera and consequently tracks the location of the markers, which are right at the tip of the fingers. These arrangements are completely interpreted, and consequently, they are made to work as interactive instructions for the application interfaces. The Entire World Becomes A Computer The Sixth Sense Technology enables us to receive information on any object against any surface. With the help of the information delivered from this technology, it becomes possible for the entire world to become a computer. The device helps us to get closer to reality, and consequently, it also assists us in taking the right decision. Wide Varieties of Applications The greatest benefit of this device is the availability of wide varieties of applications in it. Mapping can easily be done from any location. The features of zooming in and zooming out make the entire task of mapping easier. Since it is portable, it can easily be carried. There is a drawing application in the device, and this application helps the user to draw on any kind of surface. The user can also read newspaper with the help of this device. This enables the readers to view videos along with reading the newspaper. Live sports updates are also available with the help of this device. Book lovers can also easily grab on any book and Amazon ratings on these books are also available. Fingers as brush: The user can draw anything on paint with the help of his fingers. This drawing can be 3D also. Hence, no need to use mouse. Capture photos with fingers: using the fingers the user can capture photos hence, no need to carry an additional gizmo. The box created by the fingers act as frame for capturing photo. Palm is the new dialer: this technology enables the user to call without using the dialer. The dialer will be projected on palm and the user can dial the number using other hand. Read Books easily: Check out the ratings of the Book you are going to buy, it checks the ratings from the internet. And another amazing thing is that it reads the book for you. Video Newspapers: like the video newspapers of Harry Potter this technology identifies the news headline and then projects the relevant video. Check your Flight Status: Just place the ticket in front of the projector and it checks its status from the internet. Clock: the user just needs to make gesture of clock and the watch will be projected on the user’s hand. Access anywhere internet: the users can browse internet on any surface even on their palm. Conclusion This technology has seamless applications. This can be used as a replacement of the 5th senses for handicapped peoples. This can provide easy control over machineries in industry. This will have different application for different developers just depending upon how he imagines and what he wants. So, considering its widespread applications the inventor Pranav Mistry has decided to make its software open source. This will enable individuals to make their own application depending upon needs and imagination. As this technology will emerge may be new devices and hence forth new markets will evolve. Some existing devices and technologies will be discontinued but one thing is guaranteed it will write a new chapter in history of science and technology. The device recognizes wide varieties of gestures. It can easily interact with different everyday objects. It can always be expected that this technology has a bright future because it might bring about a change in the way we look at the world. It can really create a magic. For instance, if you need to make a call, you can just extend your hands into the projector, and the numbers will instantly appear before you to click. Even if, you want to know time, you can draw a circle on your wrist. It can also connect the real world with the internet, which is certainly a novel application, and can thus, be a great source of information for the world itself. Therefore, it can always be claimed that this device has a long way to go in the near future.