Learn about Wii3D.
Project description
Principal Investigator: João Lourenço
Supervisor: Dr Hannah Thinyane
The increasing ubiquity of three dimensional output devices suggests a need for three dimensional input devices. A human computer interactive system, entitled Wii3D, was developed to attempt to fill this need. The Wii3D System uses two Nintendo Wii Remotes to track the movement of infra-red lights, attached to the fingers of a user, in each of the camera's viewports. Stereoscopic triangulation is used to resolve the points in three dimensional space. Further tracking in three dimensions is achieved using predictive interpolation. A framework was designed and implemented to enable the recognition of predefined gestures using Finite State Automata and Discrete Hidden Markov Models. The aforementioned tracking data was processed by the gesture recognition module and raised the relevant events when a gesture was recognized. A user study was undertaken in order to investigate the usefulness of the Wii3D System and the general intuitiveness of the proposed interface and gestures when compared with the standard mouse and keyboard interaction technique. The Wii3D System was found to be more intuitive for multitouch applications, but was not as intuitive as the mouse and keyboard for single pointer applications, even though the proposed interaction technique was found adequate for the majority of the gestures implemented.
Project goals
Several goals were identified during the project's development:
- Investigate current state of art in three dimensional interaction to determine best practice
- Design and implement a tracking technique
- Investigate effectiveness of using Hidden Markov Models for gesture recognition
- Evaluate the intuitiveness of the interaction technique by a comparison with existing techniques and devices
About the researcher
 |
My name is João Lourenço, and I was born in Zimbabwe, where I lived for the first 16 years of my life. I lived in Gweru for the first 8 years, attending Midlands Christian School for Grades 1 to 3. I then lived in Harare for the rest of junior school where I attended Hartmann House, the preparatory school for St. George's College. I completed the first four years of high school at St. George's, where I attained my IGCSE in 2003. Upon moving to South Africa, I attended St Stithians College in Sandton, where I completed my 'A' Levels in 2005. I graduated from Rhodes University in 2009 with a Bachelor of Science degree in Computer Science (with Distinction) and Mathematical Statistics, and am currently doing my Honours in Computer Science at Rhodes. My hobbies include Taekwon-do, Choral Singing, Fishing, Camping, Ballroom Dancing and, of course, Coding. |
| Feel free to Contact Me. |
Acknowledgements
The following individuals' and groups' valuable advice, support and contributions have been fundamental in the completion of this project:
- The Andrew Mellon Foundation and Rhodes University for their generous scholarship which enabled me to continue my further studies.
- Rhodes University and the Department of Computer Science for the opportunity to complete this Honours degree.
- Dr Hannah Thinyane for her attentive supervision during the entire year. Her suggestions, knowledge and direction in every aspect of the Wii3D project were invaluable.
- Professor Shaun Bangay for his input regarding the stereo vision algorithms. His thorough understanding of three dimensional graphics and its associated algorithms was pivotal in the implementation of the Wii3D system.
- Professor Gunther Jager for his input regarding the stereo vision algorithms. His thorough understanding of three dimensional graphics and its associated algorithms was pivotal in the implementation of the Wii3D system.
- Braden King for his help and direction regarding the WiiGlove design and circuitry.
- My Family and Friends for supporting me during the trying times this year, and whose continued love and encouragement gave me the strength not to give up.
- Christine Louise Marshall for believing in me, loving me, and being the best thing that ever happened to me. Rest in Peace.
Sponsors
Thank you to the sponsors of the Rhodes University Computer Science Department:
