There are several improvements and optimizations that have been identified over the course of the investigation.
The current configuration of the Wii3D System only uses two Wii Remotes. Additional Wii Remotes could be used to increase the accuracy of the stereoscopic triangulation. This would also aid in dealing with the loss of points for the different perspectives.
The point tracker described in the Point Tracker page can be modified to incorporate acceleration and factor this observed property into the predictive interpolation. The velocities and accelerations of the two dimensional viewports may also be used in the calculation.
The development of a point tracker had some success, but the tracker can fail in some situations. It is highly probable that there are several other situations where the predictive interpolator could be confused, and more investigation into this component would be prudent before incorporating this system into a general user interface.
The Hidden Markov Models implemented in the Wii3D System are generated at application start-up. Extending the functionality of the system to incorporate object serialization and learning to the Models would allow the user to define his/her own gestures by example, rather than relying solely on the hard-coded gestures which require programming experience and a good understanding of Hidden Markov Models.
The Accord.NET library uses discrete Hidden Markov Models. Due to the continuous nature of the point coordinates in a gesture, a custom model could be developed to incorporate Gaussian mixture models in the Markov chains to form a Hidden Markov Model.