My role:
As one of three software engineers, I developed—

  • A custom hand-gesture recognition system.
  • A real-time algorithm for the location of certain pixels in 3D space.
  • The touch UI and part of the .NET to C++ communication interface.

This project was developed while I was employed at Smart Surface.

iGene, a biotechnology and forensic sciences company, built a Digital Autopsy product that allowed physicians to examine a body without having to physically dissect it. Raw data from a CT scanner (in the form of thousands of 2D images or ‘slices’) is fed into the system, which would convert it into a 3D model. This model can then be analyzed on a computer. Due to the high level of detail, the digital body can be dissected and measured to a high degree of precision. Different layers of the body can be filtered through, such as skin, muscle, and bone.

This system was designed for use with a mouse and keyboard. Our goal was to convert it into one that could be operated on a large touch-table using hand gestures, mimicking a traditional autopsy.

The finished product was put to use at a Hospital in Kuala Lumpur, the capital city of Malaysia.

A video of the product in action:

Press coverage:

Tech takes on autopsies (The star Online - Malaysia’s first news site)

Digital autopsy a non-invasive alternative (Stuff.co.nz - New Zealand’s largest news site)

Video: Digital Autopsy Malaysia (UNTV - Philippine television network)