Exploring the next frontier
of medical imaging within the OR

The essence

BD is a global medical technology company that is advancing the world of health. Together with BD, we developed a custom HoloLens application to visualize information needed for patient treatment support. Today, BD has already performed several surgeries using our application.

Play Video

The Solution

To give the employees of BD a clear understanding of what is possible, we organized an inspirational workshop. Three opportunities arose from there:

1. Training and education In the past, doctors often followed along with surgeries from within the OR itself for training purposes. However, many complex surgeries – with new medical equipment – take the attention of surgeons all over the world. In that case, a broadcast is in order. And also, with Covid-19, doctors are no longer allowed in the OR for training purposes. Now, with smartglasses such as the HoloLens, the surgeon can perform surgery while doctors follow the process from A to Z remotely through the eyes of the surgeon. He can make annotations, take screenshots, or upload files, by just using his voice or hand gestures.

2. Remote experts After a doctor followed along with a colleague surgeon, he might want to use the same procedure for his surgery. However, some guidance might still be in order. With the Microsoft HoloLens, the surgeon brings in remote experts with just a simple air tap. This means no need to use a mouse or keyboard, keeping his hands sanitized. The remote expert can follow along as if he’s looking through the eyes of the surgeon. To provide extra guidance, the expert can bring documents and visuals into the surgeon’s field of view.

3. Real-time monitoring data
Surgeons can now make different holographic screens appear. This allows them to visualize 3D models of patients, limbs, organs, or even scans, X-rays and live monitoring data. These holographic visualizations can also be shared with remote experts or remote spectators. Besides being able to operate more efficiently

Live footage from the HoloLens is taken with its built-in stereoscopic cameras. The quality of these cameras can be compared to a quality webcam. However, we are currently looking into attaching an external camera to the HoloLens to increase the video stream resolution and to display all anatomy more accurately.