By using the AR the dentist of the future will become like this

Startup "Kapanu" spun off from the University of Zurich, Switzerland, developed an augmented reality (AR) engine to be used for medical purposes in cooperation with Disney Research and developed an application that can be used for dental purposes. By reflecting the option of 3D scan of a person's mouth and how to treat / correct a tooth in the user's tooth part in real time, "how to treat and correct teeth while visually checking" You can choose whether to do "application has become.

Smile, you're in augmented reality dentistry | TechCrunch
https://techcrunch.com/2017/09/05/smile-youre-in-augmented-reality-dentistry/

We will follow the application examples of Kapanu's AR engine from three perspectives, "patient at home", "dentist in office" (dentist) and "technician in lab".


First, from the standpoint of "engineers" side.


A technician scans a patient's mouth ... ...


I model an ideal tooth based on this.


Subsequently, "patient" side. The patient uses his / her application to display his / her face.


When you trace the screen with your finger, the "ideal tooth" made by a technician is reflected in the patient's mouth and you can see what it looks like when treating your teeth.


In addition, "dentist" adjusts fine size and color of teeth from patient's request.


Of course, you can choose whatever tooth you will finally make while checking with the application.



Dental condition before treatment


It reflects the mockup of the teeth made with the 3D model to the mouth, it is like this. Multiple kinds of mockups are prepared, and it seems that you can choose the ideal tooth form.




The tooth model reflected on the mouth can freely adjust the width, height and color.



Then check how the mouth changes in real time.



The application uses automatic face analysis technology.


You can see that the center of the face, eyes and mouth are accurately recognized.


Based on this, we accurately recognize the position of the gums and teeth of the mouth ... ...



It reflects the created 3D model.


The 3D model of the tooth uses STL data ......


Color this one ......


Plan an ideal tooth silhouette ... ....


I will decide what kind of tooth shape will eventually become.


Besides, on the actual teeth ......


Overlay virtual teeth ...


By changing the color of this it is also possible to check "what will it look like if you bleach your teeth?"