2019-2021
Live RGBD FACE AR
Interactive live 3D scanner and Live AR
In this project, I developed a system that utilizes an RGBD camera in combination with a 4K RGB camera to perform rapid 3D scans of a person’s face. Using the integrated 3D AR module, the system allows for real-time design of custom eyebrows directly on the live facial model.
Finally, the designed eyebrows can be automatically converted into a 3D model, ready for printing.
Project Features:
- 3D face scan with depth camera (Single Sensor Fusion)
- Face recognition by artificial intelligence in the point cloud environment and specifying the distance and dimensions of the face
- Matching the 3D model scanned on LiveD Cloud Points (3D AR Fusion)
- Find the main landmarks of the face and marker in live and 3D mode
- Use marker and face points for 2D-3D matching for the ultimate 4K AR and design eyebrows live
- Automatic making of a printable 3D mold of designed eyebrows