3D scene reconstruction

Monocular SLAM with MDE for Dense Point Clouds & YOLO for dynamic object detection

Open project

Inspiration

The goal of this project was to attempt a real -> sim, for user interfaces. I got the idea for this after seeing a video from a robotics company on twitter. I thought it would be cool to be able to command the robots like units in starcraft.

The Approach

The actual SLAM system is based on this paper: https://arxiv.org/abs/2401.09160. Rendering is done with Gaussian Splatting in Bevy with a custom shader.

PhDs aren't real.

The truth is you can learn anything in 2-weeks. (1 phd). Although I've already spent multiple phds (2 weeks) of time on this project, PhDs aren't real.