Tesla AI Day

Deep Understanding Tesla FSD Part 2: Vector Space

From Theory to Reality, Analyze the Evolution of Tesla Full Self-Driving

From Tesla AI Day

This is the second article in my series on Deep Understanding Tesla FSD.

1. Deep Understanding Tesla FSD Part 1: HydraNet
2. Deep Understanding Tesla FSD Part 2: Vector Space
3. Deep Understanding Tesla FSD Part 3: Planning & Control, Auto Labeling, Simulation
4. Deep Understanding Tesla FSD Part 4: Labeling, Simulation, etc

In the previous article, we discussed the architecture of Tesla’s neural network — HydraNet. At present, HydraNet can only process the input from a single camera.

From: Tesla AI Day

Vector Space

When the Tesla AI team worked towards FSD, they quickly found that this is not enough. They need more cameras, and the prediction results of the perception system must be converted to three-dimensional space that is also the foundation of the Plan & Control system. Tesla calls this 3D space “Vector Space”. The information of the vehicle and the space in which it…