There is a strong rumor that Tesla will be switching from a single camera autopilot system to a triple camera system at some point. This is based on a change to the 2016 service manual schematics which reportedly show 3 cameras.
Checking some brand new Model X and S with the new refresh on 8-May-2016 shows no change so far, so it is not clear when or if this change will be made. The current module in front of the rear-view mirror hold the rain sensor and the camera. The camera is indented and faces directly forward.
Mobileye makes the EyeQ3 chip that handles the camera video and other inputs such as the radar to understand the car’s environment. Tesla produces the software/hardware to take the analysis from the EyeQ3 chip, combines it with Tesla high-definition maps and turn it into the set of auto-pilot features.
From a Mobileye presentation back in early 2015, we learn that:
- The main 50 degree camera is used to detect objects, traffic sign recognition, adaptive high-beam assist, lanes, traffic lights, path delimiters, and lateral control assist.
- The narrow 25 degree camera is used to also detect objects, lanes, traffic lights, debris further ahead than the 50 degree camera.
- The 150 degree fisheye camera is used for cars cutting in detection, lane detection on tight curves, pedestrian/cyclists/large animal detection, and 1st-in row traffic light detection.
The narrow and main cameras also provide some redundancy to each other in case of an issue with either camera or interference with the visibility of one camera. The radar provide yet another source of redundancy and helps with conditions that the cameras are weak at.
I should point out that none of these cameras would be all that suitable for a dashcam. The cameras are optimized for auto-pilot functions and may be monochrome and/or only medium definition. The frame rate also tends to be non-standard, such as 36 fps.
The cameras and the related electronics such as the EyeQ3 chip are in the housing in front of the rear-view mirror. A retrofit may be possible to older single-camera vehicles without too much difficulty. It’s unclear if Tesla will offer such a retrofit or not or what the cost of such a retrofit would be.
Another interesting point is Tesla is working directly with Mobileye. Most other car makers are working with third-party suppliers. The OEM supplier are integrating the Mobileye chip, other hardware and software as a component and is then sold to the automakers, which then needs to be integrated with the car and the car’s software. This means an extra very large layer of effort and time, and will likely put most automakers always 1-3 years behind Tesla. Fixes and improvements will be quite slow, and rarely applied to existing sold vehicles.
With the speed of changes in this area, I’m not sure I’d trust any other automaker other than Tesla to produce a safe and reliable auto-pilot system for years to come. Having the ability to do over-the air updates as Tesla does is so critical in this fast evolving field.