Tesla is migrating from programming logic to Neural Net for FSD decision making

-

-Advertisement-

Tesla firmware hacker and researcher who goes by the name of ‘green’ in cyberspace has just revealed that Tesla is migrating towards Neural Nets (NNs) for Full Self-Driving (FSD) decision making. Currently, Tesla vehicles are taking decisions such as ‘right of way’ with programming logic built in C++.

Green usually reveals his findings via his Twitter account and in the recent past has been under Tesla’s wrath resulting in a lawsuit. He posted the latest finding on Twitter in his tweet:

The Tesla hacker thinks that the Silicon Valley-based automaker is implementing this migration bit-by-bit, probably starting from the ‘right of way guessing’ function to other more complex decisions that the car needs to take.

Currently, Tesla is improving the Autopilot (FSD Beta) decision making with each firmware update it is pushing to the select few cars in the United States. With the NNs in the loop, the cars will be able to instantly get feedback from the Tesla Mothership which has tons and tons of machine learning data to help make a better decision.

Tesla Model Y Accessories by EVANNEX (Sponsored Banner).
– Sponsored –

How Computer / Autopilot Vision Works

Tesla Autopilot engineer explains how computers recognize objects via Traditional Programming vs. Machine Learning + AI.
Tesla Autopilot engineer explains how computers recognize objects via Traditional Programming vs. Machine Learning + AI. Tap/Click to load the HD version of the infographic (full video below). Source: Code.org / Tesla.

Tesla Autopilot engineer Kate Park explains how computer vision works in the following video. I have included one infographic above from the video that explains how decision making or object detection is limited to the use of traditional programming. With the use of Machine Learning + AI + Neural Nets, the whole process provides limitless possibilities.

For example, traditional programming cannot recognize “X” if it is not exactly drawn with the defined parameters (see image above). But the combination of machine learning, AI, and Neural Networks enable the computer to learn multiple patterns and possibilities an “X” can appear in front.

How Tesla Neural Net vision works, explained by Tesla AI director, Andrej Karpathy.
How Tesla Neural Net vision works, explained by Tesla AI director, Andrej Karpathy on Tesla Autonomy Day 2019. Tap/Click to load the HD version. Source: Tesla.

To make the computer vision work perfectly, it requires from thousands to millions of images to correctly define an object. In the case of Tesla, every car of the fleet sends back video data from all 8 cameras to train the Tesla Neural Net. Tesla has billions of miles of real-world driving data gathered from its worldwide fleet of more than a million cars. This gives Tesla an edge over any company working on self-driving cars and car vision neural nets.

Earlier this year, Tesla CEO Elon Musk said that the company’s powerful next-gen neural net called Dojo is being built and its version 1.0 should be up and running next year — interesting indeed.

Autopilot driving decisions migrating towards NNs is a giant leap forward in Tesla FSD development and the new year should be more interesting with the results.

Stay tuned for more, follow us on: Google News | Flipboard | RSS (Feedly).

Iqtidar Ali
Iqtidar Alihttp://www.teslaoracle.com
Iqtidar has been writing about Tesla, Elon Musk, and EVs for more than 3 years on XAutoWorld.com, many of his articles have been republished on CleanTechnica and InsideEVs, maintains a healthy relationship with the Tesla community across the Social Media sphere. You can reach him on Twitter @IqtidarAlii

Latest News

Tesla releases Cybertruck Delivery Event details, entry will require QR code scanning, TSLA stock price surges, more

Tesla (TSLA) released details of the Cybertruck Delivery Event today. The event is scheduled to take place at the...

Watch the Tesla Cybertruck drive through the salty sea water like a boss

Tesla Cybertruck is currently the most anticipated vehicle of the entire automotive industry globally. Tesla showrooms are getting rushed...

Canada’s lone Cybertruck attracts massive crowds waiting in line to get a first look, more Tesla showrooms get it in the US

On the day of Black Friday and the following weekend, a massive number of Canadians chose to see the...

Elon Musk’s iPhone wallpaper of Starship’s 2nd launch tells us a bit about his phone preferences

CEO of Tesla and SpaceX Elon Musk shared his personal phone's wallpaper on X (Twitter) a couple of days...
- Advertisement -

Elon Musk’s iPhone wallpaper of Starship’s 2nd launch tells us a bit about his phone preferences

CEO of Tesla and SpaceX Elon Musk shared his personal phone's wallpaper on X (Twitter) a couple of days...

2nd Starship launch was a success, it went way beyond stage separation and then missing in space

After 7 months of excitement, hurdles, and wait, SpaceX finally launched Starship for the 2nd time. Although both Super...

SpaceX delays Starship launch to Saturday 18th Nov to fix a grid fin on the Super Heavy rocket, says Elon Musk

SpaceX CEO Elon Musk has announced on his social media platform X that the 2nd Starship launch which was...

Tesla Tips & Tricks

Here’s how to drive a Tesla Model 3/Y without the center screen (video)

All credit goes to Tesla for making giant center...

Calculating Tesla Model 3 range loss through a cold winter night (video)

As the holiday season is nearing, cold weather is...

Watch what happens when the Tesla Model 3 screen is smashed with a hammer while driving

A tech YouTuber Taras Maksimuk has performed a very...

Tesla Quarterly Reports & Eearnings

- Advertisement -

You might also likeRELATED
Recommended for You