Tesla is migrating from programming logic to Neural Net for FSD decision making

-

-Advertisement-

Tesla firmware hacker and researcher who goes by the name of ‘green’ in cyberspace has just revealed that Tesla is migrating towards Neural Nets (NNs) for Full Self-Driving (FSD) decision making. Currently, Tesla vehicles are taking decisions such as ‘right of way’ with programming logic built in C++.

Green usually reveals his findings via his Twitter account and in the recent past has been under Tesla’s wrath resulting in a lawsuit. He posted the latest finding on Twitter in his tweet:

The Tesla hacker thinks that the Silicon Valley-based automaker is implementing this migration bit-by-bit, probably starting from the ‘right of way guessing’ function to other more complex decisions that the car needs to take.

Currently, Tesla is improving the Autopilot (FSD Beta) decision making with each firmware update it is pushing to the select few cars in the United States. With the NNs in the loop, the cars will be able to instantly get feedback from the Tesla Mothership which has tons and tons of machine learning data to help make a better decision.

Tesla Model Y Accessories by EVANNEX (Sponsored Banner).
– Sponsored –

How Computer / Autopilot Vision Works

Tesla Autopilot engineer explains how computers recognize objects via Traditional Programming vs. Machine Learning + AI.
Tesla Autopilot engineer explains how computers recognize objects via Traditional Programming vs. Machine Learning + AI. Tap/Click to load the HD version of the infographic (full video below). Source: Code.org / Tesla.

Tesla Autopilot engineer Kate Park explains how computer vision works in the following video. I have included one infographic above from the video that explains how decision making or object detection is limited to the use of traditional programming. With the use of Machine Learning + AI + Neural Nets, the whole process provides limitless possibilities.

For example, traditional programming cannot recognize “X” if it is not exactly drawn with the defined parameters (see image above). But the combination of machine learning, AI, and Neural Networks enable the computer to learn multiple patterns and possibilities an “X” can appear in front.

How Tesla Neural Net vision works, explained by Tesla AI director, Andrej Karpathy.
How Tesla Neural Net vision works, explained by Tesla AI director, Andrej Karpathy on Tesla Autonomy Day 2019. Tap/Click to load the HD version. Source: Tesla.

To make the computer vision work perfectly, it requires from thousands to millions of images to correctly define an object. In the case of Tesla, every car of the fleet sends back video data from all 8 cameras to train the Tesla Neural Net. Tesla has billions of miles of real-world driving data gathered from its worldwide fleet of more than a million cars. This gives Tesla an edge over any company working on self-driving cars and car vision neural nets.

Earlier this year, Tesla CEO Elon Musk said that the company’s powerful next-gen neural net called Dojo is being built and its version 1.0 should be up and running next year — interesting indeed.

Autopilot driving decisions migrating towards NNs is a giant leap forward in Tesla FSD development and the new year should be more interesting with the results.

Stay tuned for more, follow us on: Google News | Flipboard | RSS (Feedly).

Iqtidar Ali
Iqtidar Alihttp://www.teslaoracle.com
Author of more than 1500 articles on Tesla, SpaceX, and EVs. His work has been liked and tweeted by Elon Musk and other prominent influencers. You can reach him on Twitter @IqtidarAlii

Latest News

Tesla FSD v13.2.9 performs better in rainy conditions, UPLs, watch the first impressions

After a pause of several weeks, Tesla (TSLA) started the rollout of a new FSD 13 point release FSD...

Red hot Tesla Cybertrucks welcome Elon Musk and President Trump in Qatar (videos)

After getting a warm reception at the Doha airport by the Emir of Qatar, Sheikh Tamim bin Hamad Al...

Tesla (TSLA) regains $1 trillion market cap, Musk to bring Optimus robot dance troupe to the Shareholder Meeting

Tesla (TSLA) has once again topped the $1 trillion market capitalization mark with this week's spur in the company's...

Elon Musk shows Optimus dance moves to President Trump and the Saudi Crown Prince, Tesla (TSLA) releases new videos, more

Tesla (TSLA) CEO Elon Musk was in Saudi Arabia yesterday. He accompanied President Donald Trump to attend the 2025...
- Advertisement -

Flight 9 Starship is headed for another static fire test, expected launch schedule, more

SpaceX has moved Starship prototype 35 (Ship 35) to the Starbase, Texas launch site in preparation for the upcoming...

SpaceX Starship now has its own city—Starbase, Texas (election results)

Today, it was the election day at Cameron County. Ballots for Starbase incorporation as a Texas city and its...

SpaceX accelerates Starship Gigabay development in Florida, OLM construction makes progress, more

Elon Musk's spaceflight and astronautics company SpaceX is accelerating the Starship program in Florida as well. SpaceX is building...

Tesla Tips & Tricks

Get your Cybertruck tonneau cover fixed by Tesla as a free waterproof upgrade

Tesla (TSLA) is asking owners of the Cybertruck to...

Tesla offers access to its Model S, 3, X, Y service manuals subscription free for 1 year

Tesla has allowed its customers to subscribe to the...

SpaceX enthusiast designs a 1:110 scale LEGO Starship

A NASA/SpaceX enthusiast who goes by the name of...

Tesla Quarterly Reports & Eearnings

Tesla (TSLA) surges after Q1 2025 Earnings Call, Musk’s time at DOGE to drop significantly soon

Surprisingly, after reporting negative Q1 2025 automotive and overall...

What to expect from Tesla (TSLA) Q1 2025 Earnings Call with Elon Musk

Today's Tesla (TSLA) Q1 2025 Earnings Call is probably...

Tesla (TSLA) announces time and date of the Q1 2025 Earnings Call

Elon Musk's electric vehicle and energy storage company Tesla...
- Advertisement -

You might also likeRELATED
Recommended for You