Tesla is migrating from programming logic to Neural Net for FSD decision making



Tesla firmware hacker and researcher who goes by the name of ‘green’ in cyberspace has just revealed that Tesla is migrating towards Neural Nets (NNs) for Full Self-Driving (FSD) decision making. Currently, Tesla vehicles are taking decisions such as ‘right of way’ with programming logic built in C++.

Green usually reveals his findings via his Twitter account and in the recent past has been under Tesla’s wrath resulting in a lawsuit. He posted the latest finding on Twitter in his tweet:

The Tesla hacker thinks that the Silicon Valley-based automaker is implementing this migration bit-by-bit, probably starting from the ‘right of way guessing’ function to other more complex decisions that the car needs to take.

Currently, Tesla is improving the Autopilot (FSD Beta) decision making with each firmware update it is pushing to the select few cars in the United States. With the NNs in the loop, the cars will be able to instantly get feedback from the Tesla Mothership which has tons and tons of machine learning data to help make a better decision.

Tesla Model Y Accessories by EVANNEX (Sponsored Banner).
– Sponsored –

How Computer / Autopilot Vision Works

Tesla Autopilot engineer explains how computers recognize objects via Traditional Programming vs. Machine Learning + AI.
Tesla Autopilot engineer explains how computers recognize objects via Traditional Programming vs. Machine Learning + AI. Tap/Click to load the HD version of the infographic (full video below). Source: Code.org / Tesla.

Tesla Autopilot engineer Kate Park explains how computer vision works in the following video. I have included one infographic above from the video that explains how decision making or object detection is limited to the use of traditional programming. With the use of Machine Learning + AI + Neural Nets, the whole process provides limitless possibilities.

For example, traditional programming cannot recognize “X” if it is not exactly drawn with the defined parameters (see image above). But the combination of machine learning, AI, and Neural Networks enable the computer to learn multiple patterns and possibilities an “X” can appear in front.

How Tesla Neural Net vision works, explained by Tesla AI director, Andrej Karpathy.
How Tesla Neural Net vision works, explained by Tesla AI director, Andrej Karpathy on Tesla Autonomy Day 2019. Tap/Click to load the HD version. Source: Tesla.

To make the computer vision work perfectly, it requires from thousands to millions of images to correctly define an object. In the case of Tesla, every car of the fleet sends back video data from all 8 cameras to train the Tesla Neural Net. Tesla has billions of miles of real-world driving data gathered from its worldwide fleet of more than a million cars. This gives Tesla an edge over any company working on self-driving cars and car vision neural nets.

Earlier this year, Tesla CEO Elon Musk said that the company’s powerful next-gen neural net called Dojo is being built and its version 1.0 should be up and running next year — interesting indeed.

Autopilot driving decisions migrating towards NNs is a giant leap forward in Tesla FSD development and the new year should be more interesting with the results.

Stay tuned for more, follow us on: Google News | Flipboard | RSS (Feedly).

Iqtidar Ali
Iqtidar Alihttp://www.teslaoracle.com
Iqtidar has been writing about Tesla, Elon Musk, and EVs for more than 3 years on XAutoWorld.com, many of his articles have been republished on CleanTechnica and InsideEVs, maintains a healthy relationship with the Tesla community across the Social Media sphere. You can reach him on Twitter @IqtidarAlii

Latest News

Tesla drops the Full Self-Driving package price by $4,000 — after the reduction in monthly subscription cost

Tesla (TSLA) has dropped the price of its Full Self-Driving (FSD) Capability package from $12,000 to $8,000. The automaker...

Tesla drops the prices of Model Y, Model S, and Model X by $2,000

Tesla (TSLA) dropped the prices of Model Y, Model S, and Model X vehicle lineups by $2,000 on each...

Tesla Spring Update (2024.14) to bring Enhanced UI, Auto Shift, Hands-Free Trunk, Rear Screen Off (Release Notes)

This year, Tesla (TSLA) is preparing to roll out a feature-packed over-the-air (OTA) software update just before mid-year. The...

Tesla rolls out FSD (Supervised) v12.3.4 to a wider user base — aggressive acceleration still persists, first impressions

Tesla (TSLA) began the rollout of its latest Full Self-Driving (Supervised) version 12.3.4 (2024.3.15) late last week. Starting this...
- Advertisement -

Flight 4 Starship goes through 2nd static fire test, OLM gets repairs at Starbase, more

SpaceX conducted the 1st static fire test on Starship 29 (Ship 29) on Monday in preparation for the next...

Watch Starship Flight 3 (IFT-3) live stream recording and live updates from the SpaceX Starbase launch site

SpaceX has started live-streaming the Starship Flight 3 (IFT-3) launch and liftoff official coverage (watch below). We will be updating...

Starship Flight 3 (IFT-3) date falls on SpaceX’s 22nd foundation anniversary, FAA approves the launch

According to Elon Musk, SpaceX will attempt to fly the Starship for the 3rd time from Starbase, Texas in...

Tesla Tips & Tricks

Here’s how much battery is drained if a Tesla is left unplugged for 32 days

A Tesla Model 3 owner parked her car in...

Here’s how to drive a Tesla Model 3/Y without the center screen (video)

All credit goes to Tesla for making giant center...

Tesla Quarterly Reports & Eearnings

Tesla (TSLA) vehicle deliveries drop in Q1 2024 by 20% QoQ — but it still did better than BYD

Tesla, Inc. (TSLA) announced its Q1 2024 vehicle production...

Tesla (TSLA) achieves the 1.8 million vehicle delivery target for 2023 with a record-breaking quarter

In a press release yesterday, Tesla (TSLA) announced its...
- Advertisement -

You might also likeRELATED
Recommended for You