AI Learns to Run Faster than Usain Bolt | World Record

cozmouz · 2 years ago

At a glance

Length
10 min
Channel
cozmouz
Video from
Jul 2024
Rating
⭐⭐ Great video · 2/2
Best for
Machine learning students and AI practitioners exploring motor control and reward shaping

What this video answers

  • What is a neural network and why does the AI need one?
  • Why did the AI develop a zombie-like running gait in the first training session?
  • What does the "penalty for existing" accomplish?
  • How did the AI improve after the second training phase?
  • Can this AI learn other athletic movements, or only running?

How Deep Reinforcement Learning Teaches AI to Sprint Faster Than Usain Bolt

This video from cozmouz demonstrates an ambitious machine learning project: training a simulated humanoid ragdoll to run 100 meters faster than Usain Bolt's world record of 9.58 seconds. The AI system uses deep reinforcement learning to control a 70-kilogram, six-foot-tall digital character with full joint control across 16 articulation points. The project unfolds across three distinct training phases, each introducing new constraints and environmental conditions to push the AI toward faster, more stable running.

The overall execution is methodical and transparent. Rather than presenting a polished final result, the video documents the complete journey—including initial failures where the AI develops a zombie-like gait, then correcting course through environmental randomization and reward function refinement. By the end, the AI achieves progressively faster times: 12.30 seconds, 9.74 seconds, and finally 7.38 seconds for 100 meters, genuinely surpassing the human benchmark.

Key Moments

Key Technical Achievements in the Training Process

  • Neural Network Architecture: A modest 256-neuron hidden layer—approximately 10% of a jellyfish's neural capacity—proves sufficient to learn complex running biomechanics.
  • Reward Function Design: Initial training targets 11 meters per second average velocity (exceeding Bolt's 10.4 m/s) with a small forward-facing bonus to keep the AI in lane.
  • Gait Problem Solved via Randomization: The first training session produces an asymmetrical zombie stride. Introducing a randomized cubic environment where the AI must chase a cube at variable orientations forces bilateral leg use and eliminates the bottleneck.
  • Penalty-Driven Efficiency: A penalty for simply existing (per-step cost) plus a new penalty for falling over accelerates learning and reduces wasted motion, analogous to escaping a maze with a pursuer behind you.
  • Transfer Learning Success: Skills learned in the randomized training environment (proper bilateral locomotion) transfer cleanly back to straight-line sprinting without degradation.
  • Incremental Performance Gains: Three separate training sessions yield measurable improvements: 12.30 → 9.74 → 7.38 seconds, demonstrating convergence despite changing environmental parameters and AI height adjustments.
Featured image for the guide to AI Learns to Run Faster than Usain Bolt | World Record by cozmouz

Who Benefits From Watching This AI Training Demonstration

This video suits machine learning practitioners interested in reinforcement learning applications to physics-based simulation and anyone exploring how neural networks can acquire complex motor skills. It's particularly valuable for students and researchers studying transfer learning, reward shaping, and the role of environmental design in accelerating agent convergence. The didactic approach—explaining each component step-by-step before running training—makes it accessible to viewers with intermediate ML knowledge who want to understand both the theory and practical debugging process.

For AI enthusiasts without a deep technical background, the video offers compelling visual proof that machines can learn athletic behaviors through algorithmic incentives alone, without hard-coding motion patterns. If your work touches physics simulation, game AI development, or robotics control policies, this project demonstrates concrete techniques worth adopting. Recommended with high confidence for your learning goals.

Frequently Asked Questions About AI Sprint Training

What is a neural network and why does the AI need one?

A neural network is a mathematical structure loosely inspired by biological brains. The video describes it as a formula that processes inputs into outputs. In this case, the network reads the angles of the AI's 16 joints and outputs signals to move those joints. The hidden layers (256 nodes in this project) give the network capacity to learn complex relationships between body position and successful movement.

Why did the AI develop a zombie-like running gait in the first training session?

The AI discovered an asymmetrical but functional way to move forward: favoring one leg while dragging the other. This satisfied the reward function (moving at target velocity, staying upright) without requiring balanced bilateral motion. The video identifies this as a local optimum—good enough to get rewarded, but not optimal. Only when the environment was randomized and the AI had to face different directions did it learn to use both legs equally.

What does the "penalty for existing" accomplish?

The video explains this using a maze analogy: without time pressure, you might wander slowly. With a serial killer chasing you, you run efficiently to escape quickly. A per-step cost forces the AI to complete the 100-meter run in fewer steps, naturally encouraging faster, more economical movement. This penalty, combined with the velocity target, drives the agent toward genuinely fast sprinting rather than merely meeting the speed threshold inefficiently.

How did the AI improve after the second training phase?

The second phase introduced three key changes: (1) a penalty for falling over, discouraging unstable motion; (2) increased height from 6 feet to match Usain Bolt's 6'5" more closely (making the task harder); and (3) transfer learning from the randomized cubic environment, where the AI already learned bilateral locomotion. These factors combined allowed the third training session to achieve 7.38 seconds, a substantial improvement over the initial 12.30-second time.

Can this AI learn other athletic movements, or only running?

The video does not explore other movements, but the underlying technique—reinforcement learning with reward shaping—is general-purpose. The reward function is the key: you define what success looks like (velocity, stability, balance, direction) and let the neural network learn control policies to maximize it. In theory, you could define rewards for jumping, climbing, or other tasks and apply the same framework, though the video does not demonstrate this.

A still from the video AI Learns to Run Faster than Usain Bolt | World Record by cozmouz
Explore more artificial intelligence
See the BEST NEW products on Amazon!

Key Terms

Deep Reinforcement Learning
A machine learning method where an AI learns by taking actions in an environment, receiving rewards or penalties, and adjusting its neural network to maximize future rewards.
Neural Network
A mathematical structure with input layers, hidden layers, and output layers that processes information similarly to how a biological brain works.
Reward Function
A mathematical formula that scores how well the AI is performing at a task, guiding it toward desired behavior through incentives.
Transfer Learning
Using knowledge or skills learned in one environment or task to improve performance in a different but related environment or task.
Ragdoll Physics
A simulation method where a character's body is modeled as a loose collection of joints and limbs that respond naturally to forces, rather than following pre-set animations.

Sources: Deep Reinforcement Learning · Neural Network · Reward Function · Transfer Learning · Ragdoll Physics — definitions cross-referenced with Wikipedia

Justin’s Take

This video excels because it honestly documents the messy middle of machine learning: the zombie gait, the debugging, the failed first attempt. Many AI showcases skip straight to polished results. By showing what went wrong and how to fix it, the video teaches practical troubleshooting alongside the theoretical framework. The progression from naive agent to world-record sprint is genuinely compelling.

What impressed me most was the methodical explanation of reward design—how Bolt's average speed (10.4 m/s) becomes a target velocity of 11 m/s, and how layering penalties (falling, existing) refines the learned behavior. The transfer learning moment, where skills from the randomized environment cleanly apply to straight-line running, is an elegant illustration of why good training environments matter. This is essential viewing for anyone serious about reinforcement learning.

Great video · 2 out of 2

Justin
Justin

I started Helicopterstour.com because I genuinely believe there’s no better way to see the world than from the sky. I used to work on the Pride of America cruise ship in Hawaii, helping guests book shore excursions all over the islands. Two Vacation Hero Awards 2,000+ Guests/Week Pride of America · NCL Hawaii Shore Excursions 1000+ Tours Reviewed

Video by cozmouz on YouTube. If you enjoyed it, please subscribe to their channel and show your support for the great video.

Description

2nd Channel: https://www.youtube.com/@cozmouzlabs
Discord: https://discord.gg/S2ZeaPMjdx
Twitter: https://twitter.com/cozmouzz
Mail: cozmouz@gmail.com
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Video showcases AI trained using Deep Reinforcement Learning.
Music By Epidemic Sounds.
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

artificial intelligence, ai, machine learning, ai learns, deep reinforcement learning, ai training, evolution, neural networks, cozmouz #ai
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Chapters:
00:00 - Intro
00:48 - Neural Networks
01:48 - Reward Function
02:44 - 1st Training Session
03:53 - 1st Training Session Analysis
04:26 - Changes [ Randomization ]
05:06 - 2nd Training Session
06:08 - Transfer Learning & Changes
07:28 - 3rd Training Session
08:06 - 100m in 12.30 sec
08:22 - 100m in 9.74 sec
08:35 - 100m in 7.38 sec [ Best Run ]
09:31 - Endless Runner

Video transcript Accessibility

A full written transcript of this video, provided for accessibility. Select any timestamp to jump the video to that moment.

It's 2009 and Usain Bolt is about to 100 meters in only 9.58 seconds. A world record unlikely to be broken ever again until today. This is an artificial intelligence, a ragdoll controlled completely by an AI.

Let's check if it works. At the moment our AI is untrained and naive. So let's fix it. This is a test running track measuring precisely 100 meters. Our AI is going to be training here for thousands of hours and episodes. But before we do that, let's get to know our AI. Our ragdoll weighs 70 kilos and is six foot tall.

Inside its head is something called a neural network. Think of it as some mathematical formula which roughly mimics how the brain functions. To train this neural network, we give it inputs, which it then processes into outputs. Since we are training any AI to run, we're going to give it complete control

over all of its joints. The euler angles of each joint is extracted and arranged into a vector which is then fed into the neural network as inputs. Since we have a total of 16 joints, we will need a decently large network. Besides the input and output, there are hidden layers. The number of hidden layers and nodes is what determines the IQ of the AI.

256 should be enough. Now, this may seem like a lot of brain cells, but in reality it's only about 10% of the neurons in a jellyfish, which in turn has only about 0.00001% of the neurons in a human. Now that I've explained how dumb our AI is, let's talk about rewards. Since we are using a reinforcement learning algorithm,

we need to define a reward function. This incentivizes the AI to behave a certain way. Bolt's average speed during the record breaking 100 meter race, was about 10.4 meters per second. To beat this, the AI needs to run at at least 11 meters per second on average. So we set this as the target velocity and reward the AI for how closely it matches this speed.

As the current velocity of the AI approaches 11, the reward approaches 1. As the AI deviates away, the reward approach zero. This should encourage our AI to run fast. To make sure the AI runs in a straight lane, a small reward will be given for facing forward. Now that we have defined the reward function,

there is only one thing left to be done. Let's get to training.

So what has our AI learned? Let's see if it can now beat Usain Bolt. Usain Bolt absolutely zips away while our AI face-plants itself onto the ground, struggling to find meaning in life. So what's wrong? The AI seems to have developed a unique stride, very similar to a zombie. There is one dominant leg while the other barely drags along.

This is a severe bottleneck preventing the AI from running faster and it needs to be fixed. So how exactly do we force our AI to use both of his legs? Well, randomization. We will now use a special cubic training environment. The ragdolls orientation will be randomized every single episode.

A cube will be randomly spawned around the area, which the AI has to face towards, to earn rewards. This means the AI has to face the cube and maintain a target velocity of 3 meters per second. The lower velocity will ensure more stable training. This environment will force the AI to twist and turn in various directions

and hopefully use both of his legs.

Our AI has successfully learned to use both of its legs. If we now place our AI back into the previous environment, we can see that it's now walking properly. Since it now learned to use both of his legs, it won't forget it and we can safely bump up the target velocity back to 11.

However, before we resume training, few changes need to be made. There is now going to be a penalty for falling over. Usain Bolt is six foot five while our AI is only six foot. So it's only fair to make our AI slightly taller. There is one last change to be made and this is in the reward function itself.

We are now going to penalize the AI for a simply existing. Yes, you heard that right. A small penalty every single step. Imagine you are in a real life maze and you have to escape. There is no time limit and you can find the escape route at your own pace. Sounds pretty simple, but now imagine the same maze with a serial killer placed behind you.

You will be forced to run faster and find the escape route quickly and efficiently. This is the idea behind the small penalty. It will force the AI to run fast and use its limbs efficiently. So in summary, Our AI is now taller, there is a penalty for falling over and also a penalty for existing.

Let's get to training and see what our AI learns this time.

Since beating the world record, our AI now runs endless errands around the world utilizing its new found skill.

How videos are chosen here

Every video on Helicopterstour.com is hand-picked and reviewed by Justin — nothing is added automatically. Each one gets an original written guide and an honest rating: ⭐ 1 out of 2 means a good video worth your time, and ⭐⭐ 2 out of 2 means a great one we would recommend to anyone. The videos belong to their creators — every page links back to the original channel so you can subscribe and support them.

Contact us

Get new videos in your inbox

A short email when we publish something new. No spam — unsubscribe anytime.