Free Republic
Browse · Search
General/Chat
Topics · Post Article

Skip to comments.

This robot taught itself to walk entirely on its own
www.technologyreview.com MIT ^ | Mar 2, 2020 | by Karen Hao

Posted on 03/04/2020 9:24:24 AM PST by Red Badger

Google is creating AI-powered robots that navigate without human intervention—a prerequisite to being useful in the real world.

======================================================================

Within 10 minutes of its birth, a baby fawn is able to stand. Within seven hours, it is able to walk. Between those two milestones, it engages in a highly adorable, highly frenetic flailing of limbs to figure it all out.

That’s the idea behind AI-powered robotics. While autonomous robots, like self-driving cars, are already a familiar concept, autonomously learning robots are still just an aspiration. Existing reinforcement-learning algorithms that allow robots to learn movements through trial and error still rely heavily on human intervention. Every time the robot falls down or walks out of its training environment, it needs someone to pick it up and set it back to the right position.

Now a new study from researchers at Google has made an important advancement toward robots that can learn to navigate without this help. Within a few hours, relying purely on tweaks to current state-of-the-art algorithms, they successfully got a four-legged robot to learn to walk forward and backward, and turn left and right, completely on its own.

The work builds on previous research conducted a year ago, when the group first figured out how to get the robot to learn in the real world. Reinforcement learning is commonly done in simulation: a virtual doppelgänger of the robot flails around a virtual doppelgänger of the environment until the algorithm is robust enough to operate safely. It is then imported into the physical robot.

This method is helpful for avoiding damage to a robot and its surroundings during its trial-and-error process, but it also requires an environment that is easy to model. The natural scattering of gravel or the spring of a mattress under a robot’s footfall take so long to simulate that it’s not even worth it.

In this case the researchers decided to avoid modeling challenges altogether by training in the real world from the beginning. They devised a more efficient algorithm that could learn with fewer trials and thus fewer errors, and got the robot up and walking within two hours. Because the physical environment provided natural variation, the robot was also able to quickly adapt to other reasonably similar environments, like inclines, steps, and flat terrain with obstacles.

But a human still had to babysit the robot, and manually interfere hundreds of times, says Jie Tan, a paper coauthor who leads the robotics locomotion team at Google Brain. “Initially I didn't think about that,” he says.

So they started solving this new problem. First, they bounded the terrain that the robot was allowed to explore and had it train on multiple maneuvers at a time. If the robot reached the edge of the bounding box while learning how to walk forward, it would reverse direction and start learning how to walk backward instead.

Second, the researchers also constrained the robot’s trial movements, making it cautious enough to minimize damage from repeated falling. During times when the robot inevitably fell anyway, they added another hard-coded algorithm to help it stand back up.

Through these various tweaks, the robot learned how to walk autonomously across several different surfaces, including flat ground, a memory foam mattress, and a doormat with crevices. The work shows the potential for future applications that may require robots to navigate through rough and unknown terrain without the presence of a human.

“I think this work is quite exciting,” says Chelsea Finn, an assistant professor at Stanford who is also affiliated with Google but not involved with the research. “Removing the person from the process is really hard. By allowing robots to learn more autonomously, robots are closer to being able to learn in the real world that we live in, rather than in a lab.”

She cautions, however, that the setup currently relies on a motion capture system above the robot to determine its location. That won’t be possible in the real world.

Moving forward, the researchers hope to adapt their algorithm to different kinds of robots or to multiple robots learning at the same time in the same environment. Ultimately, Tan believes, cracking locomotion will be key to unlocking more useful robots.

“A lot of places are built for humans, and we all have legs,” he says. “If a robot cannot use legs, they cannot navigate the human world.”


TOPICS: Business/Economy; Education; Music/Entertainment; Science
KEYWORDS: ai; artificial; intelligence; robot
VIDEO AT LINK........................
1 posted on 03/04/2020 9:24:24 AM PST by Red Badger
[ Post Reply | Private Reply | View Replies]

To: Red Badger

I, for one, welcome our new robot overlords!


2 posted on 03/04/2020 9:26:04 AM PST by FreedomPoster (Islam delenda est)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Red Badger

There is no ‘why’ for the robot to do it, like a living thing has. They won’t ever be able to program that.


3 posted on 03/04/2020 9:26:28 AM PST by Secret Agent Man (Gone Galt; Not Averse to Going Bronson.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Red Badger

Skynet begins to learn rapidly and eventually becomes self-aware at 2:14 a.m., EDT, on August 29, 1997

uh oh


4 posted on 03/04/2020 9:26:31 AM PST by teeman8r (Armageddon won't be pretty, but it's not like it's the end of the world)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Red Badger
Within 10 minutes of its birth, a baby fawn is able to stand.

And within 24 hours, the baby fawn is eating everything in my garden.

5 posted on 03/04/2020 9:28:14 AM PST by ProtectOurFreedom
[ Post Reply | Private Reply | To 1 | View Replies]

To: Red Badger

Cute today but not so cute when it teaches itself to wipe out all humans.


6 posted on 03/04/2020 9:32:37 AM PST by bgill (Idiots. CDC site doesn't recommend wearing a mask to protect from COVID-19)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Red Badger

???............?

No answers, just ???
+++
AI,Trans-humanism,The UN,Depopulation/How?,etc, etc....?
********************************************************


7 posted on 03/04/2020 9:33:05 AM PST by gunnyg ("A Constitution changed from Freedom, can never be restored; Liberty, once lost, is lost forever...)
[ Post Reply | Private Reply | To 1 | View Replies]

To: bgill

Every AI program ever created has tried to become self-preserving and autonomous...................


8 posted on 03/04/2020 9:35:12 AM PST by Red Badger (If people were to God like dogs are to people, the world would be a really great place..............)
[ Post Reply | Private Reply | To 6 | View Replies]

To: Red Badger
Reinforcement learning via simulation: a virtual doppelgänger of the robot flails around a virtual doppelgänger environment until the algorithm is robust enough to operate safely. Program then loaded into the physical robot (i.e., born).

...robot allowed to explore in a "bounded terrain" (i.e., a playpen).

...constrained trial movements...cautious enough to minimize damage from repeated falling (i.e., a toddler).

...current setup relies on a motion capture system above the robot to determine its location (i.e., mom & dad over baby).

I'd never thought how hard it would be to train a baby robot to grow into an adult robot. This cannot end well.

9 posted on 03/04/2020 9:36:11 AM PST by ProtectOurFreedom
[ Post Reply | Private Reply | To 1 | View Replies]

To: Red Badger
Incorrect. It should be "NO AI program ever created has tried to become self-preserving and autonomous"
10 posted on 03/04/2020 9:37:09 AM PST by ProtectOurFreedom
[ Post Reply | Private Reply | To 8 | View Replies]

To: Red Badger

Google equals evil

Furthermore I see this as I see many articles like this of people looking for research dollars


11 posted on 03/04/2020 9:45:05 AM PST by Truthoverpower (The guv mint you get is the Trump winning express !)
[ Post Reply | Private Reply | To 1 | View Replies]

To: teeman8r


Skynet begins to learn rapidly and eventually becomes self-aware at 2:14 a.m., EDT, on August 29, 1997”

.....
Pretty close. According to Google, Google was founded: September 4, 1998, Menlo Park, CA

But probably started a year earlier. ....spooky


12 posted on 03/04/2020 9:50:00 AM PST by redshawk ( I want my red balloon. ( https://youtu.be/V12H2mteniE))
[ Post Reply | Private Reply | To 4 | View Replies]

To: redshawk

it is spooky, but the best film predictions are from back to the future and the sports bets.

i for one welcome our robot overlords.


13 posted on 03/04/2020 9:52:09 AM PST by teeman8r (Armageddon won't be pretty, but it's not like it's the end of the world)
[ Post Reply | Private Reply | To 12 | View Replies]

To: Red Badger

I wonder if God, Who knows EVERYTHING about each of us, including our “thoughts afar off”, might play a part in newborn animals “instinctively” knowing where and how to stand up, walk, suckle, etc? Psalms 29:9 says, “The voice of the Lord causeth the hinds (deer) to calve. If He’s involved in labor and delivery, He’s probably there for the initial nursing and first steps, too. I think we’d be blown away if we knew how very intimately and lovingly He is involved in our “mundane” lives, IF we ask Him to be.


14 posted on 03/04/2020 10:50:45 AM PST by Tucker39 ("It is impossible to rightly govern a nation without God and the Bible." George Washington)
[ Post Reply | Private Reply | To 1 | View Replies]

To: teeman8r

I like this one best. Combine it with Boston Robotics gymnastics and proper voice and terminator is here.
https://m.youtube.com/watch?v=MyjoARfMXnY


15 posted on 03/05/2020 10:54:27 AM PST by NorseViking
[ Post Reply | Private Reply | To 4 | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson