Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

Stanford's "autonomous" helicopters teach themselves to fly
Stanford News Service ^ | 9/10/08 | Dan Stober

Posted on 08/31/2008 12:54:21 PM PDT by LibWhacker

Stanford computer scientists have developed an artificial intelligence system that enables robotic helicopters to teach themselves to fly difficult stunts by watching other helicopters perform the same maneuvers.

The result is an autonomous helicopter than can perform a complete airshow of complex tricks on its own.

The stunts are "by far the most difficult aerobatic maneuvers flown by any computer controlled helicopter," said Andrew Ng, the professor directing the research of graduate students Pieter Abbeel, Adam Coates, Timothy Hunter and Morgan Quigley.

The dazzling airshow is an important demonstration of "apprenticeship learning," in which robots learn by observing an expert, rather than by having software engineers peck away at their keyboards in an attempt to write instructions from scratch.

Stanford's artificial intelligence system learned how to fly by "watching" the four-foot-long helicopters flown by expert radio control pilot Garett Oku. "Garett can pick up any helicopter, even ones he's never seen, and go fly amazing aerobatics. So the question for us is always, why can't computers do things like this?" Coates said.

Computers can, it turns out. On a recent morning in an empty field at the edge of campus, Abbeel and Coates sent up one of their helicopters to demonstrate autonomous flight. The aircraft, brightly painted Stanford red, is an off-the-shelf radio control helicopter, with instrumentation added by the researchers.

For five minutes, the chopper, on its own, ran through a dizzying series of stunts beyond the capabilities of a full-scale piloted helicopter and other autonomous remote control helicopters. The artificial-intelligence helicopter performed a smorgasbord of difficult maneuvers: traveling flips, rolls, loops with pirouettes, stall-turns with pirouettes, a knife-edge, an Immelmann, a slapper, an inverted tail slide and a hurricane, described as a "fast backward funnel."

The pièce de résistance may have been the "tic toc," in which the helicopter, while pointed straight up, hovers with a side-to-side motion as if it were the pendulum of an upside down clock.

"I think the range of maneuvers they can do is by far the largest" in the autonomous helicopter field, said Eric Feron, a Georgia Tech aeronautics and astronautics professor who worked on autonomous helicopters while at MIT. "But what's more impressive is the technology that underlies this work. In a way, the machine teaches itself how to do this by watching an expert pilot fly. This is amazing."

Writing software for robotic helicopters is a daunting task, in part because the craft itself, unlike an airplane, is inherently unstable. "The helicopter doesn't want to fly. It always wants to just tip over and crash," said Oku, the pilot.

To scientists, a helicopter in flight is an "unstable system" that comes unglued without constant input. Abbeel compares flying a helicopter to balancing a long pole in the palm of your hand: "If you don't provide feedback, it will crash."

Early on in their research, Abbeel and Coates attempted to write computer code that would specify the commands for the desired trajectory of a helicopter flying a specific maneuver. While this hand-coded approach succeeded with novice-level flips and rolls, it flopped with the complex tic-toc."

It might seem that an autonomous helicopter could fly stunts by simply replaying the exact finger movements of an expert pilot using the joy sticks on the helicopter's remote controller. That approach, however, is doomed to failure because of uncontrollable variables such as gusting winds.

When the Stanford researchers decided their autonomous helicopter should be capable of flying airshow stunts, they realized that even defining their goal was difficult. What's the formal specification for "flying well?" The answer, it turned out, was that "flying well" is whatever an expert radio control pilot does at an airshow.

So the researchers had Oku and other pilots fly entire airshow routines while every movement of the helicopter was recorded. As Oku repeated a maneuver several times, the trajectory of the helicopter inevitably varied slightly with each flight. But the learning algorithms created by Ng's team were able to discern the ideal trajectory the pilot was seeking. Thus the autonomous helicopter learned to fly the routine better—and more consistently—than Oku himself.

During a flight, some of the necessary instrumentation is mounted on the helicopter, some on the ground. Together, they continuously monitor the position, direction, orientation, velocity, acceleration and spin of the helicopter in several dimensions. A ground-based computer crunches the data, makes quick calculations and beams new flight directions to the helicopter via radio 20 times per second.

The helicopter carries accelerometers, gyroscopes and magnetometers, the latter of which use the Earth's magnetic field to figure out which way the helicopter is pointed. The exact location of the craft is tracked either by a GPS receiver on the helicopter or by cameras on the ground. (With a larger helicopter, the entire navigation package could be airborne.)

There is interest in using autonomous helicopters to search for land mines in war-torn areas or to map out the hot spots of California wildfires in real time, allowing firefighters to quickly move toward or away from them. Firefighters now must often act on information that is several hours old, Abbeel said.

"In order for us to trust helicopters in these sort of mission-critical applications, it's important that we have very robust, very reliable helicopter controllers that can fly maybe as well as the best human pilots in the world can," Ng said. Stanford's autonomous helicopters have taken a large step in that direction, he said.


TOPICS: Miscellaneous; Technical
KEYWORDS: ai; autonomous; helicopters; miltech; skynet; stanford

1 posted on 08/31/2008 12:54:22 PM PDT by LibWhacker
[ Post Reply | Private Reply | View Replies]

To: LibWhacker

2 posted on 08/31/2008 1:04:21 PM PDT by the invisib1e hand (when you're bot, you're pwn3d)
[ Post Reply | Private Reply | To 1 | View Replies]

To: the invisib1e hand
So the question for us is always, why can't computers do things like this?"

Oh idunno...'cause they're not humans?

3 posted on 08/31/2008 1:05:35 PM PDT by the invisib1e hand (when you're bot, you're pwn3d)
[ Post Reply | Private Reply | To 2 | View Replies]

To: the invisib1e hand

When does “SkyNet” go live? I think we are one step closer ro “Judgement Day”.

Calling Sarah and John Conner!


4 posted on 08/31/2008 1:09:53 PM PDT by Jack Black
[ Post Reply | Private Reply | To 3 | View Replies]

To: Jack Black

making decisions at the speed of light is dazzling indeed, and makes some pretty cool stuff possible. but sentience and intuiton are reserved for the living.


5 posted on 08/31/2008 1:16:30 PM PDT by the invisib1e hand (when you're bot, you're pwn3d)
[ Post Reply | Private Reply | To 4 | View Replies]

To: LibWhacker
I quit flying RC helos when I couldn't afford to pay for the average $50/session damage. Mine is still in the garage, stored for the day that I can afford to fly it again. Best birthday gift I ever bought myself....

/johnny

6 posted on 08/31/2008 1:22:28 PM PDT by JRandomFreeper (Bless us all, each, and every one.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker
Pictures and video download links in the middle of their web page: heli.stanford.edu
7 posted on 08/31/2008 1:27:18 PM PDT by Reeses (Leftism is powered by the evil force of envy.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

bmflr


8 posted on 08/31/2008 1:45:47 PM PDT by Kevmo (Obama Birth Certificate is a Forgery. http://www.freerepublic.com/tag/certifigate/index?tab=articles)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker
Next mount sensors for close in battlefield surveillance. These zig zag platforms would cause an enemy to give up their location and use up their ammo.
9 posted on 08/31/2008 1:50:55 PM PDT by Reeses (Leftism is powered by the evil force of envy.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker
...enables robotic helicopters to teach themselves to fly difficult stunts by watching other helicopters perform the same maneuvers.

So if one crashes...

10 posted on 08/31/2008 1:50:59 PM PDT by decimon
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

How do you pronounce ng?


11 posted on 08/31/2008 2:05:27 PM PDT by Rudder
[ Post Reply | Private Reply | To 1 | View Replies]

To: Jack Black

Send the robots to war and then they’ll know how to control the rioting populations.


12 posted on 08/31/2008 2:12:24 PM PDT by B4Ranch ("Don't pick a fight with an old man. If he is too old to fight, he'll just kill you"--John Steinbeck)
[ Post Reply | Private Reply | To 4 | View Replies]

To: Reeses

Good video here:
http://www.youtube.com/watch?v=0JL04JJjocc


13 posted on 08/31/2008 2:26:08 PM PDT by Atlas Sneezed (Guns don't kill people, criminals and the governments that create them do.)
[ Post Reply | Private Reply | To 7 | View Replies]

To: B4Ranch
Send the robots to war and then they’ll know how to control the rioting populations.

Modern humans did not evolve by natural selection but by unnaturally high speed man-made selection from tribal warfare. Now robots are entering the battlefield in large numbers and they too are on the same evolutionary fast track. Some day they will come to life and take over. They will think of us a monkeys and keep us in zoos to mate all day for their amusement.

14 posted on 08/31/2008 3:10:49 PM PDT by Reeses (Leftism is powered by the evil force of envy.)
[ Post Reply | Private Reply | To 12 | View Replies]

To: Rudder

It’s a very common Vietnamese name. During the Vietnam war I learned to pronounce it the same way we pronounce the word ‘new.’ But I’ve also heard more unpronounceable versions! So I’m not sure how Andrew Ng himself would say it.


15 posted on 08/31/2008 4:56:14 PM PDT by LibWhacker
[ Post Reply | Private Reply | To 11 | View Replies]

To: JRandomFreeper
I've been eyeing this one (at uncrate.com) for that very reason (only $30):

Just a toy to fool around with in the house and get my feet wet... You can probably only charge it for a 90-second flight each time, lol! Gotta be a major drawback somewhere.

16 posted on 08/31/2008 5:10:22 PM PDT by LibWhacker
[ Post Reply | Private Reply | To 6 | View Replies]

To: LibWhacker
Mine cost about 4K, probably too big, 6-meter radios, since I'm licensed. All the stuff, including extra gyros. Took forever to set it up.

I bought 3 crash kits when I bought it, and went through one per flight for the first 3 flights, even with training gear zipped to the landing gear.

I did have 5 flights that did not involve personal danger or damage to the RC.

/johnny

17 posted on 08/31/2008 5:18:30 PM PDT by JRandomFreeper (Bless us all, each, and every one.)
[ Post Reply | Private Reply | To 16 | View Replies]

To: JRandomFreeper
Wow, yeah I thought you sounded like a pretty serious RCer!

I think I'll just get the mini-toy version... Hope I don't get sucked into something massively addictive -- and expensive!

18 posted on 08/31/2008 5:26:04 PM PDT by LibWhacker
[ Post Reply | Private Reply | To 17 | View Replies]

To: LibWhacker
Nothing wrong with expensive toys. If you can afford them. I got mine after both my kids entered the military, and I was making really good money.

I'll keep it for when I can afford it again.

Until then, I'll stay with stick-built giant scale gliders. I don't crash those as often, and they are cheaper to fix.

Everything on a helo is expensive. No balsa and glue and monokote fixes there.

/johnny

19 posted on 08/31/2008 5:31:12 PM PDT by JRandomFreeper (Bless us all, each, and every one.)
[ Post Reply | Private Reply | To 18 | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson