Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

Mars Rover Remains In 'Critical' Condition...
Spaceflight Now.com ^ | 01/23/2004 | William Harwood

Posted on 01/23/2004 4:35:20 PM PST by Hiwayman

The crippled Spirit rover remains in critical condition on the surface of Mars, engineers said today, the victim of ongoing electronic seizures that have caused its central computer to reboot itself more than 60 times over the past two days.

Engineers successfully coaxed the rover to beam back limited engineering data during two brief communications sessions and they were relieved to discover the spacecraft's power system was providing the necessary life support. But Spirit's state of mind was clearly - and unusually - different in both sessions, ruling out any simple explanations for what might have gone wrong.

"We have a serious problem," said project manager Pete Theisinger. "The fact that we've got a vehicle that we believe is stable for an extensive period of time will give us time to work that problem. We can command it to talk to us and even though we get perhaps limited information, we do get good information and that helps us work through the problem.

"I expect that we will get functionality back out of this rover. I think the chances that it will be perfect again, I would think, are not good. The chances that it will not work at all, I think are also low. I think we're somewhere in that broad middle and we need to understand the problem to find out exactly where we are."

Spirit went on the blink Wednesday as it was carrying out a procedure to calibrate drive motors used by its thermal emission spectrometer. Prior to that moment, everything was operating normally. But some event, possibly a hardware failure of some sort, threw the rover's electronic brain for a loop. Since then, the spacecraft has been in a state of limbo, responding in unusual fashion to anxious flight controllers.

"This morning, we sent an early beep to the spacecraft and did not get a response," Theisinger said. "As we were preparing to send a second, the spacecraft talked to us. We got very fractional frames and then moved very quickly to ask it to speak to us for 30 minutes at 120 bits per second. We got 20 minutes of transmission in that occasion, which was a single frame of engineering data repeated.

"Then we repeated that full sequence of events and we got about 15 minutes of engineering data at 120 bits per second where the frames were updated for 15 minutes and then for the second 15 minutes we had nothing but fill data."

He said Spirit "has been in a processor reset loop of some type, mostly since Wednesday, we believe, where the processor wakes up, loads the flight software, uncovers a condition that would cause it to reset. But the processor doesn't do that immediately. It waits for a period of time - at the beginning of the day it waits for 15 minutes twice and then for the rest of the day it waits for an hour - and then it resets and comes back up."

Complicating the work to track down the problem, "the indications we have on two occasions is that the thing that causes the reset is not always perceived to be the same," Theisinger said. "We are confused by that, but that's the facts as we presume them to be right now."

The reset sequence, similar to repeatedly unplugging one's personal computer and forcing it to restart, began Wednesday morning on Mars when a calibration of the spectrometer motors ended prematurely. An anomaly team has been formed to study the telemetry and to decide what readings to request from Spirit to help narrow down the range of possible failures.

"I think we should expect that we will not be restoring functionality to Spirit for a significant period of time," Theisinger said, "I think many days, perhaps a couple of weeks, even in the best of circumstances, from what we see today."

In the meantime, he said, Spirit remains in "critical" condition.

"We do not know to what extent we can restore functionality to the system because we don't know what's broke," Theisinger said. "We don't know what started this chain of events and I think, personally, that it's a sequence of things, and we don't know, therefore, the consequences of that. I think its difficult at this very preliminary stage to assume we did not have some type of hardware event that caused this to start and therefore, we don't know to what extent we can work around that hardware event and to what extent we can get the software to ignore that hardware event if that's what we eventually have to do.

"We've got a long way to go here with the patient in intensive care. But we have been able to establish that we can command it, and we have been able to establish that it can give us information and we have been able to establish that the power system is good and we're thermally OK and those are all very, very important pieces of information.

"We are a long, long way from being done here, but we do have serious problems and our ability to eventually work around them is unknown. Do not expect a big sea change in either knowledge or theory in the next several days. This is a very complex problem."

Amid the troubleshooting, Spirit's twin - the Opportunity rover - remains on track to land early Sunday morning East Coast time on Meridiani Planum, a region on the other side of Mars where deposits of minerals that form in the presence of water have been detected. Theisinger said engineers do not believe Spirit's problem poses any generic risk to Opportunity, but he said the flight control team would be much more cautious in its daily operations to minimize the chances of a similar problem.

"It is likely, depending upon what happens in the next 48 to 72 hours, that we may not continue the Opportunity impact-to-egress with the same pace and dispatch that we did on Spirit," he said. "It depends on if we can get Opportunity to a defined, sustainable state on the ground and we can continue to make progress (with) Spirit. We will likely do that and try and continue to make progress on Spirit to get it back to some level of functionality. That's a decision the project will make in consultation with management as we take the temperature of this thing over the next couple of days."

So far, the only change for planned for Opportunity's descent is a decision to deploy its braking parachute at a slightly higher altitude than Spirit's to provide more of a safety margin.

In other developments, engineers today presented a dramatic animation of Spirit's landing based on actual telemetry from the spacecraft, showing how a sudden gust of wind forced small side-pointing rockets to fire at the last second to prevent the lander from slamming down at more than 50 mph.

The telemetry, collected earlier and subjected to complex analysis, also shows how the rover bounced across the floor of Gusev Crater before finally rolling to a stop.

Michael Malin, principal investigator of a high-resolution camera aboard NASA's Mars Global Surveyor spacecraft, unveiled a dramatic photograph showing Spirit, it's parachute and its heat shield resting on the surface of Mars. The remarkable photograph even shows several of Spirit's bounce marks in the martian soil.


TOPICS: Front Page News; News/Current Events
KEYWORDS: gusev; jpl; mars; marsrover; mer; nasa; rover; spirit
Navigation: use the links below to view more comments.
first previous 1-2021-4041-6061-79 next last
To: Hiwayman
Methinks the system is just too complex and overdesigned...
They shoud have sent a bunch of small single-instrument rovers instead
41 posted on 01/23/2004 8:04:36 PM PST by eclectic
[ Post Reply | Private Reply | To 1 | View Replies]

To: al baby

42 posted on 01/23/2004 8:52:55 PM PST by JoJo Gunn (Help control the Leftist population - have them spayed or neutered. ©)
[ Post Reply | Private Reply | To 13 | View Replies]

To: roadcat
"a stupid software error" <========== My VOTE
43 posted on 01/23/2004 9:02:03 PM PST by Robert_Paulson2
[ Post Reply | Private Reply | To 25 | View Replies]

To: roadcat
Probably some software hacker was short on caffeine and forgot to add a requisite ";" at the end of an "if" statement or "functionCall()"... heh heh...

wouldn't be the first time, nor the last.
I have to agree if it took 200 million miles through the vast cold vacuum of space, and survived even thrived after being a bouncing ball on the red planet's frozen ground... it's doubtful that hitting a stone, broke the antennae:

Houston, we have a program error... sounds like to me.
Give them a few weeks.
And LOTSA double shot latte's... they'll get it.

heh heh..
44 posted on 01/23/2004 9:06:32 PM PST by Robert_Paulson2
[ Post Reply | Private Reply | To 25 | View Replies]

To: Hiwayman; hellinahandcart; NYC GOP Chick
If they get a BSOD, they're hosed.

Microsoft will probably be looking for a license agreement...

45 posted on 01/23/2004 9:21:21 PM PST by sauropod (Graduate, Boortz Institute for Insensitivity Training)
[ Post Reply | Private Reply | To 1 | View Replies]

To: sauropod
They probably have it already!
46 posted on 01/23/2004 9:42:25 PM PST by NYC GOP Chick (What happens at CPAC stays at CPAC)
[ Post Reply | Private Reply | To 45 | View Replies]

To: NYC GOP Chick
I thought youse said youse had no access!
47 posted on 01/23/2004 9:44:56 PM PST by sauropod (Graduate, Boortz Institute for Insensitivity Training)
[ Post Reply | Private Reply | To 46 | View Replies]

To: sauropod
It's like a web tv thingie -- 24 hours of access (with a truly crappy wireless keyboard) for like $10.99
48 posted on 01/23/2004 9:49:28 PM PST by NYC GOP Chick (What happens at CPAC stays at CPAC)
[ Post Reply | Private Reply | To 47 | View Replies]

To: Hiwayman
I believe they are using vxWorks, which is a commercial real-time operating system designed for embedded systems. This OS was also used on Pathfinder.
49 posted on 01/23/2004 9:50:25 PM PST by jrp
[ Post Reply | Private Reply | To 4 | View Replies]

To: Hiwayman; All
Good website. From the article:

Each of the two rovers has only one CPU and one set of software for the entire mission. Asked about redundancy—there is no way to hot-swap components in deep space—Klemm said, “That’s why we’re sending two rovers.”

That was my first question. If it's hardware, why didn't they make everything redundant? It would seem like they could have gotten away with one rover if they made everything redundant. Wouldn't it ultimately have been cheaper than building and launching two?

50 posted on 01/23/2004 9:53:48 PM PST by DouglasKC
[ Post Reply | Private Reply | To 23 | View Replies]

To: DouglasKC; snopercod; bonesmccoy; longshadow; Phil V.; MikeD; XBob; hopespringseternal; ...
Each of the two rovers has only one CPU and one set of software for the entire mission. Asked about redundancy—there is no way to hot-swap components in deep space—Klemm said, “That’s why we’re sending two rovers.”

Huh? Good grief, I have "cross-strapped" many a failed component on machines in orbit. Usually you have the choice of either switching to a completely redundant side or, where cross-strapping is available, switching out the failed subsystem such as a demod etc.

51 posted on 01/23/2004 10:40:17 PM PST by RadioAstronomer
[ Post Reply | Private Reply | To 50 | View Replies]

To: RadioAstronomer
Huh? Good grief, I have "cross-strapped" many a failed component on machines in orbit. Usually you have the choice of either switching to a completely redundant side or, where cross-strapping is available, switching out the failed subsystem such as a demod etc.

I know...it struck me as weird too. I worked as a repair tech on an Air Force computer circa 1960's that had redunant systems. It was hot swappable, but you didn't have to swap it out to have it switch to the backup. It was all automatic. When a component failed, it flagged the component as bad and switched to backup.

Either the people that built this are really stupid or the journalist that reported it messed something up.

52 posted on 01/23/2004 10:44:22 PM PST by DouglasKC
[ Post Reply | Private Reply | To 51 | View Replies]

To: DouglasKC
I was puzzled by that statement as well. Redundant CPUs and other critical electronic harware only makes sense to me, unless there is a weight issue. I certainly don't have any insights into the design of this rover since I have never been involved with it.
53 posted on 01/23/2004 10:51:35 PM PST by RadioAstronomer
[ Post Reply | Private Reply | To 52 | View Replies]

To: RadioAstronomer
Rover gets busy

Maybe all this activity and the transmission bursts created a fault path?

Then their is the Lithium-Ion battery back up/recharging ..and the solar panel power sources.

Things Rover has to do each day..plus what NASA just asked it to do...

To many commands for Rover?

54 posted on 01/23/2004 10:51:56 PM PST by Light Speed
[ Post Reply | Private Reply | To 51 | View Replies]

To: Light Speed
Maybe all this activity and the transmission bursts created a fault path?

I doubt it. Every command sequence we sent to vehicles I was involved with were tested to the nth degree against the spacecraft simulators and the real vehicle during tests in the "high bay". If there was that kind of CPU overload, it should have been long since discovered.

55 posted on 01/23/2004 10:57:14 PM PST by RadioAstronomer
[ Post Reply | Private Reply | To 54 | View Replies]

To: baclava
In the next day or two, I believe.
56 posted on 01/23/2004 11:00:34 PM PST by New Horizon (Shorter of breath, and one day closer to death.)
[ Post Reply | Private Reply | To 26 | View Replies]

To: RadioAstronomer
Redundant CPUs and other critical electronic harware only makes sense to me, unless there is a weight issue.

I would think that additional battery backups or hardware components would present more of a weight issue than an additional CPU or entire motherboard, for that matter.

Maybe it was a design mistake, and they couldn't fit redundant electronics into the frame without a complete structural re-design, or something stupid like that.

Whoops! Well, just send it anyway and see what happens.

57 posted on 01/23/2004 11:15:22 PM PST by New Horizon (Why build one, when you can build two at twice the price?)
[ Post Reply | Private Reply | To 53 | View Replies]

To: RadioAstronomer
I wonder what is more cost effective: Designing and building a spacecraft with lots of redundancy built-in, or sending two cheaper, simpler spacecraft in the hope that one of them will survive to complete the mission? Kind of disappointing because I really wanted to see what else Gusev was going to reveal.
58 posted on 01/23/2004 11:21:32 PM PST by LibWhacker (<a href="http://www.michaelmoore.com/">Miserable Failure</a>)
[ Post Reply | Private Reply | To 51 | View Replies]

To: RadioAstronomer
On another thread http://www.freerepublic.com/focus/f-news/1064176/posts?page=57#57 it was proposed that the reason for the malfunction was static electricity due to the dry conditions on Mars. This is very likely, we will see what will happen with the next rover when it moves around and accumulate some voltage.
59 posted on 01/23/2004 11:24:15 PM PST by AdmSmith
[ Post Reply | Private Reply | To 55 | View Replies]

To: AdmSmith
What was the total distance traveled by Pathfinder's Sojourner? I know it didn't get very far from the lander, but it seems like it did a lot of exploring of it's little landing site (within 30 or 40 feet, or so).
60 posted on 01/23/2004 11:38:00 PM PST by LibWhacker (<a href="http://www.michaelmoore.com/">Miserable Failure</a>)
[ Post Reply | Private Reply | To 59 | View Replies]


Navigation: use the links below to view more comments.
first previous 1-2021-4041-6061-79 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson