Of you turn on your gas stove, does it work? Many hot water heaters are gas only. Still work in an outage
Depends on the type. Many have done away with pilot lights in favor of electric starters.