If the power goes out will the hot water turn off?

Yes. There are battery backups that can keep the tankless water heater opeating for up to 2 weeks without power.