The big decision: tank Vs. tankless gas water heater

Tankless gas water heaters offer the following advantages over traditional tank-style water heaters:

-Ability to provide endless hot water on demand
-Higher energy efficiency
-Lower operating costs
-Space savings

Note: Typically (but not always), condensing tankless gas water heaters have two heat exchangers, and non-condensing models only have one.
The extra heat exchanger in condensing tankless gas water heaters uses heat from the exhaust gas to preheat the inflowing cold water. This means condensing tankless gas water heaters are more energy efficient, and have cooler exhaust gas to vent.
Source: Navien – 

Also, Condensing tankless gas water heaters require  proper disposition of acidic condensate.

Bax, our camel mascot, explains the benefits of gas tankless water heaters
Standard Gas Water Heater
~$2,000 to $3,000 product + installation by licensed plumber 
Local Utility rebates on ENERGY STAR® certified models up to $700
Natural gas operating cost ~$300/year
Propane gas operating cost ~$500/year
Tankless Gas Water Heater
~$4,000 to $7,000 product + installation by licensed plumber 
Local Utility rebates on ENERGY STAR® certified models up to $1,500
Natural gas operating cost ~$240/year
Propane gas operating cost ~$500/year

Resources: Basic principles to properly size a tankless gas water heater