Yes, there are certainly exceptions. When I did fires, there was a conversion from canteen filling stations in fire camps to pallets of bottled water around 2000. Major mess out on the firelines, but that is a manageable situation by better supervision. Storing some water for emergencies is prudent, and the amount of generated waste would only be sporadic. Sort of depends where one lives, too, as plastic recycling is not readily available where I live, but in towns it would sure make sense. Or just refill the bottles again, they can withstand a couple uses.
I have a couple 5 gallon potable water containers for camping that I keep filled, much more inexpensive than several cases of bottled water. A gallon or two in the car is always a good idea, for thirst or to use to extinguish a small fire. I use refillable containers as there is always the need for dog water when getting back to the rig, especially where creeks are dry most of the year.
I also have a couple WWII canteens for longer term storage in my pickup... they are zinc coated which makes them antimicrobial without altering the taste like chlorine does.