You can everywhere.
Just be careful in public places there might be some signs saying, that the water is not save to drink.
Be cautious in very old buildings. The pipes might contain lead.
If you live in a normal house you can drink it shout a problem. It is cheap and even enhanced with minerals.