You gotta flush the tap for a bit. When water is stagnant in your pipes overnight contaminants can leach into it (including lead if you have lead pipes or lead in your fixtures).

Not when you have a reverse osmosis filter, it's all good