New in town doesn't mean unheard of. You could build up a reputation on the way to town that is being passed around by other travelers.

And some if the rumors could be things that happened the night before.