Then he just happened to be in the same place! You don't need to assume he's stalking you. I've seen a few people watching battles from the windows here in Goldenrod, so it's really not as big of a deal as you're making it out to be!