Yeah this often comes down to reading social cues. That’s why I said some of these problems are basically just due to men being more Aspergers, on average. My guess is a lot of “harassers” just aren’t reading social cues correctly. You need to look for IOIs before making a sexual move.
In this case, it is likely some prior interest had been established. For example, they may have been on a date already, they may have flirted, etc. Though honestly, the tone in which he said, “I’ve been waiting for you all night,” would have been key here. You want to start off friendly and move forward progressively, feeling it out as you go. It’s generally a good idea to try flirting first, and only try touching a woman after she responds positively to the flirting.