Turgon startles at the touch - he hadn't really been paying attention, but he's not usually got someone react this way to a stranger sitting down nearby.

(The flagon of ale does explain a bit)

"Hello. I fear you may have mistaken me for someone else!"

He tips his wine glass back - still full, see?