Yes, what a nice post on ssh escape keys.

So you need to press <enter> and then ~ for the escape character to work!