A couple times now with my cheap Belkin Flip KVM, the system
has appeared to freeze after changing back.

Today, I managed to get in over network connection and discovered
that everything was fine, except no input was coming in (mouse/keyboard).
Doing rmmod/modprobe on hid_belkin cleared the problem.

This is new in 2.6.36, haven't seen it in previous releases.