do all your connections share a single port on the serverside?
I think that is the problem!