Ping looks fine in your second last post.

If you even get high ping to people without NAT (which means it's a direct P2P connection), it definitely is something between you and that user.
A wireless connection can be the cause of it or stuff downloading/uploading on the background.