I lucked out relative to proximity to the AARP Goldman server, my pings are generally in the 18-22ms range, fantastic, doesn't save grace when a 300ms pinger joins.. I have a Comcast business line, it's the identical infrastructure as the consumer line but they put you to the front of the line for outages, a perk I guess. I switched over to business because I was getting dinged for download overages every month with the consumer internet and then getting charged for overages (5 kids with 5 ipads , Xboxes, etc.. )
The biggest challenge I encountered was all the local traffic clogging up my gameplay so I invested in building my network and have QOS enabled to push the video streaming down in priority. One other thing to note is that wireless is not a switched technology, in other words the maximum bandwidth divided by the number of devices connected. I had to put access points around the house to distribute the clients (Phones, tablets, Laptops, streaming) , wire where I could .. I have around 40 devices in my house and it's amazing how much equipment I had to invest in to keep the latency in check