Hi JoeSmR, and welcome to TSG.
Ping time has very little to do with how fast your connection is to you service provider and more to do with the path and how many stops the data has to make as it travels over the Internet between the game server and your computer. You have no control over this and it can change from moment to moment.
Assuming you are using some version of Windows, try running a TRACERT command to the game server's IP address. Each hop will show the ping time to each router, including your own, along the path to the server.
Ping time has very little to do with how fast your connection is to you service provider and more to do with the path and how many stops the data has to make as it travels over the Internet between the game server and your computer. You have no control over this and it can change from moment to moment.
Assuming you are using some version of Windows, try running a TRACERT command to the game server's IP address. Each hop will show the ping time to each router, including your own, along the path to the server.