It very much depends on where the local speedtest.net server is in relation to you in terms of network topology. If you're in a large city like SF or Seattle, your ISP might host a 1U box from ookla or directly peer with them at a major IX point less than 15 milliseconds away from you.