Maybe worth running an internet speed test and use those figues in rfactor "connect" settings?
Make sure you have not got anything in the background that may use internet bandwidth, like a peer-to-peer file sharer.
If you have a small network at home, other people may be hogging the internet bandwidth with big downloads. There are free utilities that could limit the max speed of these other networked pcs, leaving you a guaranteed minimum connection for driving with