Realistically, no. In normal situations, you won’t notice any difference at all.
When you share your Karma Go, you also share your speed, but most of the time this will never affect you.
If everyone around you is trying to stream Game of Thrones at the same time, then that might be an issue. To solve: team up and watch together.