Is there a way to reduce residential proxy traffic usage? Does "low cpu" mode or "no render" mode helps? Thanks for help.

Edited May 31, 20241 yr by maze1

Can tell us what numbers you're seeing for traffic, I just want to see if it includes the webdata which is 140mb on first download

20 hours ago, Czar said:

Can tell us what numbers you're seeing for traffic, I just want to see if it includes the webdata which is 140mb on first download

7 bots are using about 350 - 400 mb of traffic in 20 hours or so. What exactly is webdata and how do I know if its included on first download?. Also, what do you mean by "first download?"

Edited June 1, 20241 yr by maze1

That is too high, something is being downloaded such as images or big text files maybe, which scripts are you using?

18 hours ago, Czar said:

That is too high, something is being downloaded such as images or big text files maybe, which scripts are you using?

Maybe it's because i'm restarting all 8 bots every 2 hours, otherwise i get the "Unexpected server error" message and the script terminates. I run mostly very simple scripts.

It could be, best way is to run wireshark maybe to analyse traffic

For save proxy usage when using pay-per-GB proxies, you need to block heavey resources, enable data compression, cache data locally, optimize scraping logic, use lightweight protocols, auto proxy rotation and stickness, monitor bandwidth usage