Is there a way to reduce residential proxy traffic usage?

[maze1]

Is there a way to reduce residential proxy traffic usage? Does "low cpu" mode or "no render" mode helps? Thanks for help.

Edited May 31, 2024 by maze1

[Czar]

Can tell us what numbers you're seeing for traffic, I just want to see if it includes the webdata which is 140mb on first download

[maze1]

20 hours ago, Czar said:

Can tell us what numbers you're seeing for traffic, I just want to see if it includes the webdata which is 140mb on first download

7 bots are using about 350 - 400 mb of traffic in 20 hours or so. What exactly is webdata and how do I know if its included on first download?. Also, what do you mean by "first download?"

Edited June 1, 2024 by maze1

[Czar]

That is too high, something is being downloaded such as images or big text files maybe, which scripts are you using?

[maze1]

18 hours ago, Czar said:

That is too high, something is being downloaded such as images or big text files maybe, which scripts are you using?

Maybe it's because i'm restarting all 8 bots every 2 hours, otherwise i get the "Unexpected server error" message and the script terminates. I run mostly very simple scripts.

[Czar]

It could be, best way is to run wireshark maybe to analyse traffic

[osbotuserA]

For save proxy usage when using pay-per-GB proxies, you need to block heavey resources, enable data compression, cache data locally, optimize scraping logic, use lightweight protocols, auto proxy rotation and stickness, monitor bandwidth usage