-
Notifications
You must be signed in to change notification settings - Fork 1.4k
-
We're currently seeing over 12/Gb of bandwidth usage per hour over our proxy provider, which they are of course delighted to bill us for. We've tracked down a large percentage of the bandwidth to to URLs in the code below, which appears to be between Chrome/Chromedriver and Google servers, especially gvt1.com
Is there any way to disable Chrome's need to check for updates, or whatever it's doing, every single time it loads?
Alternatively, what's wrong with our code that is preventing the proxy bypass code from working?
With this code, we're still seeing traffic to and from: gvt1.com & googleapis.com over the socks5 proxy, so it's not bypassing correctly.
logger.info("Building Webdriver...")
os.environ["SB_ARGS"] = (
"--proxy-bypass-list="
"*.google.com;"
"*.gvt1.com;"
"edgedl.me.gvt1.com;"
"*.googleapis.com;"
"update.googleapis.com;"
"dl.google.com;"
"accounts.google.com;"
"*.googlesyndication.com;"
"*.googleusercontent.com;"
"*.ggpht.com;"
"*.google-analytics.com "
"--host-resolver-rules=MAP *.gvt1.com 0.0.0.0, MAP edgedl.me.gvt1.com 0.0.0.0"
)
driver = Driver(
uc=True,
headed=headed_flag,
devtools=False,
remote_debug=False,
incognito=True,
locale="en",
window_position="0,0",
window_size="1920,1080",
binary_location=chrome_path,
proxy=f"{proxy_type}://{use_proxy}"
)
logger.info("Webdriver Created Successfully")
Suggestions?
Beta Was this translation helpful? Give feedback.
All reactions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment