Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings
/ chromedl Public

Go library for scraping or downloading files bypassing Cloudflare protection and browser checks

License

Notifications You must be signed in to change notification settings

rusq/chromedl

Repository files navigation

Chrome File Downloader

Go Reference

The sole purpose of this package is to download files from the Internets with headless Chrome bypassing the Cloudflare and maybe some other annoying browser checks.

It does so by implementing the solutions posted in "bypass headless chrome detection issue" for chromedp.

This library may help you if the other download methods don't work, i.e. curl or the standard http.Get().

The implementation is based on this chromedp example.

Thanks to @ZekeLu for huge help in getting this going.

Tested with:

  • Chrome (stable) v90.0.4430.93.
  • github.com/chromedp/chromedp v0.6.12
  • github.com/chromedp/cdproto v0.0.0-20210323015217-0942afbea50e

Newer versions of Chrome will require some code changes, as described in this issue, as it uses calls that are deprecated in newer protocol version in order to be compatible with current stable version of Chrome (see above).

When using headless-shell docker image, please use the following tag:

FROM chromedp/headless-shell:90.0.4430.93

chromedp: Copyright (c) 2016-2020 Kenneth Shaw

About

Go library for scraping or downloading files bypassing Cloudflare protection and browser checks

Topics

Resources

License

Stars

Watchers

Forks

Languages

AltStyle によって変換されたページ (->オリジナル) /