Skip to content

Pull requests: webrecorder/browsertrix-crawler

New pull request New

8 Open 484 Closed

Pull requests list

Dedup Initial Implementation

#889 opened Oct 1, 2025 by ikreymer • Draft

1

5

Add option to respect robots.txt disallows

#888 opened Sep 30, 2025 by tw4l

Loading...

1

feat: add extraChromeArgs support for passing custom Chrome flags

#877 opened Aug 13, 2025 by aponb

Loading...

6

Check page URLs for extension before direct fetch attempt

#830 opened May 6, 2025 by ikreymer

Loading...

1

3

Improved handling of SSO-based crawling

#828 opened May 5, 2025 by ikreymer

Loading...

replace minio client with aws sdk

#547 opened Apr 16, 2024 by mguella

Loading...

2

Add cookie popup blocking via adblock-rs

#187 opened Nov 16, 2022 by tw4l • Draft

Integrate Mozilla's Readibility.js

#42 opened Apr 14, 2021 by sebastian-nagel

Loading...

7

ProTip! Exclude everything labeled bug with -label:bug.