1
1
Fork
You've already forked scrapeghost
0

adding header parameter to src/scrapeghost/scrapers.py #46

Closed
ltngonnguyen wants to merge 1 commit from add-header into main
pull from: add-header
merge into: jpt:main
jpt:main
jpt:gh-pages
jpt:november-updates
jpt:log-config
jpt:pagination-restore
ltngonnguyen commented 2023年05月29日 04:12:46 +02:00 (Migrated from github.com)
Copy link

Some pages would need a specific user agent or other HTTP headers to access, so I just added a new header parameter to the scrape method and document it in usage.md. Please also help check to see if it will be applied for chunked tags as well.

Some pages would need a specific user agent or other HTTP headers to access, so I just added a new header parameter to the scrape method and document it in usage.md. Please also help check to see if it will be applied for chunked tags as well.
jamesturk commented 2023年05月31日 00:21:53 +02:00 (Migrated from github.com)
Copy link

Hi, thanks for the interest, but this is not the preferred solution, see https://github.com/jamesturk/scrapeghost/pull/34

Hi, thanks for the interest, but this is not the preferred solution, see https://github.com/jamesturk/scrapeghost/pull/34

Pull request closed

This pull request cannot be reopened because the branch was deleted.
Sign in to join this conversation.
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
jpt/scrapeghost!46
Reference in a new issue
jpt/scrapeghost
No description provided.
Delete branch "add-header"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?