10
3
Fork
You've already forked sciop-scraping
2

Add shrimptools NPR spider #25

Open
sneakers-the-rat wants to merge 3 commits from shrimptools-npr-spider into main
pull from: shrimptools-npr-spider
merge into: Safeguarding:main
Safeguarding:main
Safeguarding:hashing-update-sneaks

from @tripleshrimp ,
just mildly refactored to make into cli, then since there were so few categories i just got all their links.

from @tripleshrimp , just mildly refactored to make into cli, then since there were so few categories i just got all their links.
lint and add cli
All checks were successful
lint / black (pull_request) Successful in 40s
lint / ruff (pull_request) Successful in 39s
tests / tests (pull_request) Successful in 1m9s
d2d342b247
@ -0,0 +137,4 @@
return audio_final, transcript_path
def crawl_atc_archive(
Author
Owner
Copy link

i don't see where these atc functions are called, and they look mostly like duplicates?

i don't see where these atc functions are called, and they look mostly like duplicates?
First-time contributor
Copy link

The atc functions are for the alternate web pages like this:

https://www.npr.org/programs/all-things-considered/archive

Not wired in right now but there in case we need them

The atc functions are for the alternate web pages like this: https://www.npr.org/programs/all-things-considered/archive Not wired in right now but there in case we need them
correct base url and rm constants
All checks were successful
lint / black (pull_request) Successful in 40s
lint / ruff (pull_request) Successful in 39s
tests / tests (pull_request) Successful in 1m8s
6f317b47a5
All checks were successful
lint / black (pull_request) Successful in 40s
lint / ruff (pull_request) Successful in 39s
tests / tests (pull_request) Successful in 1m8s
This pull request has changes conflicting with the target branch.
  • pdm.lock
  • pyproject.toml
  • src/sciop_scraping/cli/main.py
View command line instructions

Manual merge helper

Use this merge commit message when completing the merge manually.

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin shrimptools-npr-spider:shrimptools-npr-spider
git switch shrimptools-npr-spider

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch main
git merge --no-ff shrimptools-npr-spider
git switch shrimptools-npr-spider
git rebase main
git switch main
git merge --ff-only shrimptools-npr-spider
git switch shrimptools-npr-spider
git rebase main
git switch main
git merge --no-ff shrimptools-npr-spider
git switch main
git merge --squash shrimptools-npr-spider
git switch main
git merge --ff-only shrimptools-npr-spider
git switch main
git merge shrimptools-npr-spider
git push origin main
Sign in to join this conversation.
No reviewers
Labels
Clear labels
Compat/Breaking
Breaking change that won't be backward compatible
Kind/Bug
Something is not working
Kind/Documentation
Documentation changes
Kind/Enhancement
Improve existing functionality
Kind/Feature
New functionality
Kind/Security
This is security issue
Kind/Tech Debt
Kind/Testing
Issue or pull request related to testing
Priority
Critical
 The priority is critical
Priority
High
 The priority is high
Priority
Low
 The priority is low
Priority
Medium
 The priority is medium
Reviewed
Confirmed
 Issue has been confirmed
Reviewed
Duplicate
 This issue or pull request already exists
Reviewed
Invalid
 Invalid issue
Reviewed
Won't Fix
 This issue won't be fixed
Status
Abandoned
 Somebody has started to work on this but abandoned work
Status
Blocked
 Something is blocking this issue or pull request
Status
Need More Info
 Feedback is required to reproduce issue or to continue work
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
Safeguarding/sciop-scraping!25
Reference in a new issue
Safeguarding/sciop-scraping
No description provided.
Delete branch "shrimptools-npr-spider"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?