1
1
Fork
You've already forked grabit
0
Scrapes tweet data from nitter.poast.org
  • Python 85%
  • Shell 15%
2025年10月10日 20:27:43 -05:00
grabit.curl added grabit.curl 2025年10月10日 20:27:43 -05:00
grabit.nitter Split scripts for twstalker integration 2024年10月15日 10:36:22 -05:00
grabit.twstalker Split scripts for twstalker integration 2024年10月15日 10:36:22 -05:00
README.md added grabit.curl 2025年10月10日 20:27:43 -05:00

grabit is a set of Python and Bash scripts that scrapes a tweet through a given frontend, downloads the associated image and some metadata, and packages it in a format that's easy to import with Hydrus.

For example, running

grabit.nitter https://nitter.poast.org/yabumamemame/status/1577204305924304896

will generate three files in /tmp:

  1. media_FeNa89IaYAEVaot.jpg
  2. media_FeNa89IaYAEVaot.jpg.tags.txt
  3. media_FeNa89IaYAEVaot.jpg.urls.txt

grabit.nitter is (was?) known to work with:

  • nitter.poast.org
  • nitter.lucabased.xyz

grabit.twstalker is specially made for twstalker.com.

grabit.curl will work with nitter.privacyredirect.com as of 2025年10月10日, and is useful for systems that can't install chromedriver for some reason.