Popular repositories Loading

1. petals petals Public

   🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

   Python 9.8k 579

2. promptsource promptsource Public

   Toolkit for creating, sharing and using natural language prompts.

   Python 3k 377

3. Megatron-DeepSpeed Megatron-DeepSpeed Public

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 1.4k 229

4. bigscience bigscience Public

   Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

   Shell 1k 102

5. xmtf xmtf Public

   Crosslingual Generalization through Multitask Finetuning

   Jupyter Notebook 537 43

6. biomedical biomedical Public

   Tools for curating biomedical training data for large-scale language modeling

   Python 485 118