Skip to content

#

diloco

Here are 9 public repositories matching this topic...

Language: All

Filter by language

All 9 Python 8 Rust 1

meta-pytorch / torchft

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

training distributed-systems fault-tolerance consensus ml torch pytorch hsdp fsdp localsgd diloco

Updated Aug 28, 2026
Python

hypha-space / hypha

A self-managing system for distributed machine learning.

decentralized ml distributed-training diloco

Updated Jan 26, 2026
Rust

AbdelStark / nostrain

Coordinator-free distributed ML training over Nostr relays.

machine-learning nostr diloco

Updated Mar 27, 2026
Python

commonsense-ai / coop

A small language model pretrained by volunteers — pseudo-gradients arrive as Hugging Face PRs, a stateless GitHub Actions cron aggregates them (DiLoCo). No servers, no funding: donated hardware + free tiers. Live leaderboard.

language-model volunteer-computing distributed-training huggingface pretraining diloco

Updated Sep 7, 2026
Python

Zare2001 / ProjectWorldWide

Pre-training one LLM across supercomputers at once - AMD/ROCm and NVIDIA/CUDA, different queues, no shared filesystem. DiLoCo outer steps merged by a GPU-less VM via Flower/FedMom; DARL leases the corpus so no token is trained twice; membership is elastic, so a site stuck in the Slurm queue costs nothing.

hpc flower distributed-training federated-learning llm diloco torchtitan data-prallelism snellius

Updated Aug 28, 2026
Python

tsugiai / tsugi-mend

Cross-rack distributed-training reducer for PyTorch. Apache-2.0, patent-independent. Part of the unified pip install tsugi surface.

fault-tolerance gpu pytorch distributed-training fsdp llm-training diloco cross-rack

Updated Aug 5, 2026
Python

FatherMarz / thinking-at-home

Democratize AI: a download-and-forget app that turns idle computers into a language model owned by everyone. Folding@home, pointed at intelligence instead of proteins.

machine-learning pytorch commons volunteer-computing ai-safety distributed-training byzantine-fault-tolerance folding-at-home llm decentralized-ai diloco open-weights

Updated Jul 13, 2026
Python

Adnan082 / diloco-measured

Measured, not simulated: a bandwidth-controlled evaluation of semi-synchronous LLM training on commodity Ethernet.

benchmarking pytorch distributed-training local-sgd llm diloco

Updated Aug 25, 2026
Python

MasonFlint44 / OpenDiPaCo

An open implementation of DiPaCo (Distributed Path Composition) for modular, low-communication language-model training — validated on GPU.

deep-learning pytorch language-models distributed-training mixture-of-experts llm diloco dipaco low-communication-training

Updated Jun 21, 2026
Python

Add this topic to your repo

To associate your repository with the diloco topic, visit your repo's landing page and select "manage topics."