Genesis 1B Run 2 Playground
🔥
1
Generate text with a live‑training 1B‑parameter model
rob PRO
rob-x-ai
AI & ML interests
∙ Open Research
∙ Making Generative AI accessible to anyone on consumer hardware
Recent Activity
liked a Space about 22 hours ago
rob-x-ai/genesis-1b-run2-playground updated a Space 1 day ago
rob-x-ai/genesis-1b-run2-playground published a Space 1 day ago
rob-x-ai/genesis-1b-run2-playgroundOrganizations
liked a
Space about 22 hours ago
updated a
Space 1 day ago
published a
Space 1 day ago
updated a
Space 1 day ago
liked a
dataset 2 days ago
liked a
dataset 4 days ago
posted an update 7 days ago
Post
144
Genesis 1B is now public. 🔥
I’m training a 1.003B parameter model from scratch on 2× RTX 4090s and opened a public playground for early checkpoints.
The real bottleneck wasn’t training.
It was checkpointing:
FSDP full-state gather over PCIe = NCCL timeout hell
Switching to DCP sharded checkpoints changed the trajectory of the run.
- Playground: rob-x-ai/genesis-1b-playground
- Write-up: https://kroonen.ai/blog/distributed-checkpoint-failures-rtx4090/
I’m training a 1.003B parameter model from scratch on 2× RTX 4090s and opened a public playground for early checkpoints.
The real bottleneck wasn’t training.
It was checkpointing:
FSDP full-state gather over PCIe = NCCL timeout hell
Switching to DCP sharded checkpoints changed the trajectory of the run.
- Playground: rob-x-ai/genesis-1b-playground
- Write-up: https://kroonen.ai/blog/distributed-checkpoint-failures-rtx4090/
updated a
Space 7 days ago
published a
Space 7 days ago
liked a
Space 7 days ago
published a
Space 7 days ago
liked a
model 9 days ago
liked a
dataset 9 days ago
liked a
model 9 days ago
updated a
model 9 days ago
liked a
model 9 days ago
liked a
dataset 9 days ago
published a
model 9 days ago
liked 2
datasets 10 days ago