Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
In a Training Loop 🔄
174.0
TFLOPS
10
4
188
rob
PRO
rob-x-ai
Follow
fblgit's profile picture
klebster's profile picture
Pent's profile picture
21 followers
·
65 following
https://www.kroonen.ai
rob_x_ai
rob-x-ai
AI & ML interests
∙ Open Research ∙ Making Generative AI accessible to anyone on consumer hardware
Recent Activity
updated
a Space
about 17 hours ago
rob-x-ai/genesis-1b-playground
posted
an
update
1 day ago
Genesis 1B is now public. 🔥 I’m training a 1.003B parameter model from scratch on 2× RTX 4090s and opened a public playground for early checkpoints. The real bottleneck wasn’t training. It was checkpointing: FSDP full-state gather over PCIe = NCCL timeout hell Switching to DCP sharded checkpoints changed the trajectory of the run. - Playground: https://huggingface.co/spaces/rob-x-ai/genesis-1b-playground - Write-up: https://kroonen.ai/blog/distributed-checkpoint-failures-rtx4090/
updated
a Space
1 day ago
kroonen-ai/README
View all activity
Organizations
rob-x-ai
's models
11
Sort: Recently updated
rob-x-ai/stablelm-2-12b-GGUF
12B
•
Updated
Jun 6, 2024
•
106
rob-x-ai/CodeLLaMa-70b-Python-GGUF
Text Generation
•
69B
•
Updated
Jan 31, 2024
•
162
rob-x-ai/neuralchat_v3_3_laser-GGUF
7B
•
Updated
Jan 8, 2024
•
25
rob-x-ai/phi-2-GGUF
Text Generation
•
3B
•
Updated
Jan 6, 2024
•
438
•
22
rob-x-ai/Starling-LM-7B-alpha-GGUF
7B
•
Updated
Dec 7, 2023
•
20
•
1
rob-x-ai/neural-chat-7b-v3-1-GGUF
7B
•
Updated
Nov 28, 2023
•
37
rob-x-ai/Orca-2-GGUF
13B
•
Updated
Nov 28, 2023
•
49
rob-x-ai/OpenOrca-Platypus2-13B-GGUF
13B
•
Updated
Aug 30, 2023
•
8
•
2
rob-x-ai/llama2-stablebeluga-GGML
Updated
Aug 16, 2023
•
3
rob-x-ai/OpenOrca-Platypus2-13B-GGML
Updated
Aug 16, 2023
•
2
rob-x-ai/llama2-Q4_0-GGML
Updated
Jul 30, 2023
•
2