I gotta say, this is really cool
Pro Creations PRO
ProCreations
AI & ML interests
AGI and small scale-high quality AI
Recent Activity
liked
a dataset
1 day ago
ProCreations/Ultra-FineWeb-EDU
posted
an
update
2 days ago
NEW DATASETTTTT
https://huggingface.co/datasets/ProCreations/Ultra-FineWeb-EDU
This dataset is an extremely filtered version of
https://huggingface.co/datasets/openbmb/Ultra-FineWeb
for educational content only, inspired by
https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu
Right now dataset size is small (64k examples) and more examples are being processed as you read this!
Organizations
ProCreations's activity
liked
a
dataset
1 day ago
posted
an
update
2 days ago
Post
975
NEW DATASETTTTT
ProCreations/Ultra-FineWeb-EDU
This dataset is an extremely filtered version of
openbmb/Ultra-FineWeb
for educational content only, inspired by
HuggingFaceFW/fineweb-edu
Right now dataset size is small (64k examples) and more examples are being processed as you read this!
ProCreations/Ultra-FineWeb-EDU
This dataset is an extremely filtered version of
openbmb/Ultra-FineWeb
for educational content only, inspired by
HuggingFaceFW/fineweb-edu
Right now dataset size is small (64k examples) and more examples are being processed as you read this!
updated
a
dataset
2 days ago
published
a
dataset
2 days ago
posted
an
update
5 days ago
Post
196
here’s a bunch of mcp’s I made for Claude because I was bored
https://github.com/ProCreations-Official/HuggingMCP
https://github.com/ProCreations-Official/gitmcp
https://github.com/ProCreations-Official/second-opinion
https://github.com/ProCreations-Official/HuggingMCP
https://github.com/ProCreations-Official/gitmcp
https://github.com/ProCreations-Official/second-opinion
updated
a
Space
5 days ago
posted
an
update
7 days ago
Post
282
Introducing my custom AI lab!
This huggingface shows a bunch of fundamental visuals of AI’s training in real time.
ProCreations/ai-labs
Updates coming soon with a walk through mode that teaches you what it all means!
Meanwhile if you want to learn about AI and not just see it,
ProCreations/learn-ai
This huggingface shows a bunch of fundamental visuals of AI’s training in real time.
ProCreations/ai-labs
Updates coming soon with a walk through mode that teaches you what it all means!
Meanwhile if you want to learn about AI and not just see it,
ProCreations/learn-ai
liked
a
Space
7 days ago
published
a
Space
7 days ago
posted
an
update
15 days ago
Post
2422
Uggghhh what a busy week.
Been up all night fixing Intellite and I got some progress I wanted to share.
ALL errors we experienced (there’s a lot):
Gradient vanishing (AI dies)
Gradient explosion (AI barely learns and destabilizes)
Activation Explosion (AI dies)
Layer Scale Crushing Signal (AI dies)
Activation Explosion (again) (AI dies)
All fixed, but now it keeps overfitting on datasets due to a dataset handler error 😩
Been up all night fixing Intellite and I got some progress I wanted to share.
ALL errors we experienced (there’s a lot):
Gradient vanishing (AI dies)
Gradient explosion (AI barely learns and destabilizes)
Activation Explosion (AI dies)
Layer Scale Crushing Signal (AI dies)
Activation Explosion (again) (AI dies)
All fixed, but now it keeps overfitting on datasets due to a dataset handler error 😩
updated
a
Space
16 days ago
published
a
Space
16 days ago
posted
an
update
19 days ago
Post
524
PROGRESS REPORT
Intellite Chat is going well! I have made format much more uniform (now chatml), data handling now works, and we removed and added new datasets for a better mix of quality. I have also updated the default model to be fp16 instead of fp32 for faster training. Stay tuned!
Intellite Chat is going well! I have made format much more uniform (now chatml), data handling now works, and we removed and added new datasets for a better mix of quality. I have also updated the default model to be fp16 instead of fp32 for faster training. Stay tuned!
wheres the data in the dataset... lol
published
a
dataset
20 days ago
updated
a
dataset
20 days ago