I gotta say, this is really cool
Pro Creations PRO
ProCreations
AI & ML interests
AGI and small scale-high quality AI
Recent Activity
liked
a dataset
1 day ago
ProCreations/Ultra-FineWeb-EDU
posted
an
update
2 days ago
NEW DATASETTTTT
https://huggingface.co/datasets/ProCreations/Ultra-FineWeb-EDU
This dataset is an extremely filtered version of
https://huggingface.co/datasets/openbmb/Ultra-FineWeb
for educational content only, inspired by
https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu
Right now dataset size is small (64k examples) and more examples are being processed as you read this!
Organizations
ProCreations's activity
posted
an
update
2 days ago
Post
955
NEW DATASETTTTT
ProCreations/Ultra-FineWeb-EDU
This dataset is an extremely filtered version of
openbmb/Ultra-FineWeb
for educational content only, inspired by
HuggingFaceFW/fineweb-edu
Right now dataset size is small (64k examples) and more examples are being processed as you read this!
ProCreations/Ultra-FineWeb-EDU
This dataset is an extremely filtered version of
openbmb/Ultra-FineWeb
for educational content only, inspired by
HuggingFaceFW/fineweb-edu
Right now dataset size is small (64k examples) and more examples are being processed as you read this!
posted
an
update
5 days ago
Post
196
here’s a bunch of mcp’s I made for Claude because I was bored
https://github.com/ProCreations-Official/HuggingMCP
https://github.com/ProCreations-Official/gitmcp
https://github.com/ProCreations-Official/second-opinion
https://github.com/ProCreations-Official/HuggingMCP
https://github.com/ProCreations-Official/gitmcp
https://github.com/ProCreations-Official/second-opinion
posted
an
update
7 days ago
Post
282
Introducing my custom AI lab!
This huggingface shows a bunch of fundamental visuals of AI’s training in real time.
ProCreations/ai-labs
Updates coming soon with a walk through mode that teaches you what it all means!
Meanwhile if you want to learn about AI and not just see it,
ProCreations/learn-ai
This huggingface shows a bunch of fundamental visuals of AI’s training in real time.
ProCreations/ai-labs
Updates coming soon with a walk through mode that teaches you what it all means!
Meanwhile if you want to learn about AI and not just see it,
ProCreations/learn-ai
posted
an
update
15 days ago
Post
2422
Uggghhh what a busy week.
Been up all night fixing Intellite and I got some progress I wanted to share.
ALL errors we experienced (there’s a lot):
Gradient vanishing (AI dies)
Gradient explosion (AI barely learns and destabilizes)
Activation Explosion (AI dies)
Layer Scale Crushing Signal (AI dies)
Activation Explosion (again) (AI dies)
All fixed, but now it keeps overfitting on datasets due to a dataset handler error 😩
Been up all night fixing Intellite and I got some progress I wanted to share.
ALL errors we experienced (there’s a lot):
Gradient vanishing (AI dies)
Gradient explosion (AI barely learns and destabilizes)
Activation Explosion (AI dies)
Layer Scale Crushing Signal (AI dies)
Activation Explosion (again) (AI dies)
All fixed, but now it keeps overfitting on datasets due to a dataset handler error 😩
posted
an
update
19 days ago
Post
524
PROGRESS REPORT
Intellite Chat is going well! I have made format much more uniform (now chatml), data handling now works, and we removed and added new datasets for a better mix of quality. I have also updated the default model to be fp16 instead of fp32 for faster training. Stay tuned!
Intellite Chat is going well! I have made format much more uniform (now chatml), data handling now works, and we removed and added new datasets for a better mix of quality. I have also updated the default model to be fp16 instead of fp32 for faster training. Stay tuned!
wheres the data in the dataset... lol
posted
an
update
21 days ago
Post
455
Question about Intellite Chat to you guys!
(If you don’t know, Intellite Chat is my up-and-coming 100m parameter AI model focused on high-quality chat.)
What quantization variants would you want to see for Intellite Chat? It’ll come with FP32, FP16, and BF16, but any others you want? Maybe FP8 or even BitNet’s 1.58-bit quantization? Let me know!
(If you don’t know, Intellite Chat is my up-and-coming 100m parameter AI model focused on high-quality chat.)
What quantization variants would you want to see for Intellite Chat? It’ll come with FP32, FP16, and BF16, but any others you want? Maybe FP8 or even BitNet’s 1.58-bit quantization? Let me know!
- 1 reply
posted
an
update
23 days ago
Post
1905
I made a space!
Check out
https://huggingface.co/spaces/ProCreations/realtime-ai-visualization
This cool space visualizes a real neural net in real time. It trains a real 199 parameter model on XOR. With baby mode for non-devs and advanced mode for developers or enthusiasts, (hopefully) everyone will understand!
Check out
https://huggingface.co/spaces/ProCreations/realtime-ai-visualization
This cool space visualizes a real neural net in real time. It trains a real 199 parameter model on XOR. With baby mode for non-devs and advanced mode for developers or enthusiasts, (hopefully) everyone will understand!
posted
an
update
24 days ago
Post
1177
My first ever working model!
Introducing tinyvvision. An extremely small zero shot image classification model for simple shapes, letters, colors, and numbers. This is a foundation model for Intellision, an image-text-to-text model, which will be much bigger but still impressively small.
ProCreations/tinyvvision
NOTE: it’s small, mistakes will happen!!!! Not meant for complex stuff, just a demo for simple stuff.
Introducing tinyvvision. An extremely small zero shot image classification model for simple shapes, letters, colors, and numbers. This is a foundation model for Intellision, an image-text-to-text model, which will be much bigger but still impressively small.
ProCreations/tinyvvision
NOTE: it’s small, mistakes will happen!!!! Not meant for complex stuff, just a demo for simple stuff.
replied to
their
post
25 days ago
the GPU’s just disappear and your desktop adjusts for CPU only so your precious compute power for AI is gone 😈 lol
posted
an
update
25 days ago
Post
1627
WOULD YOU RATHER
part 2
All your GPUs you have suddenly vanish and any devices with a GPU turn to CPU only
Every time you use a HF space you randomly start dancing for 5 minutes
OR
Every HF model you’ve hearted / liked suddenly disappears and becomes inaccessible
part 2
All your GPUs you have suddenly vanish and any devices with a GPU turn to CPU only
Every time you use a HF space you randomly start dancing for 5 minutes
OR
Every HF model you’ve hearted / liked suddenly disappears and becomes inaccessible
-
- 4 replies
replied to
their
post
26 days ago
sorry about that lol It was late and I wanted to make a post before sleep so I didnt really think about the choices
replied to
their
post
26 days ago
Makes sense as LLM's arent very random, this dataset isnt really for making LLMs random because you just cant (yet) more as just a dump of info I dropped for someone to find a use case for. Hey, thanks for commenting!
posted
an
update
26 days ago
Post
1958
WOULD YOU RATHER
Instantly have 10 of the best GPUs in the world but you can only use/train/tune AI on it
Instantly own all of LLaMA 4 models but your GPU is 10 years old
Or do a backflip every time your AI has an error training (if you are a developer)
Instantly have 10 of the best GPUs in the world but you can only use/train/tune AI on it
Instantly own all of LLaMA 4 models but your GPU is 10 years old
Or do a backflip every time your AI has an error training (if you are a developer)
- 7 replies
posted
an
update
27 days ago
Post
2224
New dataset- what a random time, right?
Randomness… pure randomness feels refreshing to me so I made a dataset of randomness.
ProCreations/quantum-randomness
This is a dataset of 1000 entries of timestamps and real quantum randomness. I have no clue what it could be used for but it exists now
Randomness… pure randomness feels refreshing to me so I made a dataset of randomness.
ProCreations/quantum-randomness
This is a dataset of 1000 entries of timestamps and real quantum randomness. I have no clue what it could be used for but it exists now
-
- 4 replies
replied to
their
post
27 days ago
Very cool! Thanks for going out of your way to help, I saved the photo!