Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
FlameF0X 
posted an update Aug 10
Post
4012
I am very sad to say that the budget in creating of SnowflakeCore-G1 1b and 7b MoE models ran out and I can't pre-train them anymore.
AtAndDev

sad

·
FlameF0X

i know, but i spend too much time and money on pre-training the other models

9voltfan2009

Uh-oh.

karenny
•
edited Aug 22

That’s really unfortunate! It’s always tough when funding runs out, especially on such promising projects. Hopefully you can find some new support or backers soon — maybe try to contact robinhood https://robinhood.pissedconsumer.com/customer-service.html or similar platforms for potential funding options.

chyhemk

Hi bro gosh i couldn't find any way to contact youu XD. I want to ask you few things about the i3 models you created. Email me as soon as possible moviesrecommender.app@gmail.com

·
FlameF0X

Hi bro gosh i couldn't find any way to contact youu XD. I want to ask you few things about the i3 models you created. Email me as soon as possible moviesrecommender.app@gmail.com

Hi there,

I don't feel comfortable speaking with people privately since I'm only 17 (soon 18).

But if you have questions about the models, I have two repos on GitHub for them:

  • i3-papers - paper available for i3-200m for now
  • open-i3 - the code for training i3-80m for now

All the technical details and code are available there.

In this post