187 94 59

Sergio Paniego PRO

sergiopaniego

https://sergiopaniego.github.io/

AI & ML interests

None yet

Recent Activity

posted an update about 2 hours ago

Yet Another New Multimodal Fine-Tuning Recipe 🥧 🧑‍🍳 In this @HuggingFace Face Cookbook notebook, we demonstrate how to align a multimodal model (VLM) using Mixed Preference Optimization (MPO) using trl. 💡 This recipe is powered by the new MPO support in trl, enabled through a recent upgrade to the DPO trainer! We align the multimodal model using multiple optimization objectives (losses), guided by a preference dataset (chosen vs. rejected multimodal pairs). Check it out! ➡️ https://huggingface.co/learn/cookbook/fine_tuning_vlm_mpo

updated a dataset about 2 hours ago

agents-course/final-certificates

updated a dataset about 2 hours ago

agents-course/course-certificates-of-excellence

View all activity

Organizations

Posts 10

Post

Yet Another New Multimodal Fine-Tuning Recipe 🥧

🧑‍🍳 In this @HuggingFace Face Cookbook notebook, we demonstrate how to align a multimodal model (VLM) using Mixed Preference Optimization (MPO) using trl.

💡 This recipe is powered by the new MPO support in trl, enabled through a recent upgrade to the DPO trainer!

We align the multimodal model using multiple optimization objectives (losses), guided by a preference dataset (chosen vs. rejected multimodal pairs).

Check it out! ➡️ https://huggingface.co/learn/cookbook/fine_tuning_vlm_mpo

View all Posts