FasterDecoding

FasterDecoding's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

tianlecai 

authored 2 papers over 1 year ago

SnapKV: LLM Knows What You are Looking for Before Generation

Paper • 2404.14469 • Published Apr 22, 2024 • 28

JetMoE: Reaching Llama2 Performance with 0.1M Dollars

Paper • 2404.07413 • Published Apr 11, 2024 • 39

Gsunshine 

authored a paper over 1 year ago

One-Step Diffusion Distillation via Deep Equilibrium Models

Paper • 2401.08639 • Published Dec 12, 2023

tianlecai 

authored 2 papers over 1 year ago

DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

Paper • 2402.19481 • Published Feb 29, 2024 • 23

BitDelta: Your Fine-Tune May Only Be Worth One Bit

Paper • 2402.10193 • Published Feb 15, 2024 • 23

jamesliu1 

authored a paper over 1 year ago

BitDelta: Your Fine-Tune May Only Be Worth One Bit

Paper • 2402.10193 • Published Feb 15, 2024 • 23

tianlecai 

updated 2 models over 1 year ago

FasterDecoding/BitDelta_Mistral_combo

Updated Feb 14, 2024

FasterDecoding/medusa-1.0-vicuna-13b-v1.5

Text Generation • Updated Jan 25, 2024 • 227 • 1

Gsunshine 

authored a paper over 1 year ago

Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads

Paper • 2401.10774 • Published Jan 19, 2024 • 59

yli3521 

authored a paper over 1 year ago

Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads

Paper • 2401.10774 • Published Jan 19, 2024 • 59

tianlecai 

authored a paper over 1 year ago

Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads

Paper • 2401.10774 • Published Jan 19, 2024 • 59

tianlecai 

updated 2 models over 1 year ago

FasterDecoding/medusa-1.0-vicuna-33b-v1.3

Text Generation • Updated Dec 18, 2023 • 9

FasterDecoding/medusa-1.0-zephyr-7b-beta

Text Generation • Updated Dec 18, 2023 • 27 • 1

tianlecai 

updated 4 models almost 2 years ago

FasterDecoding/medusa-v1.0-vicuna-7b-v1.5

Text Generation • Updated Oct 29, 2023 • 574

FasterDecoding/medusa-vicuna-33b-v1.3

Updated Sep 11, 2023 • 27 • 4

FasterDecoding/medusa-vicuna-13b-v1.3

Updated Sep 11, 2023 • 383 • 5

FasterDecoding/medusa-vicuna-7b-v1.3

Updated Sep 11, 2023 • 1.14k • 16

tianlecai 

updated a Space almost 2 years ago

Running

README

🌖

tianlecai 

authored a paper about 2 years ago

Large Language Models as Tool Makers

Paper • 2305.17126 • Published May 26, 2023 • 3