flash_attn
torch
transformers
gradio