Q3OI-FP8 / generation_config.json
TheClusterDev's picture
Compressed LLM
7a8c2bc verified
raw
history blame
220 Bytes
{
"enable_audio_output": false,
"talker_max_new_tokens": 4096,
"talker_repetition_penalty": 1.05,
"talker_temperature": 0.9,
"talker_top_k": 50,
"talker_top_p": 1.0,
"transformers_version": "4.57.0.dev0"
}