Final_Assignment_Template

Configuration error

oremaz commited on Jun 3

Commit

6e46cdb

verified ·

1 Parent(s): 6145747

Update agent.py

Files changed (1) hide show

agent.py CHANGED Viewed

@@ -73,10 +73,10 @@ proj_llm = HuggingFaceLLM(
     tokenizer_name=model_id,
     device_map="auto",
     model_kwargs={"torch_dtype": "auto"},
     generate_kwargs={
         "temperature": 0.1,
-        "top_p": 1.0,
-        "max_new_tokens": 100000
     }
 )

     tokenizer_name=model_id,
     device_map="auto",
     model_kwargs={"torch_dtype": "auto"},
+    max_new_tokens = 100000
     generate_kwargs={
         "temperature": 0.1,
+        "top_p": 1.0
     }
 )