Final_Assignment_Template

Running

Coool2 commited on 5 days ago

Commit

83956ca

verified ·

1 Parent(s): 6e46cdb

Update agent.py

Files changed (1) hide show

agent.py CHANGED Viewed

@@ -73,7 +73,7 @@ proj_llm = HuggingFaceLLM(
     tokenizer_name=model_id,
     device_map="auto",
     model_kwargs={"torch_dtype": "auto"},
-    max_new_tokens = 100000
     generate_kwargs={
         "temperature": 0.1,
         "top_p": 1.0

     tokenizer_name=model_id,
     device_map="auto",
     model_kwargs={"torch_dtype": "auto"},
+    max_new_tokens = 100000,
     generate_kwargs={
         "temperature": 0.1,
         "top_p": 1.0