Tidzo
/

falcon-7b-esg-instruct

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Tidzo commited on Jul 4, 2023

Commit

43e5ff2

·

1 Parent(s): b0afad8

Update handler.py

Files changed (1) hide show

handler.py +1 -1

handler.py CHANGED Viewed

@@ -15,7 +15,7 @@ class EndpointHandler():
         config = PeftConfig.from_pretrained(path)
         model = AutoModelForCausalLM.from_pretrained(
-            model_name,
             load_in_4bit=True,
             trust_remote_code=True,
             device_map="auto"

         config = PeftConfig.from_pretrained(path)
         model = AutoModelForCausalLM.from_pretrained(
+            config.base_model_name_or_path,
             load_in_4bit=True,
             trust_remote_code=True,
             device_map="auto"