Training in progress, epoch 0

README.md

@@ -14,7 +14,7 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/august-gislerud-rolfsen-relu/Dummy/runs/pbz15hgu)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/august-gislerud-rolfsen-relu/Dummy/runs/7qg0ft75)
 # fine-tuned-visionllama
 
 This model is a fine-tuned version of [meta-llama/Llama-3.2-11B-Vision-Instruct](https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instruct) on an unknown dataset.
@@ -37,15 +37,15 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 0.0002
-- train_batch_size: 2
+- train_batch_size: 1
 - eval_batch_size: 8
 - seed: 42
 - gradient_accumulation_steps: 2
-- total_train_batch_size: 4
+- total_train_batch_size: 2
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: constant
 - lr_scheduler_warmup_ratio: 0.03
-- num_epochs: 0.001
+- num_epochs: 0.002
 
 ### Framework versions
 

adapter_config.json

@@ -20,8 +20,8 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_proj",
-    "q_proj"
+    "q_proj",
+    "v_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:49f65a84cd22f71f8b1ab0ea944cb942dc57467ae9561e6115840843f1f6d75e
+oid sha256:24b6d729f4db8a85acc75410c61b6c9cfbf46f2918c439e998b96c99d7b86cea
 size 23641256

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dcf99002c475d29c7b8b3b33fc65d0055881c50c18b74ba86b9d9bddc114dbac
-size 5560
+oid sha256:effbf569a58f0cadea202101788a767ec050dc826d17e88bc7bfde56afe585e6
+size 5496