File size: 1,429 Bytes
6995bc8
423fbd7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c8c6c9a
423fbd7
 
 
c8c6c9a
423fbd7
 
 
c8c6c9a
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
---
base_model: stabilityai/stable-diffusion-2-1-base
library_name: diffusers
license: creativeml-openrail-m
inference: true
tags:
- stable-diffusion
- stable-diffusion-diffusers
- text-to-image
- diffusers
- controlnet
- diffusers-training
- stable-diffusion
- stable-diffusion-diffusers
- text-to-image
- diffusers
- controlnet
- diffusers-training
---

<!-- This model card has been generated automatically according to the information the training script had access to. You
should probably proofread and complete it, then remove this comment. -->


# controlnet-ameliasasinDDG/model_out

These are controlnet weights trained on stabilityai/stable-diffusion-2-1-base with new type of conditioning.



## Intended uses & limitations
Run only with prompt Van Gogh Painting of ... since dinetuned on his paintings 

#### Limitations and bias

it it finetuned on only 3 epoch of 500 images due to computational limitations 

## Training details

  --pretrained_model_name_or_path="runwayml/stable-diffusion-v1-5" \
  --controlnet_model_name_or_path="lllyasviel/sd-controlnet-canny" \
  --output_dir="model_out" \
  --dataset_name=ameliasasinDDG/vanGogh \
  --conditioning_image_column=target \
  --image_column=source \
  --caption_column=prompt \
  --resolution=512 \
  --learning_rate=1e-5 \
  --train_batch_size=8 \
  --num_train_epochs=3 \
  --tracker_project_name="controlnet" \
  --checkpointing_steps=5000 \
  --push_to_hub