ContolnetVanGogh / README.md
ameliasasinDDG's picture
Update README.md
c8c6c9a verified
metadata
base_model: stabilityai/stable-diffusion-2-1-base
library_name: diffusers
license: creativeml-openrail-m
inference: true
tags:
  - stable-diffusion
  - stable-diffusion-diffusers
  - text-to-image
  - diffusers
  - controlnet
  - diffusers-training
  - stable-diffusion
  - stable-diffusion-diffusers
  - text-to-image
  - diffusers
  - controlnet
  - diffusers-training

controlnet-ameliasasinDDG/model_out

These are controlnet weights trained on stabilityai/stable-diffusion-2-1-base with new type of conditioning.

Intended uses & limitations

Run only with prompt Van Gogh Painting of ... since dinetuned on his paintings

Limitations and bias

it it finetuned on only 3 epoch of 500 images due to computational limitations

Training details

--pretrained_model_name_or_path="runwayml/stable-diffusion-v1-5"
--controlnet_model_name_or_path="lllyasviel/sd-controlnet-canny"
--output_dir="model_out"
--dataset_name=ameliasasinDDG/vanGogh
--conditioning_image_column=target
--image_column=source
--caption_column=prompt
--resolution=512
--learning_rate=1e-5
--train_batch_size=8
--num_train_epochs=3
--tracker_project_name="controlnet"
--checkpointing_steps=5000
--push_to_hub