ameliasasinDDG/ContolnetVanGogh

controlnet-ameliasasinDDG/model_out

These are controlnet weights trained on stabilityai/stable-diffusion-2-1-base with new type of conditioning.

Intended uses & limitations

Run only with prompt Van Gogh Painting of ... since dinetuned on his paintings

Limitations and bias

it it finetuned on only 3 epoch of 500 images due to computational limitations

Training details

--pretrained_model_name_or_path="runwayml/stable-diffusion-v1-5"
--controlnet_model_name_or_path="lllyasviel/sd-controlnet-canny"
--output_dir="model_out"
--dataset_name=ameliasasinDDG/vanGogh
--conditioning_image_column=target
--image_column=source
--caption_column=prompt
--resolution=512
--learning_rate=1e-5
--train_batch_size=8
--num_train_epochs=3
--tracker_project_name="controlnet"
--checkpointing_steps=5000
--push_to_hub