kudzueye commited on
Commit
ef0aece
·
verified ·
1 Parent(s): be45fe9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md CHANGED
@@ -13,6 +13,8 @@ Boring Reality Hunyuan LoRA
13
  This LoRA is an attempt at improving on the overall detail of generations from Hunyuan. It focus in particular on things such as improved depth of field, realistic skin texture, and better lighting.
14
  It works at generating both realistic short video clips and single frames for images.
15
 
 
 
16
  ## Video Examples
17
 
18
  <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/641ba2eeec5b871c0bcfdba3/bKisU-fni9hZIfm-dpwWu.mp4"></video>
@@ -26,6 +28,25 @@ The LoRA can also sometimes perform decently on images when you use the initial
26
 
27
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/641ba2eeec5b871c0bcfdba3/5zUD6bzyLWd2WiJY9F65U.png)
28
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  ## Additional Info
30
 
31
  [Full Video Demonstration](https://www.youtube.com/watch?v=0tuGBrDbXU0)
 
13
  This LoRA is an attempt at improving on the overall detail of generations from Hunyuan. It focus in particular on things such as improved depth of field, realistic skin texture, and better lighting.
14
  It works at generating both realistic short video clips and single frames for images.
15
 
16
+ At the moment, the candidate LoRA used here is overtrained. It is recommended to use a strength of around 0.6. You will also need to experiment a lot with the seeds, guidance, steps, and resolution. Try to keep steps over 35 and minimum resolution above 512x512. Guidance seems to work to varying degrees between 3.5-12.5. Higher guidance and strength may lead to more similarities in things such as scene and characters. You will want to experiment with lowering the guidance and strength while raising the resolution when you run into lots of distortion.
17
+
18
  ## Video Examples
19
 
20
  <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/641ba2eeec5b871c0bcfdba3/bKisU-fni9hZIfm-dpwWu.mp4"></video>
 
28
 
29
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/641ba2eeec5b871c0bcfdba3/5zUD6bzyLWd2WiJY9F65U.png)
30
 
31
+ ## Training Details
32
+ I used around 150 images only for this initial LoRA. I focused on public domain photos from around the early 2010s.
33
+
34
+ - epochs = 600
35
+ - gradient_accumulation_steps = 4
36
+ - warmup_steps = 100
37
+ #### Adapter
38
+ - type = "lora"
39
+ - rank = 32
40
+ - dtype = "bfloat16"
41
+ - only_double_blocks = true
42
+ #### Optimizer
43
+ - type = "adamw_optimi"
44
+ - lr = 0.0002
45
+ - betas = [ 0.9, 0.99,]
46
+ - weight_decay = 0.01
47
+ - eps = 1e-8
48
+
49
+
50
  ## Additional Info
51
 
52
  [Full Video Demonstration](https://www.youtube.com/watch?v=0tuGBrDbXU0)