lofi girl是一个法国的油管频道，我们拿它的封面图片练手。参考了reddit上的一个帖子。
1. img2img
第一步先直接img2img
1
2
3
4
5
| Studying girl, best quality, ultra high res, (photorealistic:1.4), stack of books and brown flower pot on table, brown cat on white window ledge
Negative prompt: paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, normal quality, ((monochrome)), ((grayscale)), skin spots, acnes, skin blemishes, age spot, glans
Steps: 28, Sampler: DPM++ SDE Karras, CFG scale: 8, Seed: 3242059520, Size: 1024x564, Model hash: fc2511737a, Model: chilloutmix_NiPrunedFp32Fix, Denoising strength: 0.38, Mask blur: 4
|
2. 重绘小猫
Send to inpaint, 涂图小猫
1
2
3
4
5
| best quality, ultra high res, (photorealistic:1.4), back of a sleeping brown cat
Negative prompt: paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, normal quality, ((monochrome)), ((grayscale)), skin spots, acnes, skin blemishes, age spot, glans
Steps: 28, Sampler: DPM++ SDE Karras, CFG scale: 8, Seed: 2007546370, Size: 1024x560, Model hash: fc2511737a, Model: chilloutmix_NiPrunedFp32Fix, Denoising strength: 0.38, Mask blur: 4
|
3. 重绘手指
Send to inpaint，使用control net(candy)重绘手指部分，使用原图作为control net输入。
1
2
3
4
5
| Studying girl, best quality, ultra high res, (photorealistic:1.4), stack of books and brown flower pot on table, brown cat on white window ledge
Negative prompt: paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, normal quality, ((monochrome)), ((grayscale)), skin spots, acnes, skin blemishes, age spot, glans
Steps: 28, Sampler: DPM++ SDE Karras, CFG scale: 8, Seed: 2851621146, Size: 1024x560, Model hash: fc2511737a, Model: chilloutmix_NiPrunedFp32Fix, Denoising strength: 0.38, Mask blur: 4, ControlNet Enabled: True, ControlNet Module: canny, ControlNet Model: control_sd15_canny [fef5e48e], ControlNet Weight: 1, ControlNet Guidance Strength: 1
|
4. 优化细节
Send to img2img，使用原图作为control net的输入，使用depth_leres算法优化细节。
这次需要使用较高的步数40，以及较低的去噪强度0.2。
1
2
3
4
5
| Studying girl, best quality, ultra high res, (photorealistic:1.4), stack of books and brown flower pot on table, brown cat on white window ledge
Negative prompt: paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, normal quality, ((monochrome)), ((grayscale)), skin spots, acnes, skin blemishes, age spot, glans
Steps: 40, Sampler: Euler a, CFG scale: 7, Seed: 3439776951, Size: 1024x560, Model hash: fc2511737a, Model: chilloutmix_NiPrunedFp32Fix, Denoising strength: 0.2, Mask blur: 4, ControlNet Enabled: True, ControlNet Module: depth_leres, ControlNet Model: control_depth-fp16 [400750f6], ControlNet Weight: 1, ControlNet Guidance Strength: 1
|
5. 灯光
我们使用inpaint sketch在袖子上画一些黄色来模拟灯光，只需要画高亮部分，保留一部分袖子原本的颜色。
继续使用原图作为control net输入，使用depth_leres算法来控制阴影。把步数设得高一些(60)，去躁强度不要太高（0.6），让颜色慢慢Difussion（扩散）。
1
2
3
4
5
| Studying girl, best quality, ultra high res, (photorealistic:1.4), stack of books and brown flower pot on table, brown cat on white window ledge
Negative prompt: paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, normal quality, ((monochrome)), ((grayscale)), skin spots, acnes, skin blemishes, age spot, glans
Steps: 60, Sampler: Euler a, CFG scale: 8, Seed: 3524037322, Size: 1024x560, Model hash: fc2511737a, Model: chilloutmix_NiPrunedFp32Fix, Denoising strength: 0.6, Mask blur: 4, ControlNet Enabled: True, ControlNet Module: depth_leres, ControlNet Model: control_depth-fp16 [400750f6], ControlNet Weight: 1, ControlNet Guidance Strength: 1
|
使用灯光蒙板
在上面的打光我们是不希望改动画面，只希望增加灯光。
但如果是在直接生成时，可以使用灯光蒙板来控制灯光。
使用img2img，主体为一张灯光蒙板，control net使用lofi girl原图的depth。
效果会是这样：
6. 再次优化细节
模拟完灯光后，高亮边缘会有一些毛糙，需要再次优化。我们完全按照优化的参数，再来一次。
