The 2 Big Challenges of Making Manga with AI
The biggest challenges of producing manga or illustration series with AI are character consistency and panel layout (page composition). Unifying all panels with a consistent look by prompts alone is currently hard; you need to combine several techniques.
Character-Consistency Methods
1. Reference Image
- Midjourney --cref for character reference
- SD's IP-Adapter / Reference ControlNet
- Sora 2 / Runway Reference feature
2. A Dedicated Model via LoRA
Making a LoRA trained on 20-50 images of the same character lets you produce a stable art style every time. Many LoRAs are also published on Civitai.
3. Fixed Seed + Minor Diff
Fix the seed number and finely tweak the prompt. Effective when you want to change only expression/pose.
4. Inpaint
Regenerate just the face separately. Photoshop's generative fill or SD's Inpaint can be used.
