Add IP-Adapter install script and reference-image workflow docs
New script: comfyui-install-ipadapter.sh - Installs cubiq/ComfyUI_IPAdapter_plus custom nodes - Downloads CLIP Vision encoders and IP-Adapter models (SDXL/SD1.5) - Optional --faceid flag for stronger face identity lock - Skips already-downloaded files, pulls updates on re-run - Prints wiring diagram and example prompts after install README: - Add "IP-Adapter: same face, different settings" section with task table, install commands, workflow guide, weight tuning - Clarify IP-Adapter = ComfyUI direct (not from OWUI chat) - Add both new scripts to the file listing table https://claude.ai/code/session_01PtYTPherSJaxDEVPgF6Nxu
This commit is contained in:
@@ -67,6 +67,8 @@ sudo systemctl status local-ai
|
||||
| `configure-storage.sh` | 239 | Storage/mount configuration helper. Run separately if you have a secondary drive for AI data. |
|
||||
| `kiwix_download.sh` | 198 | Downloads ZIM files (Wikipedia, Stack Overflow, etc.) for offline use. Run separately — files are large. |
|
||||
| `invokeai-import-lora.sh` | 85 | Copies a LoRA `.safetensors` file into InvokeAI's Docker model volume. |
|
||||
| `comfyui-import-lora.sh` | 97 | Copies a LoRA into ComfyUI and prints workflow setup instructions. |
|
||||
| `comfyui-install-ipadapter.sh` | 185 | Installs IP-Adapter nodes + models into ComfyUI for reference-image workflows (same face, different settings). |
|
||||
|
||||
### Which setup script should I use?
|
||||
|
||||
@@ -377,6 +379,60 @@ Switch between them in **Admin → Settings → Images → Import Workflow**. Th
|
||||
|
||||
Mismatched architectures will produce errors or garbage output.
|
||||
|
||||
### IP-Adapter: same face, different settings (reference image workflows)
|
||||
|
||||
IP-Adapter lets you upload a reference photo and generate new images that preserve the face/subject while changing everything else — age, emotion, setting, art style. This is different from LoRAs (which bake in a trained style). IP-Adapter works from a single image with no training needed.
|
||||
|
||||
#### What you can do
|
||||
|
||||
| Task | How | Example prompt |
|
||||
|------|-----|----------------|
|
||||
| Different setting | Reference face + new scene | "same person, sitting in a cafe in Paris" |
|
||||
| Age up/down | Reference face + age prompt | "same person as an elderly man" or "same person as a child" |
|
||||
| Emotions | Reference face + emotion | "same person, laughing" or "same person, crying" |
|
||||
| Art style | Reference face + style | "same person, oil painting, renaissance style" |
|
||||
| Pose change | Reference face + pose | "same person, looking over shoulder, dramatic lighting" |
|
||||
|
||||
#### Quick install
|
||||
|
||||
```bash
|
||||
./comfyui-install-ipadapter.sh # SDXL models (~2.5GB)
|
||||
./comfyui-install-ipadapter.sh --faceid # + FaceID for stronger face lock
|
||||
./comfyui-install-ipadapter.sh --all # SDXL + SD 1.5 models
|
||||
```
|
||||
|
||||
Then restart ComfyUI: `docker restart comfyui`
|
||||
|
||||
#### Basic workflow in ComfyUI
|
||||
|
||||
1. Open `http://<ip>:8188`
|
||||
2. Add nodes: right-click → Add Node → ipadapter
|
||||
3. Wire up:
|
||||
```
|
||||
[Load Checkpoint] → MODEL → [IPAdapter Apply] → [KSampler] → [VAE Decode] → [Save Image]
|
||||
→ CLIP → [CLIP Text Encode] → positive →
|
||||
[Load Image (your photo)] → [IPAdapter Unified Loader] → ipadapter →
|
||||
```
|
||||
4. **IPAdapter Unified Loader**: set preset to `PLUS FACE (portrait)`
|
||||
5. **IPAdapter Apply**: set weight 0.7–1.0 (higher = more faithful to reference)
|
||||
6. Text prompt: describe the new scene/emotion/age
|
||||
7. Click **Queue Prompt**
|
||||
|
||||
#### Adjusting face fidelity
|
||||
|
||||
| Weight | Effect |
|
||||
|--------|--------|
|
||||
| 0.5–0.6 | Loose reference — inspired by the face but not a match |
|
||||
| 0.7–0.8 | Good balance — recognizable face, creative freedom in scene |
|
||||
| 0.9–1.0 | Strong lock — very close to reference face |
|
||||
| FaceID preset | Strongest — uses face detection for identity lock |
|
||||
|
||||
#### Important: ComfyUI only (not from Open WebUI chat)
|
||||
|
||||
IP-Adapter workflows require uploading a reference image to ComfyUI. Open WebUI's image generation integration only sends text prompts — it can't attach reference images. For this use case, work directly in ComfyUI at `http://<ip>:8188`.
|
||||
|
||||
For text-only image generation from Open WebUI chat, use [LoRA workflows](#using-loras-with-open-webui-workflow-per-style) instead.
|
||||
|
||||
### Setup: AUTOMATIC1111 (alternative)
|
||||
|
||||
If you prefer AUTOMATIC1111 over ComfyUI:
|
||||
|
||||
Reference in New Issue
Block a user