Add comfyui-import-lora.sh and LoRA workflow docs

- New script: comfyui-import-lora.sh — copies .safetensors into ComfyUI's Docker volume and prints step-by-step instructions for wiring it into a workflow and exporting to Open WebUI - README: Add "Using LoRAs with Open WebUI" section documenting the workflow-per-style pattern, multi-LoRA management, and architecture compatibility table https://claude.ai/code/session_01PtYTPherSJaxDEVPgF6Nxu
2026-03-22 20:05:24 +00:00
parent 3bd714960f
commit 84afe5c571
2 changed files with 149 additions and 0 deletions
@@ -303,6 +303,64 @@ In any Open WebUI chat, type something like:

 The model will detect the image generation request and pass it to ComfyUI.

+### Using LoRAs with Open WebUI (workflow-per-style)
+
+LoRAs let you apply trained styles (anime, photorealistic, specific characters, etc.) to image generation. The trick: **bake the LoRA into a ComfyUI workflow, export it, and import into Open WebUI.** After that, you iterate from chat without touching ComfyUI.
+
+#### Step 1: Import your LoRA file
+
+```bash
+./comfyui-import-lora.sh ~/Downloads/my-style-lora.safetensors "Anime Style"
+```
+
+Or manually:
+```bash
+docker cp ~/Downloads/my-style-lora.safetensors comfyui:/opt/ComfyUI/models/loras/
+```
+
+#### Step 2: Build a workflow with the LoRA (one-time)
+
+1. Open ComfyUI at `http://<ip>:8188`
+2. Load the default text-to-image workflow
+3. Add a **Load LoRA** node: right-click → Add Node → loaders → Load LoRA
+4. Wire it between the checkpoint and the rest of the pipeline:
+   ```
+   [Load Checkpoint] → MODEL → [Load LoRA] → MODEL → [KSampler]
+                     → CLIP  →             → CLIP  → [CLIP Text Encode]
+   ```
+5. Select your LoRA file, set `strength_model` and `strength_clip` (start 0.7–0.85)
+6. Test it — click **Queue Prompt** and verify it works
+7. Enable **Dev Mode** (gear icon) → click **Save (API Format)**
+
+#### Step 3: Import into Open WebUI
+
+1. Open WebUI → **Admin** → **Settings** → **Images**
+2. Click **Import Workflow** → upload the `workflow_api.json`
+3. Map the prompt node (usually CLIPTextEncode)
+4. Save
+
+Now every "Generate an image of..." in chat uses your LoRA automatically.
+
+#### Managing multiple LoRA styles
+
+Each LoRA needs its own exported workflow. Practical approach:
+
+1. Build a workflow per style (e.g. `anime-lora.json`, `photorealistic-lora.json`)
+2. Switch between them in **Admin → Settings → Images → Import Workflow**
+3. The active workflow applies to all image generation requests
+
+> **Limitation:** You can't switch LoRAs dynamically from chat or adjust LoRA weight per-message. The workflow JSON is fixed. To change styles, swap the workflow in OWUI settings.
+
+#### LoRA compatibility
+
+| LoRA trained on | Must use checkpoint |
+|----------------|-------------------|
+| SD 1.5 | Any SD 1.5 model (e.g. `v1-5-pruned-emaonly.safetensors`) |
+| SDXL | Any SDXL model (e.g. `sd_xl_base_1.0.safetensors`) |
+| Flux | Flux checkpoint |
+
+Mismatched architectures will produce errors or garbage output.
+
 ### Setup: AUTOMATIC1111 (alternative)

 If you prefer AUTOMATIC1111 over ComfyUI: