This workflow turns a pair of images into a short, coherent video by leveraging Wan 2.1’s inpainting-based video diffusion. You provide a start frame and an end frame; the WanFunInpaintToVideo node then guides the model to synthesize the in‑between motion while preserving subject and scene details anchored in your images. Text prompts (via CLIPTextEncode) steer style and content, while negative prompts help suppress artifacts.
Under the hood, Step1 loads the core components: UNETLoader (Wan2.1 / Wan), VAELoader/VAEDecode for latent <-> pixel space conversion, and CLIPLoader for text conditioning. Your start/end frames are brought in with LoadImage and encoded using CLIPVisionLoader + CLIPVisionEncode to produce image conditioning for the UNet. KSampler drives the diffusion process using ModelSamplingSD3 for the correct sigma schedule, with CFGZeroStar and SkipLayerGuidanceDiT stabilizing guidance. The Attention Booster group applies UNetTemporalAttentionMultiply to strengthen temporal consistency across frames. Finally, CreateVideo assembles frames and SaveVideo writes the finished clip.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run "Wan 2.1 Inpainting" (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
// This workflow, exported in API format (see note below)
const wf = await client.workflows.fromFile("wan2.1_fun_inp_api.json");
const asset = client.assets.fromFile("input.png");
wf.setInput("72", "image", asset); // LoadImage
wf.setInput("6", "text", "your prompt here"); // CLIPTextEncode
const job = await client.run(wf);
await job.getOutputs("80")[0].toFile("output.png"); // SaveVideoThe SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
