The 'Change Any Objects' workflow in ComfyUI is designed to enable users to seamlessly replace or alter objects within a video using simple text prompts or optional reference images. This workflow leverages advanced inpainting techniques, utilizing models like SAM3 and Wan2.1 VACE, to achieve precise object masking and replacement. The process begins with loading video inputs and setting up the necessary configurations using nodes like VHS_LoadVideo and WanVideoDecode. The SAM3 model is crucial for video segmentation and object masking, allowing users to specify which objects to alter through intuitive prompts. Once the objects are identified, the Wan2.1 VACE model takes over to inpaint and replace these objects with new content derived from the user's prompts or reference images. This combination of models and nodes provides a powerful tool for video editing, enabling creative transformations without the need for extensive manual editing.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run "Change Any Objects" (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
// This workflow, exported in API format (see note below)
const wf = await client.workflows.fromFile("templates_shane_change_any_objects_api.json");
const asset = client.assets.fromFile("input.png");
wf.setInput("204", "image", asset); // LoadImage
const job = await client.run(wf);
await job.getOutputs("164")[0].toFile("output.png"); // VHS_VideoCombineThe SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
