Image & Audio Generation

​

generate_image

• action:“image” — Text-to-image. Builds a txt2img workflow, filling any unspecified parameter from your configured defaults (get_defaults (action:“set”) / COMFYUI_DEFAULT_* / config file), auto-selecting a local checkpoint when none is given — checkpoints known to lack a text encoder (e.g. video models) are skipped. prompt is required. For full control over the node graph, use create_workflow + enqueue_workflow instead.
• action:“audio” — Text-to-audio, supporting the ACE Step 1.5 and Stable Audio 3 model families. Builds the appropriate workflow graph, filling unspecified parameters from your defaults and auto-selecting local models. model_family, prompt and duration are required. Requires a running ComfyUI with the corresponding model files installed.
• action:“video” — Text-to-video, or image-to-video when image is given (animate a start frame). Composes an LTX-2.3 distilled workflow on your LOCAL GPU using the render-verified Comfy-Org node stack (gemma text encoder + abliterated/distilled LoRAs). Needs the LTX-2.3 models (~24-46GB): install with apply_manifest —path packs/ltx-2.3-txt2vid/manifest.yaml (or ltx-2.3-img2vid for i2v); returns an actionable error if the checkpoint is missing. seconds is converted to an 8n+1 frame count. For i2v, higher strength means MORE adherence to the start frame but LESS motion (1.0 can freeze the clip) — keep ~0.6. This minimal path omits the synchronized audio + stage-2 spatial upscale that the full ltx-2.3 packs ship. prompt is required. The video is written under output/video/ — find it with get_image (action:“list_outputs”) (VHS/SaveVideo outputs may not appear in /history).
• action:“3d” — Generate a 3D model (glb/obj/fbx) from a text prompt or an input image, using the connected ComfyUI’s hosted partner 3D nodes (Tripo, Meshy, Rodin, Hunyuan3D — auto-detected from the server; these are paid API nodes needing a comfy.org API key/login on the server or COMFY_API_KEY here). mode is required (“text” needs prompt, “image” needs image). Poll queue (action:“status”) / get_history (action:“list”) for the resulting model file (saved to ComfyUI’s output directory). If the server has no 3D-capable API nodes, returns an actionable error naming local-pack alternatives.
• action:“controlnet” — Image conditioned by a ControlNet preprocessed image (pose skeleton, depth, canny, normal, etc.) plus a text prompt. Upload the control image first with upload_image (action:“image”), then pass its filename as control_image. prompt and control_image are required; checkpoint and controlnet_model auto-resolve from local models. control_image must ALREADY be a preprocessed map (this action does not run the preprocessor); requires a running ComfyUI with a matching controlnet model in models/controlnet/.
• action:“ip_adapter” — Image guided by a reference image’s style/subject via IP-Adapter, plus a text prompt. Requires the ComfyUI_IPAdapter_plus custom nodes. Upload the reference first with upload_image (action:“image”), then pass its filename as reference_image. prompt and reference_image are required; checkpoint auto-resolves. Requires a running ComfyUI with ComfyUI_IPAdapter_plus and a matching IP-Adapter model installed, or the workflow will fail at execution time.
• action:“regenerate” — Re-enqueue the workflow that produced an EXISTING ASSET, optionally applying overrides. Overrides are applied to any node input matching the key name (e.g. cfg, steps, sampler_name, scheduler, seed, denoise, text). Seeds are re-randomized by default so each call yields a fresh image unless seed is explicitly passed in overrides. asset_id is required. To re-run from execution HISTORY rather than a registered asset, use enqueue_workflow (action:“rerun”).
• action:“upscale” — Upscale an image with an ESRGAN super-resolution model. Builds an UpscaleModelLoader → ImageUpscaleWithModel workflow (scale=2 supersamples the 4x result back down for sharper output) and enqueues it on your LOCAL GPU. Upload the source first with upload_image (action:“image”) (or stage a prior output with upload_image (action:“stage”)), then pass its filename as image. Needs an upscale model in models/upscale_models/ (e.g. 4x-ClearRealityV1 / 4x_foolhardy_Remacri, provided by the anima/ernie packs or download_model); returns an actionable error if none is found. image is required.
• action:“remove_background” — Remove an image’s background, returning a transparent (RGBA) cutout. Builds a LoadImage → BiRefNetRMBG → SaveImage workflow using the ComfyUI-RMBG (BiRefNet) matting node and enqueues it on your LOCAL GPU. Upload the source first with upload_image (action:“image”) (or stage a prior output with upload_image (action:“stage”)), then pass its filename as image. Requires the ComfyUI-RMBG custom node (pack: wan-transparent, or install_custom_node ‘comfyui-rmbg’); the BiRefNet model auto-downloads on first run. If the node isn’t installed, returns an actionable error telling you how to install it. image is required.

​

Parameters

​

Examples

{
  "tool": "generate_image",
  "arguments": {
    "action": "image",
    "prompt": "a red fox in deep snow, golden hour, sharp focus"
  }
}

{
  "tool": "generate_image",
  "arguments": {
    "action": "image",
    "prompt": "a red fox in deep snow, golden hour, sharp focus",
    "negative_prompt": "blurry, watermark, text",
    "width": 1344,
    "height": 768,
    "steps": 30,
    "cfg": 4.5,
    "seed": 12345
  }
}

{
  "tool": "generate_image",
  "arguments": {
    "action": "video",
    "prompt": "a red fox walking through deep snow, camera slowly pushing in",
    "seconds": 5,
    "resolution": "832x480",
    "fps": 16
  }
}

{
  "tool": "generate_image",
  "arguments": {
    "action": "regenerate",
    "asset_id": "a3f9c1",
    "overrides": {
      "steps": 40
    }
  }
}