https://aescripts.com/local-diffusion/

Local Diffusion for After Effects: AI-Powered Creativity Inside Your Workflow  Transform Text into Visuals Without Leaving After Effects  Local Diffusion integrates Stable Diffusion AI directly into Adobe After Effects, enabling artists to generate, modify, and enhance visuals using simple text prompts. This plugin eliminates tedious round-tripping between external tools, streamlining AI-powered design within your compositing workspace.

Key Features

1. Text-to-Image Generation

   • Create high-res images, textures, or backgrounds from descriptive prompts (e.g., "cyberpunk cityscape at dusk").

   • Adjust resolution, seed values, and sampling steps for granular control.

2. Intelligent Image Editing

   • Inpainting: Replace masked areas (e.g., remove objects, add elements) via AI.

   • Outpainting: Extend backgrounds or canvas beyond frame borders.

   • Image-to-Image: Redesign existing layers using prompts (e.g., "make this forest look enchanted").

3. Real-Time ControlNet Support

   • Lock compositions to depth maps, edges, or poses for consistent AI generation.

   • Maintain structural integrity while altering styles.

4. Non-Destructive Workflow

   • All AI operations are layer-based with adjustable parameters.

   • Preserve original assets and iterate infinitely.

Use Cases

• Concept Art & Pre-Viz: Rapidly visualize scenes during storyboarding.

• Asset Creation: Generate custom textures, icons, or matte paintings.

• VFX Cleanup: Remove wires, rigs, or lens flares from footage.

• Style Transfer: Apply "watercolor," "oil painting," or "photorealistic" effects to animations.

Technical Highlights

• Offline Processing: Optional local AI engine (via Automatic1111) for data privacy.

• GPU Acceleration: Leverages CUDA/NVIDIA for faster renders.

• Compatibility: AE 2021+ (Win/Mac); requires 8GB+ VRAM for optimal performance.