imtibuilds
P1 · Imtiaz

Chapter 4 of 5

System

Image and Video Model Testing

Findings

  1. FLUX dev won cost to quality in a six-model image bake-off

    Source Image providers report · May 2026

  2. GPT Image 2 medium quality cost 9x low quality, not the projected 3.9x

    Source API usage probe · Aug 2026

  3. Reference batching on GPT Image 2 saved nothing (50.18 vs 50.19 credits)

    Source Bake-off round 3 · Aug 2026

  4. Seedance image to video lost the subject's identity in 5 of 7 cuts; stills held

    Source Fenrir test · Aug 2026

What it is

Bake-offs across image and video models to pick the best cost to quality for each job.

Stack

  • FLUX dev
  • GPT Image 2
  • Nano Banana 2
  • Krea
  • Higgsfield
  • OpenArt
  • Seedance
  • Veo
  • MiniMax
  • ComfyUI on Comfy Cloud
  • FFmpeg
  • Remotion

Next chapter

Where I test AI on my own products.