← Latest papers
🤖 AI

Kontinuous Kontext: Continuous Strength Control for Instruction-based Image Editing

The paper introduces Kontinuous Kontext, an instruction-based image editing model that enables smooth, continuous control over edit strength by training a lightweight projector to map a scalar strength value and text instruction into the model's modulation space, allowing users to adjust edits from subtle to fully realized across diverse operations without attribute-specific training.

Original authors: Rishubh Parihar, Or Patashnik, Daniil Ostashev, R. Venkatesh Babu, Daniel Cohen-Or, Kuan-Chieh Wang

Published 2026-07-22
📖 8 min read🧠 Deep dive

Original authors: Rishubh Parihar, Or Patashnik, Daniil Ostashev, R. Venkatesh Babu, Daniel Cohen-Or, Kuan-Chieh Wang

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine you are holding a magic wand that can change pictures just by speaking to them. You say, "Make the dog look like a cat," and poof, the dog's face morphs into a feline. This is the world of instruction-based image editing, a superpower built on generative AI. These are computer brains trained on billions of photos and captions, learning to paint new pictures from scratch or tweak existing ones based on your words. For a long time, these wizards could only do one thing: follow your command to the letter. If you asked for a "blue jacket," they gave you a jacket that was 100% blue. If you asked for "snow," the whole scene became a blizzard. But what if you wanted just a little bit of snow? Or a jacket that was mostly red but with a hint of blue? Until now, the magic wand was a bit clumsy; it was an on/off switch, not a dimmer.

This is where the story of Kontinuous Kontext begins. The researchers wanted to turn that clunky on/off switch into a smooth, sliding dimmer. They asked a simple question: Can we teach an AI to understand not just what to change, but how much to change it? They didn't just want the AI to guess the right amount; they wanted a user to be able to drag a slider and watch the image transform gradually, like turning up the volume on a song or adjusting the brightness on a screen. This paper introduces a new way to give AI that fine-grained control, allowing us to dial an edit from "nothing happened" to "completely transformed" in a single, smooth motion.


The Problem: The "All-or-Nothing" Magic Wand

Imagine you are a chef with a magical recipe book. If you ask for "spicy soup," the book gives you a bowl that is so hot it burns your tongue. If you ask for "mild soup," it gives you a bowl that tastes like water. You can't ask for "just a little kick." That is exactly how current image-editing AI works. You give it a text instruction, like "turn the jacket into fur," and it either does nothing or goes all the way to a full, fluffy transformation. There is no middle ground.

Previous attempts to fix this were like trying to build a new kitchen for every single ingredient. Some scientists tried to train special models just for changing hair color, others for changing the weather, and others for changing the shape of objects. It was like having a different chef for every dish. It worked, but it was slow, expensive, and you couldn't easily mix and match. You needed a single, universal chef who could handle any request and let you control the intensity of every single change.

The Solution: The "Volume Knob" for AI

The team behind Kontinuous Kontext (a playful name mixing "Continuous" and "Context") built a system that acts like a universal volume knob for image edits. Instead of just listening to the instruction "Make it blue," the AI now listens to the instruction plus a number that says "how blue."

Think of the AI as a musician playing a song. The text instruction is the sheet music, telling the musician what to play. The new "slider" is the volume knob. In the past, the musician could only play the song at full volume or silence. Now, with Kontinuous Kontext, you can turn the knob from zero to ten. At zero, the song is silent (the image is unchanged). At five, the music is soft and gentle (a subtle edit). At ten, it's a rock concert (a full transformation). The magic is that the transition between zero and ten is perfectly smooth, with no sudden jumps or glitches.

How They Taught the AI to Slide

You might wonder: "Where did they get the data to teach the AI this?" After all, real people don't usually take a photo, edit it slightly, edit it a bit more, and then edit it fully, saving every step along the way. That kind of data doesn't exist in the wild.

So, the researchers became data magicians. They created a synthetic dataset—a fake but realistic library of examples. Here is how they did it:

  1. The Setup: They took 110,000 random photos.
  2. The Command: They used a smart AI assistant to write a unique instruction for each photo, like "Turn the car into a spaceship."
  3. The Full Edit: They used a powerful existing AI (called Flux Kontext) to make the full edit, turning the car into a spaceship.
  4. The Bridge: This was the tricky part. They needed to show the AI what the car looked like at 10%, 20%, 50%, and 90% spaceship-ness. They used a special "morphing" tool to create these in-between images, like a video fading from one scene to another.
  5. The Cleanup: The morphing tool wasn't perfect. Sometimes it made weird artifacts, like a car with half a wheel or a spaceship that looked like a blob. The researchers built a strict filter to throw away any "bad" examples where the transition wasn't smooth or the image looked broken. They ended up with 64,000 high-quality "edit trajectories" (smooth paths from start to finish).

The Secret Sauce: The "Translator" Projector

The core invention is a tiny, lightweight network they call a projector. Think of the main AI model as a giant, complex orchestra. The text instruction tells the orchestra what to play. The new projector is a tiny translator that sits between the slider and the orchestra.

When you slide the slider to "0.5" (halfway), the translator doesn't just shout "HALF!" at the orchestra. Instead, it whispers a very specific, calibrated instruction to the orchestra's conductor (the modulation space). It says, "Okay, for this specific instruction about a blue jacket, apply this exact amount of blue."

The paper found that if they just tried to feed the number into the text words (like adding a "half" token), the music would get jumpy and weird. But by feeding the number into the modulation space—a hidden layer where the AI controls the "vibe" of the image—they could make the changes smooth and precise. It's like realizing that to change the volume, you shouldn't yell at the singer; you should adjust the amplifier's gain knob directly.

What They Found (and What They Didn't)

The results were impressive. When they tested their system against other methods, Kontinuous Kontext was the clear winner in smoothness.

  • The Competition: Other methods were like a broken elevator. They would go from the ground floor to the 10th floor, but sometimes they would skip the 5th floor entirely, or the doors would open on the wrong floor. Some methods tried to just "morph" two images together, but that often resulted in weird, blurry monsters in the middle steps.
  • The Winner: Kontinuous Kontext moved like a smooth elevator. As the slider went from 0 to 1, the image changed gradually and logically. A jacket didn't suddenly turn blue; it slowly gained more blue. A snowy scene didn't just pop into existence; the snowflakes slowly appeared and the ground slowly turned white.

The paper also showed that this method works for everything, not just one thing. Whether you are changing the color of a dress, the material of a rock (making it look like gold), the shape of a car, or the entire weather of a scene, the same slider works. This is huge because it means you don't need a different model for every type of edit. One universal model can handle it all.

However, the authors are honest about the limits. The system is great at "continuous" edits, like changing colors or materials. But if you ask for a very specific, hard geometric change—like rotating a car 90 degrees perfectly—the system sometimes struggles, because the base AI it's built on (Flux Kontext) also struggles with that. Also, if you try to push the slider past the maximum (like asking for "120% blue"), the system doesn't know what to do; it just stops at 100% or gets confused. It's a dimmer switch, not a time machine.

Why This Matters

This paper suggests that we are moving past the era of "yes or no" AI. We are entering the age of "how much?" By giving users a slider, Kontinuous Kontext bridges the gap between the messy, creative human desire for nuance and the rigid, binary nature of computer code. It turns image editing from a game of chance—where you hope the AI guesses the right amount of change—into a precise instrument where you can tune the result exactly to your taste.

The researchers didn't just build a better tool; they showed that the "knob" for controlling intensity is already hiding inside these AI models, waiting to be found. They just had to build the right key to unlock it. Now, instead of asking an AI to "make it perfect," you can finally tell it, "Make it almost perfect," and watch it slide right into place.

Drowning in papers in your field?

Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.

Try Digest →