11

7:13 - 7:45

What the router consumes and decides

Watch from 7:13

The router is the system's selective gate. It does not enhance every image. Instead, it examines the available evidence and decides whether an image should go to the enhancement branch or remain unchanged on the skip branch.

Source focus (07:13–07:45): The presenters describe a router that combines a text description, metadata, and the image. It requests a structured description, grades that representation against a rubric with pass/fail criteria, and then chooses enhance or skip. The transcript does not specify the structured schema, rubric fields, or threshold values.

The router's inputs are multimodal

The router consumes three kinds of information:

  1. The image — the visual evidence in the uploaded food photo.
  2. A text description — a textual account of what the image is supposed to show.
  3. Metadata — information associated with the item or listing.

These inputs are useful together because each one answers a different question. The image shows what is visibly present. The description and metadata provide context about what the image represents. A routing decision should therefore not rely on visual appearance alone or on text alone.

For example, an image can look polished but still fail to represent the item described by the listing. Conversely, a text description can sound clear while the image contains too little evidence to support it. Combining the modalities gives the router a basis for checking both visual quality and content consistency.

Why use a structured intermediate representation?

The router first asks for a structured description. This is an intermediate representation: the system turns the raw multimodal evidence into a more organized account before making the branch decision.

The benefit is separation of responsibilities:

image + text description + metadata
                ↓
       structured description
                ↓
        rubric-based grading
                ↓
          enhance or skip

A raw image is difficult to connect directly to an operational decision. A structured representation makes the relevant observations explicit enough to grade. It can describe the aspects that the rubric cares about, while keeping the final routing action separate from the act of describing the input.

This does not mean that the structured description is automatically correct. It is another model-produced representation that must be checked against explicit criteria. Its value is that it gives the evaluator a consistent object to inspect rather than leaving the decision as an unexplained impression from the model.

At about 07:32, the slide depicts the router's sequence: multimodal image-and-text input, rubric-based grading with pass or below-bar outcomes, and an enhance-or-skip decision. The visible slide does not disclose the underlying schema or numerical thresholds.

The rubric turns judgment into a route

A rubric is a set of explicit criteria used to judge an input. In this flow, the criteria have pass/fail behavior. The router grades the structured description against the rubric and uses the result to choose a downstream branch.

The decision can be understood as follows:

Router result Operational action Meaning
Rubric indicates that enhancement is appropriate Enhance Send the image to the editing path because processing is considered worthwhile.
Rubric indicates that enhancement is not warranted Skip Keep the image out of the enhancement path rather than forcing an edit.

The exact criterion names and thresholds are not given in the source. The important design idea is the boundary between evaluation and action:

  • Description and grading ask, “What does this input contain, and does it meet the routing criteria?”
  • Routing asks, “Which downstream operation should run?”

That boundary makes the decision inspectable. If a case is sent to the wrong branch, the team can ask whether the multimodal description was inaccurate, whether the rubric was applied incorrectly, or whether the route mapping itself was wrong. These are different failure types, even though they can all appear later as a disappointing final image.

Enhance versus skip is a selective quality decision

The router is not simply a classifier that predicts whether an image is “good” in the abstract. Its practical question is whether enhancement is the appropriate next operation for this particular input.

That distinction matters. Enhancement is not free, and changing an image that already meets the desired bar may provide little value or may move it away from the source. A selective system spends its editing effort where it is expected to help and preserves the original when enhancement is not justified.

The skip branch is therefore not a failure state. It is a deliberate safety and fidelity choice:

input image
     ├── rubric says enhancement is appropriate → enhance
     └── rubric says enhancement is not warranted → skip / retain original

The router's decision should also be kept separate from the later editor result. A correct route does not guarantee that the editor will produce a good image. Likewise, a poor edited image does not by itself prove that routing was wrong. Routing evaluates the branch choice; later editing and QA evaluate what happened after that choice.

A concrete example

Imagine that the input consists of a food photo, a listing description, and item metadata.

  1. The router receives all three inputs.
  2. It requests a structured account of the image and its relevant context.
  3. It grades that account against the routing rubric.
  4. If the criteria indicate that enhancement is appropriate, it invokes the enhancement branch.
  5. Otherwise, it selects skip and retains the original path.

The example is intentionally abstract because the source does not provide the schema, the individual rubric fields, or the threshold values. Those details would determine how the system behaves in edge cases, but they are not stated here.

The mental model to keep

Think of the router as a multimodal triage layer:

  • it gathers evidence from the image and its textual context;
  • it normalizes that evidence into a structured representation;
  • it applies an explicit rubric;
  • it chooses whether the next operation is enhancement or no enhancement.

This makes the router the first decision point in selective image improvement. Its job is not to perform the edit and not to serve as the final publish gate. Its job is to choose the appropriate path using evidence that can be graded and later evaluated as a routing decision.

Source visuals

A three-stage routing flow refers to an image and text input, grades the result against a rubric, and decides whether to enhance or skip.

The visible slide directly depicts the requested router sequence: multimodal image-and-text input, rubric-based pass/Below bar grading, and an enhance-or-skip decision.

Source at 7:32
100% Space + drag to pan | Ctrl/Cmd + wheel to zoom