Vision Studio

Squint Vision Studio maps a trained model's embedding space, marks the regions where it can be trusted and not trusted, and exports that map so every decision is precise.

The Squint Vision Studio Discovery workspace, showing a model's embedding space as a coloured cluster mapThe Squint Vision Studio Discovery workspace, showing a model's embedding space as a coloured cluster map

Squint Vision Studio is a cognitive engine for analysing trained models. It provides workflows for inspecting labelled datasets, quantifying and visualising training results, and examining model behaviour. It can also be used to visualise a model's embedding space. By analysing this space and identifying areas where errors are likely to occur, users can create triggers that improve the model's runtime behaviour.

Instead of treating the classifier as a black box Squint Vision Studio is built to better understand a model's internal feature representation. This space holds a highly informative representation of how a model 'views' samples and makes decisions. By interpreting and understanding how data maps to this feature space, we can improve runtime decision making.

How it works

Import your model

Squint Vision Studio works with trained PyTorch and TensorFlow models. You point it at the model and the dataset it was trained on.

Three stacked planes of sample points, the middle one highlightedThree stacked planes of sample points, the middle one highlighted

Review the map

Squint Vision Studio constructs a picture of how your model sees its data, where classes separate cleanly, where they overlap, and where mistakes gather.

Converging paths meeting at a node, with a dashed branch leading to a separate circleConverging paths meeting at a node, with a dashed branch leading to a separate circle

Set your thresholds

You decide how cautious the system should be. A high-consequence application sets a stricter bar than a high-throughput one.

A radial dial of spokes around concentric rings and a centre dotA radial dial of spokes around concentric rings and a centre dot

Export the watchdog

Squint Vision Studio constructs a lightweight component that ships alongside your model.

A square linked by a dashed line to a small circleA square linked by a dashed line to a small circle

Route in production

The watchdog labels each prediction as it happens and sends it down the path you configured.

Two overlapping circles with the intersection hatchedTwo overlapping circles with the intersection hatched

From that map, Squint Vision Studio constructs a component that runs alongside your model and checks every decision before it is made. Each one gets one of three labels.

Concentric rings around a solid centre

Trusted

The model has handled cases like this reliably before. The decision is accepted and the system keeps moving.

Two overlapping rings with a dot where they meet

Ambiguous

The model has been unreliable on cases like this. The decision goes for a second opinion, from a stronger model or a person.

A filled circle with a small separate dot outside it

Out-of-distribution

The model has seen nothing like this before. The decision is held back and flagged for review.

Read more about the workflow example, from model upload to deployed routing

Featured Case Study

BUILDING A SQUINTING PIPELINE FOR WEED/CROP DETECTION WITH SQUINT VISION STUDIO

How embedding-space monitoring can make embedded computer vision systems more reliable, efficient, and production-ready

Side-by-side seedling trays comparing ground-truth labels with model predictions for weed and crop detectionSide-by-side seedling trays comparing ground-truth labels with model predictions for weed and crop detection

Diagram showing the architecture of a Studio Squinting Pipeline integrated into a production ML system.

Architecture diagram: an office training-time setup on the left feeding a runtime deployed system on the right, where a watchdog wrapper routes predictions down trusted, ambiguous and out-of-distribution pathsArchitecture diagram: an office training-time setup on the left feeding a runtime deployed system on the right, where a watchdog wrapper routes predictions down trusted, ambiguous and out-of-distribution paths

Research Paper

MACHINE LEARNING WITH APPLICATIONS

A novel application of XAI in squinting models: A position paper

Read More
A grid of per-patch attribution heatmaps in blue, red and green, with a rainbow intensity scale beside it

Documentation

You will be guided through the process of setting up a project, importing the CIFAR-10 dataset and model...

This guide walks you through a complete workflow in Squint Vision Studio using the Breast Histopathology Images Dataset...

This guide walks you through a complete workflow in Squint Vision Studio using a custom 10-class subset of the COCO dataset...

You will be guided through the process of setting up a project, importing the MNIST dataset and model...