# What is Instance Segmentation?

Instance segmentation assigns pixels both a semantic class and a distinct object identity. Unlike semantic segmentation, it separates multiple objects of the same class into individual masks.

Source pixels

Image processing

Image derivative

Image processing maps source pixels and metadata into a derivative with deliberate dimensions and encoding. This diagram shows image broadly, not specifically Instance Segmentation.

<span aria-hidden="true" id="how-it-works"></span>

## How Instance Segmentation works

An instance-aware model produces a separate spatial mask for each detected object together with its category and confidence. Architectures may first propose objects and predict masks per proposal, or derive identities from a unified pixel representation. This output preserves count and overlap relationships that a class-only region map loses. It feeds object editing, inventory, robotics, tracking, and measurement after inference and mask postprocessing.

<span aria-hidden="true" id="key-facts"></span>

## Key facts

1. 1Panoptic segmentation combines countable object instances with non-instance background regions, while instance segmentation can omit amorphous background classes entirely.
2. 2Two partially occluded objects of one category require separate identity hypotheses; a model may merge them into one mask even when its combined class area looks correct.
3. 3Instance identifiers are categorical, so mask resizing or export must preserve exact IDs; interpolating the identifier image creates invalid intermediate object numbers.

<span aria-hidden="true" id="when-it-matters"></span>

## When Instance Segmentation matters

Use instance segmentation when a system must count, edit, measure, or track separate objects rather than one combined class region. Overlapping or partially hidden objects can be merged, split, or missed, affecting downstream totals and masks.

<span aria-hidden="true" id="category-use-cases"></span>

## Common use cases for image

These examples cover image broadly, not specifically Instance Segmentation.

* Generating responsive website images, thumbnails, avatars, social cards, and product imagery.
* Standardizing user uploads to safe dimensions, formats, and metadata policies.
* Applying crops, overlays, watermarks, background operations, or visual analysis at scale.

<span aria-hidden="true" id="at-scale"></span>

## Working with image

This guidance covers image broadly, not just Instance Segmentation.

Image software decodes the source into pixels, applies spatial or color operations, and encodes the result. Resize filters, crop coordinates, operation order, and output settings determine both appearance and file size.

Image operations interact with resolution, aspect ratio, alpha, color profiles, orientation, and compression. Test the complete sequence because changing the order of resize, crop, sharpen, and encode operations can change the result.

### What you gain

* One source can produce consistent variants for different layouts and devices.
* Automated optimization reduces bytes without requiring editors to prepare every derivative.
* Explicit transformation rules make crops, dimensions, and formats reproducible.

### What it costs

* Smaller dimensions and stronger compression reduce transfer size but can remove useful detail.
* Automatic crops scale well but can cut off important subjects when detection or focal information is wrong.
* Wide-gamut, HDR, and transparent assets need an end-to-end path that preserves those properties.

### Before production

1. 1Test representative dimensions, transparency, color profiles, orientation, and animated inputs.
2. 2Compare visual quality at the actual display size, not only at 100% zoom.
3. 3Set explicit crop, fit, and upscaling rules so edge cases remain predictable.

[← Indexed Color](/glossary/indexed-color.md)[Inter-Frame Compression →](/glossary/inter-frame-compression.md)

More in image

* [Image Watermarking](/glossary/image-watermarking.md)
* [Image-to-Image Translation](/glossary/image-to-image-translation.md)
* [Indexed Color](/glossary/indexed-color.md)
* [Jaggies](/glossary/jaggies.md)
* [Median Filter](/glossary/median-filter.md)
* [Megapixel](/glossary/megapixel.md)

[All 505 terms](/glossary.md)

## Turn media knowledge into a working pipeline

Connect uploads, processing, AI, storage, and delivery through one declarative API — with the encoding stack, scaling, and format churn handled for you.

[Try Transloadit for free](/c/signup/)