---
title: What is semantic and instance segmentation?
description: In this blog we will look at ai-driven image analysis for microscopy and how it contributes to advanced and accelerated scientific biology research.
image: https://www.arivis.com/hubfs/5fa190418c897676b1bcda54_large_2545px.jpg
---

 arivis Scientific Image Analysis

- [Contact](https://www.arivis.com/contact)

Close

- Products 
    - ZEISS arivis Pro 
          - [ZEISS arivis Pro](https://www.arivis.com/products/pro)
          - [ZEISS arivis Pro VR](https://www.arivis.com/products/pro/vr)
    - [ZEISS arivis Hub](https://www.arivis.com/products/hub)
    - [ZEISS arivis Cloud](https://www.arivis.com/products/cloud-ai)
- Resources 
    - [Publications](https://www.arivis.com/resources/publications)
    - [Case Studies](https://www.arivis.com/resources) 
          - [Mitochondria Analysis with Deep Learning](https://www.arivis.com/case-study/deep-learning-segmentation-mitochondria)
          - [Compartmentalization of Chromatin](https://www.arivis.com/case-study/distribution-and-compartmentalization-chromatin-nucleus)
          - [Gastrulation & Migration Phenotypes](https://www.arivis.com/case-stydy/gastrulation-and-migration-phenotypes)
          - [Advanced 4D Tracking of Meiotic Spindle Dynamic](https://www.arivis.com/case-study/advanced-4d-tracking-of-meiotic-spindle-dynamic)
          - [Migration of Interneurons in Developing Mouse Brain](https://www.arivis.com/case-study/migration-of-interneurons-in-the-developing-mouse-brain)
          - [Exploring Whole Organisms at Single-cell Resolution](https://www.arivis.com/case-study/exploring-whole-organisms-at-single-cell-resolution)
          - [Image Analysis Workflow for EM images](https://www.arivis.com/use-case/image-analysis-workflow-for-mining-em-images)
    - [Webinars and Workshops](https://www.arivis.com/resources/webinars-workshops-trainings)
    - [Tutorials](https://www.arivis.com/tutorials-series)
    - [AI eBook](https://www.arivis.com/ai-ebook)
    - [AI Blog](https://www.arivis.com/blog)
    - How to's 
          - [AI, ML and DL](https://www.arivis.com/applications/ai-machine-learning-deep-learning)
          - [Importing from Open Source](https://www.arivis.com/applications/exchange-objects-open-source-software)
          - [Region Growing](https://www.arivis.com/applications/region-growing)
          - [Membrane-based Segmentation](https://www.arivis.com/use-case/membrane-based-segmentation)
          - [Colocalization](https://www.arivis.com/use-case/colocalization)
          - [Customizable Magic Wand](https://www.arivis.com/use-case/customizable-magic-wand)
          - [Color Settings](https://www.arivis.com/use-case/use-case-color-settings)
          - [Tracking](https://www.arivis.com/applications/dynamics-and-tracking)
          - [Blob Finder](https://www.arivis.com/use-case/blob-finder)
          - [Visualization in Charts and 4D viewer](https://www.arivis.com/use-case/use-case-visualization-in-charts-and-4d-viewer)
- Service & Support 
    - [Knowledge Base](https://kb.arivis.com/)
    - [Software Newsletter](https://www.arivis.com/contact/newsletter)
- [About](https://www.arivis.com/about-us) 
    - [News](https://www.arivis.com/arivis-news)
    - [Career](https://www.arivis.com/career)
    - [Partners](https://www.arivis.com/technology-partner)
    - [Awards](https://www.arivis.com/awards)

SEARCH

[![Contact](https://hubspot-no-cache-eu1-prod.s3.amazonaws.com/cta/default/9058989/f6b72482-6e31-424f-9f83-11d8125b109d.png)](https://hubspot-cta-redirect-eu1-prod.s3.amazonaws.com/cta/redirect/9058989/f6b72482-6e31-424f-9f83-11d8125b109d)

[![partner-logo-zeiss-1](https://www.arivis.com/hs-fs/hubfs/arivis-website-assets/images/partner/partner-logo-zeiss-1.png?width=48&height=48&name=partner-logo-zeiss-1.png)](https://www.arivis.com) [![partner-logo-zeiss-1](https://www.arivis.com/hs-fs/hubfs/arivis-website-assets/images/partner/partner-logo-zeiss-1.png?width=40&height=40&name=partner-logo-zeiss-1.png)](https://www.arivis.com)

- Products 
    - ZEISS arivis Pro 
          - [ZEISS arivis Pro](https://www.arivis.com/products/pro)
          - [ZEISS arivis Pro VR](https://www.arivis.com/products/pro/vr)
    - [ZEISS arivis Hub](https://www.arivis.com/products/hub)
    - [ZEISS arivis Cloud](https://www.arivis.com/products/cloud-ai)
- Resources 
    - [Publications](https://www.arivis.com/resources/publications)
    - [Case Studies](https://www.arivis.com/resources) 
          - [Mitochondria Analysis with Deep Learning](https://www.arivis.com/case-study/deep-learning-segmentation-mitochondria)
          - [Compartmentalization of Chromatin](https://www.arivis.com/case-study/distribution-and-compartmentalization-chromatin-nucleus)
          - [Gastrulation & Migration Phenotypes](https://www.arivis.com/case-stydy/gastrulation-and-migration-phenotypes)
          - [Advanced 4D Tracking of Meiotic Spindle Dynamic](https://www.arivis.com/case-study/advanced-4d-tracking-of-meiotic-spindle-dynamic)
          - [Migration of Interneurons in Developing Mouse Brain](https://www.arivis.com/case-study/migration-of-interneurons-in-the-developing-mouse-brain)
          - [Exploring Whole Organisms at Single-cell Resolution](https://www.arivis.com/case-study/exploring-whole-organisms-at-single-cell-resolution)
          - [Image Analysis Workflow for EM images](https://www.arivis.com/use-case/image-analysis-workflow-for-mining-em-images)
    - [Webinars and Workshops](https://www.arivis.com/resources/webinars-workshops-trainings)
    - [Tutorials](https://www.arivis.com/tutorials-series)
    - [AI eBook](https://www.arivis.com/ai-ebook)
    - [AI Blog](https://www.arivis.com/blog)
    - How to's 
          - [AI, ML and DL](https://www.arivis.com/applications/ai-machine-learning-deep-learning)
          - [Importing from Open Source](https://www.arivis.com/applications/exchange-objects-open-source-software)
          - [Region Growing](https://www.arivis.com/applications/region-growing)
          - [Membrane-based Segmentation](https://www.arivis.com/use-case/membrane-based-segmentation)
          - [Colocalization](https://www.arivis.com/use-case/colocalization)
          - [Customizable Magic Wand](https://www.arivis.com/use-case/customizable-magic-wand)
          - [Color Settings](https://www.arivis.com/use-case/use-case-color-settings)
          - [Tracking](https://www.arivis.com/applications/dynamics-and-tracking)
          - [Blob Finder](https://www.arivis.com/use-case/blob-finder)
          - [Visualization in Charts and 4D viewer](https://www.arivis.com/use-case/use-case-visualization-in-charts-and-4d-viewer)
- Service & Support 
    - [Knowledge Base](https://kb.arivis.com/)
    - [Software Newsletter](https://www.arivis.com/contact/newsletter)
- [About](https://www.arivis.com/about-us) 
    - [News](https://www.arivis.com/arivis-news)
    - [Career](https://www.arivis.com/career)
    - [Partners](https://www.arivis.com/technology-partner)
    - [Awards](https://www.arivis.com/awards)

[![Contact](https://hubspot-no-cache-eu1-prod.s3.amazonaws.com/cta/default/9058989/f6b72482-6e31-424f-9f83-11d8125b109d.png)](https://hubspot-cta-redirect-eu1-prod.s3.amazonaws.com/cta/redirect/9058989/f6b72482-6e31-424f-9f83-11d8125b109d)

[Sreenivas Bhattiprolu](https://www.arivis.com/blog/author/sreenivas-bhattiprolu) Oct 13, 2023, 12:56:40 PM 3 min read

# What is semantic and instance segmentation?

[Previous Post](https://www.arivis.com/blog/what-to-expect-with-small-training-datasets-for-instance-segmentation)

<https://www.arivis.com/blog>

[Next Post](https://www.arivis.com/blog/why-the-future-of-microscopy-is-computational)

Segmentation is an image processing technique that provides information about various regions of interest in an image. It involves classifying each pixel to one or more classes.

For *semantic segmentation*, all pixels corresponding to a class are given the same pixel value. For *instance segmentation*, all pixels corresponding to each instance (or object) of a class are given unique values. The values range from 0 (background) to N, where N refers to the total number of objects in the image.

![5fa190fd7964094ff7f6a556\_image\_segm\_instance](https://www.arivis.com/hs-fs/hubfs/5fa190fd7964094ff7f6a556_image_segm_instance.jpg?width=1569&height=414&name=5fa190fd7964094ff7f6a556_image_segm_instance.jpg)

There are many techniques for segmentation ranging from histogram thresholding to traditional machine learning to deep learning. The exact approach depends on the complexity of the application. Deep learning has been proven to be very efficient at segmenting objects against a busy background.

The following video provides a further explanation by demonstrating segmentation approaches for simple, medium complex, and high complex images, respectively.  

<iframe width="200" height="113" src="https://www.youtube.com/embed/VjK3hCnj8xA?feature=oembed" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen title="What is semantic and instance segmentation?" style="position: absolute; top: 0px; left: 0px; width: 100%; height: 100%; border: none;"></iframe>

For complex images that require deep learning, **arivis Cloud offers free tools for semantic and instance segmentation.** These tools allow the user to perform segmentation using state of the art deep learning algorithms **without writing or interacting with code**.

 

Sreenivas Bhattiprolu

![sreeni-removebg-preview](https://www.arivis.com/hs-fs/hubfs/sreeni-removebg-preview.png?width=250&height=247&name=sreeni-removebg-preview.png)

Dr. Sreenivas Bhattiprolu's team at ZEISS focuses on solving tough microscopy challenges by leveraging the latest advancements in digital technology and artificial intelligence. Dr. Bhattiprolu has over 25 years of experience in microscopy. He received his Doctorate in Materials Sciences and Engineering from Michigan Technological University and earned his Master’s degree in Physics from the University of Hyderabad.

## RELATED ARTICLES

## [Sreenivas Bhattiprolu Oct 12, 2023, 2:00:43 PM 14 min read What to expect with small training datasets for instance segmentation? Deep neural networks require large amounts of training data to tune millions of parameters and develop a learned model for ... Start Reading](https://www.arivis.com/blog/what-to-expect-with-small-training-datasets-for-instance-segmentation)

## [Sreenivas Bhattiprolu Oct 12, 2023, 1:40:57 PM 6 min read Large Image Analysis Strategies Analyzing large images? Here are a few image analysis strategies to get the work done. Working with large microscopy images can ... Start Reading](https://www.arivis.com/blog/large-image-analysis-strategies)

## [Sreenivas Bhattiprolu Dec 20, 2023, 10:55:50 AM 20 min read Scalable Image Analysis for Biotech and Pharma How ZEISS arivis Hub Can Help Transform Biotech & Pharma Research. In the realm of biotech and pharma research, the journey ... Start Reading](https://www.arivis.com/blog/scalable-image-analysis-for-biotech-and-pharma)

**Related ZEISS Websites** [Research Microscopy](https://www.zeiss.com/microscopy/en/home.html) [ZEISS Group](https://www.zeiss.com/int) <https://www.zeiss.com/int>

- [Privacy](https://www.zeiss.com/data-protection)
- [Imprint](https://www.arivis.com/imprint)
- [Contact](https://www.arivis.com/contact)

Subscribe to our newsletter

© Carl Zeiss Microscopy GmbH - All rights reserved

- [Privacy Notice](https://zeiss.com/data-protection)
- [Legal Notice](https://www.zeiss.com/microscopy/en/legal-information/legal-notice.html)
- [Imprint](https://www.arivis.com/imprint)
- [Contact](https://www.arivis.com/contact)
- [Cookie Policy](https://www.zeiss.com/data-protection/int/cookie-policy.html)