RESEARCH

COMPUTER VISION

PointRend: Image Segmentation As Rendering

June 10, 2020

Abstract

We present a new method for efficient high-quality image segmentation of objects and scenes. By analogizing classical computer graphics methods for efficient rendering with over- and undersampling challenges faced in pixel labeling tasks, we develop a unique perspective of image segmentation as a rendering problem. From this vantage, we present the PointRend (Point-based Rendering) neural network module: a module that performs point-based segmentation predictions at adaptively selected locations based on an iterative subdivision algorithm. PointRend can be flexibly applied to both instance and semantic segmentation tasks by building on top of existing state-of-the-art models. While many concrete implementations of the general idea are possible, we show that a simple design already achieves excellent results. Qualitatively, PointRend outputs crisp object boundaries in regions that are over-smoothed by previous methods. Quantitatively, PointRend yields significant gains on COCO and Cityscapes, for both instance and semantic segmentation. PointRend's efficiency enables output resolutions that are otherwise impractical in terms of memory or computation compared to existing approaches. Code has been made available at https://github.com/facebookresearch/detectron2/tree/master/projects/PointRend.

Download the Paper

AUTHORS

Written by

Alexander Kirillov

Kaiming He

Ross Girshick

Yuxin Wu

Publisher

CVPR

Related Publications

November 13, 2026

RESEARCH

NLP

Unbundling Multimodal Vision Encoding

Ellis Brown, Chris Hoang, Shang-Wen Li, Mike Lewis, Marjan Ghazvininejad, Luke Zettlemoyer, Lucas Beyer, Mengye Ren, Jakob Verbeek, Saining Xie, Hu Xu

November 13, 2026

October 19, 2026

RESEARCH

NLP

Muse Glimmer 30B: An On-Device Agentic Model

Muse Glimmer team

October 19, 2026

October 14, 2026

RESEARCH

Human-Guided Agentic AI for End-to-End EHR Research: Sequential Antibody-Drug Conjugate Pathways in Breast Cancer

Arturo Loaiza-Bonilla

October 14, 2026

October 14, 2026

RESEARCH

Pickleball injuries, search interest, and participation in the United States, 2014-2023: an ecological time series study

Daniel Kim

October 14, 2026

Help Us Pioneer The Future of AI

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.