Skip to content
Part IA Michaelmas Term

Visual Computing Pipeline

Overview

The course is structured around the Visual Computing Pipeline, which describes how visual information flows between the physical world, computers, and human observers:

The Visual Computing Pipeline showing Scene, Digital Image, Display Light, and Human Perception

Pipeline Stages

1. Scene Description

The mathematical model of the 3D scene:

  • Geometry (objects, shapes, surfaces)
  • Materials (surface properties, textures)
  • Lighting (light sources, intensities)
  • Camera (viewpoint, projection)

2. Computer Graphics (Rendering)

The process of generating a digital image from the 3D scene description:

  • Input: Scene description
  • Output: 2D array of pixel values
  • Methods: Ray tracing, rasterisation

3. Image Display

Converting the digital image in memory into physical light output:

  • Monitor (CRT, LCD, OLED)
  • Projector
  • Print

4. Visual Perception

How the human eye and brain capture and process the displayed light to perceive the scene:

  • Photoreceptor response
  • Neural processing
  • Cognitive interpretation

5. Image Analysis and Computer Vision

The inverse of rendering: extracting a 3D scene description or understanding from digital images:

  • Object recognition
  • Depth estimation
  • Scene understanding

Forward vs Inverse Problems

Forward (Graphics): Scene → Image

  • Well-defined mathematical process
  • Rendering algorithms solve this

Inverse (Vision): Image → Scene

  • Ill-posed problem
  • Multiple scenes can produce the same image

Summary

  • The visual computing pipeline describes the flow from scene to perception
  • Computer graphics solves the forward problem (scene to image)
  • Computer vision solves the inverse problem (image to understanding)
  • Understanding the whole pipeline helps design better rendering algorithms