Part IA Michaelmas Term
Visual Computing Pipeline
Overview
The course is structured around the Visual Computing Pipeline, which describes how visual information flows between the physical world, computers, and human observers:
Pipeline Stages
1. Scene Description
The mathematical model of the 3D scene:
- Geometry (objects, shapes, surfaces)
- Materials (surface properties, textures)
- Lighting (light sources, intensities)
- Camera (viewpoint, projection)
2. Computer Graphics (Rendering)
The process of generating a digital image from the 3D scene description:
- Input: Scene description
- Output: 2D array of pixel values
- Methods: Ray tracing, rasterisation
3. Image Display
Converting the digital image in memory into physical light output:
- Monitor (CRT, LCD, OLED)
- Projector
4. Visual Perception
How the human eye and brain capture and process the displayed light to perceive the scene:
- Photoreceptor response
- Neural processing
- Cognitive interpretation
5. Image Analysis and Computer Vision
The inverse of rendering: extracting a 3D scene description or understanding from digital images:
- Object recognition
- Depth estimation
- Scene understanding
Forward vs Inverse Problems
Forward (Graphics): Scene → Image
- Well-defined mathematical process
- Rendering algorithms solve this
Inverse (Vision): Image → Scene
- Ill-posed problem
- Multiple scenes can produce the same image
Summary
- The visual computing pipeline describes the flow from scene to perception
- Computer graphics solves the forward problem (scene to image)
- Computer vision solves the inverse problem (image to understanding)
- Understanding the whole pipeline helps design better rendering algorithms