DL0021 Feature Map

What is the feature map in Convolutional Neural Networks?

Answer

A feature map is the output produced when one convolutional filter slides across its input: a 2D grid of activations whose values encode where and how strongly a specific pattern (an edge orientation, texture, or object part) appears at each spatial location. A convolutional layer applies many filters in parallel, so its output is a stack of feature maps, one per filter, forming the layer’s channels.

(1) Output of One Filter: Each feature map is generated by a single filter convolving over the input; the layer output stacks one map per filter, so 64 filters produce 64 channels.
(2) Location and Strength: A high activation at position (i, j) means the filter’s pattern (e.g., a vertical edge or a corner) is strongly present around that location.
(3) Evolving Semantics with Depth: Early maps respond to edges and textures, middle maps to parts and shapes, and deep maps to whole objects with class-specific meaning.

An input silhouette and three feature maps produced by different filters showing vertical edges, horizontal edges, and all edges highlighted at their spatial locations.

Figure 1: Three filters applied to the same input produce three different feature maps; each lights up where its own pattern (vertical, horizontal, or any edge) appears.

Mathematical Formulation:
y^{(c)}_{ij} = \sum_{a=1}^{k}\sum_{b=1}^{k}\sum_{d=1}^{C_{in}} w^{(c)}_{abd}\, x_{i+a,\, j+b,\, d} + b_c
\text{output shape} = (H_{out},\ W_{out},\ C_{out}), \quad C_{out} = \text{number of filters}

Where:

  • y^{(c)}_{ij} is the activation of feature map c at spatial position (i, j).
  • w^{(c)}_{abd} are the weights of filter c of size k \times k \times C_{in}; b_c is its bias.
  • x_{i+a,\, j+b,\, d} is the input activation; C_{in} and C_{out} are the input and output channel counts.

Hierarchical Representation: As activations flow deeper, each new feature map is computed from the previous layer’s maps, so neurons see progressively larger receptive fields and combine simpler patterns into richer ones, the foundation of a CNN’s representational power.

The same input shown with a fine low-level edge feature map, a coarser mid-level part feature map, and a blocky high-level object feature map illustrating the feature hierarchy.

Figure 2: Depth turns fine edges into parts and finally into an object-level representation. Resolution drops while semantic content rises.


Login to view more content


Log in to track your progress

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *