1
This final section of the chapter covers random signals and processes, key noise models (white noise, thermal noise, bandlimited white noise), and the power spectral density and autocorrelation function used to characterize them.
2
Random Signals & Processes A random signal (stochastic process) cannot be predicted exactly in advance; it is described statistically by properties such as mean, variance, and correlation, rather than by a deterministic formula.
3
A process is stationary if its statistical properties do not change over time; it is wide-sense stationary (WSS) if its mean is constant and its autocorrelation depends only on the time difference between samples, not on absolute time.
4
Ergodicity: a process is ergodic if its time averages (computed from a single sample function) equal its ensemble (statistical) averages — a convenient property allowing practical measurement of statistics from a single observed record.
5
Noise Models Noise Type Description White noise An idealized noise model with constant (flat) power spectral density across all frequencies; theoretically infinite total power, used as a convenient analytical approximation Thermal noise Physical noise arising from random electron motion due to temperature; well-approximated as white noise over practical bandwidths, with power spectral density proportional to temperature Bandlimited white noise White noise passed through an ideal bandpass/lowpass filter, giving it finite (realistic) total power while retaining a flat spectrum within the passband PSD & Autocorrelation Function Power Spectral Density (PSD): describes how a random signal's average power is distributed across frequency; for white noise, the PSD is a constant, S(f) = N₀/2 across all frequencies.
6
Autocorrelation function (AC function): measures how similar a random process is to a time-shifted version of itself, R(τ) = E[X(t)X(t+τ)]; for a WSS process, it depends only on the lag τ.
7
The Wiener-Khinchin theorem relates PSD and autocorrelation: the PSD is the Fourier transform of the autocorrelation function.
8
For ideal white noise, the autocorrelation is an impulse at τ=0 (R(τ) = (N₀/2)δ(τ)), reflecting that samples are uncorrelated for any nonzero time separation.