Introduction To Digital Signal Processing
Introduction To Digital Signal Processing
Introduction to
Course Syllabus
Introduction: What is DSP, brief history of the topic, applications. Continuous-time (CT) and Discrete-time (DT) signals: analog versus digital signals. Interpolation and Sampling: Continuous-time (CT) signals, interpolation, sampling. The sampling theorem as orthonormal basis expansion. Processing of CT signals in DT. Statistics, Probability, and Noise: stochastic signal processing and quantization; signal processing as geometry, vectors spaces, bases, approximations. The Z-transform: characterization of DT signals and systems; response of a linear time-invariant (LTI) system to an arbitrary excitation; Fourier Analysis: The discrete Fourier transform (DFT) and series (DFS). The discrete-time Fourier transform (DTFT) and the fast Fourier transform (FFT). Linear Filters: Linear time-invariant systems, convolution, ideal and realizable filters. Filter design and implementation. Digital Filters: FIR and IIR filter structures. Analog-to-Digital (ADC) and Digitalto-Analog (DCA) converters. Digital Communication Systems: Analog channels and bandwidth/power constraints. Modulation and demodulation. Transmitter and receiver design. Image Processing: Introduction to image processing and two-dimensional (2D) Fourier analysis. Filtering and compression. The JPEG compression standard.
DSP Applications
DSP Applications
DSPhasrevolutionizedmanyareasinscienceandengineering. Afewofthesediverseapplicationsareshownabove.
Interdisciplinarity of DSP
Variance Mean
Ratio of the peak-to-peak amplitude Vpp to the standard deviation for several common waveforms. For the square wave, this ratio is 2; for the triangle wave it is 3.46; for the sine wave it is ~2.86 . While random noise has no exact peakto-peak (pp) value, it is approximately 6 to 8 times the standard deviation .
Nonstationary Processes
Signals generated from nonstationary processes. Both the mean and standard deviation are variable (a). The standard deviation remains constant (e.g., one), whereas the mean changes from a 0 to 2 (b). It is a common analysis approach to break these signals into short segments, and calculate the statistics of each segment individually.
If N is small, the statistical noise in the calculated mean will be very large. In other words, you do not have access to enough data to properly characterize the process. The larger the value of N, the smaller the expected error will become. A milestone in probability theory, the Strong Law of Large Numbers, guarantees that the error becomes zero as N approaches infinity.
Histograms
Figure (a) shows 128 samples from a very long signal, with each sample being an integer between 0 and 255. Figures (b) and (c) show histograms using 128 and 256,000 samples from the signal, respectively. Histograms are smoother when more samples are used.
If.
The the statistical noise (roughness) of the histogram is inversely proportional to the square root of the number of samples used. The histogram is formed from an acquired signal. The corresponding curve for the underlying process is called the probability mass function (pmf). Histograms are always calculated using a finite number of samples, while the pmf is what would be obtained with an infinite number of samples. The histogram and the pmf are used with discrete data only. A similar concept applies to continuous signals, such as voltages in analog electronics. The probability density function (pdf), also called the probability distribution function, is to continuous signals what the pmf is to discrete signals.
The relationship between (a) the histogram, (b) the probability mass function (pmf), and (c) the probability density function (pdf). The histogram is calculated from a finite number of samples. The pmf describes the probabilities of the underlying process. The pdf is similar to the pmf, but it is used with continuous rather than discrete signals.
The signal is 300 samples long, with each sample a floating point number uniformly distributed between 1 and 3. Figures (b) and (c) show binned histograms, using 601 and 9 bins, respectively. A large number of bins results in poor resolution along the vertical axis, while a small number of bins provides poor resolution along the horizontal axis