Joint Source-Channel Coding

Preface xi
 
1 Introduction and Background 1
 
1.1 Simplified Model for a Communication System 2
 
1.2 Entropy and Information 3
 
1.3 Introduction to Source Coding 6
 
1.3.1 Sampling and Quantization of Signals 6
 
1.3.2 Source Coding of Quantized Signals 9
 
1.3.3 Distortion and Rate-distortion Theory 13
 
1.4 Channels, Channel Coding, and Capacity 17
 
1.4.1 Channel Models 17
 
1.4.2 Wireless Channels 19
 
1.4.3 Channel Coding and Channel Capacity 23
 
1.5 Layered Model for a Communication System 26
 
1.6 Distortion, Quality of Service, and Quality of Experience 30
 
1.6.1 Objective Measurements of Distortion or Quality 31
 
1.6.2 Subjective and Perceptually Based Measurements of Distortion or Quality 32
 
1.7 Shannon's Separation Principle and Joint Source-Channel Coding 36
 
1.8 Major Classes of Joint Source-Channel Coding Techniques 40
 
References 42
 
2 Source Coding and Signal Compression 43
 
2.1 Types of Sources 43
 
2.2 Lossless Compression 46
 
2.2.1 Entropy Coding 47
 
2.2.2 Predictive Coding 52
 
2.3 Lossy Compression 54
 
2.3.1 Quantization 54
 
2.3.2 Differential Coding 62
 
2.3.3 Transform Coding 63
 
2.3.4 Subband and Wavelet Coding 65
 
2.4 Embedded and Layered Coding 68
 
2.5 Coding of Practical Sources 71
 
2.5.1 Image Coding - JPEG 71
 
2.5.2 Embedded Image Coding - SPIHT 75
 
2.5.3 Video Coding 78
 
2.5.4 Speech Coding 83
 
References 86
 
3 Channel Coding 87
 
3.1 Linear Block Codes 87
 
3.1.1 Binary Linear Block Codes 90
 
3.1.2 Generator Matrix, Parity-Check Matrix, and Syndrome Testing 91
 
3.1.3 Common Linear Block Codes 92
 
3.1.4 Error and Erasure Correction with Block Codes 95
 
3.2 Convolutional Codes 97
 
3.2.1 Code Characterization:

Andres Kwasinski, Rochester Institute of Technology, USA
 
Dr. Kwasinski received his Ph.D. degree in Electrical and Computer Engineering from the University of Maryland in 2004. He is currently a Professor with the Department of Computer Engineering, Rochester Institute of Technology, Rochester, New York. Prior to this he was with Texas Instruments Inc., the Department of Electrical and Computer Engineering at the University of Maryland, and Lucent Technologies. Dr. Kwasinski has been a member of the IEEE Signal Processing Magazine Editorial Board, as Associate Editor and Area Editor for over twelve years. He was Editor for the IEEE Transactions on Wireless Communications and IEEE Wireless Communications Letters, the Globecom 2010 Workshop Co-Chair and the Chair of the IEEE Multimedia Technical Committee Interest Group on Distributed and Sensor Networks for Mobile Media Computing and Applications. He is a Senior Member of the IEEE.
 
Vinay Chande, Qualcomm Inc., USA
 
Vinay Chande has a Ph.D. in Electrical Engineering from the University of Maryland and his engineering education from Indian Institute of Technology, Mumbai. Dr. Chande works as a Systems Engineer at Wireless Research and Development at Qualcomm Technologies Inc. His current work gives him an opportunity to participate in and witness the advances in millimeter-wave radio bands, unlicensed spectrum access and machine learning for Industrial IoT.