RTP
Audio and Video for the Internet (paperback): Audio and Video for the Internet
Published on 14. June 2012
Book
Paperback/Softback
432 pages
978-0-321-83362-4 (ISBN)
More details
Person
Colin Perkins is a research assistant professor at the University of Southern California Information Sciences Institute, where his research interests include scaling Internet multimedia conferencing to support very large distributed meetings and to very high quality. From 1996 to 2000, he was a research fellow with the Department of Computer Science, University College, London, where he conducted research into advanced VoIP and IP-based videoconferencing technologies, and developed one of the earliest RTP teleconferencing implementations. He is co-chair of the Audio/Video Transport and Multiparty Multimedia Session Control working groups of the IETF, and has authored several RFC standards relating to RTP. He holds a Ph.D. in electronic engineering from the University of York.
0672322498AB05092003
0672322498AB05092003
Content
Preface.
Acknowledgements.
I. INTRODUCTION TO NETWORKED MULTIMEDIA.
1. An Introduction To RTP.
A Brief History of Audio/Video Networking.
Early Packet Voice and Video Experiments.
Audio and Video on the Internet.
ITU Standards.
Audio/Video Streaming.
A Snapshot of RTP.
Related Standards.
Overview of an RTP Implementation.
Behavior of an RTP Sender.
Behavior of an RTP Receiver.
Summary.
2. Voice And Video Communication Over Packet Networks.
TCP/IP and the OSI Reference Model.
Performance Characteristics of an IP Network.
Measuring IP Network Performance.
Average Packet Loss.
Packet Loss Patterns.
Packet Duplication.
Packet Corruption.
Network Transit Time.
Acceptable Packet Sizes.
Effects of Multicast.
Effects of Network Technologies.
Conclusions about Measured Characteristics.
Effects of Transport Protocols.
UDP/IP.
TCP/IP.
Requirements for Audio/Video Transport in Packet Networks.
Benefits of Packet-Based Audio/Video.
Summary.
II. MEDIA TRANSPORT USING RTP.
3. The Real-Time Transport Protocol.
Fundamental Design Philosophies of RTP.
Application-Level Framing.
The End-to-End Principle.
Achieving Flexibility.
Standard Elements of RTP.
The RTP Specification.
RTP Profiles.
RTP Payload Formats.
Optional Elements.
Related Standards.
Call Setup and Control.
Session Description.
Quality of Service.
Future Standards Development.
Summary.
4. RTP Data Transfer Protocol.
RTP Sessions.
The RTP Data Transfer Packet.
Header Elements.
Header Extensions.
Payload Headers.
Payload Data.
Packet Validation.
Translators and Mixers.
Translators.
Mixers.
Summary.
5. RTP Control Protocol.
Components of RTCP.
Transport of RTCP Packets.
RTCP Packet Formats.
RTCP RR: Receiver Reports.
RTCP SR: Sender Reports.
RTCP SDES: Source Description.
RTCP BYE: Membership Control.
RTCP APP: Application-Defined RTCP Packets.
Packing Issues.
Security and Privacy.
Packet Validation.
Participant Database.
Timing Rules.
Reporting Interval.
Basic Transmission Rules.
Forward Reconsideration.
Reverse Reconsideration.
BYE Reconsideration.
Comments on Reconsideration.
Common Implementation Problems.
Summary.
6. Media Capture, Playout, And Timing.
Behavior of a Sender.
Media Capture and Compression.
Audio Capture and Compression.
Video Capture and Compression.
Use of Prerecorded Content.
Generating RTP Packets.
Timestamps and the RTP Timing Model.
Fragmentation.
Payload Format-Specific Headers.
Behavior of a Receiver.
Packet Reception.
Receiving Data Packets.
Receiving Control Packets.
The Playout Buffer.
Basic Operation.
Playout Time Calculation.
Adapting the Playout Point.
Playout Adaptation for Audio with Silence Suppression.
Playout Adaptation for Audio without Silence Suppression.
Playout Adaptation for Video.
Decoding, Mixing, and Playout.
Decoding.
Audio Mixing.
Audio Playout.
Video Playout.
Summary.
7. Lip Synchronization.
Sender Behavior.
Receiver Behavior.
Synchronization Accuracy.
Summary.
III. ROBUSTNESS.
8. Error Concealment.
Techniques for Audio Loss Concealment.
Measuring Audio Quality.
Silence Substitution.
Noise Substitution.
Repetition.
Other Techniques for Repairing Speech Signals.
Techniques for Video Loss Concealment.
Motion-Compensated Repetition.
Other Techniques for Repairing Video.
Packet Loss.
Dependency Reduction.
Interleaving.
Summary.
9. Error Correction.
Forward Error Correction.
Parity FEC.
Unequal Error Protection.
Reed-Solomon Codes.
Audio Redundancy Coding.
Channel Coding.
Partial Checksum.
Reference Picture Selection.
Retransmission.
RTCP as a Framework for Retransmission.
Applicability.
Implementation Considerations.
At a Receiver.
At the Sender.
Summary.
10. Congestion Control.
The Need for Congestion Control.
Congestion Control on the Internet.
Implications for Multimedia.
Congestion Control for Multimedia.
TCP-Like Rate Control.
TCP-Friendly Rate Control.
Layered Coding.
Summary.
IV. ADVANCED TOPICS.
11. Header Compression.
Introductory Concepts.
Patterns, Robustness, and Local Implementation.
Standards.
Compressed RTP.
Operation of CRTP: Initialization and Context.
Operation of CRTP: Compression and Decompression.
Effects of Packet Loss.
Robust Header Compression.
Operation of ROHC: States and Modes.
Compression Efficiency.
Considerations for RTP Applications.
Summary.
12. Multiplexing And Tunneling.
The Motivation for Multiplexing.
Tunneling Multiplexed Compressed RTP.
Basic Concepts of TCRTP.
Implementing TCRTP.
Performance.
Other Approaches to Multiplexing.
GeRM.
Application-Specific Multiplexing.
Summary.
13. Security Considerations.
Privacy.
Confidentiality.
Confidentiality Features in the RTP Specification.
Confidentiality Using the Secure RTP Profile.
Confidentiality Using IP Security.
Other Considerations.
Authentication.
Authentication Using Standard RTP.
Authentication Using the Secure RTP Profile.
Authentication Using IP Security.
Replay Protection.
Denial of Service.
Mixers and Translators.
Active Content.
Other Considerations.
Summary.
References.
IETF RFC Standards.
IETF Internet-Drafts.
Other Standards.
Conference and Journal Papers.
Books.
Web Sites.
Other References.
Index. 0672322498T05222003
Acknowledgements.
I. INTRODUCTION TO NETWORKED MULTIMEDIA.
1. An Introduction To RTP.
A Brief History of Audio/Video Networking.
Early Packet Voice and Video Experiments.
Audio and Video on the Internet.
ITU Standards.
Audio/Video Streaming.
A Snapshot of RTP.
Related Standards.
Overview of an RTP Implementation.
Behavior of an RTP Sender.
Behavior of an RTP Receiver.
Summary.
2. Voice And Video Communication Over Packet Networks.
TCP/IP and the OSI Reference Model.
Performance Characteristics of an IP Network.
Measuring IP Network Performance.
Average Packet Loss.
Packet Loss Patterns.
Packet Duplication.
Packet Corruption.
Network Transit Time.
Acceptable Packet Sizes.
Effects of Multicast.
Effects of Network Technologies.
Conclusions about Measured Characteristics.
Effects of Transport Protocols.
UDP/IP.
TCP/IP.
Requirements for Audio/Video Transport in Packet Networks.
Benefits of Packet-Based Audio/Video.
Summary.
II. MEDIA TRANSPORT USING RTP.
3. The Real-Time Transport Protocol.
Fundamental Design Philosophies of RTP.
Application-Level Framing.
The End-to-End Principle.
Achieving Flexibility.
Standard Elements of RTP.
The RTP Specification.
RTP Profiles.
RTP Payload Formats.
Optional Elements.
Related Standards.
Call Setup and Control.
Session Description.
Quality of Service.
Future Standards Development.
Summary.
4. RTP Data Transfer Protocol.
RTP Sessions.
The RTP Data Transfer Packet.
Header Elements.
Header Extensions.
Payload Headers.
Payload Data.
Packet Validation.
Translators and Mixers.
Translators.
Mixers.
Summary.
5. RTP Control Protocol.
Components of RTCP.
Transport of RTCP Packets.
RTCP Packet Formats.
RTCP RR: Receiver Reports.
RTCP SR: Sender Reports.
RTCP SDES: Source Description.
RTCP BYE: Membership Control.
RTCP APP: Application-Defined RTCP Packets.
Packing Issues.
Security and Privacy.
Packet Validation.
Participant Database.
Timing Rules.
Reporting Interval.
Basic Transmission Rules.
Forward Reconsideration.
Reverse Reconsideration.
BYE Reconsideration.
Comments on Reconsideration.
Common Implementation Problems.
Summary.
6. Media Capture, Playout, And Timing.
Behavior of a Sender.
Media Capture and Compression.
Audio Capture and Compression.
Video Capture and Compression.
Use of Prerecorded Content.
Generating RTP Packets.
Timestamps and the RTP Timing Model.
Fragmentation.
Payload Format-Specific Headers.
Behavior of a Receiver.
Packet Reception.
Receiving Data Packets.
Receiving Control Packets.
The Playout Buffer.
Basic Operation.
Playout Time Calculation.
Adapting the Playout Point.
Playout Adaptation for Audio with Silence Suppression.
Playout Adaptation for Audio without Silence Suppression.
Playout Adaptation for Video.
Decoding, Mixing, and Playout.
Decoding.
Audio Mixing.
Audio Playout.
Video Playout.
Summary.
7. Lip Synchronization.
Sender Behavior.
Receiver Behavior.
Synchronization Accuracy.
Summary.
III. ROBUSTNESS.
8. Error Concealment.
Techniques for Audio Loss Concealment.
Measuring Audio Quality.
Silence Substitution.
Noise Substitution.
Repetition.
Other Techniques for Repairing Speech Signals.
Techniques for Video Loss Concealment.
Motion-Compensated Repetition.
Other Techniques for Repairing Video.
Packet Loss.
Dependency Reduction.
Interleaving.
Summary.
9. Error Correction.
Forward Error Correction.
Parity FEC.
Unequal Error Protection.
Reed-Solomon Codes.
Audio Redundancy Coding.
Channel Coding.
Partial Checksum.
Reference Picture Selection.
Retransmission.
RTCP as a Framework for Retransmission.
Applicability.
Implementation Considerations.
At a Receiver.
At the Sender.
Summary.
10. Congestion Control.
The Need for Congestion Control.
Congestion Control on the Internet.
Implications for Multimedia.
Congestion Control for Multimedia.
TCP-Like Rate Control.
TCP-Friendly Rate Control.
Layered Coding.
Summary.
IV. ADVANCED TOPICS.
11. Header Compression.
Introductory Concepts.
Patterns, Robustness, and Local Implementation.
Standards.
Compressed RTP.
Operation of CRTP: Initialization and Context.
Operation of CRTP: Compression and Decompression.
Effects of Packet Loss.
Robust Header Compression.
Operation of ROHC: States and Modes.
Compression Efficiency.
Considerations for RTP Applications.
Summary.
12. Multiplexing And Tunneling.
The Motivation for Multiplexing.
Tunneling Multiplexed Compressed RTP.
Basic Concepts of TCRTP.
Implementing TCRTP.
Performance.
Other Approaches to Multiplexing.
GeRM.
Application-Specific Multiplexing.
Summary.
13. Security Considerations.
Privacy.
Confidentiality.
Confidentiality Features in the RTP Specification.
Confidentiality Using the Secure RTP Profile.
Confidentiality Using IP Security.
Other Considerations.
Authentication.
Authentication Using Standard RTP.
Authentication Using the Secure RTP Profile.
Authentication Using IP Security.
Replay Protection.
Denial of Service.
Mixers and Translators.
Active Content.
Other Considerations.
Summary.
References.
IETF RFC Standards.
IETF Internet-Drafts.
Other Standards.
Conference and Journal Papers.
Books.
Web Sites.
Other References.
Index. 0672322498T05222003