RTP
Audio and Video for the Internet
Published on 19. June 2003
Book
Hardback
432 pages
978-0-672-32249-5 (ISBN)
Description
The Real-time Transport Protocol (RTP) provides a framework for delivery of audio and video across IP networks with unprecedented quality and reliability. In RTP: Audio and Video for the Internet, Colin Perkins, a leader of the RTP standardization process in the IETF, offers readers detailed technical guidance for designing, implementing, and managing any RTP-based system. By bringing together crucial information that was previously scattered or difficult to find, Perkins has created an incredible resource that enables professionals to leverage RTP's benefits in a wide range of Voice-over IP (VoIP) and streaming media applications. He demonstrates how RTP supports audio/video transmission in IP networks, and shares strategies for maximizing performance, robustness, security, and privacy. Comprehensive, exceptionally clear, and replete with examples, this book is the definitive RTP reference for every audio/video application designer, developer, researcher, and administrator.
Key coverage includes: *RTP's goals, design philosophy, and relationships with other protocols *The psychology of human perception in the design of media delivery systems *RTP data transfer and control protocols, including framing, loss detection, reception quality feedback, and membership control *Media playout, timing, and synchronization, including lip synchronization *Mitigating network problems: error concealment, error correction, and congestion control *Optimizing performance over low-speed links: header compression, multiplexing, and tunneling *Integrating leading media codecs and standards into RTP systems *Securing RTP sessions: encryption, authentication, and the new secure RTP profile for wireless networks *Extensive references and practical examples throughout 0672322498B05092003
Key coverage includes: *RTP's goals, design philosophy, and relationships with other protocols *The psychology of human perception in the design of media delivery systems *RTP data transfer and control protocols, including framing, loss detection, reception quality feedback, and membership control *Media playout, timing, and synchronization, including lip synchronization *Mitigating network problems: error concealment, error correction, and congestion control *Optimizing performance over low-speed links: header compression, multiplexing, and tunneling *Integrating leading media codecs and standards into RTP systems *Securing RTP sessions: encryption, authentication, and the new secure RTP profile for wireless networks *Extensive references and practical examples throughout 0672322498B05092003
More details
Language
English
Place of publication
New Jersey
United States
Publishing group
Pearson Education (US)
Target group
College/higher education
Dimensions
Height: 181 mm
Width: 243 mm
Thickness: 33 mm
Weight
821 gr
ISBN-13
978-0-672-32249-5 (9780672322495)
Copyright in bibliographic data and cover images is held by Nielsen Book Services Limited or by the publishers or by their respective licensors: all rights reserved.
Schweitzer Classification
Person
Colin Perkins is a research assistant professor at the University of Southern California Information Sciences Institute, where his research interests include scaling Internet multimedia conferencing to support very large distributed meetings and to very high quality. From 1996 to 2000, he was a research fellow with the Department of Computer Science, University College, London, where he conducted research into advanced VoIP and IP-based videoconferencing technologies, and developed one of the earliest RTP teleconferencing implementations. He is co-chair of the Audio/Video Transport and Multiparty Multimedia Session Control working groups of the IETF, and has authored several RFC standards relating to RTP. He holds a Ph.D. in electronic engineering from the University of York.
0672322498AB05092003
0672322498AB05092003
Content
Preface.
Acknowledgements.
I. INTRODUCTION TO NETWORKED MULTIMEDIA.
1. An Introduction To RTP.
A Brief History of Audio/Video Networking.
Early Packet Voice and Video Experiments.
Audio and Video on the Internet.
ITU Standards.
Audio/Video Streaming.
A Snapshot of RTP.
Related Standards.
Overview of an RTP Implementation.
Behavior of an RTP Sender.
Behavior of an RTP Receiver.
Summary.
2. Voice And Video Communication Over Packet Networks.
TCP/IP and the OSI Reference Model.
Performance Characteristics of an IP Network.
Measuring IP Network Performance.
Average Packet Loss.
Packet Loss Patterns.
Packet Duplication.
Packet Corruption.
Network Transit Time.
Acceptable Packet Sizes.
Effects of Multicast.
Effects of Network Technologies.
Conclusions about Measured Characteristics.
Effects of Transport Protocols.
UDP/IP.
TCP/IP.
Requirements for Audio/Video Transport in Packet Networks.
Benefits of Packet-Based Audio/Video.
Summary.
II. MEDIA TRANSPORT USING RTP.
3. The Real-Time Transport Protocol.
Fundamental Design Philosophies of RTP.
Application-Level Framing.
The End-to-End Principle.
Achieving Flexibility.
Standard Elements of RTP.
The RTP Specification.
RTP Profiles.
RTP Payload Formats.
Optional Elements.
Related Standards.
Call Setup and Control.
Session Description.
Quality of Service.
Future Standards Development.
Summary.
4. RTP Data Transfer Protocol.
RTP Sessions.
The RTP Data Transfer Packet.
Header Elements.
Header Extensions.
Payload Headers.
Payload Data.
Packet Validation.
Translators and Mixers.
Translators.
Mixers.
Summary.
5. RTP Control Protocol.
Components of RTCP.
Transport of RTCP Packets.
RTCP Packet Formats.
RTCP RR: Receiver Reports.
RTCP SR: Sender Reports.
RTCP SDES: Source Description.
RTCP BYE: Membership Control.
RTCP APP: Application-Defined RTCP Packets.
Packing Issues.
Security and Privacy.
Packet Validation.
Participant Database.
Timing Rules.
Reporting Interval.
Basic Transmission Rules.
Forward Reconsideration.
Reverse Reconsideration.
BYE Reconsideration.
Comments on Reconsideration.
Common Implementation Problems.
Summary.
6. Media Capture, Playout, And Timing.
Behavior of a Sender.
Media Capture and Compression.
Audio Capture and Compression.
Video Capture and Compression.
Use of Prerecorded Content.
Generating RTP Packets.
Timestamps and the RTP Timing Model.
Fragmentation.
Payload Format-Specific Headers.
Behavior of a Receiver.
Packet Reception.
Receiving Data Packets.
Receiving Control Packets.
The Playout Buffer.
Basic Operation.
Playout Time Calculation.
Adapting the Playout Point.
Playout Adaptation for Audio with Silence Suppression.
Playout Adaptation for Audio without Silence Suppression.
Playout Adaptation for Video.
Decoding, Mixing, and Playout.
Decoding.
Audio Mixing.
Audio Playout.
Video Playout.
Summary.
7. Lip Synchronization.
Sender Behavior.
Receiver Behavior.
Synchronization Accuracy.
Summary.
III. ROBUSTNESS.
8. Error Concealment.
Techniques for Audio Loss Concealment.
Measuring Audio Quality.
Silence Substitution.
Noise Substitution.
Repetition.
Other Techniques for Repairing Speech Signals.
Techniques for Video Loss Concealment.
Motion-Compensated Repetition.
Other Techniques for Repairing Video.
Packet Loss.
Dependency Reduction.
Interleaving.
Summary.
9. Error Correction.
Forward Error Correction.
Parity FEC.
Unequal Error Protection.
Reed-Solomon Codes.
Audio Redundancy Coding.
Channel Coding.
Partial Checksum.
Reference Picture Selection.
Retransmission.
RTCP as a Framework for Retransmission.
Applicability.
Implementation Considerations.
At a Receiver.
At the Sender.
Summary.
10. Congestion Control.
The Need for Congestion Control.
Congestion Control on the Internet.
Implications for Multimedia.
Congestion Control for Multimedia.
TCP-Like Rate Control.
TCP-Friendly Rate Control.
Layered Coding.
Summary.
IV. ADVANCED TOPICS.
11. Header Compression.
Introductory Concepts.
Patterns, Robustness, and Local Implementation.
Standards.
Compressed RTP.
Operation of CRTP: Initialization and Context.
Operation of CRTP: Compression and Decompression.
Effects of Packet Loss.
Robust Header Compression.
Operation of ROHC: States and Modes.
Compression Efficiency.
Considerations for RTP Applications.
Summary.
12. Multiplexing And Tunneling.
The Motivation for Multiplexing.
Tunneling Multiplexed Compressed RTP.
Basic Concepts of TCRTP.
Implementing TCRTP.
Performance.
Other Approaches to Multiplexing.
GeRM.
Application-Specific Multiplexing.
Summary.
13. Security Considerations.
Privacy.
Confidentiality.
Confidentiality Features in the RTP Specification.
Confidentiality Using the Secure RTP Profile.
Confidentiality Using IP Security.
Other Considerations.
Authentication.
Authentication Using Standard RTP.
Authentication Using the Secure RTP Profile.
Authentication Using IP Security.
Replay Protection.
Denial of Service.
Mixers and Translators.
Active Content.
Other Considerations.
Summary.
References.
IETF RFC Standards.
IETF Internet-Drafts.
Other Standards.
Conference and Journal Papers.
Books.
Web Sites.
Other References.
Index. 0672322498T05222003
Acknowledgements.
I. INTRODUCTION TO NETWORKED MULTIMEDIA.
1. An Introduction To RTP.
A Brief History of Audio/Video Networking.
Early Packet Voice and Video Experiments.
Audio and Video on the Internet.
ITU Standards.
Audio/Video Streaming.
A Snapshot of RTP.
Related Standards.
Overview of an RTP Implementation.
Behavior of an RTP Sender.
Behavior of an RTP Receiver.
Summary.
2. Voice And Video Communication Over Packet Networks.
TCP/IP and the OSI Reference Model.
Performance Characteristics of an IP Network.
Measuring IP Network Performance.
Average Packet Loss.
Packet Loss Patterns.
Packet Duplication.
Packet Corruption.
Network Transit Time.
Acceptable Packet Sizes.
Effects of Multicast.
Effects of Network Technologies.
Conclusions about Measured Characteristics.
Effects of Transport Protocols.
UDP/IP.
TCP/IP.
Requirements for Audio/Video Transport in Packet Networks.
Benefits of Packet-Based Audio/Video.
Summary.
II. MEDIA TRANSPORT USING RTP.
3. The Real-Time Transport Protocol.
Fundamental Design Philosophies of RTP.
Application-Level Framing.
The End-to-End Principle.
Achieving Flexibility.
Standard Elements of RTP.
The RTP Specification.
RTP Profiles.
RTP Payload Formats.
Optional Elements.
Related Standards.
Call Setup and Control.
Session Description.
Quality of Service.
Future Standards Development.
Summary.
4. RTP Data Transfer Protocol.
RTP Sessions.
The RTP Data Transfer Packet.
Header Elements.
Header Extensions.
Payload Headers.
Payload Data.
Packet Validation.
Translators and Mixers.
Translators.
Mixers.
Summary.
5. RTP Control Protocol.
Components of RTCP.
Transport of RTCP Packets.
RTCP Packet Formats.
RTCP RR: Receiver Reports.
RTCP SR: Sender Reports.
RTCP SDES: Source Description.
RTCP BYE: Membership Control.
RTCP APP: Application-Defined RTCP Packets.
Packing Issues.
Security and Privacy.
Packet Validation.
Participant Database.
Timing Rules.
Reporting Interval.
Basic Transmission Rules.
Forward Reconsideration.
Reverse Reconsideration.
BYE Reconsideration.
Comments on Reconsideration.
Common Implementation Problems.
Summary.
6. Media Capture, Playout, And Timing.
Behavior of a Sender.
Media Capture and Compression.
Audio Capture and Compression.
Video Capture and Compression.
Use of Prerecorded Content.
Generating RTP Packets.
Timestamps and the RTP Timing Model.
Fragmentation.
Payload Format-Specific Headers.
Behavior of a Receiver.
Packet Reception.
Receiving Data Packets.
Receiving Control Packets.
The Playout Buffer.
Basic Operation.
Playout Time Calculation.
Adapting the Playout Point.
Playout Adaptation for Audio with Silence Suppression.
Playout Adaptation for Audio without Silence Suppression.
Playout Adaptation for Video.
Decoding, Mixing, and Playout.
Decoding.
Audio Mixing.
Audio Playout.
Video Playout.
Summary.
7. Lip Synchronization.
Sender Behavior.
Receiver Behavior.
Synchronization Accuracy.
Summary.
III. ROBUSTNESS.
8. Error Concealment.
Techniques for Audio Loss Concealment.
Measuring Audio Quality.
Silence Substitution.
Noise Substitution.
Repetition.
Other Techniques for Repairing Speech Signals.
Techniques for Video Loss Concealment.
Motion-Compensated Repetition.
Other Techniques for Repairing Video.
Packet Loss.
Dependency Reduction.
Interleaving.
Summary.
9. Error Correction.
Forward Error Correction.
Parity FEC.
Unequal Error Protection.
Reed-Solomon Codes.
Audio Redundancy Coding.
Channel Coding.
Partial Checksum.
Reference Picture Selection.
Retransmission.
RTCP as a Framework for Retransmission.
Applicability.
Implementation Considerations.
At a Receiver.
At the Sender.
Summary.
10. Congestion Control.
The Need for Congestion Control.
Congestion Control on the Internet.
Implications for Multimedia.
Congestion Control for Multimedia.
TCP-Like Rate Control.
TCP-Friendly Rate Control.
Layered Coding.
Summary.
IV. ADVANCED TOPICS.
11. Header Compression.
Introductory Concepts.
Patterns, Robustness, and Local Implementation.
Standards.
Compressed RTP.
Operation of CRTP: Initialization and Context.
Operation of CRTP: Compression and Decompression.
Effects of Packet Loss.
Robust Header Compression.
Operation of ROHC: States and Modes.
Compression Efficiency.
Considerations for RTP Applications.
Summary.
12. Multiplexing And Tunneling.
The Motivation for Multiplexing.
Tunneling Multiplexed Compressed RTP.
Basic Concepts of TCRTP.
Implementing TCRTP.
Performance.
Other Approaches to Multiplexing.
GeRM.
Application-Specific Multiplexing.
Summary.
13. Security Considerations.
Privacy.
Confidentiality.
Confidentiality Features in the RTP Specification.
Confidentiality Using the Secure RTP Profile.
Confidentiality Using IP Security.
Other Considerations.
Authentication.
Authentication Using Standard RTP.
Authentication Using the Secure RTP Profile.
Authentication Using IP Security.
Replay Protection.
Denial of Service.
Mixers and Translators.
Active Content.
Other Considerations.
Summary.
References.
IETF RFC Standards.
IETF Internet-Drafts.
Other Standards.
Conference and Journal Papers.
Books.
Web Sites.
Other References.
Index. 0672322498T05222003