多媒体计算 通信与应用
2002-1
人民邮电出版社
斯坦梅茨
854
1085000
本书从多媒体部件、系统和应用三个主要方面来阐述，内容系统、丰富、全面，从操作系统和硬件到用户界面、应用和编程采样，覆盖了包括新领域在内的许多重要的主题。本书由18章构成：前5章介绍了多媒体、媒体等概念及数据流的特点，具体讲述了声音/音频、图像和图形、视频和动画的基本概念、构成和表示方法；第6章概括了对音频和视频数据的存储，进行数据压缩的原因及实现数据压缩的编码方法(如DCT等)；第7、8章介绍了光存储介质和计算机技术；第9章详细讲述了资源和进程管理，给出了大量实时处理的主要算法；第10章概述了网络系统的层、协议、服务及网络的分类，也介绍了局域网、广域网和城域网的特点、分类和组成；第11章论述了在应用层子系统和传输层子系统中如何实现多媒体通信，如何实现QoS和资源管理；第12章简单描述了多媒体数据库的组成和管理；第13章通过利用ODA、SGML、超文本和超媒体及MHEG对文档体系结构进行了分析；第14章引入了多媒体的一个重要内容，即多媒体交互界面的设计；第15章较为详细地描述了多媒体系统的核心--多媒体同步问题，包括同步的构想、要求以及一个多媒体同步的参考模型等；第16章的内容是编程抽象，详细概述了诸如库、系统软件、高级过程编程语言和面向对象方法的抽象层次；最后在第17、18章，讲述了多媒体在媒体成分制作与合成、媒体通信及娱乐等方面的应用和多媒体未来的发展方向。 本书既可作为高校相关专业多媒体课程的教材，又可作为在此领域工作的各类人员的参考资料。
1 Introduction1.1 Branch-overlapping Aspects of Multimedia 1.2 Content 1.3 Global Structure 1.4 Multimedia Literature 2 Multimedia：Media and Data Streams 2.1 Medium 2.1.1 The Perception Medium 2.1.2 The Representation Medium 2.1.3 The Presentation Medium 2.1.4 The Storage Medium 2.1.5 The Transmission Medium 2.1.6 The Information Exchange Medium 2.1.7 Representation Values and Representation Spaces 2.1.8 Representation Dimensions 2.2 Main Properties of a Multimedia System 2.2.1 Multimedia System Definition 2.2.2 Combination of Media 2.2.3 Independence 2.2.4 Computer-supported Integration 2.2.5 Communication Systems 2.3 Multimedia 2.4 Traditional Data Streams Characteristics 2.4.1 Asynchronous Transmission Mode 2.4.2 Synchronous Transmission Mode 2.4.3 Isochronous Transmission Mode 2.5 Data Stream Characteristics for Continuous Media 2.5.1 The Time Interval Between a Complete Transmission of Consecutive Packets 2.5.2 Variation of Consecutive Packet Amount 2.5.3 Contiguous Packets 2.6 Information Units 3 Sound/Audio 3.1 Basic Sound Concepts 3.1.1 Computer Representation of Sound 3.1.2 Audio Formats 3.2 Music 3.2.1 MIDI Basic Concepts 3.2.2 MIDI Devices 3.2.3 MIDI Messages 3.2.4 MIDI and SMPTE Timing Standards 3.2.5 MIDI Software 3.3 Speech 3.3.1 Speech Generation 3.3.2 Speech Analysis 3.3.3 Speech Transmission 4 Images and Graphics 4.1 Basic Concepts 4.1.1 Digital Image Representation 4.1.2 Image Format 4.2 Computer Image Processing 4.2.1 Image Synthesis 4.2.2 Image Analysis 4.2.3 Image Transmission 4.3 Comments 5 Video and Animation 5.1 Basic Concepts 5.1.1 Video Signal Representation 5.1.2 Computer Video Format 5.2 Television 5.2.1 Conventional Systems 5.2.2 Enhanced Definition Systems 5.2.3 High-Definition Systems 5.2.4 Transmission 5.3 Computer-based Animation 5.3.1 Basic Concepts 5.3.2 Animation Languages 5.3.3 Methods of Controlling Animation 5.3.4 Display of Animation 5.3.5 Transmission of Animation 5.3.6 Comments 6 Data Compression 6.1 Storage Space 6.2 Coding Requirements 6.3 Source，Entropy and Hybrid Coding 6.4 Some Basic Compression Techniques 6.5 JPEG 6.5.1 Image Preparation 6.5.2 Lossy Sequential DCT-based Mode 6.5.3 Expanded Lossy DCT-based Mode 6.5.4 Lossless Mode 6.5.5 Hierarchical Mode 6.6 H.261(px64) 6.6.1 Image Preparation 6.6.2 Coding Algorithms 6.6.3 Data Stream 6.7 MPEG 6.7.1 Video Encoding 6.7.2 Audio Encoding 6.7.3 Data Stream 6.7.4 MPEG-2 6.7.5 MPEG-4 6.8 DVI 6.8.1 Video Encoding 6.8.3 Data Stream 6.9 Comments 7 Optical Storage Media 7.1 History 7.2 Basic Technology 7.3 Video Disks and Other WORMs 7.4 Compact Disk Digital Audio 7.4.1 Preliminary Technical Background 7.4.2 Eight-to-Fourteen Modulation 7.4.3 Error Handling 7.4.4 Frames，Tracks，Areas and Blocks of a CD-DA 7.4.5 Advantages of Digital CD-DA Technology 7.5 Compact Disk Read Only Memory 7.5.1 Blocks 7.5.2 Modes 7.5.3 Logical Data Format 7.5.4 Limitations of the CD-ROM Technology 7.6 CD-ROM Extended Architecture 7.6.1 Form 1 and Form 2 7.6.2 Compressed Data of Different Media 7.7 Further CD-ROM-based Developments 7.7.1 Compact Disk Interactive 7.7.2 Compact Disk Interactive Ready Format 7.7.3 Compact Disk Bridge Disk 7.7.5 Digital Video Interactive 7.8 Compact Disk Write Once 7.8.1 Principle of the CD-WO 7.8.2 Sessions 7.9 Compact Disk Magneto Optical 7.9.1 Principle of the magnetic-Optical Method 7.9.2 Areas of the CD-MO 8 Computer Technology 8.1 Communication Architecture 8.1.1 Hybrid Systems 8.1.2 Digital Systems 8.2 Multimedia Workstation 8.3 Comments 9 Multimedia Operating Systems 9.1 Introduction 9.2 Real Time 9.2.1 The Notion of “Real-Time” 9.2.2 Real Time and Multimedia 9.3 Resource Management 9.3.1 Resources 9.3.2 Requirements 9.3.3 Components and Phases 9.3.4 Allocation Scheme 9.3.5 Continuous Media Resource Model 9.4 Process Management 9.4.1 Real Time Process Management in Conventional Operating Systems：An Example 9.4.2 Real-time Processing Requirements 9.4.3 Traditional Real-time Scheduling 9.4.4 Real-time Scheduling：Systim Model 9.4.5 Earliest Deadline First Algorithm 9.4.6 Rate Monotonic Algorithm 9.4.7 EDF and Rate Monotonic：Context switches 9.4.8 EDF and Rate Monotonic：Processor Utilizations 9.4.9 Extensions to Rate Monotonic Scheduling 9.4.10 Other Approaches for In-Time Scheduling 9.4.11 Preemptive versus Non-preemptive Task Scheduling 9.4.12 Scheduling of Continuous Media Tasks：Prototype Operating Systems 9.5 File Systems 9.5.1 Traditional File Systems 9.5.2 Multimedia File Systems 9.6 Additional Operating System Issues 9.6.1 Additional Operating System Issues 9.6.2 Memory Management 9.6.3 Device Management 9.7 System Architecture 9.7.1 UNIX-based Systems 9.7.2 QuickTime 9.7.3 Windows Multimedia Extensions 9.7.4 OS/2 Multimedia Presentation Manager/2 9.8 Concluding Remarks 10 Networking Systems 10.1 Layers，Protocols and Services 10.2 Networks 10.3 Local Area Networks(LANs)10.3.1 High-speed Ethernet 10.3.2 Token Ring 10.3.3 FDDI 10.3.4 Local ATM Networks 10.4 Metropolitan Area Networks(MANs) 10.4.1 Distributed Queue Dual Bus(DQDB) 10.4.2 Orwell 10.4.3 MAN Connectivity to ATM Networks 10.5 Wide Area Networks(WANs) 10.5.1 Traditional WAN's 10.5.2 B-ISDN:ATM 10.6 Conclusion 11 Multimedia Communication Systems 11.1 Application Subsystem 11.1.1 Collaborative Computing 11.1.2 Session Management 11.2 Transport Subsystem 11.2.1 Requirements 11.2.2 Transport Layer 11.2.3 Network Layer 11.3 Quality of Service and Resource Management 11.3.1 Basic Concepts 11.3.2 Establishment and Closing of the Multimedia call 11.3.3 Managing Resources during Multimedia Transmission 11.3.4 Architectural Issues 11.4 Comments 11.4.1 Trends in Collaborative Computing 11.4.2 Trends in Transport Systems 12 Database Systems 12.1 Multimedia Database Management System 12.2 Characteristics of an MDBMS 12.3 Data Analysis 12.4 Data Structure 12.4.1 Raw Data 12.4.2 Registering Data 12.4.3 Descriptive Data 12.4.4 Examples of Multimedia Structures 12.4.5 Comments on Data Analysis 12.5 Operations on Data 12.6 Integration in a Database Model 12.6.1 Relational Database Model 12.6.2 Object-oriented Database Model 12.7 Comments 13 Documents，Hypertext and MHEG 13.1 Documents 13.1.1 Document Architecture 13.1.2 Manipulation of Multimedia Data 13.2 Hypertext and Hypermedia 13.2.1 Hypertext，Hypermedia and Multimedia 13.2.2 Hypermedia Systems：An Example 13.2.3 History 13.2.4 Systems：Architecture，Nodes and Pointers 13.2.5 Some Final Comments about Hypertext Systems 13.3 Document Architecture SGML 13.3.1 Some Details 13.3.2 SGML and Multimedia 13.3.3 Closing Comments about SGML 13.4 Document Architecture ODA 13.4.1 Some Details on ODA 13.4.2 ODA and Multimedia 13.5 MHEG 13.5.1 Example of an Interactive Multimedia Presentation 13.5.2 Derivation of a Class Hierarchy 13.5.3 Contents 13.5.4 Behavior 13.5.5 User Interaction 13.5.6 Container 13.5.7 Closing Comments 14 User Interfaces 14.1 General Design Issues 14.1.1 Architectural Issues 14.1.2 Information Characteristics for Presentation 14.1.3 Presentation Function 14.1.4 Presentation Design Knowledge 14.1.5 Effective Human-Computer Interaction 14.2 Current Work 14.3 Extension through Video and Audio 14.4 Video at the User Interface 14.4.1 Hardware for Visualization of Motion Pictures 14.4.2 Example：Remote Camera Control Application 14.5 Audio at the User Interface 14.6 User-friendliness as the Primary Goal 14.6.1 Easy to Learn Instructions 14.6.2 Context-sensitive Help Functions 14.6.3 Easy to Remember Instructions 14.6.4 Effective Instructions 14.6.5 Aesthetics 14.6.6 Effective Implementation Support 14.6.7 Entry Elements 14.6.8 Meaningful Location of Functions 14.6.9 Presentation 14.6.10 Dialogue Boxes 14.6.11 Additional Design Criteria 14.6.12 Design-specific Criteria 14.7 Comments 15 Synchronization 15.1 Introduction 15.2 Notion of Synchronization 15.2.1 Multimedia Systems 15.2.2 Basic Synchronization Issues 15.2.3 Intra-and Inter-object Synchronization 15.2.4 Live and Synthetic Synchronization 15.2.5 Comment 15.3 Presentation Requirements 15.3.1 Lip Synchronization Requirements 15.3.3 Elementary Media Synchronization 15.4 A Reference Model for Multimedia Synchronization 15.4.1 Existing Classification Approaches 15.4.2 The Synchronization Reference Model 15.4.3 Synchronization in a Distributed Environment 15.4.4 Aggregate Characteristics of the Synchronization Reference Model 15.5 Synchronization Specification 15.5.1 Quality of Service 15.5.2 Multimedia Synchronization Specification Methods 15.5.3 Interval-based Specifications 15.5.4 Axes-based Synchronization 15.5.5 Control Flow-based Specification 15.5.6 Event-based Synchronization 15.5.7 Scripts 15.5.8 Comment 15.6 Case Studies 15.6.1 Synchronization in MHEG 15.6.2 HyTime 15.6.3 Firefly System 15.6.4 MODE 15.6.5 Multimedia Tele-orchestra 15.6.6 Littles Framework 15.6.7 ACME 15.6.8 Further Synchronization-related Systems 15.6.9 Comment 15.7 Summary and Outlook 15.7.1 Summary 15.7.2 Future Topics 15.7.3 Conclusion 16 Abstractions for Programming 16.1 Abstraction Levels 16.2 Libraries 16.3 System Software 16.3.1 Data as Time Capsules 16.3.2 Data as Streams 16.4 Toolkits 16.5 Higher Programming Languages 16.5.1 Media as Types 16.5.2 Media as Files 16.5.3 Media as Processes 16.5.4 Programming Language Requirements 16.6 Object-oriented Approaches 16.6.1 Application-specific Metaphors as Classes 16.6.2 Application-generic Metaphors as Classes 16.6.3 Devices as Classes 16.6.4 Processing Units as Classes 16.6.5 Media as Classes 16.6.6 Communication-specific Metaphors as Classes 16.7 Comments 17 Multimedia Applications 17.1 Introduction 17.1.1 Programs 17.1.2 Structure 17.2 Media Preparation 17.2.2 Remarks on the Current Status 17.3 Media Composition 17.3.1 Text and Graphics Editors 17.3.2 Image Editors 17.3.3 Animation Editors 17.3.4 Sound Editors 17.3.5 Video Editors 17.4 Media Integration 17.4.1 Multimedia Editors 17.4.2 Hypermedia/Hypertext Editors 17.4.3 Authoring Tools 17.5 Media Communication 17.5.1 Tele-Services 17.5.2 Implementation of Conversational Services 17.5.3 Implementation of Messaging Services 17.5.4 Implementation of Retrieval Services 17.5.5 Implementation of Tele-action Services 17.5.6 Implementation of Tele-operation Services 17.5.7 Applications of Tele-services 17.6 Media Consumption 17.6.1 Viewing Multimedia Documents 17.6.2 Books：Proceedings and Newspapers 17.6.3 Kiosks 17.6.4 Tele-shopping 17.7 Media Entertainment 17.7.1 Virtual Reality 17.7.2 Interactive Video 17.7.3 Interactive Audio 17.7.4 Games 17.8 Trends 18 Future Directions 18.1 Where Are We Today? 18.1.1 User Interface 18.1.2 Operating Systems 18.1.3 Multimedia Documents 18.1.4 Synchronization 18.1.5 Programming 18.2 What Are the Next Steps? 18.2.1 Devices 18.2.2 Visualization 18.2.3 Mobility 18.2.4 Interactivity 18.2.5 Operating Systems 18.2.6 Further Issues in Virtual Environments 18.2.7 Multimedia User Interface 18.2.8 Hypermedia 18.2.9 Multimedia Applications 18.3 What Are the Multimedia Research Issues? A Abbreviations Bibliography Index
