Multimedia Information Extraction

Foreword ix Alan F. Smeaton

Preface xiii Mark T. Maybury

Acknowledgments xv

Contributors xvii

1 Introduction 1 Mark T. Maybury

2 Multimedia Information Extraction: History and State of the Art 13 Mark T. Maybury

Section 1 Image Extraction 41

3 Visual Feature Localization for Detecting Unique Objects in Images 45 Madirakshi Das, Alexander C. Loui, and Andrew C. Blose

4 Entropy-based Analysis of Visual And Geolocation Concepts in Images 63 Keiji Yanai, Hidetoshi Kawakubo, and Kobus Barnard

5 the Meaning of 3d Shape and Some Techniques To Extract It 81 Sven Havemann, Torsten Ullrich, and Dieter W. Fellner

6 a Data-driven Meaningful Representation Of Emotional Facial Expressions 99 Nicolas Stoiber, Gaspard Breton, and Renaud Seguier

Section 2 Video Extraction 113

7 Visual Semantics for Reducing False Positives in Video Search 119 Rohini K. Srihari and Adrian Novischi

8 Automated Analysis of Ideological Bias in Video 129 Wei-Hao Lin and Alexander G. Hauptmann

9 Multimedia Information Extraction in a Live Multilingual News Monitoring System 145 David D. Palmer, Marc B. Reichman, and Noah White

10 Semantic Multimedia Extraction Using Audio and Video 159 Evelyne Tzoukermann, Geetu Ambwani, Amit Bagga, Leslie Chipman, Anthony R. Davis, Ryan Farrell, David Houghton, Oliver Jojic, Jan Neumann, Robert Rubinoff, Bageshree Shevade, and Hongzhong Zhou

11 Analysis of Multimodal Natural Language Content in Broadcast Video 175 Prem Natarajan, Ehry MacRostie, Rohit Prasad, and Jonathan Watson

12 Web-based Multimedia Information Extraction Based on Social Redundancy 185 Jose San Pedro, Stefan Siersdorfer, Vaiva Kalnikaite, and Steve Whittaker

13 Information Fusion and Anomaly Detection with Uncalibrated Cameras in Video Surveillance 201 Erhan Baki Ermis, Venkatesh Saligrama, and Pierre-Marc Jodoin

Section 3 Audio, Graphics, and Behavior Extraction 217

14 Automatic Detection, Indexing, and Retrieval Of Multiple Attributes From Cross-lingual Multimedia Data 221 Qian Hu, Fred J. Goodman, Stanley M. Boykin, Randall K. Fish, Warren R. Greiff, Stephen R. Jones, and Stephen R. Moore

15 Information Graphics in Multimodal Documents 235 Sandra Carberry, Stephanie Elzer, Richard Burns, Peng Wu, Daniel Chester, and Seniz Demir

16 Extracting Information From Human Behavior 253 Fabio Pianesi, Bruno Lepri, Nadia Mana, Alessandro Cappelletti, and Massimo Zancanaro

Section 4 Affect Extraction From Audio and Imagery 269

17 Retrieval of Paralinguistic Information In Broadcasts 273 Björn Schuller, Martin Wöllmer, Florian Eyben, and Gerhard Rigoll

18 Audience Reactions for Information Extraction About Persuasive Language in Political

Communication 289 Marco Guerini, Carlo Strapparava, and Oliviero Stock

19 the Need for Affective Metadata in Content-based Recommender Systems for Images 305 Marko TkalCiC, Jurij TasiC, and Andrej KoSir

20 Affect-based Indexing for Multimedia Data 321 Gareth J. F. Jones and Ching Hau Chan

Section 5 Multimedia Annotation And Authoring 347

21 Multimedia Annotation, Querying, And Analysis in Anvil 351 Michael Kipp

22 Toward Formalization of Display Grammar for Interactive Media Production with Multimedia

Information Extraction 369 Robin Bargar

23 Media Authoring with Ontological Reasoning: Use Case for Multimedia Information Extraction 385 Insook Choi

24 Annotating Significant Relations on Multimedia Web Documents 401 Matusala Addisu, Danilo Avola, Paola Bianchi, Paolo Bottoni, Stefano Levialdi, and Emanuele Panizzi

Abbreviations and Acronyms 419

References 425

Index 461