Big Data Analytics in Earth, Atmospheric, and Ocean Sciences

Contributors vii

Preface xiii

1 An Introduction to Big Data Analytics 1
Erik Hoel

Part I: Big Data Analytics Architecture 29

2 Introduction to Big Data Analytics Architecture 31
Thomas Huang

3 Scaling Big Earth Science Data Systems Via Cloud Computing 35
Hook Hua, Gerald Manipon, and Sujen Shah

4 NOAA Open Data Dissemination (Formerly NOAA Big Data Project/Program) 65
Adrienne Simonson, Otis Brown, Jenny Dissen, Edward J. Kearns, Kate Szura, and Jonathan Brannock

5 A Data Cube Architecture for Cloud-Based Earth Observation Analytics 95
Peter Wang, Robert Woodcock, Ronnie Taib, Matt Paget, and Alex Held

6 Open Source Exploratory Analysis of Big Earth Data With Nexus 115
Thomas Huang, Edward M. Armstrong, Nga T. Chung, Eamon Ford, rank R. Greguska III, Joseph C. Jacob, Brian D. Wilson, Elizabeth Yam, and Alice Yepremyan

7 Benchmark Comparison of Cloud Analytics Methods Applied to Earth Observations 137
Christopher Lynnes, Michael M. Little, Thomas Huang, Joseph Charles Jacob, Chaowei Phil Yang, Mahabaleshwara Hegde, and Hailiang Zhang

Part II: Analysis Methods for Big Earth Data 153

8 Introduction to Analysis Methods for Big Earth Data 155
Christopher Lynnes

9 Spatial Statistics for Big Data Analytics in the Ocean and Atmosphere: Perspectives, Challenges, and Opportunities 159
Kevin A. Butler and Tiffany C. Vance

10 Giving Scientists Back Their Flow: Analyzing Big Geoscience Data Sets in the Cloud 177
Niall Robinson, Theo McCaie, Jacob Tomlinson, Alex Hilson, Tom Powell, Rachel Prudden, Megan Fitzsimon, and Alberto Arribas

11 The Distributed Oceanographic Match-Up Service 195
Shawn R. Smith, Mark A. Bourassa, Jocelyn Elya, Thomas Huang, Kevin Michael Gill, Frank R. Greguska III, Nga Chung, Vardis Tsontos, Benjamin Holt, Thomas Cram, and Zaihua Ji

Part III: Big Earth Data Applications 221

12 Introduction to Big Earth Data Applications 223
Christopher Lynnes and Tiffany C. Vance

13 Topological Methods for Pattern Detection in Climate Data 227
Grzegorz Muszynski, Vitaliy Kurlin, Dmitriy Morozov, Michael Wehner, Karthik Kashinath, and Prabhat Ram

14 Exploring Large Scale Data Analysis and Visualization for Atmospheric Radiation Measurement Data Discovery Using NoSQL Technologies 243
Bhargavi Krishna, Kyle Dumas, and Giri Prakash

15 Demonstrating Condensed Massive Satellite Data Sets for Rapid Data Exploration: The MODIS Land Surface Temperatures of Antarctica 259
G. E. Grant, D. W. Gallaher, and Q. Lv

16 Developing Big Data Infrastructure for Analyzing AIS Vessel Tracking Data on a Global Scale 279
Rob Bochenek, Jessica Austin, John-Marc Dunaway, and Tiffany C. Vance

17 Future of Big Earth Data Analytics 299
Christopher Lynnes and Thomas Huang

Index 311