
Data Analytics with Hadoop
Description
Alles über E-Books | Antworten auf Fragen rund um E-Books, Kopierschutz und Dateiformate finden Sie in unserem Info- & Hilfebereich.
Ready to use statistical and machine-learning techniques across large data sets? This practical guide shows you why the Hadoop ecosystem is perfect for the job. Instead of deployment, operations, or software development usually associated with distributed computing, you'll focus on particular analyses you can build, the data warehousing techniques that Hadoop provides, and higher order data workflows this framework can produce.
Data scientists and analysts will learn how to perform a wide range of techniques, from writing MapReduce and Spark applications with Python to using advanced modeling and data management with Spark MLlib, Hive, and HBase. You'll also learn about the analytical processes and data systems available to build and empower data products that can handle?and actually require?huge amounts of data.
- Understand core concepts behind Hadoop and cluster computing
- Use design patterns and parallel analytical algorithms to create distributed data analysis jobs
- Learn about data management, mining, and warehousing in a distributed context using Apache Hive and HBase
- Use Sqoop and Apache Flume to ingest data from relational databases
- Program complex Hadoop and Spark applications with Apache Pig and Spark DataFrames
- Perform machine learning techniques such as classification, clustering, and collaborative filtering with Spark's MLlib
More details
Other editions
Additional editions

Content
- Intro
- Copyright
- Table of Contents
- Preface
- What to Expect from This Book
- Who This Book Is For
- How to Read This Book
- Overview of Chapters
- Programming and Code Examples
- GitHub Repository
- Executing Distributed Jobs
- Permissions and Citation
- Feedback and How to Contact Us
- Safari® Books Online
- How to Contact Us
- Acknowledgments
- Part I. Introduction to Distributed Computing
- Chapter 1. The Age of the Data Product
- What Is a Data Product?
- Building Data Products at Scale with Hadoop
- Leveraging Large Datasets
- Hadoop for Data Products
- The Data Science Pipeline and the Hadoop Ecosystem
- Big Data Workflows
- Conclusion
- Chapter 2. An Operating System for Big Data
- Basic Concepts
- Hadoop Architecture
- A Hadoop Cluster
- HDFS
- YARN
- Working with a Distributed File System
- Basic File System Operations
- File Permissions in HDFS
- Other HDFS Interfaces
- Working with Distributed Computation
- MapReduce: A Functional Programming Model
- MapReduce: Implemented on a Cluster
- Beyond a Map and Reduce: Job Chaining
- Submitting a MapReduce Job to YARN
- Conclusion
- Chapter 3. A Framework for Python and Hadoop Streaming
- Hadoop Streaming
- Computing on CSV Data with Streaming
- Executing Streaming Jobs
- A Framework for MapReduce with Python
- Counting Bigrams
- Other Frameworks
- Advanced MapReduce
- Combiners
- Partitioners
- Job Chaining
- Conclusion
- Chapter 4. In-Memory Computing with Spark
- Spark Basics
- The Spark Stack
- Resilient Distributed Datasets
- Programming with RDDs
- Interactive Spark Using PySpark
- Writing Spark Applications
- Visualizing Airline Delays with Spark
- Conclusion
- Chapter 5. Distributed Analysis and Patterns
- Computing with Keys
- Compound Keys
- Keyspace Patterns
- Pairs versus Stripes
- Design Patterns
- Summarization
- Indexing
- Filtering
- Toward Last-Mile Analytics
- Fitting a Model
- Validating Models
- Conclusion
- Part II. Workflows and Tools for Big Data Science
- Chapter 6. Data Mining and Warehousing
- Structured Data Queries with Hive
- The Hive Command-Line Interface (CLI)
- Hive Query Language (HQL)
- Data Analysis with Hive
- HBase
- NoSQL and Column-Oriented Databases
- Real-Time Analytics with HBase
- Conclusion
- Chapter 7. Data Ingestion
- Importing Relational Data with Sqoop
- Importing from MySQL to HDFS
- Importing from MySQL to Hive
- Importing from MySQL to HBase
- Ingesting Streaming Data with Flume
- Flume Data Flows
- Ingesting Product Impression Data with Flume
- Conclusion
- Chapter 8. Analytics with Higher-Level APIs
- Pig
- Pig Latin
- Data Types
- Relational Operators
- User-Defined Functions
- Wrapping Up
- Spark's Higher-Level APIs
- Spark SQL
- DataFrames
- Conclusion
- Chapter 9. Machine Learning
- Scalable Machine Learning with Spark
- Collaborative Filtering
- Classification
- Clustering
- Conclusion
- Chapter 10. Summary: Doing Distributed Data Science
- Data Product Lifecycle
- Data Lakes
- Data Ingestion
- Computational Data Stores
- Machine Learning Lifecycle
- Conclusion
- Appendix A. Creating a Hadoop Pseudo-Distributed Development Environment
- Quick Start
- Setting Up Linux
- Creating a Hadoop User
- Configuring SSH
- Installing Java
- Disabling IPv6
- Installing Hadoop
- Unpacking
- Environment
- Hadoop Configuration
- Formatting the Namenode
- Starting Hadoop
- Restarting Hadoop
- Appendix B. Installing Hadoop Ecosystem Products
- Packaged Hadoop Distributions
- Self-Installation of Apache Hadoop Ecosystem Products
- Basic Installation and Configuration Steps
- Sqoop-Specific Configurations
- Hive-Specific Configuration
- HBase-Specific Configurations
- Installing Spark
- Glossary
- Index
- About the Authors
- Colophon
System requirements
File format: PDF
Copy-Protection: Adobe-DRM (Digital Rights Management)
System requirements:
- Computer (Windows; MacOS X; Linux): Install the free reader Adobe Digital Editions prior to download (see eBook Help).
- Tablet/smartphone (Android; iOS): Install the free app Adobe Digital Editions or the app PocketBook before downloading (see eBook Help).
- E-reader: Bookeen, Kobo, Pocketbook, Sony, Tolino and many more (only limited: Kindle).
The file format PDF always displays a book page identically on any hardware. This makes PDF suitable for complex layouts such as those used in textbooks and reference books (images, tables, columns, footnotes). Unfortunately, on the small screens of e-readers or smartphones, PDFs are rather annoying, requiring too much scrolling.
This eBook uses Adobe-DRM, a „hard” copy protection. If the necessary requirements are not met, unfortunately you will not be able to open the eBook. You will therefore need to prepare your reading hardware before downloading.
Please note: We strongly recommend that you authorise using your personal Adobe ID after installation of any reading software.
For more information, see our eBook Help page.