SAP Data Services
The Comprehensive Guide
1st Edition
Will be published approx. on 28. February 2015
Book
Hardback
524 pages
978-1-4932-1167-8 (ISBN)
Description
It's time to extract, transform, and load your skills on managing enterprise data! With this book on SAP Data Services, you'll be an expert in no time. After learning about topics like planning, blueprinting, and integrating SAP Data Services, you'll get into the core of the book - detailed steps on how to perform Data Services tasks. Get the skills you need for your daily job, from basic tasks like designing objects, to advanced duties like analyzing unstructured text.
Highlights:
Data Services architecture and OS
Enterprise information management
Installation: Windows and Linux
Configuration
Troubleshooting
Data Services objects
Datastores
Data Services scripting language
Social media analytics
Information Steward
Integration: data warehousing and retail
Highlights:
Data Services architecture and OS
Enterprise information management
Installation: Windows and Linux
Configuration
Troubleshooting
Data Services objects
Datastores
Data Services scripting language
Social media analytics
Information Steward
Integration: data warehousing and retail
More details
Persons
Author
Bing Chen leads the Advanced Analytics practice at Method360 and has over 18 years of experience in IT consulting, from custom application development to data integration, data warehousing, and business analytics applications on multiple database and BI platforms. He specializes in advanced analytics and data processing technologies such as in-memory SAP HANA, column-oriented and cloud databases, Apache Hadoop, predictive analysis, data visualization, and data integration platforms such as SAP Data Services. He speaks on a regular basis at SAP and other industry conferences. Bing lives in San Francisco, California, with his wife and two children.
James Hanck is co-founder of Method360 and currently leads the Enterprise Information Management practice. In this role he leads a team to analyze, design, and build integration and information governance solutions to improve businesses' data quality. James regularly speaks at conferences on integration and information governance. He brings over 20 years' experience ensuring that trusted information is delivered and available in the simplest manner possible. Prior to Method360, James worked at various consulting and software companies including General Electric Capital Consulting, Metamor Worldwide, and IBM. James is a licensed attorney with a doctorate in law and has his certificate in High Tech Law.
Patrick Hanck is a lead Enterprise Information Management consultant at Method360. He specializes in provisioning information, system implementation, and process engineering, and he has been recognized through business excellence and process improvement awards. Patrick has over 25 years of experience in consulting and program management, working in aerospace, IT management, finance, legal, services supply chain, distribution, and retail industries. Prior to entering the world of information technology, he was a rocket scientist. He has a degree in mechanical engineering and project management certifications from Stanford and George Washington University. Patrick lives in Los Gatos, California, with his wife and two children.
Scott Hertel is a senior Enterprise Information Management consultant with over 15 years of consulting experience helping companies integrate, manage, and improve the quality of their data. He specializes in data governance, data quality improvement, master data management, and data migration projects. Scott has spoken at numerous seminars and conferences on these and other related topics. Scott lives in San Francisco, California, with his wife and children.
Allen Lissarrague is a senior BI technologist with over 15 years of experience directly in SAP analytics and information products. His experience includes new product implementation and migration, as well as advanced troubleshooting. He is also considered a performance enhancement specialist. Allen lives in the San Francisco Bay area with his wife and three children.
Paul Médaille is well known in the SAP technical community for his conference presentations, webinars, and contributions to SDN. Paul has been with SAP for more than 10 years as a consultant, educator, and product manager, with deep knowledge of Basis, SOA, and SAP NetWeaver Process Integration. He has a degree in mathematics from the University of California at Davis, and lives in Eugene, Oregon, with his wife Jessica and two greyhounds.
Content
... Acknowledgments ... 15
... Introduction ... 17
PART I ... Installation and Configuration ... 21
1 ... System Considerations ... 23
1.1 ... Building to Fit Your Organization ... 23
1.2 ... Operating System Considerations ... 36
1.3 ... File System Settings ... 41
1.4 ... Network ... 45
1.5 ... Sizing Appropriately ... 45
1.6 ... Summary ... 55
2 ... Installation ... 57
2.1 ... SAP BusinessObjects Business Intelligence Platform and Information Platform Services ... 57
2.2 ... Repositories ... 64
2.3 ... Postal Directories ... 74
2.4 ... Installing SAP Server Functions ... 82
2.5 ... Configuration for Excel Sources in Linux ... 84
2.6 ... SAP Information Steward ... 89
2.7 ... Summary ... 90
3 ... Configuration and Administration ... 91
3.1 ... Server Tools ... 91
3.2 ... Set Up Landscape Components ... 132
3.3 ... Security and Securing Sensitive Data ... 140
3.4 ... Path to Production ... 150
3.5 ... Operation Readiness ... 157
3.6 ... How to Troubleshoot Execution Exceptions ... 166
3.7 ... Summary ... 172
PART II ... Jobs in SAP Data Services ... 173
4 ... Application Navigation ... 175
4.1 ... Introduction to Data Services Object Types ... 175
4.2 ... Hypothetical Work Request ... 177
4.3 ... Data Services Designer ... 180
4.4 ... Data Services Workbench ... 190
4.5 ... Summary ... 205
5 ... Objects ... 207
5.1 ... Jobs ... 208
5.2 ... Workflow ... 217
5.3 ... Logical Flow Objects ... 222
5.4 ... Data Flows ... 223
5.5 ... Transforms ... 231
5.6 ... Datastores ... 299
5.7 ... File Formats ... 309
5.8 ... Summary ... 327
6 ... Variables, Parameters, and Substitution Parameters ... 329
6.1 ... Substitution Parameters ... 331
6.2 ... Global Variables ... 335
6.3 ... Variables ... 336
6.4 ... Local Variables ... 337
6.5 ... Parameters ... 339
6.6 ... Example: Variables and Parameters in Action ... 340
6.7 ... Summary ... 342
7 ... Programming with SAP Data Services Scripting Language and Python ... 343
7.1 ... Why Code? ... 343
7.2 ... Functions ... 345
7.3 ... Script Object ... 349
7.4 ... Coding within Transform Objects ... 352
7.4.1 ... User-Defined Transforms ... 352
7.4.2 ... SQL Transform ... 356
7.5 ... Summary ... 357
8 ... Change Data Capture ... 359
8.1 ... Comparing CDC Types ... 360
8.2 ... CDC Design Considerations ... 362
8.3 ... Source-Based CDC Solutions ... 363
8.4 ... Target-Based CDC Solution ... 372
8.5 ... Timestamp CDC Process ... 376
8.6 ... Summary ... 379
PART III ... Applied Integrations and Design Considerations ... 381
9 ... Social Media Analytics ... 383
9.1 ... The Use Case for Social Media Analytics ... 384
9.2 ... The Process of Structuring Unstructured Data ... 387
9.3 ... The Entity Extraction Transform ... 394
9.4 ... Approach to Creating a Social Media Analytics Application ... 404
9.5 ... Summary ... 411
10 ... Design Considerations ... 413
10.1 ... Performance ... 414
10.2 ... Simplicity ... 426
10.3 ... Summary ... 427
11 ... Integration into Data Warehouses ... 429
11.1 ... Kimball Methodology ... 430
11.2 ... Hadoop and SAP HANA ... 451
11.3 ... Summary ... 454
12 ... Industry-Specific Integrations ... 455
12.1 ... Retail: Facilitating Customer Loyalty ... 455
12.2 ... Distribution: SAP BW/SAP APO Integration with SAP ECC ... 465
12.3 ... Summary ... 473
PART IV ... Special Topics ... 475
13 ... SAP Information Steward ... 477
13.1 ... Match Review ... 477
13.2 ... Cleansing Package Builder ... 490
13.3 ... Metadata Management ... 496
13.4 ... Summary ... 498
14 ... Where Is SAP Data Services Headed? ... 499
14.1 ... The Key Themes for SAP Data Services ... 500
14.2 ... The State of the State ... 501
14.3 ... Beyond SP03 ... 504
14.4 ... Help Shape the Future of Data Services ... 505
14.5 ... Summary ... 508
... The Authors ... 509
... Index ... 513