Testing SAP Solutions

... Preface to the Second Edition ... 15

... Foreword to the Revised and Extended Second English Edition ... 19

... Foreword to the Second Edition ... 21

... Foreword to the First Edition ... 27

1 ... Introduction ... 31

PART I ... Methodology ... 41

2 ... Theory of Software Testing ... 43
... 2.1 ... System Changes Necessitate Testing ... 43
... 2.2 ... Test Types ... 47
... 2.3 ... Test Stages ... 49
... 2.4 ... Black-Box Testing and White-Box Testing ... 56
... 2.5 ... Test Case Design for Black-Box Testing ... 57
... 2.6 ... Test Data ... 62
... 2.7 ... Basic Procedures for Planning and Execution ... 62
... 2.8 ... Selecting Test Tools ... 66
... 2.9 ... Conclusion ... 75

3 ... Test Methodology ... 77
... 3.1 ... Roadmaps in SAP Solution Manager ... 78
... 3.2 ... Project Preparation ... 90
... 3.3 ... Business Blueprint ... 95
... 3.4 ... Realization ... 101
... 3.5 ... Final Preparation ... 109
... 3.6 ... Go-Live & Support and Run ... 119
... 3.7 ... Conclusion ... 121

PART II ... Functional Testing ... 123

4 ... Test Management with SAP Solution Manager ... 125
... 4.1 ... Testing in the Context of SAP Enterprise Support, Run SAP, and SAP Standards for Solution Operations ... 127
... 4.2 ... SAP Solution Manager Enterprise Edition ... 131
... 4.3 ... SAP Solution Manager--Basic Settings ... 146
... 4.4 ... Project-Related Testing with SAP Solution Manager ... 152
... 4.5 ... Integration Scenarios ... 193
... 4.6 ... Solution-Related Testing ... 209
... 4.7 ... Summary ... 212
... 4.8 ... Customer Report by SOKA-BAU ... 215
... 4.9 ... Customer Report by SEWAG ... 229
... 4.10 ... Customer Report by BSH Bosch und Siemens Hausgeräte GmbH ... 241
... 4.11 ... Update of the Customer Report by BSH Bosch und Siemens Hausgeräte GmbH ... 251
... 4.12 ... Customer Report by Reno Fashion & Shoes GmbH ... 260
... 4.13 ... Update of the Customer Report by Hamm-Reno-Group GmbH & Co. KG ... 268

5 ... Project-Related Testing with SAP Solution Manager and SAP Quality Center by HP ... 275
... 5.1 ... SAP Quality Center by HP ... 276
... 5.2 ... SAP Solution Manager Adapter for SAP Quality Center by HP ... 279
... 5.3 ... Test Management in the SAP Quality Center by HP ... 282
... 5.4 ... Summary ... 309
... 5.5 ... Customer Report by Endress+Hauser Group ... 309
... 5.6 ... Customer Report by DB Systel GmbH ... 323

6 ... Supporting Test Automation with SAP TAO ... 337
... 6.1 ... Basic Principle: Automation Through Composition ... 338
... 6.2 ... Components of and Prerequisites for SAP TAO Technology ... 340
... 6.3 ... Using SAP TAO to Create Test Cases ... 343
... 6.4 ... Using SAP TAO to Maintain Test Cases ... 356
... 6.5 ... Summary ... 360

7 ... Economic Aspects of Test Automation ... 361
... 7.1 ... Cost Model for Software Testing ... 363
... 7.2 ... Cost Model for Software Errors ... 378
... 7.3 ... Overall View ... 382
... 7.4 ... Summary ... 383
... 7.5 ... Customer Report by INVISTA Resins & Fibers GmbH ... 383
... 7.6 ... Update to Customer Report by INVISTA Resins & Fibers GmbH ... 397

8 ... Test Automation with eCATT ... 411
... 8.1 ... Implementation and Prerequisites ... 412
... 8.2 ... Creating and Running UI-Driven Tests ... 426
... 8.3 ... Creating Tests Via Direct Program Control ... 457
... 8.4 ... Creating Tests for Web Services ... 461
... 8.5 ... Integration with External Test Tools ... 465
... 8.6 ... Implementing Checks ... 470
... 8.7 ... Managing Test Data ... 483
... 8.8 ... Modularizing Test Scripts ... 493
... 8.9 ... Additional eCATT Commands ... 497
... 8.10 ... Starting, Logging, and Analyzing Test Executions ... 503
... 8.11 ... Overview of the eCATT Versions ... 519
... 8.12 ... Further Steps ... 521
... 8.13 ... Summary: Advantages of the Integration of eCATT in the SAP System ... 521
... 8.14 ... Customer Report by Zürcher Kantonalbank ... 524

9 ... SAP Test Data Migration Server ... 531
... 9.1 ... Data Privacy for Test Data Collection ... 533
... 9.2 ... Process Types ... 535
... 9.3 ... Architecture and System Landscape ... 543
... 9.4 ... Data Transfer and Extraction ... 545
... 9.5 ... Creation and Refresh of Test Systems ... 547
... 9.6 ... Summary ... 550
... 9.7 ... Customer Report by Behr GmbH & Co. KG ... 551
... 9.8 ... Customer Report by Infineon Technologies AG ... 559

PART III ... Performance Tests ... 567

10 ... Project Outline of a Performance Test ... 569
... 10.1 ... Load Test--Stress Test--Volume Test ... 571
... 10.2 ... Roles in the Performance Test Project ... 572
... 10.3 ... Phase Model of a Performance Test ... 574
... 10.4 ... Planning ... 575
... 10.5 ... Performing the Load Test ... 584
... 10.6 ... Performing the Stress Test ... 589
... 10.7 ... Completing ... 590
... 10.8 ... Summary ... 593

11 ... SAP LoadRunner by HP ... 595
... 11.1 ... LoadRunner Virtual User Generator ... 597
... 11.2 ... LoadRunner Controller and LoadRunner Agent ... 600
... 11.3 ... LoadRunner Analysis ... 602
... 11.4 ... SAP Performance Center by HP ... 603
... 11.5 ... Summary ... 607
... 11.6 ... Customer Report by HeidelbergCement AG ... 608
... 11.7 ... Customer Report by Sanofi-Aventis ... 616

12 ... Monitoring a Performance Test ... 627
... 12.1 ... Sample Process In Case Performance Problems Occur ... 628
... 12.2 ... Localization of Performance Bottlenecks ... 630
... 12.3 ... Transactions for Technical Monitoring ... 634
... 12.4 ... Summary ... 648

PART IV ... Test Center ... 649

13 ... Test Center ... 651
... 13.1 ... Setting Up a Test Center ... 653
... 13.2 ... Test Center Services ... 656
... 13.3 ... Summary ... 660
... 13.4 ... Customer Report by Deutsche Telekom AG ... 660

... Appendices ... 691
... A ... SAP Solution Manager Test Workbench vs. SAP Test Organizer ... 693
... B ... SAP NetWeaver Knowledge Warehouse--Functionality in SAP Solution Manager ... 697
... C ... Recommended Reading ... 701
... D ... The Authors ... 703

... Index ... 705