Table of contents for Integrated approach to web performance testing : a practitioner's guide / B.M. Subraya, editor.

Bibliographic record and links to related information available from the Library of Congress catalog.

Note: Contents data are machine generated based on pre-publication provided by the publisher. Contents may have variations from the printed book or be incomplete or contain other coding.


Counter
Chapter 1
Web-Based Systems and Performance Testing
WEB SYSTEMS AND POOR PERFORMANCE
How Web Users React On Web Application¿s Poor Performance
User¿s Previous Experience with Internet Speed
User¿s Knowledge on Internet
User¿s Level of Patience
User¿s Knowledge about the Application
User¿s Need for the Web site
Stake Holder¿s Expectations on Performance
THE NEED FOR PERFORMANCE TESTING
When Do You Detect Performance Bottlenecks?
GENERAL PERCEPTION ABOUT PERFORMANCE TESTING
Response Time Testing
Throughput Testing
Capacity Testing
Myths on Performance Testing
A COMPLETE PERFORMANCE TESTING: ¿LESS¿ APPROACH
Load Testing
Endurance Testing
Stress Testing
Spike Testing
DIFFERENCE BETWEEN THE COMPONENTS OF LESS
Configuration Testing
Scalability Testing
PERFORMANCE TESTING LIFE CYCLE
Performance Testing In Traditional Development Life Cycle
Performance Testing In Modern Development Life Cycle
Which Systems are Vulnerable to Performance Problems?
Web-Based Applications
Benefits from Performance Testing
Constraints of Performance Testing
REFERENCES
BIBILOGRAPHY
 Chapter2
Performance Testing: Factors That Impact on Performance
PROJECT PECULARITIES
Rapid Application Development Approach
TECHNICAL PECULIARITIES
Security Threat
Developer¿s Negligence on Performance
Complex User Interface
WEBSITE CONTENTS
Hyper Text Markup Language (HTML) /TEXT
Images
Multimedia
Executable Applications
CLIENT ENVIRONMENT
Different Browsers and Its Impact
Different Platforms
Protocol¿s Impact on Performance
SERVER ENVIRONMENT
Server Farm
Load Balancing at Server Farm
File Transfer between Servers
Location of the Server
Web Server Connected To LAN
Web Server Connected To a Subnet
Web Server Placed in a LAN inside a Firewall
Web Server Placed In A LAN outside A Firewall
Renting Server Space
Remote Hosting a Server
Network Operating Systems (NOS)
Storage Area Networks (SAN)
Technology Dependency
NETWORK ENVIRONMENT
Internet Service Providers (ISP)
Leased Phone Lines/Dialup
Cable Modem
ISDN
Leased Lines (T1, T3)
Frame Relay
Asynchronous Transfer Mode (ATM)
Switched Multimegabit Data Service (SMDS)
WEB CACHING
Client Caching
Proxy Caching
Server Caching
CHALLENGES AHEAD
SUMMARY
REFERENCES
BIBLIOGRAPHY
Chapter 3
Performance Testing: Reference Technology and Languages
CLIENT- SERVER AND WEB -BASED TECHNOLOGY
Client-Server Technology
Difference between Client-Server Technology and Web Technology
WEB SERVER AND APPLICATION SERVER
Web Server
Application Server
EVOLUTION OF MULTI TIER ARCHITECTURE
Single-tier Architecture
Two-tier Architecture
Three-tier Architecture
Web-based Thin Client
Web-based Thick Client
Three Tiered Web-based System
Advantages of Multi-Tier Architecture
Scalability
Security
Flexibility
Better Quality and Reusability
SCRIPTING LANGUAGES FOR WEB-BASED APPLICATIONS
Basic Web Page Development Languages
Hyper Text Markup Language (HTML)
Extensible Markup Language (XML)
Extensible Hypertext Markup Language (XHTML)
Cascading Style Sheets (CSS)
Python
Virtual Reality Modeling Language (VRML)
Common Gateway Interface (CGI)
Client -side Scripting
JavaScript
Jscript
Visual Basic (VB) Script
Server-side Scripting
Java Server Pages (JSP)
Active Server Pages (ASP)
Microsoft .NET
Hypertext Preprocessor (PHP)
Server Side Includes (SSI)
MEETING THE CHALLENGES
SUMMARY
REFERENCES
BIBLIOGRAPHY
 Chapter 4
Test Preparation Phase I: Test Definition
NEED FOR TEST DEFINITION PHASE
PERFORMANCE REQUIREMENTS AND ITS IMPORTANCE
BUSINESS FUNCTIONS RELATED PERFORMANCE REQUIREMENT
Business Context
Business Events
External Events
Temporal Events
Business Operations
Introducing the New Business Operation
Enhancing the Existing Operation
Business Objectives of the System
Logistics of Operations
User Base
INFRASTRUCTURE AND NETWORK ENVIRONMENT
Network Environment
Hardware/Software System
EXPLICITLY SPECIFIED REQUIREMENTS FOR PERFORMANCE
Interfacing System, If any,
Responsibilities
Operation Profile
How do you prepare An Operation Profile?
Service Level Agreements (SLA)
Miscellaneous
Management Conditions and Constraints
DEVELOPING PERFORMANCE TEST STRATEGY DOCUMENT
Performance Testing Objectives
Stakeholders
Freezing Project Scope
System Acceptance Criteria
Early Component Level Performance Testing
Performance Measurements
Test Execution Methodology
Test Loads Considering Transaction Volumes and Variety
Test Environment
Test Data Sources/ Test Data Bed
User Think Time
Stress and Duration Testing
Project Activities and Schedule
Project Risks
SUMMARY
REFERENCES
BIBLIOGRAPHY
Chapter 5
Test Preparation Phase II: Test Design
IMPORTANCE OF TEST DESIGN PHASE
Benchmark Design
What are the Desirable Attributes of a Benchmark?
How to Design a Good Benchmark?
BENCHMARK REQUIREMENTS
Operation Profile
Planned Behavior of the System
Types of Transactions
Guidelines for Designing a Benchmark
How Many Benchmarks Are Required?
A Sample Benchmark
Fine tune the Operation Profile
DEVELOPING A WORKLOAD
 Types of Workload
Goal Oriented
Transaction Oriented
Architecture Oriented
Growth Oriented
 
 What are the Characteristics of a Workload?
Categorization of Transactions
 Business Domain Specific
 Resource Hungry
 Concurrency
 Interacting
 Infrastructure Related
Assigning Weights
Weights to User Groups
Weights to Transaction Type
Sample workload
SEQUENCING TRANSACTIONS
Continuous
SELECTION OF TOOLS
SUMMARY
REFERENCES
BIBLIOGRAPHY
Chapter 6
Test Preparation Phase III: Test Build
DEVELOPING PERFORMANCE TEST PLAN
What are the Contents of a Typical Performance Test Plan Document?
WORKING WITH PROPER TESTING ENVIRONMENT
Operational Environment
Simulated Environment
Hardware and Software Requirements
Requirements to Setup Client Environment
Testing with Different Browsers
Testing With Different Operating Systems
Client Caching
Different Protocol Setup
Requirements to Setup Server Environment
Requirements to Setup Network Environment
Requirements to Setup Mainframe Environment
Mapping Simulated Environment to Operational Environment
Simulated Environment Is Exactly Equal To Operational Environment
Simulated Environment is Less Equipped than Operational Environment
Simulated Environment is more Equipped than Operational Environment
Investment on Environment
CHALLENGES IN CREATING A SIMULATED ENVIRONMENT
Identifying Noises
Scalability Issues
Resource and or Budget Limitations
Isolated Environment
DEVELOPING TEST SCRIPTS
Issues in Recorded Scripts
PREPARING TEST SCHEDULE
DEFINING TESTING PROCESS
ANALYSIS OF RISK FACTORS
Testing Started before a System Architecture Studied
Lack of Test Development Guidelines
Integration Problems with Various Tools in SDLC
Redundant Information Kept in Multiple Repositories
Automated Test Script Generation is Cumbersome
Training is Too Late in the Process, So Test Engineers Lacked Tool Knowledge
Late Introduction of Testing Tools
There are Expectations of Early Payback
Tool has Problems Recognizing Third-Party Controls
Various Tool Versions in Use
SUMMARY
REFERENCES
BIBLIOGRAPHY
Chapter 7
Performance Test Execution Phase
ENTRY CRITERIA
Freezing of all Major Business Functions
Working of all Major Business Functions and Features
Fixing and Retesting of All Major Defects
Availability of Proper Test Bed.
Ensuring the Availability of Test Team
Right Version of the Tool
EXIT CRITERIA
Successful completion of Tests Runs
Generation of Result Data
Zero Functional Bug during Test Runs
Setting Performance Parameters
Response time
Throughput
Utilization
ELABORATION TESTING
How to Conduct Elaboration Testing?
SELF SATISFACTION TEST (SST)
MULTIPLE RUNS
CHALLENGES IN TEST EXECUTION
Functional Bugs in the Application
Problems in Database Connection Pooling
Managing Heap Size
Session Tracking in Test Scripts
Issues in Creating a Test Datapool
Issues with Application Server
Network may get Choked due to Wrong Configuration
GUIDELINES FOR TEST EXECUTION
SUMMARY
REFERENCES
Chapter 8
Post Test Execution Phase
OBJECTIVES OF ANALYSIS PHASE
ANALYSIS PROCESS
ANALYZE TEST LOGS
Contents of Test Log
Need for the Test Logs
Use of Test Logs
VERIFYING PASS OR FAIL CRITERIA
TEST REPORTS
Target Audience for the Results
Tables and Graphs
Bar Chart
Scatter Chart
Performance Report
Compare Performance Reports
Command Usage Reports
Cumulative Statistics
Summary Statistics
Command Trace Report
AREAS OF IMPROVEMENT
Processor
Physical Disk
Memory
Network Traffic
TUNING PROCESS
Start Tuning Process
Identify the Bottleneck
Bottleneck
Cause of Bottleneck
Find the Root Cause of Bottlenecks
Front end Monitoring
Server Monitoring
Network Monitoring
Remove Bottleneck by Attacking Root Cause
Stop Tuning Process
Performance Tuning at Workload Level
GUIDELINES FOR PERFORMANCE TUNING
SUMMARY
REFERENCES
BIBLIOGRAPHY
Chapter 9
Performance Test Automation
PERFORMANCE TEST AUTOMATION PROCESS
PREPARATION PHASE
Why and When to Automate?
Understanding Architecture
Develop and Analyze Performance Requirements
Performance Testing Goals
Test Objectives and the Success Criteria
Description of the System to be tested
Constraints on Test Automation
Scope of the System
Model the Real Users
Uniform Distribution of Think Time
Normal Distribution of Think Time
Negative Exponential Distribution of Think Time
Develop Test Strategy
Defining Performance Pass/Fail Criteria
Identifying the Measurement Criteria
Selection of Tools
Performance Measurements
Virtual Users
Acceptance Criteria
Test Runs and Test Cycles
Test Duration
Minimizing Risk Factors
PLANNING PHASE
Overview Phase
Design Phase
Operation Phase
Tools Analysis and Usage
Guidelines for Selecting Tools
Develop workloads
Develop or Generate Test Scripts
Setup Test Environment
Resource Planning
Plan Test Bed
Strategize Run
EXECUTION PHASE
Elaboration Test
Multiple Runs
POST EXECUTION PHASE
Review of Various Logs
Presentation of Results
Analysis of Results
Identifying and Fixing the Bottlenecks
Guidelines for Performance Tuning
Infrastructure Level Tuning
SUMMARY
REFERENCES
BIBLIOGRAPHY
Chapter 10
Introduction to Performance Monitoring and Tuning: Java and .NET
AREAS OF BOTTLENECKS IN WEB BASED APPLICATIONS
PERFORMANCE COUNTERS IN OPERATING SYSTEM
PERFORMANCE MONITORING AND TUNING IN THE UNIX
PERFORMANCE MONITORING AND TUNING IN WINDOWS 2000
ARCHITECTURAL SIMILARITIES BETWEEN JAVA AND .NET
PERFORMANCE MONITORING AND TUNING ¿ JAVA
Performance Counters in JVM
Performance Monitoring Tool: Jconsole
Java Coding Guidelines
PERFORMANCE MONITORING AND TUNING - .NET
Performance Counters
CLR Performance Counters
.NET Framework Performance Counters
Performance Monitoring Tool: PERFMON
.NET FRAMEWORK TUNING
CLR Tuning
ASP.NET Application: Identifying Bottlenecks and Tuning
CODING GUIDELINES
SUMMARY
REFERENCES
BIBLIOGRAPHY

Library of Congress Subject Headings for this publication:

Web services.
Application software -- Development.
Computer software -- Testing.