Execution establishes workflows into context for test performance.
System Test Modes#
During a project phase, system test can face different modes of operation.
System Integration
Happens in the early stage when the product is developed. Things change quickly. Close cooperation between developer and tester is required. Test cases are created along with the requirements.
First-time integration of new components may happen in an integration event, where developer, tester and experts together test and evaluate.
System Testing
Once all components and features are integrated successfully. Test activities are more structured with proper planning and documentation. The goal is to verify the system towards the product launch.
System Maintenance
After the product is launched. Ensures products in the market still work. Important for complex embedded systems that depend on other systems, interfaces or software updates. Problems at this phase have direct customer impact.
Test Management Operations#
Control and monitoring of ongoing test activities is vital:
- Managing resources efficiently and effectively
- Handle problems and resolve blockers
- Ensure that testing targets are reached
- Maintain overview of all activities
- Communication flow between test team, project and stakeholders
Control and Monitoring
Keeping test activities on track across all domains: Test Planning, Test Infrastructure, Test Execution, Problem Management, and Reporting.
Prioritization
A constant effort on a day-to-day basis. Gets increasingly important with complexity and agility. Requires overview of the whole product under test and direct control over test team resources.
Versatility#
Adaptability
Handling emergencies, coping with stress, creative problem-solving, managing uncertain scenarios, acquiring new knowledge, interpersonal and cultural adaptability.
Flexibility
The ability to evolve and transform. Feedback loop: Observe → Understand → Adjust → Stabilize.
Resilience emerges when adaptability and flexibility are balanced.
Agility#
If development is agile, Quality Assurance and System Test have to manage it. Agile development brings challenges in terms of quality — changes are inherent risks. Working in agile projects of complex systems requires versatility.
Scalability#
Scaling factors: variants, test cases, test environment. Includes System-of-Systems Testing (SoS Testing) where multiple independent complex systems interact.
Stability#
Development: develop for stability, reduce dependencies, clear interfaces, use bugs as feedback loops.
Test: stable test team, good documentation, on-boarding/off-boarding, systems and processes in place.