6 best practices for Continuous Testing
By Anil Jaising Published On January 9, 2022
Continuous Testing is challenging. These six best practices can help steer the path
For any highly competitive industry that relies on a smooth and stable user experience, it is vital that their development teams accelerate release cycles, lower operating costs and ultimately reduce risks. Continuous testing is one way companies can achieve these objectives.
Test Plans: Product level test plans provide overall guidance for product test strategies and policies and indicate the strategy and contract for measuring test coverage.
Test plans should be reviewed by product developers, architects, test engineers and operation staff.
2. Test Coverage Metrics to consider
- Requirements coverage %
- Test Plan coverage %
- Code coverage %
- Function coverage %
- Artifacts coverage %
- Code module coverage %
- Dependencies coverage %
3. Test Automation
- Automation tests that offer the highest level of coverage of the most risky application behavior for the least amount of automation efforts
- 85% to 100% of test automation should be typical. Minimize manual tests
- Delivery and deployment tests are usually fully automated
4. Test Versioning
Tests are as important as the code. All version of test artifacts (test plans, test suites, test cases) should be kept in a secure repository.
A test management database (TMDB) is a repository for meta data that describes tests, test schedules and test results. Examples of meta data include test attributes and tags that describe the purpose and version of a test and test results, the time to execute a test and verdict history. Configure the TMDB as a service.
5. Test Environment Orchestration
- Automatically setup the test environment and resources (physical and virtual) to match the requirements of a test
- Automatically execute the tasks to setup the environment
6. Test Triggers
Test framework should be integrated into the overall continuous delivery pipeline and should be triggered by the previous step in the pipeline
References
I would love to hear from you about what you would like us to add to this article that will help you better understand the product owner role. Please share your comments below.
Anil Jaising is a Certified Scrum Trainer®, Certified DevOps Institute Trainer and a Certified Training from the BACK of the Room – Virtual Edition Trainer. Anil teaches Certified Scrum Master (CSM) and Certified Scrum Product Owner (CSPO), Advanced Scrum Master (A-CSM) workshops from Scrum Alliance He also teaches Training from the BACK of the Room In Room and Virtual Edition). He is also the chief product owner of a telemetry plugin At A Glance on Atlassian Jira.
Scrum, Product Management, and DevOps: Simplifying the jargon
The internet and social media are full of Agile, Scrum, Product Management, and DevOps jargon, including incorrect and misunderstood concepts. This could be problematic for a learner seeking knowledge. Without a course with Scrum Alliance, Scrum.org, or DevOps Institute, this knowledge is difficult to achieve.
The Concepts & Beyond blog is a free suite of articles and videos packaged in tiny chunks. You will learn or refine your knowledge and skills to help your team and organization be effective. When you want to take your knowledge further, we invite you to join us for our Certified ScrumMaster(CSM), Certified Scrum Product Owner (CSPO), Certified DevOps Engineering Foundations (DOEF) and Training from the Back of The Room courses across the USA and Canada.
1 Comment
Test Result Dashboards