How does DevOps affect the modern tester? How Should it? How does the software testing lifecycle fit in with continuous integration and delivery? Will QA still have relevance in a DevOps organization? Here’s my take on these important questions.
Risk Assessment and Software Testing
I can’t stress the importance of risk assessment and software testing enough. In a world enamoured by the promise of DevOps, it’s not unusual for QA professionals and testers to fear that they will be left out. This anxiety is unfounded. In the words of DevOps writer Bill Dickenson, “As the number of release cycles rises, so does the risk of disruptive code entering the system and eroding the very value DevOps created.” When addressing this reality, QA and testing must be brought right into the flow of the process instead of being reserved for the end of the cycle. This is good news. Rather than being treated as an unavoidable source of delays or a hurdle to overcome, risk mitigation and testing can become a valuable part of every phase in the SDLC.
Continuous Integration and Deployment
Continuous Integration and Deployment are in place. Now is the time for continuous testing. At QA Consultants, we’re seeing an increase in requests for CT, and it is a fantastic concept that we encourage more organizations to pursue. In Ragnar Lonn’s article on continuous testing, he speaks of the importance of qualitative risk assessment and how automation can help mitigate risk throughout the SDLC. He also notes the difference between automation and CT. “In essence, automated testing constitutes the detection process for software issues and defect prevention, whereas Continuous Testing addresses the wider challenge of improving the effectiveness of these detection sensors.” In our experience, automated testing on check-in does not take away from manual tests or end-to-end testing. All are needed in the DevOps environment.
Speed is Essential
Speed Is Essential for DevOps-Oriented software testing. It would be wonderful to have weeks or months at the end of the SDLC to focus on testing. However, that is simply not feasible. Speed is vital. That’s one reason there’s an increasing demand for testers who can write code quickly and implement same-day tests that are run on check-in and then fixed and updated as needed.
As an example of how things have changed over the last decade, it’s no longer possible to wait for functional code complete to run performance tests. At QA Consultants, we have actually done load tests the same day on brand new code. Of course, that rapid load testing is only possible with modern tools that make experimentation possible—and the insight of people who thoroughly understand performance and load testing. Don’t get me wrong. This is not the ideal state and certainly not the only software test plan. You still want methodical, planned out and recurring performance tests just like with regression testing. But during a CD cycle deploying code every day, you can gain consistency running a load test every day as well.
Takeaways for QA and Software Testers
There are several takeaways for QA and Software Testers to maintain relevance.
- As we have already learned from Agile, organizations cannot use DevOps for development and have a waterfall QA approach. Those processes are not going to mix. Instead, QA must prepare to be assimilated.
- Traditional non-technical QA is at risk of becoming more UAT focused. QA must demonstrate value in developing risk mitigation strategies and technical solutions that are focused on achieving business goals.
- The SDET (Software Development Engineer in Test) role will see a rise in prominence. Testers will need to have more developed skills and knowledge to support their Developer counterparts on the DevOps team in all phases of the SDLC.
Finally, we need more developers who are willing to become part of the QA and testing conversation. It is my personal hope that we will see much higher levels of participation from the development community to create truly cross-functional teams for DevOps going forward.
If your organization is struggling to integrate QA and software testing into your DevOps workflow, contact our team here for insight and assistance today.
Brian Bernknopf
Managing Director, U.S. Ops
Email: bbernknopf@qaconsultants.com
Brian Bernknopf is the Managing Director for U.S. Operations at QA Consultants.
Mr. Bernknopf currently serves as the Managing Director of QA Consultants USA, Inc. (QAC). He is responsible for the daily operations and management of the US business, ongoing sales and business development, staff and project management, and solution creation. QAC has been one of North America’s fasted growing independent software testing services firms over the last 20 years and Mr. Bernknopf is responsible for their US expansion. Mr. Bernknopf is also a board member to the Dallas Per Scholas program that has the mission of breaking the cycle of poverty through IT Job and Workforce Training. Mr. Bernknopf is a proven industry leader with a deep specialization in IT Consulting and Advisory, Software Quality Assurance, and IT Systems Integration. He has spent his 20-year career in management consulting and while having worked in multiple industry verticals and with a variety of software technologies, has always been focused on software quality management and governance. His responsibilities have included sales, delivery, and management of IT solutions and engagements focused on: QA Governance, Test Automation, Performance, Mobile QA, ERP (SAP), Package Applications (ERPBPMEtc.), COE Development, and complex QA solutions. Prior to joining QAC, Mr. Bernknopf was a Senior Vice President for KMS and a Vice President at Virtusa, where he led a 2000 person QA practice. Before Virtusa, Mr. Bernknopf was a Principal at Capgemini and was Director of their Insurance QA Practice. In addition to QA, Brian has experience in large program and project management, alliance management, and marketing. Mr. Bernknopf has over 20 years in the Quality Assurance and Quality Management industry and is a frequent speaker at Quality Management events. His early patent applications for test automation built the foundation for his QA career and a pursuit of QA Solutions
