A global insurance company encountered significant challenges with delivery quality and time to market. The client had committed a common red flag mistake of using the same vendor for development and testing. This vendor had not utilized any formal quality and testing practices and processes. Upon inspection, QA Consultants discovered the mobile app as well as the backend systems were riddled with defects and required in-depth and extensive quality assurance.
The solution included QA Consultants defining a comprehensive test strategy, developing approximately 3,000 test cases, performing 14,000 test case executions, and identifying 700 defects. The QA Consultants team supported the successful delivery of three agile development releases (work packages) with multiple sprints (spanning a 10-month timeframe).
This time, due to QA Consultants’ expertise, the pilot and full production launches were defect-free. The client was pleased with the results which saved time, money, and the company reputation to produce defect-free products. As a result, the client is currently engaged with QA Consultants for subsequent releases of the mobile app and other projects.
The mobile app was intended as a new sales platform for the outside sales team. This project was part of a digital transformation moving the financial institution from paper-based sales to digital. The intention was to create an app designed for the Apple iPad in the broker environment. The test strategy called for the inclusion of 10-15 iPad versions including various models, resolutions, and types. QA Consultants conducted tests through the QAC Mobile CoE, Mobile Test Lab, and TestFactory™ teams.
During an initial discovery, QA Consultants found that there weren’t any formal testing processes in place, nor any records of the testing performed (test strategy, test plan, test cases, test results, etc.). QAC delivered a best practice testing program for an agile SDLC and was engaged to be the QA and testing partner.
The test activities included test strategy and test planning, risk-based test strategy, test coordination, test case development, test data development, test environment management, test execution and defect capture, defect management, end-user UAT coordination and engagement, test closure reporting, and executive quality presentations.
The test scope included functional testing, user experience testing, usability testing, cross-device compatibility testing, integration and interface testing, end-to-end testing (from the mobile app through to the back-end systems), and user acceptance testing across multiple languages (English and French). A mobile test automation pilot was provided as a non-charge value-add to highlight the benefits of smoke, sanity, and regression testing for future testing.
QA Consultants’ engagement resulted in the development of ~3,000 test cases, over 14,000 test case executions, and the identification of hundreds of defects across varying devices over the course of multiple sprints. Both the pilot and full production launches were defect-free. The client was pleased with the results which saved time, money, and the company reputation to produce defect-free products.
The user base was ecstatic with the new digital approach to the sales process. The financial institution engaged QA Consultants for subsequent releases of the mobile app and further projects.
QA Consultants utilized an on-demand engagement which allowed for flexibility as required. Throughout the project, the team size fluctuated from two to fifteen. The roles included were one QA Manager/Lead, twelve QA Specialists, one QA Automation Architect, and one Engagement Delivery Manager.
Project aims/goals
- Implement formal QA and testing best practice processes and methodology into the client’s agile SDLC
- Test the agile sprints to ensure defect-free code releases both in the mobile app and in the back-end systems
- Coordinate business user acceptance testing and facilitate signoffs
- Perform a mobile test automation pilot to show the capability and benefits of automated testing
Methodology/work undertaken
- Agile SDLC-based testing methodology was utilized based on the QA Consultants proprietary QualityPoint methodology
- Test activities
- Test strategy and test planning
- Test coordination
- Test case development
- Test data development
- Test environment management
- Test execution and defect capture
- Defect management
- End-user UAT coordination and engagement
- Test closure reporting
- Executive program quality presentations
- Test scope
- Functional testing
- User experience testing
- Usability testing
- Cross-device compatibility testing
- Integration and interface testing
- End-to-end testing (from the mobile app through to the back-end systems)
- User acceptance testing
- Multi-language testing (English and French)
- Mobile test automation pilot
- Metrics
- ~3,000 test cases were developed
- >14,000 test case executions were performed
- >700 defects were identified
- >10 iPad device types were tested
- 3 Agile development releases (work packages) with multiple sprints for each were tested (spanning a 10-month timeframe)
Challenges/obstacles overcome
QA Consultants entered a development program in mid-flight. At the time, the development vendor was not performing formal testing and delivered poor quality code releases. Each defect required multiple iterations and delivery delays, which caused misalignment with the business and end-users.
QA Consultants had to implement testing best practice methodologies, processes, and procedures mid-flight. Such modifications required change management for the existing teams. As a result, the development vendor was uncooperative with QAC as a testing partner. QA Consultants faced time restrictions to deliver on an already late schedule.
Results and evaluation
QA Consultants’ engagement resulted in the identification of hundreds of defects over the course of multiple sprints. Both the pilot and full production launches were delivered with a high standard of quality. The user base was pleased with the new digital approach to the sales process. As a result, the client is currently engaged with QA Consultants for subsequent releases of the mobile app and other projects.
Find out how QA Consultants can solve quality assurance problems.
Already know what you need? Contact QA Consultants today.