Black Box And Gray Box Testing Transformed The Customer Experience Of An American Cosmetic Brand

Expertise: Functional Testing Usability Testing Performance Testing Regression Testing Integration Testing Compatibility Testing Security Testing Sanity Testing Smoke Testing End-to-End Testing API Testing
Verticals: Retail & eCommerce
Technologies: PostmanAzure DevOps
Home > Portfolio > Black Box And Gray Box Testing Transformed The Customer Experience Of An American Cosmetic Brand
Client Overview
A leading cosmetic brand from the Caribbean wanted to test its website, mobile app, and web app as they were underperforming and causing the churn rate to rise. Founded in 1979, the client has positioned itself in the vanguard of creating an exciting array of makeup products for people of color. We helped the client test its customer-facing assets by performing compatibility testing, performance testing, usability testing, and more. The outcome of the engagement enabled the client to improve the UX of its assets and follow more rigorous data protection standards.
Business Needs
The client had three customer-facing assets - a website, a web app, and a mobile app. And the client wanted to test each of these three assets to make sure that no leads fell through the cracks. To ensure all the leads remained intact, the client wanted all its assets to be tested thoroughly. And that was the reason why the client was looking for a testing partner to do the job. Some of the business needs that prompted the client to embark on an engagement are mentioned below.

  • Ensuring that the app, website, and web app performed every function correctly
  • Making sure all three assets had user-friendly interfaces that worked smoothly
  • Identifying and plugging any security loopholes in the client's website, web app, and mobile app
  • Examining that the assets of the client worked well on different devices that belonged to different operating systems
Strategy & Solution
The client teamed up with our testing team to make sure we tested each of its assets from end to end. Our team of testers did just that. The team started with having multiple discovery meetings with the client, where it gathered the requirements and later analyzed them. After deeply analyzing the requirement, our lead testers went ahead with the plan of dividing the team into three groups. One group of testers was supposed to test the client's mobile app. Likewise, the second group of testers was supposed to test the website. And the last group of testers looked after running test cases for the web app. Each group got its own lead tester. However, there was only one dedicated project manager who looked after the entire testing cycle and coordinated with the client.

The testers who were responsible for testing the client's mobile app carried out a series of tests. The client had a loyalty app, so its key users were the brand's repeat customers. Our team made sure that the target audiences of the app did not face any issues. In that regard, our testers performed different tests to see whether the UI and UX of the app were working well. Moreover, our team carried out performance tests to ensure the app was functioning with zero bugs. The mobile app had to be viewed on different screens, so the team even ensured that it worked well even on screens that supported different resolutions. Likewise, the team even ran a check to ensure that the app did not face any ghost-touch issues. The team then checked whether the app had any security flaws. Data security was the client's top priority as the app. It was because the mobile app, along with the web app, stored the customer's critical data. As it was a native app for both iOS and Android, we even ran compatibility tests on both operating systems. All in all, we followed a device-based testing approach to make sure the client's mobile app worked well on multiple smart devices - smartphones, tabs, etc.

One group of testers was devoted to testing the client's web app. On the web app, our team performed a series of tests. These tests included integrity testing, security testing, performance testing, usability testing, and interoperability testing. These tests helped the team ensure that the app adhered to the established data-security best practices. Moreover, carrying out performance testing helped the team ensure that the web application performed well even during peak traffic. Then the team even ran a usability test; this test was performed to make sure the web app was usable on different screens of laptops and desktops. Last, the team checked the web app against different interoperability parameters. That was how the team made sure the web application could run seamlessly on different operating systems - Windows and macOS.

Last, we even ran some checks on the website because that was the first point of contact for the client. Some of the tests we performed on the client's website included testing cross-browser compatibility and cross-device compatibility. That way, our team ensured that the site was responsive and performed well on different browsers - Safari, Chrome, Mozilla, Microsoft Edge, Brave, Opera, etc. Testing cross-device compatibility even ensured the site performed well on different iOS and Android devices. We even performed integration testing and security testing on the client's website. Through carrying out performance testing on the site, we made it a point that it never slowed itself down - even if it received heavy traffic.

Our Testing Process

For each of our test projects, we follow a testing life cycle that guides us at every testing phase we perform. And this time also, our testing team was guided by a rock-solid testing strategy. The testing life cycle we used for this project helped streamline the execution and delivery to a great extent. Moreover, having a testing process always helps our team to get clear visibility into different test schedules. Here are some highlights of the testing process we followed in executing this project.

  • Discovered different project requirements with the client's business team
  • Examined the project requirements in detail to create a comprehensive testing strategy
  • Developed different test-case designs for evaluating the features and functionalities of the product
  • Analyzed the test environment thoroughly to see which operating system can be ideal for carrying out the tests
  • Implemented different test cases seamlessly
  • Executed the tests as per a specific test cycle closure with clearly marked exit criteria
Business Outcomes
Once the testing schedules for the client's website, web app, and mobile app came to an end, we delivered fully tested assets. And once these assets were deployed perfectly, the client could reap a number of benefits. Here is a brief rundown of the benefits the client received once the engagement drew to a close.

  • Created a fully functional and highly secure website
  • Improved the UX of the mobile app and the web app
  • Made sure stringent data protection standards were established and followed
Client's Speak
I am very happy to report that Flexsin has been my technology partner for many engagements. The testing squad from Flexsin helped me improve the usability and security of my website, web app, and mobile app. All the best!
Shivam Maharaj
Freeport, Trinidad & Tobago
Let's collaborate and discover propositions that unlock business opportunities.
  • attach_file Attach File
  • Please Validate Captcha