How Flip cut their regression test duration by 1.5 weeks
Flip is a series B startup enabling free, instant inter-bank transfer for Indonesian consumers and businesses in South East Asia. Below, we spoke to Harith Fanani, the Staff Test Engineer at Flip. We asked him how he had come to work with Global App Testing, and how he'd come to save a week and a half in Flip's troublesome regression testing suite.
Interested in learning about how we could help you? Talk to a member of our team.
Flip is an Indonesian Fintech company. Its main product is free and seamless interbank transfer for consumers and businesses.
Founded in 2015, Flip raised a $48m in a series B in 2021. That sets Flip on a course to continue their formidable growth into 2024 and beyond.
- Financial transactions is a regulated space which makes for long regression cycles.
- The lack of in-house device management meant that the Flip team was unable to simulate the real experiences of their users
Month-long continuous regression cycles
Global App Testing delivered a bespoke solution to booking dot com which was tailored to their challenges and goals.
Regression tests in two days or less
"When we first signed up with GAT, we wanted to see how long your testers could take.... it was amazing that you could get through our test cycles in days."
The Flip team jettisoned as much of their regression cycles as they could to Global App Testing in order to radically improve the speed of releases. "The main reason I'd recommend Global App Testing is that you can complete the test cases much faster than our internal testers.
Broader and best-practice device mix in the staging environment
"We base our targeting in Global App Testing on the device mix which represents most of our users. This is really useful because many of the most critical bugs we've found with Global App Testing have been on devices we haven't always had the facility to test in-house. For example with Oppo or Xiaomi devices."
1.5 weeks saved per sprint cycle
The main result is that Harith is able to get regression tests done much faster. "Since we can release more, faster, to users, that impacts our revenue. The marketing teams can roll out the campaign earlier to users. That’s why we wanted a testing service... to get more efficient and more effective. We can also get features to users faster."
20% of total test scenarios automated
Harith says he and his team conduct just 30% of the test case scenarios that they did before. Global App Testing have taken on 50% of the test case scenarios, resulting in a time and labour saving more than the value of the GAT contract. Additionally, that free time has allowed the Flip team to automate the final 20% of test cases resulting in a direct saving.