We have a complex and highly customized NetSuite environment and need to test hundreds of test cases. When we were testing manually, it would take our QA Analyst an average of one day to define and document six test cases in Microsoft Excel. Execution, verification and documentation of these six test cases would take roughly three hours for every test cycle. This translated into hundreds of hours spent in testing.
With Xcelero, we can define the same six test cases in one and half hours and when done they are already documented in the SuiteApp. The QA Analyst now submits test cases for automated execution in our sandbox at her convenience and checks in on the results after attending to other tasks. Moreover she can either isolate specific use cases for testing or select every case and mark all for execution just before logging out at the end of the day. The routines run overnight and the following morning the results are ready. The SuiteApp captures screenshots at each step in the process so it is easy to identify point of failure as the onscreen error message is also captured. The impact to the rework-retest cycle is significant because developers already know what happened and when, time is not wasted retracing steps with end users.
The test model is built within the sandbox environment and periodically copied to production which means it is also copied into the release preview environment, and it is not lost when the sandbox is refreshed. As soon as access is available to the release preview all test scenarios can be executed and results determined. This immediate heads-up is invaluable to the upgrade process.