Fiserv Auckland - Intermediate Software Test Engineer: Difference between revisions

The PTF was executed using Newman in a Node.js project, with a custom reporter developed to process events emitted by Newman during execution. This allowed for real-time capture of scenario results and detailed logs, providing clear insights into failed scenarios and partial successes. Results were sent to the Current Health Status dashboard, as well as to a dedicated Splunk instance for comprehensive monitoring and analysis. The dashboard and Splunk implementations are detailed in the sections below.  

The PTF used environment variables to set which FI and user to run for, and it was designed to be able to run several users in parallel. The TFS build server was configured to run scenarios for all the users at the same time once per hour.

 

 

This approach proved invaluable in monitoring the fluid and non-deterministic testing environment, enabling nuanced categorization of scenario outcomes beyond pass/fail distinctions, ensuring a more accurate assessment of system readiness and performance.