Every Success Story Requires a First Step

Logo xinfo

X-info Switch from Selenium to Testup

written by Michael Tscharmi, Project Leader Testautomation, x-Info

The Challenge

Create an easy maintainable test suite

Our software is a dashboard to provide data visualization of manufacturing key figures. One of our customers is the leading automotive manufacturers in Munich. Our smart mining solution enables the management to optimize the output of all assembly lines.

Our situation was that we performed manually the final acceptance of our dashboard data visualization software with us as the supplier. This required a lot of time with some communication loops. Some test cases were already written in Selenium, but this also cost us a lot of programming effort and tied up a lot of resources for maintenance and enhancement.

We were looking for a better solution that is faster and easier to maintain.

About the company

Xinfo is developing intelligent software solutions for the systematic improvement of efficiency, maintenance and QM processes.

Number of Employees

15

Industry

Software Automation

Testup was used for

Replace Selenium tests and create a new test suite

ROI

Reduced manual regression testing time by 5x

The Solution – Replace Selenium with Testup

Switching from Selenium to Testup made our test suite more flexible and much easier to maintain.

Within 6 months, the Thetaris team set up for us a cloud solution on premise in the customer network and built a test suite for all business functions.

Manage execution delay

Some response times of data analysis reports were a real critical problem for Selenium. Due to the large amount of data, the calculation of some results took longer than a minute. These results were no longer processed by Selenium in time.

Our new solution handles very long response times. During visual object recognition, Testup waits impassively for minutes before evaluating the comparison. Now the automation expert can set timeouts for each assertion easily.

Manage testdata

One of the game changer was to connect a dedicated data snapshot to our test environment. All test case scenarios ran against the same test data source. The test environment was built in a container always before an execution of the test suite started. With this setup all regression tests returned comparable results.

Multiply solution

It was easy to scale the tests to different locations (DE, EN, AUT, CN). Because tests in Testup can be created in modules, we could create robust test chains that could run against different manufacturing sites. Tests also returned comparable results on stage and production. Only one module, the login process, had to be changed, while the following test cases remained stable.

Analyse results

With the automatically generated visual reports, the customer was able to preview existing and new features and provide us with much faster and more detailed feedback early during development.

Maintain testsuite

With the solution found maintaining the test suite became natural. After a short introduction all colleagues could maintain the tests and easily add additional feature tests to the suite.

The Impact

New releases can be done much faster and the communication with the customer became much easier

The solution installed saved us and our customer at least 5 man days for each release.

Since the test cases can be created without coding the developers can now focus on their own tasks while the test can be extended by our designer and our technical writer.

The communication and feedback with our customers became more detailed and project-related as recording summaries can be printed out and presented to the customer for visual inspections:

  • Important requirements were confirmed by our customer right after the tests
  • With the visual test results, all new features of eacha software release are documented in detail, which increases the confidence in our product among all parties involved

Our customer was happy with the the new test automation solution since they get auto generated visual test reports done by Testup every day. This also improved the communication and feedback between customer’s project management and business lines.

Share on

Share on facebook
Share on google
Share on twitter
Share on linkedin

Liked this article?

We have a lot more where that came from!
Join the subscribers who stay ahead of the pack.

By entering your email, you agree to our Terms of Service and Privacy Policy.

Well done so far!

Was something unclear?

We have our own Slack workspace for your support, which you are welcome to join.