Testup.io – The best way to find bugs
Author: gutjen
Jenny spearheads our marketing efforts. She’s successfully creating and implementing strategies that enhance our brand visibility and market presence. Her expertise is key to communicating our value proposition effectively to our target audience.
X-info Switch from Selenium to Testup
The Challenge
Create an easy maintainable test suite
Our software is a dashboard to provide data visualization of manufacturing key figures. One of our customers is the leading automotive manufacturers in Munich. Our smart mining solution enables the management to optimize the output of all assembly lines.
Our situation was that we performed manually the final acceptance of our dashboard data visualization software with us as the supplier. This required a lot of time with some communication loops. Some test cases were already written in Selenium, but this also cost us a lot of programming effort and tied up a lot of resources for maintenance and enhancement.
We were looking for a better solution that is faster and easier to maintain.
About the company
Xinfo is developing intelligent software solutions for the systematic improvement of efficiency, maintenance and QM processes.
Number of Employees
15
Industry
Automotive
Testup was used for
Replace Selenium tests and create a new test suite
ROI
Reduced manual regression testing time by 5x
The Solution – Replace Selenium with Testup
Switching from Selenium to Testup made our test suite more flexible and much easier to maintain
Within 6 months, the Thetaris team set up for us a cloud solution on premise in the customer network and built a test suite for all business functions.
Manage Execution Delay
Some response times of data analysis reports were a real critical problem for Selenium. Due to the large amount of data, the calculation of some results took longer than a minute. These results were no longer processed by Selenium in time.
Our new solution handles very long response times. During visual object recognition, Testup waits impassively for minutes before evaluating the comparison. Now the automation expert can set timeouts for each assertion easily.
Manage Testdata
One of the game changer was to connect a dedicated data snapshot to our test environment. All test case scenarios ran against the same test data source. The test environment was built in a container always before an execution of the test suite started. With this setup all regression tests returned comparable results.
Multiply Solution
It was easy to scale the tests to different locations (DE, EN, AUT, CN). Because tests in Testup can be created in modules, we could create robust test chains that could run against different manufacturing sites. Tests also returned comparable results on stage and production. Only one module, the login process, had to be changed, while the following test cases remained stable.
Analyse Results
With the automatically generated visual reports, the customer was able to preview existing and new features and provide us with much faster and more detailed feedback early during development.
Maintain Testsuite
With the solution found maintaining the test suite became natural. After a short introduction all colleagues could maintain the tests and easily add additional feature tests to the suite.
The Impact
New releases can be done much faster and the communication with the customer became much easier
The solution installed saved us and our customer at least 5 man days for each release.
Since the test cases can be created without coding the developers can now focus on their own tasks while the test can be extended by our designer and our technical writer.
The communication and feedback with our customers became more detailed and project-related as recording summaries can be printed out and presented to the customer for visual inspections:
- Important requirements were confirmed by our customer right after the tests
- With the visual test results, all new features of each software release are documented in detail, which increases the confidence in our product among all parties involved
Our customer was happy with the the new test automation solution since they get auto generated visual test reports done by Testup every day. This also improved the communication and feedback between customer’s project management and business lines.
Life with COVID. Some Ups and Some Downs
Please read the interview of startup.info with Stefan, one of our co-founders. The interview is about how we are dealing with the COVID-19 pandemic.
Structure of the testup.io App
Overview
The testup.io app has a clear structure.
Projects
On the first hierarchical level you find the projects.
Test cases
For every project you can define several test cases.
Recordings
Everytime you run a test, TestUp automatically makes a recording. You’ll find them by clicking on the open-button on the testcase overview.
Recording Viewer
To inspect the recording in detail, you can click the view-button to see pictures of the recorded and run test.
Getting Started
testup.io is a visual test automation app. You don’t need any coding skills. We want you to have an easy start with our app.
After registration/login:
- Click on
- Click on
- Click on
In please type in input data for your test case: name of the test, url (address of the website under test) and dimentions. There is a variety of test devices of your choice. Press and start testing!
The Video gives you a short overview of how you can jump-start your website testing with testup.io.
The Three Parts of the Editor
On the left side of the editor, you see the browser window of your website you like to test.
On the right, there is the list of checks and inputs.
On the top, there is an editor menu.
Anchor Areas
You need to select an anchor area, which indicates that the website is correctly loaded and the next action can be performed.
Anchor areas are easyly recorded by selecting the desired area with the mouse.
Play
By clicking the play button you execute the action(s). Then you can select the next area for a check.
If the testup.io AI finds all recorded areas on the page, the page is good.
Clicking on a Button
A common command on webites is to perform a search on the site by clicking the search button.
The precondition for the search is that the search button is visible on the site. To check this you can mark the area with the search button and schedule a click.
Clicking the play button searches the magnifying glass icon and clicks on it. The search input field will then appeare on the left.
Enter Text
If you want to enter text to a input field, you have to check first, if that input field appeared. If so, you can send text keys to it.
That means your test checks the search input field by selecting it as an anchor area. Then, you schedule a click and play the action.
Then you can schedule text input simply by typing the text you want with your keyboard and press the play button. The text appears then in the input field.
Enter Special Keys
Entering special keys works in the same way as entering text. Just press the key and the command is recorded.
But it is also possible to press one of the special keys in the insert section in the control center.
Pressing the play button will perform the action.
In this test the search results appear.
Swiping
In order to see the picture of the first item in full, you need to scroll.
You can schedule a swipe in the test, just by swiping on the browser screen.
Then you can check that the item is visible in full.
