Posted on Leave a comment

X-info Switch from Selenium to Testup

The Challenge

Create an easy maintainable test suite

Our software is a dashboard to provide data visualization of manufacturing key figures. One of our customers is the leading automotive manufacturers in Munich. Our smart mining solution enables the management to optimize the output of all assembly lines.

Our situation was that we performed manually the final acceptance of our dashboard data visualization software with us as the supplier. This required a lot of time with some communication loops. Some test cases were already written in Selenium, but this also cost us a lot of programming effort and tied up a lot of resources for maintenance and enhancement.

We were looking for a better solution that is faster and easier to maintain.

About the company

Xinfo is developing intelligent software solutions for the systematic improvement of efficiency, maintenance and QM processes.

Number of Employees

15

Industry

Software Automation

Testup was used for

Replace Selenium tests and create a new test suite

ROI

Reduced manual regression testing time by 5x

The Solution – Replace Selenium with Testup

Switching from Selenium to Testup made our test suite more flexible and much easier to maintain.

Within 6 months, the Thetaris team set up for us a cloud solution on premise in the customer network and built a test suite for all business functions.

Manage execution delay

Some response times of data analysis reports were a real critical problem for Selenium. Due to the large amount of data, the calculation of some results took longer than a minute. These results were no longer processed by Selenium in time.

Our new solution handles very long response times. During visual object recognition, Testup waits impassively for minutes before evaluating the comparison. Now the automation expert can set timeouts for each assertion easily.

Manage testdata

One of the game changer was to connect a dedicated data snapshot to our test environment. All test case scenarios ran against the same test data source. The test environment was built in a container always before an execution of the test suite started. With this setup all regression tests returned comparable results.

Multiply solution

It was easy to scale the tests to different locations (DE, EN, AUT, CN). Because tests in Testup can be created in modules, we could create robust test chains that could run against different manufacturing sites. Tests also returned comparable results on stage and production. Only one module, the login process, had to be changed, while the following test cases remained stable.

Analyse results

With the automatically generated visual reports, the customer was able to preview existing and new features and provide us with much faster and more detailed feedback early during development.

Maintain testsuite

With the solution found maintaining the test suite became natural. After a short introduction all colleagues could maintain the tests and easily add additional feature tests to the suite.

The Impact

New releases can be done much faster and the communication with the customer became much easier

The solution installed saved us and our customer at least 5 man days for each release.

Since the test cases can be created without coding the developers can now focus on their own tasks while the test can be extended by our designer and our technical writer.

The communication and feedback with our customers became more detailed and project-related as recording summaries can be printed out and presented to the customer for visual inspections:

  • Important requirements were confirmed by our customer right after the tests
  • With the visual test results, all new features of eacha software release are documented in detail, which increases the confidence in our product among all parties involved

Our customer was happy with the the new test automation solution since they get auto generated visual test reports done by Testup every day. This also improved the communication and feedback between customer’s project management and business lines.

Posted on Leave a comment

Structure of the Testup app

Overview

The Testup app has a clear structure.

Projects

On the first hierarchical level you find the projects.

Test cases

For every project you can define several test cases.

Recordings

Everytime you run a test, TestUp automatically makes a recording. You’ll find them by clicking on the open-button on the testcase overview.

Recording Viewer

To inspect the recording in detail, you can click the view-button to see pictures of the recorded and run test.

Posted on Leave a comment

Create Test Case

After setting up new project you can see the empty testcase overview. As there is no test case recorded yet, the page is blank.

  1. Click on the top right.
  2. Enter Name of testcase.
    This will help you to keep the overview if you have several testcases in one project.
  3. Leave Predecessor field empty unless you want to extend your test.
    Possible Predecessors are the other test cases in this project and they are shown in the selection menu.
  4. Leave the System by default to test in Webbrowser.
  5. Enter the Url of the website you like to test.
  6. Choose the Dimensions of the device on which you’d like to test your website.
    If you don’t find a suitable device, set Width and Height according to your individual needs.
  7. Click on the top right to start recording the test.

Please notice

If you like to learn basic actions in the Editor before creating your first real test case, leave all setting by default. This will take you to Testup Playground.

Posted on Leave a comment

Getting Started

Testup is a visual test automation app. You don’t need any coding skills and we want you to have an easy start with our app.

After registration/login:

  1. Click on
  2. Click on
  3. Click on

In  please type in input data for your test case: name of the test, url (address of the website under test) and dimentions. There is a variety of test devices of your choice. Press  and start testing!

The Video gives you a short overview of how you can jump-start your website testing with Testup.

The Three Parts of the Editor

On the left side of the editor, you see the browser window of your website you like to test.

On the right, there is the list of checks and inputs.

Anchor Areas

You need to select an anchor area, which indicates that the website is correctly loaded and the next action can be performed.

Anchor areas are easyly recorded by selecting the desired area with the mouse.

Play

By clicking the play button you execute the actrion(s). Then you can select the next area for a check.

If the Testup AI finds all recorded areas on the page, the page is good.

Clicking on a Button

A common command on webites is to perform a search on the site by clicking the search button. 

The precondition for the search is that the search button is visible on the site. To check this you can mark the area with the search button and schedule a click.

Clicking the play button searches the magnifying glass icon and clicks on it. The search input field will then appeare on the left.

Enter Text

If you want to enter text to a input field, you have to check first, ir that input field appeared. If so, you can send text keys to it. 

That means your test checks the search input field by selecting it as an anchor area. Then, you schedule a click and play the action. 

Then you can schedule text input simply by typing the text you want with your keyboard and press the play button. The text appears then in the input field.

Enter Special Keys

Entering special keys works in the same way as entering text. Just press the key and the command is recorded. 

But it is also possible to press one of the special keys in the insert section in the control center.

Pressing the play button will perform the action.

In this test the search results appear. 

Swiping

In order to see the picture of the first item in full, you need to scroll. 

You can schedule a swipe in the test, just by swiping on the browser screen. 

Then you can check that the item is visible in full.