Posted on Leave a comment

Text inputs

To enter and send text inputs to the Test Device:

Make sure the Editor is in mode.

Make sure the entry field on the Device Screen is active.

  1. Click on on Editor menu.
  2. Type the text with your keyboard.
  3. Press [Enter] on your keyboard to send the input to the Test Device.

Please notice

As an advanced user you can skip pressing .
Just type in the text and press [Enter] to confirm and play the action.

Posted on Leave a comment

Our Journey to No-Code Test Automation

For the last 14 years, I have been working on tools for developers at Thetaris. My Co-founder Stefan and I developed, we developed all kinds of tools, from Excel plugins, financial mathematics libraries, test suites, apps to a full-fledged IDE for our own programming language ThetaML. During this work, we found that many developers in our community struggle with maintaining their applications. The developers fix a bug or implement a new requirement and suddenly, a seemingly unrelated feature of the application breaks.

Unit Testing is part of the solution

There should be an easy answer: testing. From the large projects we completed at Thetaris, we know that Unit-Tests are part of the solution. They are quick and can be used to automatically stop bugs from entering the code case. But they are not sufficient. The applications still break.

Manual testing is mandatory

Manual testing is an expensive and time-consuming solution. However, it works. The testers identify not only functional issues, but also UX glitches and text typos. Consequently, testers need the focus of attention. The testers should be enabled to maintain their own automated tests. Over the years, we tried many different approaches to reach this goal.

Selenium-Python, Cucumber

I thought, why not make my testers to QA engineers. We created a Python library which uses a simple language such that test cases are easy to understand and easy to extend. In other projects we used Cucumber, a simple language to make test cases easy to understand. Both approaches delivered the same result: A QA engineer is required for the language definition and testers can run tests. In some cases, tester can add test themselves. But, usually, they need a developer again who changes some of the application code.

Visual Testing

Why would that be? Why can testers not just test the software without knowledge of the internal workings? I thought that a manual tester uses the User Interface, only. This must be completely sufficient to write automated tests using the UI. Using my computer vision experiences, I created a prototype in Python to provide a proof of concept for a visual test automation. It worked surprisingly well. No inner knowledge of the application was necessary anymore.

Testing in Cloud

Another main issue testers face when running automated tests is the constantly changing infrastructure: E.g. Google Chrome gets an update and the Selenium Driver breaks. The connection of the native app using Appium on the local desk is another constant source of issues. Working in the cloud with Browserstack for native devices and Mabl for websites shows that testing belongs in the cloud. Testers are more productive and happier when they do not have to care about the test system infrastructure.

Simplicity

The last missing piece to a wide acceptance of test tools by testers is simplicity. I am lucky that my Co-founder is a UX nerd. During the development of our own test platform, Stefan included iteration after iteration to minimize the required user interaction for test recording. Minimizing the decisions a user has to make, we are also minimizing errors the user can do. We constantly collect feedback from new users of our application and simplify it further.

Putting it all together: Testup

Now, we have put it all together in the Testup project: Visual Testing using Computer Vision, Infrastructure in the Cloud and Simplicity by No-Code test creation. The effort is fruitful: Test are easy to create, easy to ready and easy to change. The next step is the version 0.9 which we will release in a few days with an open beta. We are looking forward to your feedback!

Posted on Leave a comment

How can I insert a “page-down” command?

Option 1

Just press the key on Editor menu in Insert mode.

Option 2

Just press the key on your keyboard.

Option 3

Just click on the scrolling bar on the Device Screen and then play the action.

Option 4

Just swipe by holding the mouse button down, where the swipe shall start and release the mouse button where the swipe ends. Click on “Play this” to perform the action on the system under test.

There’s a special page just about scrolling.

Posted on Leave a comment

I cannot continue. I get a red button [NOT FOUND]. What can I do?

The anchor image cannot be found on the Device screen. This can mainly two reasons. Let’s go through them.

Issue 1: Your website has changed.

A common reason for the is that your website has changed. Thus, the image which we call anchor area cannot be found on the website. Make sure that your anchor area do not change. Animations or written date stamps are common pit falls. Here is a description how you should choose your anchor area. Now click on the red button and select “Retake image”.

Issue 2: You skipped a few steps in the editor

Reset the system under test by choosing “Play to here“.

If the problem stays, you probably have Issue 1 and need to “Retake Image”.

Posted on Leave a comment

How can I select an entry of a drop down menu? My click does not work.

In some cases, scheduling a click on a drop down menu entry will always select the first entry. In this case, you need to use the keyboard for selecting the proper entry:

Make the drop down menu active by scheduling a mouse click on it. Run the click.
Schedule <DOWN> until you reach the entry you need.
Schedule <ENTER> for selecting the entry.

Posted on Leave a comment

I do not want testup.io to interfere with Google Analytics. What can I do?

If you are running testup.io in your production environment, the test execution will show up in Google Analytics. The best way to prevent this from happening is to create a filter for our IP address. Here is what you do:

Exclude Testup IP Address From Google Analytics

  1. Login to Google Analytics and select your profile.
  2. Select the Admin menu.
  3. Under Account select All Filters.
  4. Click Add Filter.
  5. Give the filter a name (can be anything, e.g. TestUP IP)
  6. Leave Filter Type as predefined.
  7. It should read: Exclude + traffic from the IP addresses + that are equal to.
  8. Enter the IP address :
3.65.122.186 

Posted on Leave a comment

Structure of the testup.io App

Overview

The testup.io app has a clear structure.

Projects

On the first hierarchical level you find the projects.

Test cases

For every project you can define several test cases.

Recordings

Everytime you run a test, TestUp automatically makes a recording. You’ll find them by clicking on the open-button on the testcase overview.

Recording Viewer

To inspect the recording in detail, you can click the view-button to see pictures of the recorded and run test.

Posted on Leave a comment

Create Test Case

After setting up new project you can see the empty testcase overview. As there is no test case recorded yet, the page is blank.

  1. Click .
  2. Enter Name of testcase.
    This will help you to keep the overview if you have several testcases in one project.
  3. Select Test.
  4. Select the device: Browser, Desktop or Mobile.
  5. Choose Browser to test in Webbrowser.
  6. Enter the Url of the website you like to test.
  7. Leave Chrome by default or choose Chrome (Selenium)/Firefox.
  8. Click to start recording the test.

Advanced

  1. Select Folder if you want to keep your tests organised in a folder.
  2. Select Successor Test and choose a Predecessor if you want to extend your test.
    Possible Predecessors are the other test cases in this project and they are shown in the selection menu. You can either keep per default the settings of your Predecessor or you can change them by checking the Override box.
  3. Choose the Dimensions of the device on which you’d like to test your website.
    If you don’t find a suitable device, set Width and Height according to your individual needs.

Please notice

If you like to learn basic actions in the Editor before creating your first real test case, leave all setting by default. This will take you to testup.io Playground.