results [TAST DokuWiki ]

User Tools

Site Tools


Sidebar

First steps in TAST

What is UML

Computer setup for TAST use

FAQ

Recognized Issues

TAST tool Menu

TAST Adaptors

Adaptors examples

TAST Integrations

Interesting features

Documentation of technical administration

Modeling recommendations

Training in the TAST tool

results

This is an old revision of the document!


Results

This option of TAST allows the user to see the results of the Test Cases executed.

A list of Test Sets executed for a specific domain and project is displayed, with information about execution times and status. It can be filtered by:

  • Domain.
  • Project.
  • Test Set.
  • User.

The list of test sets, will also show the following information for each Test Set:

  • Name of the Test Set.
  • Diagram name / Test case data name.
  • Starting time of the Test Set execution.
  • Finishing time of the Test Set execution.
  • Status: is the result of the execution (OK or KO).
  • Actions: with the following indicators:
    • Updated to ALM: YES or NO.
    • Download evidence: using this option you can store in a PC directory the evidence of test cases executed
    • Path of the Test Case Data.
    • Download evidences document

Upload results to ALM

Sometimes you may want to optimize your time by running your tests without uploading to ALM, with the idea of uploading them later on, when you´re satisfied with the results, or just because you want to upload them while you have lunch. The option “Upload results to ALM” on the Top Right corner will help you to organize your schedule and decide when and what you want to upload to ALM.

This option allows to upload to ALM a Test Set, or a group of them. You can use the data fields to filter the results list. If you want to upload a set of TS as a result of your filter, you can check-in the “Select all” check/box and all the elements displayed will be selected. The check box is located on the left side of the List headers.

IMPORTANT: Only the visible elements will be selected; this means that if the result of the filter uses more than one page, only the visible page will be affected. Would you want to select more TS, you can navigate to the next screen and select the rest of TS, the previous selection will remain active unless you check-out the “Select all” option.

Once you are happy with the selection, press the “Upload results to ALM” button.


A new screen will be displayed to define the parameters of the upload.

All fields must be fulfilled before the upload is allowed:

  • Test Set Name (Manual input).
  • ALM Domain (A dropdown box allows to select the Domain).
  • ALM Project (A dropdown box allows to select the Project).
  • Test Plan Folder (A pop-up window will show the Folder Tree corresponding to the Domain/Project).
  • Test Lab Folder (A pop-up window will show the Folder Tree corresponding to the Domain/Project/Test Plan).

Upload results to ALM step by step

To upload to ALM step by step we have to go to Results in TAST then choose the test set we want to upload and click the button “upload to ALM“ as we explain in the last part (Upload to ALM).

Once the pop-up appears, we have to select the checkbox of „“Step by step“ if we want to activate this new functionality and save the results by steps in ALM.

Then configure the upload to ALM. Once is uploaded, open ALM and search for the test we have uploaded. After that we choose the execution we want, for example like in the following image.



Consecutively in the “new test instance“ details window we have to click in runs and then choose the run ID (and click it), for example:

Finally we are in “run details“ in this window we have to click in steps and then we will see al the documented steps uploaded from the executed tcd. If a step comes with a clip a screenshot is attached to it.


Results Evidences Document

From the Results page, you can access to the Results Evidence Document. You must click in the Document Evidence button on the “Actions” column.

Example of Evidence Document

This is an example of the Results evidence document:

ts_testinggatesnoisalated_13.02.2019_13.18.32_13.02.2019_13.18.54.docx

Structure of the Evidence Document

The structure of the Results Evidence Document is the following:

Introduction

  • Test Set ID.
  • Name of Test Case.
  • Number of steps.
  • Final Result of the Test Set.
  • Description of the Test Case.
  • Result Details.
  • Link to Diagram.
  • Link to Test Case Data.
  • Link to Test Set.

(for each step) Execution Steps

  • Step number.
  • Mapped element (message).
  • Parameters.
  • Description.
  • Expected Result.
  • Actual Result.
  • Step Result.

Download of the Evidence Document

It is possible to download the evidence document by clicking the icon into the execution result and saving the document in the desired path, as presented in the following image:

IMPORTANT: There are cases, that due to the dimension of the evidences, the document generation takes some time and a warning message appears, informing you that you should click again the download button for properly downloading the evidence document.

results.1576598257.txt.gz · Last modified: 2019/12/17 15:57 by montse