Research Papers

Building a Classification System for Failed Test Reports: Industrial Experience

Running complex test suites against a financial transaction system produces huge amounts of responses, both expected and unexpected. In this article, we outline our experience of using ML for reliable automatic extraction of "that" unexpected response from a big number of same type messages produced a by system under test. We describe classification approaches and data manipulations we have tried, and explain the final choices. Also we outline business constraints and final design decisions for the resultant tool. We also address the task of classifying difference patterns between expected and actual responses in attempt to provide automated pre-judgement on a reason for test failure. We outline clustering considerations and results achieved.

Read more

Development of Intelligent Virtual Assistant for Software Testing Team

This is a vision paper on incorporating of embodied virtual agents into everyday operations of software testing team. An important property of intelligent virtual agents is their capability to acquire information from their environment as well as from available data bases and information services. Research challenges and issues tied up with development of intelligent virtual assistant for software testing team are discussed.

Read more

Raising the Quality of Bug Reports by Predicting Software Defect Indicators

The descriptive quality of bug reports is one of the essential parts of defect management. Sometimes they provide inadequate or incorrect data about software problems, which can lead to incomplete defect fixing or omission of serious defects. Therefore, it is vital to evaluate and improve the quality of bug reports. This paper proposes an approach that helps to resolve this problem by predicting various indicators. The values of these indicators allow QA engineers to evaluate the quality of defect description and correct it in a suitable way. This paper also introduces Nostradamus, a new open source tool built to implement the approach. The tool uses machine learning techniques to analyze the data stored in software defect repositories and evaluates the interdependence of defect attributes, including such a crucial element as a defect description. This paper describes the approach, the tool that is based on it and the typical use cases.

Read more

Towards a Formal Modelling of Order-driven Trading Systems using Petri Nets: A Multi-Agent Approach

Electronic trading systems provide the computational support for stock exchanges. Liquid markets use order-driven systems, i.e., where client requests, for trading financial instruments, are served through individual orders. This paper presents Petri net models assembling some crucial processes executed within order-driven systems such as orders submission, application of precedence rules, and the order matching mechanism. Such processes were modelled as types of agents running in a multi-agent system (MAS) using nested Petri nets (NP-nets) - a convenient formalism for modelling MAS. With NP-nets, we focus on the control-flow perspective (causal dependence between activities executed by agents) and in the synchronization between agents. Conversely, we have used coloured Petri nets to extend the model including orders as objects with attributes. Thus, this work with Petri nets represents an experimental & initial research phase to validate trading systems using related methods such as process mining, simulations and model checking.

Read more

Overview of Applications of Passive Testing Techniques

Overview of recent research on passive testing methods and tools, which covers 104 manually selected papers most relevant to this topic. The papers were classified according to their approaches, methods, and application areas. Each class is summarized in a separate section. Besides, statistics is provided for the publication time, authorship and most popular topics.

Read more

Analysis of the Characteristics and Causes of Underestimated Bug Reports

The bug-fixing process requires software maintenance resources. Usually, defects are submitted, fixed and closed, but sometimes they have to be reopened because of a change of resolution. It happens when a defect was evaluated incorrectly at the beginning. This problem can increase maintenance costs and software quality in general. In this paper, we investigate the characteristics of such defects and their bug reports and call them “underestimated”. Our research is based on general statistical indicators and text descriptions of defect reports. We propose using different methods of feature selection and ranking in order to reveal the significant terms of such defects. The top of significant terms of the underestimated bug reports can help to find the root causes of such life cycles.

Read more