NTMIST 2012 Abstracts

Full Papers Short Papers
Full Papers
Paper Nr: 1
Title:

Change Impact Analysis for Large-scale Enterprise Systems
Authors:

Wen Chen, Asif Iqbal, Akbar Abdrakhmanov, Jay Parlar, Chris George, Mark Lawford, Tom Maibaum and Alan Wassyng
Abstract: This paper is concerned with analysing the potential impact of changes to enterprise systems, and in particular on how regression testing following such changes can be minimised. The target scope of the approach we describe in this paper is systems containing hundreds of thousands of classes and millions of methods. It is extremely difficult and costly to apply regular regression testing techniques to such systems. Retesting everything after a change is very expensive, and in practice often unnecessary. Selective retesting is dangerous if the impacts of change are not understood, and analysing such systems to understand what is being changed and what the impacts are is difficult. This paper proposes a way to perform a change impact analysis which makes it possible to do efficient, targeted regression testing of enterprise systems. Our approach has been tried on a large system comprising 4.6 million methods with 10 million dependences between them. Using our approach, maintainers can focus on a smaller, relevant subset of their test suites instead of doing testing blindly. We include a case study that illustrates the savings that can be attained.
Download
Short Papers
Paper Nr: 2
Title:

Performance Impact of Fuzz Testing Windows Embedded Handheld Applications
Authors:

Nizam Abdallah and Sita Ramakrishnan
Abstract: Mobile systems are increasingly impacting our personal and business lives. It is crucial that we develop mobile software applications that are robust, efficient and deliver value to a wide range of users. As a result, appropriate software testing methodologies need to be employed during the development of these mobile applications to ensure high level of quality and robustness. Software test automation methodologies and fuzz testing techniques have proven to be successful in finding defects during the development lifecycle. However, due to the fact that mobile devices are resource constrained devices with limited memory and CPU, there are performance constraints that need to be considered when developing a test automation framework for mobile devices. This research introduces Torqueo. Torqueo is an automated fuzz testing tool designed specifically to target Windows Embedded Handheld GUI applications. It is capable of interacting with GUI applications using either Win32 API or .NET reflection API, and it is also capable of executing test scenarios from pre-generated test data and randomly generated test data at run time. The experiments described in this paper discuss the performance impact on memory usage of invoking GUI controls using the Win32 API vs. .NET reflection.
Download
Paper Nr: 4
Title:

Fault Injection for Web-services
Authors:

Marek Rychlý and Martin Žouželka
Abstract: Recently, web-services have become a popular technology for implementing information systems as service-oriented applications. The service orientation allows to decompose complex software systems into collections of cooperating and autonomous components which communicate asynchronously via messages of appropriate formats. Nevertheless, the assurance of reliability and robustness of these systems is becoming more and more complicated matter. For this reason, the new testing methods such as fault injection and specialised tools for automated validation of web-services appear. This paper discusses the design, implementation, and evaluation of a tool for software implemented fault injection into web-services. This tool allows to monitor and to test the most common types of web-services according to given setup criteria.
Download