5th Workshop on
Validation, Analysis and Evolution of Software Tests

March 18, 2022 | co-located with SANER 2022, Honolulu, Hawaii Virtual

Call for Papers

Aims, scope and topics of interest.

Software projects accumulate large sets of test cases, encoding valuable expert knowledge about the software under test to the extent of many person years. Over time the reliability of the tests decreases, and they become difficult to understand and maintain. Extra effort is required for repairing broken tests and for adapting test suites and models to evolving software systems.

The International Workshop on Validation, Analysis and Evolution of Software Tests (VST) is a unique event bringing together academics, industrial researchers, and practitioners for exchanging experiences, solutions and new ideas in applying methods, techniques and tools from software analysis, evolution and re-engineering to advance the state of the art in test development and maintenance.

VST 2022 is the 5th of a series of workshops following VST 2021, VST 2020, VST 2018 and, VST 2016.

The workshop invites high quality submissions related, but are not limited, to:

 ●  Test minimization and simplification

 ●  Fault localization and automated repair

 ●  Change analysis for software tests

 ●  Test visualization

 ●  Test validation

 ●  Documentation analysis

 ●  Bug report analysis

 ●  Test evolution

 ●  Test case generation

 ●  Model-based testing

 ●  Combinations of the topics above

  Download Call for Papers (txt)

Important Dates

Anywhere on earth.

Abstract submission deadline December 10, 2021 AoE

Paper submission deadline December 17, 2021 AoE

Notifications January 7, 2022

Camera Ready January 12, 2022


Instructions and submission site.

We encourage submissions on the topics mentioned above with a page limit of max 8 pages, IEEE format. In addition, we will also allow position papers and tool demo papers of two to four pages.

Papers will be by reviewed by at least three program committee members following a full double-blind review process. Paper selection is based on scientific originality, novelty, and the potential to generate interesting discussions. Accepted papers will be published in the IEEE Digital Library along with the SANER proceedings.

Submission Instructions

  • Papers must not exceed the page limit of 8 pages (including all text, references, appendices, and figures), position papers and tool demos 2-4 pages

  • Papers must conform to the IEEE formatting guidelines for conference proceedings

  • Papers must be original work that has neither appeared elsewhere for publication nor which is under review for another publication

  • Papers must be submitted in PDF format at https://easychair.org/conferences/?conf=vst2022

  Submit your paper at: VST 2022 EasyChair submission site


Location and schedule.

Online - 12:00-16:45 UTC
New York - 08:00-12:45 EST (UTC-5)
London - 12:00-16:45 GMT (UTC+0)
Vienna - 13:00-17:45 CET (UTC+1)
Tokyo - 21:00-01:45+1 JST (UTC+9)

13:00-13:10 CET - Welcome    (8:00 EST, 12:00 GMT, 13:00 CET, 14:00 EET, 21:00 JST)
13:10-14:10 CET
Keynote: Do Tests Generated by AI Help Developers? Open Challenges, Applications, and Opportunities
Annibale Panichella

Keynote Slides

Do Tests Generated by AI Help Developers? Open Challenges,
Applications, and Opportunities

Annibale Panichella

Abstract - Nowadays, Artificial intelligence (AI) plays a critical role in automating different human-intensive tasks, including software engineering tasks. Since the late 70s, researchers have proposed automated techniques to automatically generate test data (fuzzing) or test suites (test suite generation). Proposed techniques span from simple heuristics to more advanced AI-based techniques and evolutionary intelligence in particular. While recent studies have shown that these techniques achieve high coverage and find bugs, generated tests can be hard to understand and maintain. This talk will provide an overview and reflection on state-of-the-art techniques, open challenges, and research opportunities towards more accessible tests that are easy to integrate within the DevOps cycle. To this aim, the talk will cover relevant application domains, including "traditional" software and emerging cyber-physical systems.

Bio - Annibale Panichella is an Assistant Professor in the Software Engineering Research Group (SERG) at Delft University of Technology (TU Delft) in the Netherlands. He is the head of the Computation Intelligence for Software Engineering Lab (CISELab) within Software Engineering Group (SERG) in Delft. His research interests include security testing, software testing, search-based software engineering, testing for AI, empirical software engineering. He serves and has served as a program committee member of various international conferences (e.g., ICSE, ESEC/FSE, ISSTA, GECCO, ICST, ICPC) and as a reviewer for international journals (e.g., TSE, TOSEM, TEVC, EMSE, STVR) in the fields of software engineering and evolutionary intelligence. More details can be found at: https://apanichella.github.io.

14:10-14:20 CET - Chat & Break
14:20-14:40 CET
Fault Localization in Server-Side Applications Using Spectrum-Based Fault Localization
Yoshitomo Sha, Masataka Nagura and Shingo Takada

14:40-15:00 CET
Using Source Code Metrics for Predicting Metamorphic Relations at Method Level
Alejandra Duque-Torres, Dietmar Pfahl, Claus Klammer and Stefan Fischer

15:00-15:20 CET
iTest: Using coverage measurements to improve test efficiency
Stefan Fischer, Denise Rigoni and Nikola Obrenović

15:20-15:30 CET - Chat & Break
15:30-15:50 CET
An Exploratory Study on the Characteristics of Gherkin Specifications in Open-Source Projects
Adwait Chandorkar, Nitish Patkar, Andrea Di Sorbo and Oscar Nierstrasz

15:50-16:10 CET
What do we know about readability of test code? - A Systematic Mapping Study
Dietmar Winkler, Pirmin Urbanke and Rudolf Ramler

16:10-16:30 CET
Type Profiling to the Rescue: Test Amplification in Python and Smalltalk
Serge Demeyer, Mehrdad Abdi and Ebert Schoofs

16:30-16:40 CET - Chat & Break
16:40-17:00 CET
ProPy: Prolog-based Fault Localization Tool for Python
Janneke Morin and Krishnendu Ghosh

17:00-17:20 CET
Visualizing Web Application Execution Log to Improve Software Security Defect Localization
Matthew Puentes, Yunsen Lei, Noëlle Rakotondravony, Lane Harrison and Craig Shue

17:20-17:45 CET - Discussion & Closing


Chairs and program committee.

Program Committee

Pekka Aho, Open University, The Netherlands

Cyrille Artho, KTH Royal Institute of Technology, Sweden

Serge Demeyer, University of Antwerp, Belgium

Alexander Egyed, Johannes Kepler University Linz, Austria

Michael Felderer, University of Innsbruck, Austria

Angelo Gargantini, University of Bergamo, Italy

Vahid Garousi, Queen's University Belfast, United Kingdom

Sebastiano Panichella, Zurich University of Applied Sciences, Switzerland

Dietmar Pfahl, University of Tartu, Estonia

Fiorella Zampetti, University of Sannio, Italy


Get In touch.

Email us