Papers Accepted

Session 1: Testing Systems of Systems (09:00 am - 09.30 am) - Session Chair: Barbara Russo

Invited Speaker:

Validating System of Systems: approaches and open challenges, Francisco Gortazar


The IT industry is in the process of modernizing their assets to embrace the cloud-native paradigm and be ready for a fierce market competition that is pushing time-to-market to its minimum, by releasing value several times a day. Despite this pressure, we shall not forgot that the software we are releasing needs to be reliable, safe and secure. The validation of these system of systems poses new challenges. We will explore current industrial and research practices and open challenges when validating these system of systems. Presentation Available

Design for Testability of ERMTS Applications (09:30 am - 09:50 am) - Presentation Available

Andrea Riboni, Luca Guglielmo, Matteo Orrù, Pietro Braione and Giovanni Denaro

Towards In-Vivo Testing of Mobile Applications (09:50 am - 10:10 am) - Presentation Available

Mariano Ceccato, Luca Gazzola, Fitsum Meshesha Kifetew, Leonardo Mariani, Matteo Orrù and Paolo Tonella

Governing Regression Testing in Systems of Systems (10:10 am - 10:30 am) - Presentation Available

Antonia Bertolino , Guglielmo De Angelis and Francesca Lonetti

Session 2: Architecture and evolution (11:00 am - 11:30 am) - Session Chair: Davide Rossi

Invited Speaker:

Test-based Scalability and Resilience Assessment of Microservice-based Software Systems, Andrè van Hoorn


Microservice-based software systems promise high degrees of (auto-)scalability and resilience. Load and resilience testing are established measurement-based techniques to assess these quality properties. However, their application in the context of microservices is challenging, e.g., due to the architectural system complexity, uncertainties in the operational environment, and modern development paradigms such as DevOps. In this talk, I will present some of our recent approaches to assess scalability and resilience for microservices in the DevOps context. The approaches employ the automated generation and efficient execution of load and resilience tests based on automatically extracted operational data and architectural information. - Presentation Available

Introducing Trust in Service-oriented Distributed Systems through Blockchain (11:30 am - 11:50 am) - Presentation Available

Marco Autili, Francesco Gallo, Paola Inverardi, Claudio Pompilio and Massimo Tivoli

Big-data Applications as Self-adaptive Systems of Systems (11:50 am - 12:10 pm) - Presentation Available

Luciano Baresi, Giovanni Denaro and Giovanni Quattrocchi

Automatic performance monitoring and regression testing during the transition from monolith to microservices (12:10 am - 12:30 pm) - Presentation Available

Barbara Russo and Andrea Janes

Session 3: Reliability and resilience (01:30 pm - 02:00 pm) - Session Chair: Francesco Gallo

Invited Speaker:

Ensuring and demonstrating diverse quality attributes of complex systems: problems of models and cultures, Lorenzo Strigini


We live among very complex systems that work efficiently and safely, apparently justifying our trust in them. Yet justifying that trust and preserving it, while the systems, their environment, and the threats against them, change, is difficult enough to motivate this workshop. This talk will focus on the variety, emphasised in the workshop's programme, of "quality attributes that SoSs must satisfy such as reliability, security, resilience": it will discuss the need for addressing these diverse attributes together, and the difficulties in doing so, even for "planned" engineered systems, for reasons both technical and cultural; and speculate on how the methods in use can scale towards better assurance for less planned and more complex socio-technical systems. - Presentation Available

Avoiding Faults due to Dangling Dependencies by Synchronization in Microservices Applications (02:00 pm - 02:20 pm) - Presentation Available

Antonio De Iasio and Eugenio Zimeo

Resilient Reactive Systems based on Runtime Semantic Models (02:20 pm - 02:40 pm) - Presentation Available

Ester Giallonardo, Francesco Poggi, Davide Rossi and Eugenio Zimeo

A Hybrid Framework for Web Services Reliability and Performance Assessment (02:40 pm - 03:00 pm) - Presentation Available

Antonio Guerriero, Raffaela Mirandola, Roberto Pietrantuono and Stefano Russo

Session 4: Anomaly detection (03:30 pm - 04:00 pm) - Session Chair: Eugenio Zimeo

Invited Speaker:

Assessing and Improving the Trustworthiness of Cloud Applications: The ATMOSPHERE Approach, Marco Vieira


Self-adaptive cloud applications should be able to reflect on their own state and perform adaptations to achieve specific goals. Quality models can be used to express trustworthiness properties such as security, privacy, fairness, etc., and are a way to represent the goals of an application. In practice, one quality model allows computing a score by continuously aggregating raw data collected from the system, portraying how trustworthy that system is. In this talk we will discuss a framework and a platform for measuring and improving trustworthiness properties of applications that are deployed in cloud environments. The framework specifies a trustworthiness assessment lifecycle inspired in MAPE-K, and covers both design-time and run-time aspects. The platform implements a distributed monitoring system based on probes, which is highly flexible and supports the analysis. Trustworthiness scores are used to plan adaptations by evaluating rules, which are finally executed by means of actuators deployed in the system. A concrete example of application in an industrial project will be presented. - Presentation Available

Anomaly Detection as-a-service (04:00 pm - 04:20 pm) - Presentation Available

Marco Mobilio, Matteo Orru, Oliviero Riganelli, Alessandro Tundo and Leonardo Mariani

Towards Runtime Monitoring for malicious behaviors detection in Smart Ecosystems (04:20 pm - 04:40 pm)

Emilia Cioroaica, Felicita Di Giandomenico, Thomas Kuhn, Francesca Lonetti, Eda Marchetti, Jasmin Jahic and Frank Schnicke