Andrea Stocco
Scientific Researcher at fortiss • Assistant Professor at the Technical University of Munich
fortiss
Guerickestr. 25, München
office 317
---TUM
Boltzmannstr. 3, Garching bei München
office 01.11.037
I am a scientific researcher and head of the Automated Software Testing (AST) Field of Competence at fortiss and an Assistant Professor at the Chair of Software Engineering for Data-intensive Applications of the School of Computation, Information and Technology of the Technical University of Munich (TUM).
My research focuses on the interface between software engineering and deep learning with the goals of improving the robustness, reliability, and dependability of data-intensive software systems.
Current interests involve monitoring techniques and automated functional oracles for deep learning-based systems, with a particular focus on autonomous vehicles, and the robustness and maintainability of test suites of modern web applications.
My current and past topics are:
- Testing AI-based systems
[ICSE 2025, ICST 2025a, ICST205b, ICSEW 2025, TOSEM 2024, EMSE 2024, TSE 2022, ASE 2022, JSEP 2021, ICST 2021, ICSE 2020, EMSE 2020, ISSREW 2020] - Grey literature analysis
[QUATIC 2023, SOFSEM 2021, ICSTW 2021] - Studies of JS bugs
[ICST 2019, STVR 2020] - Computer vision for Software Engineering
[TSE 2020, ESEC/FSE 2018, STVR 2017, SAC 2015, SCAM 2014] - Near-duplicate detection in web app models
[ICSE 2020] - Assertion-preserving test minimization
[ICSE 2018] - Web test generation
[ICST 2020, ESEC/FSE 2019] - Web test repair
[FSE 2016, ESEC/FSE 2018] - Web test robustness
[JSEP 2016, ICST 2015, SBST 2015, ISSREW 2014, WSE 2013] - Web test maintainability
[SQJ 2017, ICWE 2016, AST 2015]
news
| Apr 04, 2025 |  The paper Benchmarking Generative AI Models for Deep Learning Test Input Generation received the IEEE Computer Society TCSE Distinguished Paper Award at ICST 2025! |
|---|---|
| Apr 04, 2025 | The paper Benchmarking Image Perturbations for Testing Automated Driving Assistance Systems received the IEEE Computer Society TCSE Distinguished Paper Award at ICST 2025! |
| Mar 30, 2025 |  The paper Automated Factual Benchmarking for In-Car Conversational Systems using Large Language Models has been accepted for publication at IV 2025 (Main Technical Track)! |
| Mar 12, 2025 |  I joined the editorial board of the Empirical Software Engineering journal! Consider submitting your research! |
| Jan 19, 2025 | The paper Efficient Domain Augmentation for Autonomous Driving Testing Using Diffusion Models has been accepted for publication at ICSE 2025 (Main Technical Track)! |
| Dec 18, 2024 | Two papers accepted for ICST 2025 (Main Technical Track)! |
| Dec 18, 2024 | The paper System Safety Monitoring of Learned Components Using Temporal Metric Forecasting has been accepted for publication at ACM Transactions on Software Engineering and Methodology! |
| Dec 10, 2024 | The paper Two is Better Than One: Digital Siblings to Improve Autonomous Driving Testing has been accepted for presentation in the Journal-first track of ICSE 2025! |
| Dec 09, 2024 | The paper OpenCat: Improving Interoperability of ADS Testing has been accepted for publication at DeepTest 2025! |
| Dec 04, 2024 | I joined the PC of ICSE 2026! Have a look at the CfP and consider submitting your research! |
| Oct 19, 2024 | I joined the PC of the FORGE 2025 (Data and Benchmarking track)! Have a look at the CfP and consider submitting your research! |
| May 13, 2024 | I joined the PC of FSE 2025! Have a look at the CfP and consider submitting your research! |
| May 12, 2024 | I joined the PC of ICST 2025! Have a look at the CfP and consider submitting your research! |
| Apr 09, 2024 | I joined the PC of ISSTA 2025! Have a look at the CfP and consider submitting your research! |
| Mar 30, 2024 | I joined the editorial board of the Journal of Software: Evolution and Process! |
| Mar 04, 2024 | I have been recognized as a Distinguished Reviewer 2023 for the IEEE Transactions on Software Engineering (top 7% contributors) |
| Mar 01, 2024 | I have been recognized as a Distinguished Reviewer 2023 for the ACM Transactions on Software engineering and Methodology |
| Feb 08, 2024 | The paper Two is Better Than One: Digital Siblings to Improve Autonomous Driving Testing has been accepted for publication in Empirical Software Engineering! |
| Jan 31, 2024 | I am the Program Chair of SCAM 2024 (Research Track)! Have a look at the CfP and consider submitting your research! |
| Jan 04, 2024 | I joined the PC of the QUATIC 2024 (Thematic Track Verification, Validation, and Testing)! Have a look at the CfP and consider submitting your research! |
| Dec 07, 2023 | I joined the PC of the FORGE 2024! Have a look at the CfP and consider submitting your research! |
| Dec 07, 2023 | I joined the PC of the AIST 2024! Have a look at the CfP and consider submitting your research! |
| Dec 07, 2023 | The paper Assessing Quality Metrics for Neural Reality Gap Input Mitigation in Autonomous Driving Testing has been accepted for publication at ICST 2024 (Main Reseach Track)! |
| Dec 07, 2023 | The paper Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification has been accepted for publication at ICST 2024 (Main Reseach Track)! |
| Nov 28, 2023 | I joined the PC of the ASE 2024! Have a look at the CfP and consider submitting your research! |
| Oct 15, 2023 | I joined the PC of the ESEC/FSE 2024 (Industry Track)! Have a look at the CfP and consider submitting your research! |
| Sep 19, 2023 | I joined the PC of the ICSME 2024! Have a look at the CfP and consider submitting your research! |
| Sep 14, 2023 | Best Paper Award for the paper A Retrospective Analysis of Grey Literature for AI-supported Test Automation at QUATIC 2023 |
| Aug 31, 2023 | I joined the PC of the SANER 2024! Have a look at the CfP and consider submitting your research! |
| Aug 09, 2023 | I joined the PC of the SWQD 2024! Have a look at the CfP and consider submitting your research! |
| Jul 27, 2023 | I joined the PC of the ICST 2024! Have a look at the CfP and consider submitting your research! |
| Jul 03, 2023 | I joined the PC of the SSBSE 2023 (Replication and Negative Results / New Ideas and Emerging Results Track)! Have a look at the CfP and consider submitting your research! |
| Jun 21, 2023 | The paper A Retrospective Analysis of Grey Literature for AI-supported Test Automation has been accepted for QUATIC 2023 (Verification, Validation, and Testing track)! |
| Jun 20, 2023 | I joined the PC of the ReSAISE 2024! Have a look at the CfP and consider submitting your research! |
| Jun 12, 2023 | I joined the ACM TOSEM Replicated Computational Results Distinguished Reviewers Board |
| May 21, 2023 | I joined the PC of the SCAM 2023 (Replication and Negative Results Track)! Have a look at the CfP and consider submitting your research! |
| May 17, 2023 | I joined the PC of the ISSRE 2023! Have a look at the CfP and consider submitting your research! |
| May 10, 2023 | I joined the PC of the ASE 2023! Have a look at the CfP and consider submitting your research! |
| May 09, 2023 | I joined the PC of the SCAM 2023 (New Ideas and Emerging Results Track)! Have a look at the CfP and consider submitting your research! |
| Apr 24, 2023 | I joined the PC of the WAISE 2023! Have a look at the CfP and consider submitting your research! |
| Apr 05, 2023 | I joined the OC of the ESEC/FSE 2024 as a social media co-chair! Have a look at the CfP and consider submitting your research! |
| Mar 06, 2023 | I joined the PC of the ESEC/FSE 2023 (Ideas, Visions and Reflections Track)! Have a look at the CfP and consider submitting your research! |
| Mar 01, 2023 | 💥 I joined fortiss GmbH as Head of the Automated Software Testing unit. |
| Mar 01, 2023 | 💥 I joined the Technical University of Munich (TUM) as an Assistant Professor at the Chair of Software Engineering for Data-intensive Applications of the School of Computation, Information and Technology. |
| Feb 13, 2023 | I joined the defense committee of Hazem Fahmy, Ph.D. candidate at the University of Luxembourg. The PhD topic is Automated Debugging and Repair of DNN-based Safety-critical Software Systems. |
| Feb 02, 2023 | I joined the PC of the ICSME 2023! Have a look at the CfP and consider submitting your research! |
| Jan 27, 2023 | The paper Model vs System Level Testing of Autonomous Driving Systems: A Replication and Extension Study has been accepted for publication in Empirical Software Engineering! |
| Dec 12, 2022 | I joined the PC of the ESEC/FSE 2023 (Industry Track)! Have a look at the CfP and consider submitting your research! |
| Nov 14, 2022 | 🏎 The hackathon Formula USI 2022 has successfully taken place: 40 students have competed over three days to realize their first self-driving car based on the Donkey Car platform and win 9,000 CHF. Have you missed the event? You can access our YouTube playlist. |
| Nov 11, 2022 | I am co-organizing the 4th International Workshop on Testing for Deep Learning and Deep Learning for Testing (DeepTest 2023) within the ICSE 2023 conference! Have a look at the CfP and consider submitting your research! |
| Oct 10, 2022 |  I gave a keynote about the topic of Testing and Evaluation of Autonomous Driving Systems: From Simulated to Real-world Test Environments at the 1st Workshop on Autonomous Software Testing (AUST) co-located ASE 2022 at the Oakland Center, Michigan, USA 🇺🇸 |
| Oct 03, 2022 | I joined the PC of the 2023 ACM Web Conference (formerly known as International World Wide Web Conference, abbreviated WWW)! Have a look at the CfP and consider submitting your research! |
| Sep 26, 2022 | I am the Program Chair of ICSE 2024 (Demonstration Track)! Have a look at the CfP and consider submitting your research! |
| Sep 24, 2022 | I joined the PC of SANER 2023 (Reproducibility Studies and Negative Results Track)! Have a look at the CfP and consider submitting your research! |
| Sep 20, 2022 | I joined the ACM TOSEM Board of Distinguished Reviewers |
| Aug 16, 2022 | The paper Mind the Gap! A Study on the Transferability of Virtual vs Physical-world Testing of Autonomous Driving Systems has been accepted for publication in IEEE Transactions on Software Engineering! |
| Jul 21, 2022 | The paper ThirdEye: Attention Maps for Safe Autonomous Driving Systems has been accepted for publication at ASE 2022 (Main Reseach Track)! |
| Jul 18, 2022 | I joined the PC of SANER 2023! Have a look at the CfP and consider submitting your research! |
| May 17, 2022 | I joined the PC of SSBSE 2022 (Replications and Negative Results) within the ESEC/FSE 2022 conference! Have a look at the CfP and consider submitting your research! |
| Mar 10, 2022 | I gave a talk about the topic of Testing and Evaluation of Autonomous Driving Systems: From Simulated to Real-world Test Environments at the Software Institute Seminars 🇨🇭 Here’s a YouTube screencast |
| Mar 01, 2022 | I joined the PC of ISSRE 2022! Have a look at the CfP and consider submitting your research! |
| Feb 28, 2022 | I joined the PC of SCAM 2022 (Replication and Negative Results Track) colocated with ICSME 2022! Have a look at the CfP and consider submitting your research! |
| Nov 30, 2021 | I gave a talk about the topic of Testing and Evaluation of Autonomous Driving Systems: From Simulated to Real-world Test Environments at the Swedish Association for Software Testing (SAST) 🇸🇪 together with Dr. Gunel Jahangirova |
| Nov 22, 2021 | I joined the PC of SANER 2022 (Reproducibility Studies and Negative Results Track)! Have a look at the CfP and consider submitting your research! |
| Nov 17, 2021 | I joined the PC of ICWE 2022! Have a look at the CfP and consider submitting your research! |
| Nov 07, 2021 | 🏎 The hackathon Formula USI 2021 has successfully taken place: 32 students have competed over three days to realize their first self-driving car based on the Donkey Car platform and win 5,000 CHF. Have you missed the event? You can access our YouTube playlist. |
| Oct 07, 2021 | I joined the OC of ASE 2022 as a Review Process Co-Chair! Have a look at the CfP and consider submitting your research! |
| Sep 10, 2021 | I joined the PC of ICST 2022! Have a look at the CfP and consider submitting your research! |
| Sep 09, 2021 | The paper Confidence-driven Weighted Retraining for Predicting Safety-Critical Failures in Autonomous Driving Systems has been accepted for publication at Journal of Software: Evolution and Process! |
| Jul 01, 2021 | I joined the PC of GAUSS 2021, co-located with ISSRE 2021! Have a look at the CfP and consider submitting your research! |
| May 05, 2021 | I joined the PC of ISSRE 2021! Have a look at the CfP and consider submitting your research! |
| May 01, 2021 | I joined the PC of SSBSE 2021 (Replications and Negative Results) within the ESEM 2021 conference! Have a look at the CfP and consider submitting your research! |
| Apr 16, 2021 | Best Presentation Award for the paper Web Test Automation: Insights from the Grey Literature at NEXTA 2021 |
| Feb 10, 2021 | One paper accepted for ICST Workshops 2021 (IEEE Workshop on NEXt level of Test Automation)! |
| Jan 18, 2021 | I joined the PC of MobileSoft 2021 (Vision and Tool Demos) within the ICSE 2021 conference! Have a look at the CfP and consider submitting your research! |
| Dec 23, 2020 |  The paper Web Test Automation: Insights from the Grey Literature has been nominated for the Best Paper Award at SOFSEM 2021 (Foundations of Software Engineering track)! |
| Dec 11, 2020 | The paper Quality Metrics and Oracles for Autonomous Vehicles Testing has been accepted for publication at ICST 2021 (Main Reseach Track)! |
| Dec 03, 2020 | I am co-organizing the 3rd International Workshop on Testing for Deep Learning and Deep Learning for Testing (DeepTest 2021) within the ICSE 2021 conference! Have a look at the CfP and consider submitting your research! |
| Dec 03, 2020 | I am co-organizing the 5h International Workshop on Programming Technology for the Future Web (ProWeb 2021) within the Programming 2021 conference! Have a look at the CfP and consider submitting your research! |
| Nov 11, 2020 | I joined the PC of ICWE 2021. Consider submitting your research! Conference is going to be from May 18 to May 21, in Biarritz, France :france:. |
| Oct 13, 2020 | The paper A Survey on the Use of Computer Vision to Improve Software Engineering Tasks has been accepted for publication in IEEE Transactions on Software Engineering! |
| Sep 25, 2020 | Our graduate Marco Calzana wins the Swissengineering Ticino Award (and 1,000 CHF) for the best MSc thesis in Informatics! |
| Sep 21, 2020 | The paper Web Test Automation: Insights from the Grey Literature has been accepted for SOFSEM 2021 (Foundations of Software Engineering track)! |
| Aug 25, 2020 | The paper Towards Anomaly Detectors that Learn Continuously has been accepted for GAUSS 2020! |
| Jul 31, 2020 | The paper Testing Machine Learning based Systems: A Systematic Mapping has been accepted for publication in Empirical Software Engineering! |
| Jul 22, 2020 | The paper BugsJS: A Benchmark and Taxonomy of JavaScript Bugs has been accepted for publication in Software Testing, Verification and Reliability! |
| Jul 12, 2020 | I joined the PC of ESEC/FSE 2021. Consider submitting your research! Conference is going to be from August 23 to August 27, 2021 in Athens, Greece  . |
| Jul 11, 2020 | ACM SIGSOFT Distinguished Artifact Awards for the paper Taxonomy of Real Faults in Deep Learning Systems at ICSE 2020 |
| Jul 06, 2020 | I joined the PC of ICST 2021. Consider submitting your research! Conference is going to be virtual from April 12 to April 16, 2021. |
| Dec 10, 2019 | The paper Dependency-Aware Web Test Generation has been accepted for publication in ICST 2020 (Main Reseach Track)! |
| Dec 09, 2019 | Three papers accepted for ICSE 2020 (Main Technical Track)! |
| Sep 19, 2019 | I gave a talk about the topic of Black-box Confidence Estimation for Misbehavior Prediction in Autonomous Driving Systems at the Software Institute Seminars 🇨🇭 |
| May 24, 2019 | Two papers accepted for ESEC/FSE 2019 (Main Technical Track)! |