The HotCloudPerf workshop proposes a meeting venue for academics and practitioners, from experts to trainees, in the field of cloud computing performance. The new understanding of cloud computing covers the full computational continuum from data centers to edge resources to IoT sensors and devices. The workshop aims to engage this community and to lead to the development of new methodological aspects for gaining a deeper understanding not only of cloud performance, but also of cloud operation and behavior, through diverse quantitative evaluation tools, including benchmarks, metrics, and workload generators. The workshop focuses on novel cloud properties such as elasticity, performance isolation, dependability, and other non-functional system properties, in addition to classical performance-related metrics such as response time, throughput, scalability, and efficiency.

The HotCloudPerf workshop is technically sponsored by the Standard Performance Evaluation Corporation (SPEC)’s Research Group (RG) and is organized annually by the RG Cloud Group. HotCloudPerf has emerged from the series of yearly meetings organized by the RG Cloud Group, since 2013. The RG Cloud Group group is taking a broad approach, relevant for both academia and industry, to cloud benchmarking, quantitative evaluation, and experimental analysis.

09:00 Opening

Session 1: AI performance
Chaired by Klervie Toczé

09:10 Keynote: “The Cloud AI Imperative: Performance, Regulation, and Intelligent Automation” by Padma Apparao

10:10  SPEC RG Cloud highlights

10:30 Morning coffee break

Session 2: Resource management and performance evaluation
Chaired by Tommaso Cucinotta

11:00 Anders Nou, Sacheendra Talluri, Alexandru Iosup, Daniele Bonetta
        Investigating Performance Overhead of Distributed Tracing in Microservices and Serverless Systems
        Short Workshop Paper

11:20 Zhiqi Li, Ruiqi Yu, Jianshu Liu
        IrisBench: An Open-source Benchmark Suite for Video Processing Systems in Cloud
        Full Workshop Paper

11:45 Klervie Toczé
        Introducing Resource Awareness Levels in Edge Computing Resource Management
        Short Workshop Paper

12:05 Sharod Roychoudhury, Dheeraj Chahal, Rekha Singhal
        GenAI for Bottleneck Detection in Cloud Architecture
        Full Workshop Paper (online)

12:30 Lunch break

Session 3: Memory and service performance
Chaired by Cristina Abad

14:00 James McMahon, Vinita Pawar, Ryan Stutsman
        Remote Memory Prefetching: Is Coarse-grained Fine?
        Full Workshop Paper  

14:25 Vinita Pawar, Ankit Bhardwaj, Ryan Stutsman
        ObjectTier: Non-invasively Boosting Memory Tiering Performance
        Full Workshop Paper

14:50 Sándor Battaglini-Fischer, Bálint László Szarvas, Nishanthi Srinivasan, Xiaoyu Chu, Alexandru Iosup
        FAILS: A Framework for Automated Collection and Analysis of LLM Service Incidents
        Full Workshop Paper (Online)

15:15 Afternoon coffee break

Session 4: Applications & performance modeling
Chaired by Klervie Toczé

16:00 Yannik Lubas, Martin Straesser, Ivo Rohwer, Samuel Kounev, André Bauer
        Microservice Applications and Their Workloads on Github
              Full Workshop Paper  

16:25 Panel: Performance modeling for the computing continuum
Moderator: Klervie Toczé
Panelists: Padma Apparao (Intel), Tommaso Cucinotta (Scuola Universitaria Superiore Pisa), Matthijs Jansen (Vrije Universiteit Amsterdam), Jose Castillo Lema (RedHat) 

17:20 Closing

17:30 End of HotCloudPerf 2025

1. Empirical performance studies in cloud computing environments, applications, and systems, including observation, measurement, and surveys.

2. Performance analysis using modeling and queueing theory for cloud environments, applications, and systems.

3. Simulation-based studies for all aspects of cloud computing performance.

4. Operational techniques for self-organization, resource management, and scheduling in cloud environments, e.g. service meshes, auto-scaling, auto-tiering.

5. End-to-end performance engineering for pipelines and workflows in cloud environments, or of applications with non-trivial SLAs.

6. Tools for monitoring and studying cloud computing performance.

7. General and specific methods and methodologies for understanding and engineering cloud performance.

8. Methodological and practical aspects of software engineering, performance engineering, and computer systems related to hot topics in cloud performance, e.g. serverless, microservices, non Von Neumann architectures, virtualization/containerization.

9. Case studies on cloud performance and its interaction with the computing continuum, including benchmarking, exploratory studies, dataset collection and negative results.

10. Sustainability and energy-efficiency in cloud computing environments, applications, and systems.

11. Network, storage and accelerators in the computing continuum.

Cloud computing environments, applications, and systems should be understood in the broad sense and include works looking at the computing continuum (i.e. IoT-edge/fog-cloud). 

1. Full-papers (6 pages including tables and figures but not references and appendices)

2. Short-papers (3 pages including tables and figures but not references and appendices)

3. Talk only (1-2 pages, not included in the proceedings).

The format of the submissions is single-blind and needs to follow the ACM format of the companion conference, ICPE.

All presented papers will have a good amount of time allocated for Q&A plus feedback. In addition, the presentation session will be wrapped up by a 10-15 min discussion. 

By submitting your article to an ACM Publication, you are hereby acknowledging that you and your co-authors are subject to all ACM Publications Policies, including ACM’s new Publications Policy on Research Involving Human Participants and Subjects. Alleged violations of this policy or any ACM Publications Policy will be investigated by ACM and may result in a full retraction of your paper, in addition to other potential penalties, as per ACM Publications Policy.

Please ensure that you and your co-authors obtain an ORCID ID, so you can complete the publishing process for your accepted paper. ACM has been involved in ORCID from the start and we have recently made a commitment to collect ORCID IDs from all of our published authors. The collection process has started and will roll out as a requirement throughout 2022. We are committed to improve author discoverability, ensure proper attribution and contribute to ongoing community efforts around name normalization; your ORCID ID will help in these efforts.

Articles and talk-only contributions are required to be submitted via HotCRP. 

You can find the full Call for Papers (CfP) here: CfP

Klervie Toczé, VU Amsterdam, the Netherlands

André Bauer, Illinois Institute of Technology, USA

Dragi Kimovski, Klagenfurt University, Austria

Daniele Bonetta, VU Amsterdam, the Netherlands

To contact the chairs, you can send an email. 

Cristina L. Abad, Escuela Superior Politécnica del Litoral, Ecuador

Nikolas Herbst, University of Würzburg, Germany

Alexandru Iosup, VU Amsterdam, the Netherlands