The HotCloudPerf workshop proposes a meeting venue for academics and practitioners, from experts to trainees, in the field of cloud computing performance. The new understanding of cloud computing covers the full computational continuum from data centers to edge resources to IoT sensors and devices. The workshop aims to engage this community and to lead to the development of new methodological aspects for gaining a deeper understanding not only of cloud performance, but also of cloud operation and behavior, through diverse quantitative evaluation tools, including benchmarks, metrics, and workload generators. The workshop focuses on novel cloud properties such as elasticity, performance isolation, dependability, and other non-functional system properties, in addition to classical performance-related metrics such as response time, throughput, scalability, and efficiency.

This seventh edition of the HotCloudPerf is supported by the EU Graph-Massiviser project.
The HotCloudPerf workshop is technically sponsored by the Standard Performance Evaluation Corporation (SPEC)’s Research Group (RG) and is organized annually by the RG Cloud Group. HotCloudPerf has emerged from the series of yearly meetings organized by the RG Cloud Group, since 2013. The RG Cloud Group group is taking a broad approach, relevant for both academia and industry, to cloud benchmarking, quantitative evaluation, and experimental analysis.

ROOM LT308  of the Department of Computing, Imperial College London, 180 Queen’s Gate, SW7 2RH  

09:00 Opening

Session 1: Performance, Scaling and Energy Efficiency. Chaired by Dragi Kimovski

09:10 Keynote 1: “Upscaling messaging and stateful computation” by Josef Spillner

10:00 Dante Niewenhuis, Sacheendra Talluri, Alexandru Iosup and Tiziano De Matteis.
FootPrinter: Quantifying Data Center Carbon Footprint.
Full Workshop Paper

10.20 Sai Sindhur Malleni, Raul Sevilla Canavate and Vishnu Challa.
Into the Fire: Delving into Kubernetes Performance and Scale with Kube-burner.
Invited Talk from ICPE Demo

10:30 Morning coffee break

Session 2: Serverless, Multi-Cloud and Computing Continuum. Chaired by Nikolas Herbst

11:00 Keynote 2: “Engineering serverless application life-cycles in federated serverless infrastructures” by Sas­hko Ris­tov

11:50 Chetan Phalak, Dheeraj Chahal, Manju Ramesh and Rekha Singhal
Towards Geo-Distributed Training of ML Models in a Multi-Cloud Environment
Full Workshop Paper

12:10 Dragi Kimovski
Hypergraphs: Facilitating High-Order Modeling of the Computing Continuum
Short Workshop Paper

12:25 Morning wrap-up

12:30 Lunch break

Session 3: Cloud Native, Kubernetes and Emerging Applications. Chaired by Klervie Toczé

14:00 Keynote 3: “Continuous Developer Feedback for Cloud Native Systems” by Robert Chatley  

14:50 Runyu Jin, Paul Muench, Travis Janssen, Brian Hatfield and Veera Deenadhayalan.
Baking Disaster-Proof Kubernetes Applications with Efficient Recipes.
Full Workshop Paper

15:10 Radu Apşan, Damla Ural, Paul Daniëlse, Eames Trinh, Vlad-Andrei Cursaru, Jesse Donkervliet and Alexandru Iosup.
Towards a Workload Trace Archive for Metaverse Systems
Full Workshop Paper

15:30 Afternoon coffee break

Session 4: Workflows and Systems. Chaired by Cristina Abad

16:00 Simon Triendl and Sashko Ristov
Peeking behind the serverless implementations and deployments of the Montage Workflow
Full Workshop Paper 

16:20 Ivo Rohwer, Maximilian Schwinger, Nikolas Herbst, Peter Friedl, Michael Stephan and Samuel Kounev
Resource Demand Profiling of Monolithic Workflows
Short Workshop Paper

16:35 Debajyoti Halder, Manas Acharya, Aniket Malsane, Anshul Gandhi and Erez Zadok
Empirical Evaluation of ML Models for Per-Job Power Prediction
Full Workshop Paper 

16:55 Zebin Ren, Krijn Doekemeijer and Animesh Trivedi
A Systematic Configuration Space Exploration of the Linux Kyber I/O Scheduler
Full Workshop Paper

17:15 Closing and SPEC RG Cloud Summary

17:30 End of HotCloudPerf 2024 

1. Empirical performance studies in cloud computing environments, applications, and systems, including observation, measurement, and surveys.

2. Performance analysis using modeling and queueing theory for cloud environments, applications, and systems.

3. Simulation-based studies for all aspects of cloud computing performance.

4. Operational techniques for self-organization, resource management, and scheduling in cloud environments, e.g. service meshes, auto-scaling, auto-tiering.

5. End-to-end performance engineering for pipelines and workflows in cloud environments, or of applications with non-trivial SLAs.

6. Tools for monitoring and studying cloud computing performance.

7. General and specific methods and methodologies for understanding and engineering cloud performance.

8. Methodological and practical aspects of software engineering, performance engineering, and computer systems related to hot topics in cloud performance, e.g. serverless, microservices, non Von Neumann architectures, virtualization/containerization.

9. Case studies on cloud performance and its interaction with the computing continuum, including benchmarking, exploratory studies, dataset collection and negative results.

10. Sustainability and energy-efficiency in cloud computing environments, applications, and systems.

11. Network, storage and accelerators in the computing continuum.

Cloud computing environments, applications, and systems should be understood in the broad sense and include works looking at the computing continuum (i.e. IoT-edge/fog-cloud). 

1. Full-papers (6 pages including tables and figures but not references and appendices)

2. Short-papers (3 pages including tables and figures but not references and appendices)

3. Talk only (1-2 pages, not included in the proceedings).

The format of the submissions is single-blind and needs to follow the ACM format of the companion conference, ICPE.

All presented papers will have a good amount of time allocated for Q&A plus feedback. In addition, the presentation session will be wrapped up by a 10-15 min discussion. 

By submitting your article to an ACM Publication, you are hereby acknowledging that you and your co-authors are subject to all ACM Publications Policies, including ACM’s new Publications Policy on Research Involving Human Participants and Subjects. Alleged violations of this policy or any ACM Publications Policy will be investigated by ACM and may result in a full retraction of your paper, in addition to other potential penalties, as per ACM Publications Policy.

Please ensure that you and your co-authors obtain an ORCID ID, so you can complete the publishing process for your accepted paper. ACM has been involved in ORCID from the start and we have recently made a commitment to collect ORCID IDs from all of our published authors. The collection process has started and will roll out as a requirement throughout 2022. We are committed to improve author discoverability, ensure proper attribution and contribute to ongoing community efforts around name normalization; your ORCID ID will help in these efforts.

Articles and talk-only contributions are required to be submitted via EasyChair. The track corresponding to HotCloudPerf2024 should be selected.

You can find the full Call for Papers (CfP) here: CfP

Dragi Kimovski, Klagenfurt University, Austria

Klervie Toczé, Linköping University, Sweden

Nikolas Herbst, University of Würzburg, Germany

Tiziano De Matteis, VU Amsterdam, the Netherlands

To contact the chairs, you can email: hotcloudperf2024@easychair.org 

Cristina L. Abad, Escuela Superior Politécnica del Litoral, Ecuador

Alexandru Iosup, VU Amsterdam, the Netherlands