Distributed Function Cache for Heterogeneous Serverless Cloud - Artificial Intelligence Lab, IRT b<>com
Poster De Conférence Année : 2023

Distributed Function Cache for Heterogeneous Serverless Cloud

Résumé

Serverless computing relies on the composition of short-lived stateless functions that are executed following events such as HTTP requests. These functions are mostly deployed in containers called ”replicas”. Scaling a FaaS application, i.e. to maintain a consistent level of performance, consists in growing or shrinking the pool of function replicas following load peaks. When a function is requested while no replica exists on the cluster, it goes through a cold start that incurs an additional initialization delay to the function’s response time. Function images are stored in repositories on dedicated nodes and pulled by worker nodes where and when functions are deployed. Depending on image size, this can have detrimental consequences on request latency with deployments where cold starts dominate a function’s total response time. To mitigate these issues, we propose a distributed function cache that opportunistically takes advantage of available disk space and memory on worker nodes in the cluster. Such nodes are highly heterogeneous: we consider functions that can be executed on different platform architectures, ranging from CPUs, to GPUs and FPGAs. Furthermore, storage on these nodes exhibit various levels of performance and cost, ranging from HDDs, to SSDs and NVMs. By proactively caching functions from the same application using adequate storage on the same nodes, we seek to minimize cold starts and data movement to improve total response times. We evaluate our platform in a simulation environment using workload traces derived from Microsoft’s Azure Functions, enriched with measurements from a deepfake detection project at the B<>com Institute of Research and Technology.
Fichier principal
Vignette du fichier
Per3S_Poster (4).pdf (469.03 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04303898 , version 1 (23-11-2023)

Licence

Identifiants

  • HAL Id : hal-04303898 , version 1

Citer

Vincent Lannurien, Laurent D’orazio, Olivier Barais, Stephane Paquelet, Jalil Boukhobza. Distributed Function Cache for Heterogeneous Serverless Cloud. Per3S - Performance and Scalability of Storage Systems, May 2023, Paris, France. pp.1-1, 2023. ⟨hal-04303898⟩
94 Consultations
89 Téléchargements

Partager

More