As more and more companies are migrating (or planning to migrate) from on-premise to Cloud, their focus is to find anomalies and deficits as early as possible in the development life cycle. This presentation will introduce Frisbee, a next-generation platform designed to address the pain points that developers and QA engineers face when testing a distribution application. Among others, Frisbee helps in modeling complex topologies with dynamic operating conditions, scaling from a single workstation to hundreds of machines, and performing automated checks for deviation from expected behavior.

Given a template describing the system under test and a workflow describing the experiment, Frisbee automatically interfaces with Kubernetes to i) deploy the application software in containers ii) launch performance benchmarks iii) apply Chaos practices at running components iv) monitor site-wide health metrics v) and notify systems with status updates during the testing procedure. We demonstrate the practicality of Frisbee through a series of tests that help developers in understanding uncertainties at the level of application (e.g., dynamically changing request patterns), infrastructure (e.g., crashes, network partitions), and deployment (e.g., network distance, saturation points).

The tool is available at: https://github.com/CARV-ICS-FORTH/frisbee