Welcome to ASCAR Pilot’s documentation!

About ASCAR Pilot

The Pilot Benchmark Framework provides a tool (bench) and a library (libpilot) to automate computer performance measurement tasks. This is a project under active development. The project is designed to answer questions like these that rise often from performance measurement:

  • How long shall I run this benchmark to get a precise result?

  • Is this new scheduler really 3% faster than our old one or is that a measurement error?

  • Which setting is faster for my database, 20 worker threads or 25 threads?


Both Pilot and this documentation are in alpha stage and are under active development. There may be inconsistencies, missing parts, or even errors in this documentation. Should you notice anything wrong, please drop us a message. We also welcome contributions! Please fork the code (which includes this documentation) on github and hack. Send us a pull request when you make something interesting. Thank you!

The main documentation for the site is organized into the following sections:

Indices and tables

Part of this documentation has been published as paper: Yan Li, Yash Gupta, Ethan L. Miller, and Darrell D. E. Long. Pilot: A Framework that Understands How to Do Performance Benchmarks the Right Way. In Proceedings of IEEE 24th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS‘16), 2016.

This is a research project from the Storage Systems Research Center in UC Santa Cruz. This research was supported in part by the National Science Foundation under awards IIP-1266400, CCF-1219163, CNS-1018928, CNS-1528179, by the Department of Energy under award DE-FC02-10ER26017/DESC0005417, by a Symantec Graduate Fellowship, by a grant from Intel Corporation, and by industrial members of the Center for Research in Storage Systems. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the sponsors.