Compuverde

Purpose and goal

The goal for this project was to increase the read and write performance in Compuverde´s distributed storage system by using a cache instead of always retrieving stored data from the hard disk. Our performance measurements (see separate report) show that our cache has increased the throughput with a factor 5-75 (depending on the use case). The response time has decreased with a factor 10-100 depending on the workload. The cache developed in this project puts the performance of Compuverde´s storage system ahead of the competition. This means that we have reached the goal of the project.

Results and expected effects

We have implemented and evaluated a cache for Compuverde´s distributed storage system. The cache functionality is implemented in software and the data in the cache are stored in small and fast SSDs (Solid State Disks) connected to the storage servers in the system. We expected that the cache would put Compuverde´s storage system ahead of the competition regarding throughput and access times; we have achieved this. Our performance evaluation shows that the cache has increased the throughput with a factor 5-75 (depending on the case); the response time has decreased with a factor 10-100.

Approach and implementation

The project had three phases: 1. Developing a first cache prototype - 6 months 2. Evaluating the prototype - 3 months 3. Developing and evaluating a final cache system - 6 months Developing and evaluating the prototype helped us to identify the performance bottlenecks in the system. The experiences from the prototype were thus very valuable when we developed the final cache system. We also had a very productive cooperation with the researchers from Blekinge Institute of Technology, and we could benefit from their long experience of working with multiprocessor cache systems.