Scalability Testing Framework (Old)

Design documents and user guide for testing framework

Introduction

The Scalability Testing Framework is designed to support testing client operation tests on distributed hosts. The framework provides means for coordinating a large number of concurrent client operations.

Documents

Design document: https://docs.google.com/a/lbl.gov/document/d/1SV65epwzFxz7OeIdXGCBzl9Pyer_15xM-69LEWPymWs/edit

User Guide

Configuration:

In order to configure framework parameters (e.g. the client host addresses or the number of clients per host), the user will need to set values in the config.yaml file. This file contains a map for all relevant framework data and can even be used for defining input values for the client programs' execution commands.

Most values in the map are either strings or integers. The client host addresses are in the form of a list of lists. Each element of the outer list represents a single host. The inner lists contain only two values: the host address and the host port.

Client Programs:

The framework is used to define the environment and input for the client programs. The client program can be anything from a "curl" command to a script to a multithreaded Java program. The name of the file or package will need to be identified in the config file. The means for compiling and/or running the program will need to be defined in the MessengerThread's run routine. Currently, any programs to be run will need to be copied to the hosts manually. Automated copying using SCP is still being developed.