LetItBench provides a set of non-optimized and approximation-resilient application which can be targeted by automatic tools to leverage the approximation opportunities that they offer.

1. Requirements
2. Benchmarks
3. Benchmarks Configuration
4. Run the Benchmarks

• A recent version of CMake (>=3.12):
  • Most linux distribution provides a CMake package (may be an outdated version).
  • Pre-build binaries for multiple systems can be downloaded from the cmake website.
• GNU make

The benchmarks configuration resides in the LetItBench/benchmarks_configuration folder. This folder contains:

• MasterConfig.cmake
  • Set the variable COMMON_BATCH_NUM to configure the number of runs.
  • Set the list COMMON_BENCH_COMPILE_OPTION to the relevant compilation options.
  • Set the list COMMON_BENCH_LINK_OPTION to the relevant linker options.
  • Set the list BENCHMARK_SET to point to a new application configuration file to add a new application.
• <ApplicationName>.cmake
  • Set the list *_COMPILE_OPTIONS to override the common compilation options.
  • Set the list *_LINK_OPTIONS to override the common compilation options.
  • Uncomment *_BATCH_NUM to override the number of batch runs for this application.
  • Create new run by creating a list starting with its name and followed by the application parameters.
  • Disable / Enable runs by removing / adding a run (application parameters) to the *_BENCHMARKS list.

Follow the following instructions in a terminal:

git clone https://github.com/Syllo/LetItBench.git
mkdir -p LetItBench/build && cd LetItBench/build
cmake ..
make bench # To run only one time
make batch-bench # To run the benchmarks multiple times in a row (see BATCH_NUM in Configuration)
make gather-data # To gather the data from all the runs into a single file

The results will be available in the directory LetItBench/benchmarks_result_directory.