Commit Graph

63 Commits

Author SHA1 Message Date
Guillaume Raffy 431f728793 the cmake options are no longer hardcoded
This way, it's more flexible and it will allow this code to be independant from hibridon
2022-06-02 15:59:27 +02:00
Guillaume Raffy ac639b3a08 fixed bug that coused the checkout to fait because it was performed from a non-git repository
also removed unneed hibridon dependency (it's planned to make this bench code work for any git/cmake repository)
2022-06-02 15:58:00 +02:00
Guillaume Raffy 97a04d2831 it's now possible to choose aversion of the code to test
note: previously, it didn't work
2022-06-02 14:34:14 +02:00
Guillaume Raffy 05ec8a5181 made `hibench.py` (better name than `starbench.py`) parse options so that it is more generic.
This change will allow jobs to perform hibridon benchmarks
2022-06-02 13:01:16 +02:00
Guillaume Raffy c65cd60a54 measure_hibridon_perf now takes the name of the test as a parameter to make it more generic 2022-06-01 16:17:10 +02:00
Guillaume Raffy ddcb9f1175 now the number of threads per run is restricted to what the user asks 2022-06-01 12:06:58 +02:00
Guillaume Raffy 0ecddcf8f8 minor flake fix 2022-06-01 12:06:10 +02:00
Guillaume Raffy d45d53c3ac fixed bugs discovered after running from scratch 2022-06-01 12:05:28 +02:00
Guillaume Raffy e643be2435 cleanup by removing debug traces and replacing them with useful messages 2022-05-31 19:03:00 +02:00
Guillaume Raffy 9b12ce7cd2 added a way to redirect stdout and stderr to files to avoid pollution on the console 2022-05-31 18:55:16 +02:00
Guillaume Raffy 34fc73cccf added support for commands depending on worker to `StarBencher`
This allows `measure_hibridon_perf` to launch `ctest` in a safe way (each worker has its own build directory). As a result, measure_hibridon_perf now works.
2022-05-31 17:59:28 +02:00
Guillaume Raffy 35d271ff63 added support for various stop conditions in `StarBencher`
added an extra stop condition in which the command is simply executed once

however, I found out that `measure_hibridon_perf` doesn't currently work because it suffers from racing conditions : if multiple tests are runat the same time, the output file gets writtent by multiple processes, which cause some tests to fail because they can't find the output file if the timings is wrong....
2022-05-31 16:50:38 +02:00
Guillaume Raffy f136861893 added a tool to measure the performance of a specific version of hibridon
This benchmarking tool includes `starbench` a benchmarking method (inspired by `hpl`'s `stardgemm`) which runs the same command in parallel, so that performance is measured in conditions similar to what a user would experience in a compute cluster environment.

This is functional but still work in progress (the code dates from the 03/05/2022).
2022-05-31 12:37:00 +02:00