Commit Graph

11 Commits

Author SHA1 Message Date
Guillaume Raffy a8203589b7 added example use of clusterbench_submit for running a production hibridon benchmark on IPR's alambix cluster
work related to [https://bugzilla.ipr.univ-rennes.fr/show_bug.cgi?id=3958]
2024-12-10 18:57:54 +01:00
Guillaume Raffy b85f381241 v0.0.15
- clusterbench-submit now appends the cluster job number to the launcher. This will improve traceability.

work related to [https://bugzilla.ipr.univ-rennes.fr/show_bug.cgi?id=3958]
2024-11-27 13:50:38 +01:00
Guillaume Raffy 263474eb5a v0.0.14
- fixes to validate that `clusterbench-submit` work in a real situation (on alambix cluster):
  - fixed bug in hibridon benchmark where the requested ram was way too small
  - made sure the location of iprbench hardcoded virtual env path is writable
  - fixed bug in exception message
- updated the `README.md`

work related to [https://bugzilla.ipr.univ-rennes.fr/show_bug.cgi?id=3958]
2024-11-27 11:02:54 +01:00
Guillaume Raffy 8d674055bc v0.0.13
- minor change (renamed example becnchmark name 'hibench' as 'hibridon')

work related to [https://bugzilla.ipr.univ-rennes.fr/show_bug.cgi?id=3958]
2024-11-26 16:56:11 +01:00
Guillaume Raffy 011d4eddf9 refactored iprbench to separate ipr benchmark framework from the actual benchmarks
This decoupling allows to write benchmarks as modules that can be used in various situations (from a benchmark job or directly from a user), but this design will allow automatic registering of the benchmark results in a user selectable form (sql database, stdout, etc.)

- separated `hibenchonphysix.py` into `clusterbench.py` (tool to run a benchmark on a cluster) and `hibench.py` (hibridon benchmark module) so that `clusterbench.py` no longer has a knowledge about hibridon.
- there are currently 2 ways to run a bechmark:
  1. as a simple run through `clusterbench-run` command (which will eventually be renamed as iprbench-run since it might be completely independent from the concept of cluster)
  2. as cluster jobs  through `clusterbench-submit` command
- added unit test
- added another benchmark `mamul1` that is used as a unittest because it has 2 benefits over `hibench` benchmark:
   1. it's standalone (no external resources needed)
   2. it's quicker to execute

note: this refactoring work is not complete yet, but the concept  proof is complete (the 2 unittests pass):
- still need to provide the user a way to switch between IpRCluster and DummyCluster(which is only intended to only be used for testing clusterbench))
- still need to run multiple configs of the same benchmark in one run (as hibenchonphysix did)

work related to [https://bugzilla.ipr.univ-rennes.fr/show_bug.cgi?id=3958] and [https://bugzilla.ipr.univ-rennes.fr/show_bug.cgi?id=3372]
2024-10-22 09:16:41 +02:00
Guillaume Raffy fe4a07a67e refactored all iprbench code found in `usecases/ipr/hibench` into a `iprbench` python package
The main motivation for this is to allow the code executed by jobs to benefit from multiple packages (eg iprbench, [stargemm](https://github.com/g-raffy/starbench), cocluto) to perform common missing tasks such as registering the results output in the iprbench database.

work related to [https://bugzilla.ipr.univ-rennes.fr/show_bug.cgi?id=3958] and [https://bugzilla.ipr.univ-rennes.fr/show_bug.cgi?id=3372]
2024-10-10 18:06:09 +02:00
Guillaume Raffy c4732fee87 improved usecase file hierarchy to accomodate multiple uses cases 2024-09-27 23:53:24 +02:00
Guillaume Raffy c05ff89d29 added a complete standalone usage example (mamul1: mutiplication of matrices) in the form of a unit test
note: [matmul] is a copy of [https://github.com/g-raffy/flobe/tree/main/benchmarks/mamul1]
2024-06-30 15:53:03 +02:00
Guillaume Raffy b8c8a1b0e6 turned starbench into an installable package
work related to  [https://bugzilla.ipr.univ-rennes.fr/show_bug.cgi?id=3878]
2024-06-21 14:48:00 +02:00
Guillaume Raffy f87e564528 reorganized files and documented 2022-06-10 08:39:22 +02:00
g-raffy 165da43619
Create README.md 2022-06-09 15:59:52 +02:00