Store official GH pipeline benchmarks separately #146
Labels
feature
New feature or request
infrastructure
Non-quantum things to improve the robustness of our package, e.g. CI/CD
Within the run_benchmarks.sh script, we just save everything in the ucc/benchmarks/results folder. It would be nice if we had a way to separate these official runs (on the GH action) from local testing runs we might do, or indeed the previous local runs from before we implemented the pipeline.
One way to do this is to modify the benchmark script something like
This would also solve the problem of file conflicts when writing to datafiles created on the same day (initially this is something I did to not end up with a bunch of individual datafiles when running multiple compiler x benchmark combinations in parallel.
In #133 I change the ucc/benchmarks/scripts/save function to only append to the same file if they were run in the same hour on the same day, which seems like a reasonable compromise to me.
The text was updated successfully, but these errors were encountered: