[ocaml-platform] Benchmarking in OPAM

[Thomas Gazagnaire]

>> So for the moment, focussing on the benchmark library would seem to
>> be the best thing to do: I've not really used any of them, and would
>> be interested in knowing what I ought to adopt for (e.g.) the Mirage
>> protocol libraries.  Once we have that in place, the OPAM test integration
>> should be much more straightforward.
> 
> Maybe this is also a good time to promote a single benchmarking
> framework.  As the other two libraries mentioned by Török Edwin,
> Benchmark computes the mean and std deviation — it just does not
> expose them to the user.  All these libs have a lot in common and,
> IMHO, it would be best to merge the features of the 3 libraries.  I
> agree with the proposed split.  As I understand it:
> 
> - Benchmark: type defining what is a benchmarking sample, functions to
>  write and read it to a simple format [more complex formats,
>  e.g. XML, can be supported by Benchmark_manager], functions to
>  perform tests (min number of samples, min running time).
> 
> - Benchmark_manager: all the rest. Statistical tests,... as already
>  described by Gabriel.
> 

FWI, few months ago Pierre has also started to work on a bench framework (which uses OPAM to set-up some kind of environment for the benchs):

https://github.com/chambart/ocp-bench

--
Thomas