Patrick East e6727cbdf2 Add opa bench and opa test --bench ...

This adds in a new CLI sub command `opa bench` which will load
and evaluate similar to `opa eval` but will perform benchmark testing
of the query.

There is also a new `--bench` option for `opa test` which will
similarly perform benchmarking, except on the unit tests.

Both use the golang testing frameworks benchmark tooling, and the
output format is compliant with the go benchmark standard when using
the newly added `gobench` output format option.

They both support specifying a `--count` to run the benchmark a
number of times and a `--benchmem` option to report memory statistics.

To help enable using the `opa test` command better with the benchmark
option there is now a `--run`/`-r` option that can be provided to
specify a regex for what test cases should be run. The regex supports
anything that is supported by re2:

https://github.com/google/re2/wiki/Syntax

These changes required updating to Go 1.13 to get the ability to
report custom metrics with the benchmark results
https://golang.org/pkg/testing/#B.ReportMetric To get Netlify on board
we needed to add a `.go-version` file to the root of the repo. This is
now the single source of truth for the OPA golang version.

Fixes: #1424
Signed-off-by: Patrick East <east.patrick@gmail.com>

2020-02-24 14:03:42 -08:00

..

reporter_test.go

Add opa bench and opa test --bench

2020-02-24 14:03:42 -08:00

reporter.go

Add opa bench and opa test --bench

2020-02-24 14:03:42 -08:00

runner_test.go

Add opa bench and opa test --bench

2020-02-24 14:03:42 -08:00

runner.go

Add opa bench and opa test --bench

2020-02-24 14:03:42 -08:00