Version 0.1.50

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Fixed self contained coordinator circular dependency import @filipecosta90 (#121)

Version 0.1.41

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Fixed linting issues @filipecosta90 (#115)

Tooling changes: Benchmark artifacts builder

• Added --docker-air-gap to builder and scc @filipecosta90 (#116)

Tooling changes: Self-contained coordinator

• Added --docker-air-gap to builder and scc @filipecosta90 (#116)

Tooling changes: Setup agnostic cli benchmark runner (solely client)

• Allows the standalone runner to collect perf profiles @slice4e (#111)

Version 0.1.39

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Fix preload warning @slice4e (#112)

Version 0.1.35

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

Tooling changes: Self-contained coordinator

• Added consumer-id to self contained coordinator. Enables multi consumers @filipecosta90 (#110)

Version 0.1.34

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

Tooling changes: Self-contained coordinator

• Fixed self_contained_coordinator r.ping() using 6379 port and not redis_proc_start_port @filipecosta90 (#109)

Version 0.1.33

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

Tooling changes: Self-contained coordinator

• Enabled to specify redis_proc_start_port on self contained coordinator; Include merge-base commit tests on API trigger @filipecosta90 (#106)

Version 0.1.32

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Fixed dbconfig array version of SPEC @filipecosta90 (#103)
• Included development how-to on the readme @filipecosta90 (#102)

Tooling changes: Setup agnostic cli benchmark runner (solely client)

• Adding --test-time to memtier_benchmark-10Mkeys-load-hash-5-fields-with-100B-values-pipeline-10.yml @slice4e (#100)

Version 0.1.31

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Fixed 4 test-cases, which were completing too quickly @slice4e (#98)
• Fixed small duration benchmarks for HSET. Included 1KiB HSET variation @filipecosta90 (#99)

Version 0.1.30

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• delete the stopped container by default at tear down @slice4e (#96)

Version 0.1.29

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

Tooling changes: Setup agnostic cli benchmark runner (solely client)

• Added --client_aggregated_results_folder and --preserve_temporary_client_dirs to redis-benchmarks-spec-client-runner @filipecosta90 (#95)