Skip to content

Commit

Permalink
Performance: run benchmarks on r6i.4xlarge instance (#622)
Browse files Browse the repository at this point in the history
  • Loading branch information
alexklibisz authored Dec 4, 2023
1 parent 6fb94fc commit 99e1cf7
Show file tree
Hide file tree
Showing 4 changed files with 10 additions and 10 deletions.
2 changes: 1 addition & 1 deletion docs/pages/performance.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ classes: wide

## Method

The results on this page are produced by running elastiknn on the ann-benchmarks benchmark on an AWS EC2 r6i.8xlarge instance.
The results on this page are produced by running elastiknn on the ann-benchmarks benchmark on an AWS EC2 r6i.4xlarge instance.
We use `task dockerStartBenchmarkingCluster` to start a single-node benchmarking cluster `task annbRunLocalFashionMnist` to run the benchmark.

See the ann-benchmarks directory in the Elastiknn repository for more details.
Expand Down
2 changes: 1 addition & 1 deletion docs/pages/performance/fashion-mnist/plot.b64

Large diffs are not rendered by default.

Binary file modified docs/pages/performance/fashion-mnist/plot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
16 changes: 8 additions & 8 deletions docs/pages/performance/fashion-mnist/results.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
|Model|Parameters|Recall|Queries per Second|
|---|---|---|---|
|eknn-l2lsh|L=100 k=4 w=1024 candidates=500 probes=0|0.378|377.213|
|eknn-l2lsh|L=100 k=4 w=1024 candidates=1000 probes=0|0.447|320.000|
|eknn-l2lsh|L=100 k=4 w=1024 candidates=500 probes=3|0.635|302.384|
|eknn-l2lsh|L=100 k=4 w=1024 candidates=1000 probes=3|0.717|259.201|
|eknn-l2lsh|L=100 k=4 w=2048 candidates=500 probes=0|0.767|335.978|
|eknn-l2lsh|L=100 k=4 w=2048 candidates=1000 probes=0|0.846|287.923|
|eknn-l2lsh|L=100 k=4 w=2048 candidates=500 probes=3|0.921|229.917|
|eknn-l2lsh|L=100 k=4 w=2048 candidates=1000 probes=3|0.960|204.375|
|eknn-l2lsh|L=100 k=4 w=1024 candidates=500 probes=0|0.378|374.760|
|eknn-l2lsh|L=100 k=4 w=1024 candidates=1000 probes=0|0.447|317.451|
|eknn-l2lsh|L=100 k=4 w=1024 candidates=500 probes=3|0.634|302.484|
|eknn-l2lsh|L=100 k=4 w=1024 candidates=1000 probes=3|0.716|262.492|
|eknn-l2lsh|L=100 k=4 w=2048 candidates=500 probes=0|0.767|333.057|
|eknn-l2lsh|L=100 k=4 w=2048 candidates=1000 probes=0|0.846|284.019|
|eknn-l2lsh|L=100 k=4 w=2048 candidates=500 probes=3|0.921|228.224|
|eknn-l2lsh|L=100 k=4 w=2048 candidates=1000 probes=3|0.960|205.738|

0 comments on commit 99e1cf7

Please sign in to comment.