Skip to content

Latest commit

 

History

History
111 lines (97 loc) · 3.65 KB

README.md

File metadata and controls

111 lines (97 loc) · 3.65 KB

Batch Request API Benchmark

Having 100 items stored.

Tests:

  • Getting 10000 objects
    1. 10000x GET /items/54
    2. 10000x POST /bra-v0 requesting GET /items/54
    3. 1000x POST /bra-v0 requesting 10x GET /items/54
    4. 100x POST /bra-v0 requesting 100x GET /items/54
  • Getting 100000 objects
    1. 100000x GET /items/54
    2. 100000x POST /bra-v0 requesting GET /items/54
    3. 10000x POST /bra-v0 requesting 10x GET /items/54
    4. 1000x POST /bra-v0 requesting 100x GET /items/54
    5. 100x POST /bra-v0 requesting 1000x GET /items/54

Tests will be run:

  1. Without concurrency
  2. With 10 concurrent threads
  3. With 100 concurrent threads

and

  1. On HashMap based repository (/items in SampleController)
  2. On Reactive MongoDB repository (/mongo-items in SampleMongoController)

Before each test run docker containers will be recreated.

Running tests

To recreate tests execute run.sh bash script.

Results

  • Without concurrency on HashMap repository

    • 10k elements
      1. 10000x ORIG: Done in 7.320s
      2. 10000x1 BRA: Done in 12.255s
      3. 1000x10 BRA: Done in 1.558s
      4. 100x100 BRA: Done in 0.658s
    • 100k elements
      1. 100000x ORIG: Done in 56.638s
      2. 100000x1 BRA: Done in 81.478s
      3. 10000x10 BRA: Done in 13.962s
      4. 1000x100 BRA: Done in 6.063s
      5. 100x1000 BRA: Done in 5.067s

  • With 10 concurrent threads on HashMap repository

    • 10k elements
      1. 10000x ORIG: Done in 3.841s
      2. 10000x1 BRA: Done in 8.347s
      3. 1000x10 BRA: Done in 1.134s
      4. 100x100 BRA: Done in 0.416s
    • 100k elements
      1. 100000x ORIG: Done in 20.699s
      2. 100000x1 BRA: Done in 28.972s
      3. 10000x10 BRA: Done in 5.928s
      4. 1000x100 BRA: Done in 3.018s
      5. 100x1000 BRA: Done in 2.617s

  • With 100 concurrent threads on HashMap repository

    • 10k elements
      1. 10000x ORIG: Done in 3.018s
      2. 10000x1 BRA: Done in 6.854s
      3. 1000x10 BRA: Done in 1.230s
      4. 100x100 BRA: Done in 0.621s
    • 100k elements
      1. 100000x ORIG: Done in 17.862s
      2. 100000x1 BRA: Done in 24.352s
      3. 10000x10 BRA: Done in 5.685s
      4. 1000x100 BRA: Done in 2.690s
      5. 100x1000 BRA: Done in 2.496s

  • Without concurrency on MongoDB repository

    • 10k elements
      1. 10000x ORIG: Done in 12.056s
      2. 10000x1 BRA: Done in 15.192s
      3. 1000x10 BRA: Done in 2.766s
      4. 100x100 BRA: Done in 1.571s
    • 100k elements
      1. 100000x ORIG: Done in 100.900s
      2. 100000x1 BRA: Done in 125.835s
      3. 10000x10 BRA: Done in 25.682s
      4. 1000x100 BRA: Done in 15.231s
      5. 100x1000 BRA: Done in 14.134s

  • With 10 concurrent threads on MongoDB repository

    • 10k elements
      1. 10000x ORIG: Done in 5.763s
      2. 10000x1 BRA: Done in 8.559s
      3. 1000x10 BRA: Done in 2.099s
      4. 100x100 BRA: Done in 1.631s
    • 100k elements
      1. 100000x ORIG: Done in 34.893s
      2. 100000x1 BRA: Done in 44.710s
      3. 10000x10 BRA: Done in 15.834s
      4. 1000x100 BRA: Done in 10.889s
      5. 100x1000 BRA: Done in 11.151s

  • With 100 concurrent threads on MongoDB repository

    • 10k elements
      1. 10000x ORIG: Done in 5.470s
      2. 10000x1 BRA: Done in 8.950s
      3. 1000x10 BRA: Done in 2.684s
      4. 100x100 BRA: Done in 1.920s
    • 100k elements
      1. 100000x ORIG: Done in 27.902s
      2. 100000x1 BRA: Done in 37.519s
      3. 10000x10 BRA: Done in 15.109s
      4. 1000x100 BRA: Done in 11.024s
      5. 100x1000 BRA: Done in 10.889s