Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: refactor load tests / demos to use a common mz-client #3739

Merged
merged 4 commits into from
Jul 27, 2020

Conversation

ruchirK
Copy link
Contributor

@ruchirK ruchirK commented Jul 26, 2020

Fixes MaterializeInc/database-issues#1160


This change is Reviewable

@ruchirK ruchirK marked this pull request as draft July 26, 2020 17:24
ruchirK added 2 commits July 26, 2020 15:11
Also get rid of macros for view definition.

Touches #3709
@ruchirK ruchirK marked this pull request as ready for review July 27, 2020 00:29
@ruchirK ruchirK changed the title test: refactor perf-upsert to use common mz_client test: refactor load tests / demos to use a common mz-client Jul 27, 2020
@ruchirK ruchirK requested a review from benesch July 27, 2020 14:36
Copy link
Contributor

@benesch benesch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is fantastic! Thanks so much for doing this! :lgtm_strong:

Reviewed 3 of 3 files at r1, 9 of 9 files at r2, 20 of 20 files at r3.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved

@ruchirK ruchirK merged commit 65203e1 into MaterializeInc:main Jul 27, 2020
jkosh44 added a commit to jkosh44/materialize that referenced this pull request Sep 12, 2022
This commit makes the storage usage collection interval configurable,
so that it is easier to test.

Works towards resolving MaterializeInc#3739
jkosh44 added a commit to jkosh44/materialize that referenced this pull request Sep 12, 2022
This commit makes the storage usage collection interval configurable,
so that it is easier to test.

Works towards resolving MaterializeInc#3739
jkosh44 added a commit that referenced this pull request Sep 13, 2022
This commit makes the storage usage collection interval configurable,
so that it is easier to test.

Works towards resolving #3739
jkosh44 added a commit to jkosh44/materialize that referenced this pull request Sep 14, 2022
Previously, the Coordinator would collect storage metrics on a regular
interval using a tokio::time::interval. This was lacking in the
following ways:
  - Any time spent waiting would be forgotten in between restarts.
  - A crash loop could potentially cause repeated consecutive
  collections if we decided to blindly collect usages on restart.

This commit changes the logic to check when the previous collection was
and see how much more time needs to be spent waiting.

Fixes MaterializeInc#3739
jkosh44 added a commit to jkosh44/materialize that referenced this pull request Sep 14, 2022
Previously, the Coordinator would collect storage metrics on a regular
interval using a tokio::time::interval. This was lacking in the
following ways:
  - Any time spent waiting would be forgotten in between restarts.
  - A crash loop could potentially cause repeated consecutive
  collections if we decided to blindly collect usages on restart.

This commit changes the logic to check when the previous collection was
and see how much more time needs to be spent waiting.

Fixes MaterializeInc#3739
jkosh44 added a commit to jkosh44/materialize that referenced this pull request Sep 19, 2022
Previously, the Coordinator would collect storage metrics on a regular
interval using a tokio::time::interval. This was lacking in the
following ways:
  - Any time spent waiting would be forgotten in between restarts.
  - A crash loop could potentially cause repeated consecutive
  collections if we decided to blindly collect usages on restart.

This commit changes the logic to check when the previous collection was
and see how much more time needs to be spent waiting.

Fixes MaterializeInc#3739
jkosh44 added a commit to jkosh44/materialize that referenced this pull request Sep 19, 2022
Previously, the Coordinator would collect storage metrics on a regular
interval using a tokio::time::interval. This was lacking in the
following ways:
  - Any time spent waiting would be forgotten in between restarts.
  - A crash loop could potentially cause repeated consecutive
  collections if we decided to blindly collect usages on restart.

This commit changes the logic to check when the previous collection was
and see how much more time needs to be spent waiting.

Fixes MaterializeInc#3739
jkosh44 added a commit to jkosh44/materialize that referenced this pull request Sep 19, 2022
Previously, the Coordinator would collect storage metrics on a regular
interval using a tokio::time::interval. This was lacking in the
following ways:
  - Any time spent waiting would be forgotten in between restarts.
  - A crash loop could potentially cause repeated consecutive
  collections if we decided to blindly collect usages on restart.

This commit changes the logic to check when the previous collection was
and see how much more time needs to be spent waiting.

Fixes MaterializeInc#3739
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants