Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Block additional crawlers from going over NuGet Gallery DB #3407

Closed
cristinamanum opened this issue Dec 7, 2016 · 2 comments
Closed

Block additional crawlers from going over NuGet Gallery DB #3407

cristinamanum opened this issue Dec 7, 2016 · 2 comments
Assignees
@cristinamanum
Labels
Area: Gallery UI Area: Performance Type:Feature Verified-Dev Verified-Int Verified-Prod

Comments

@cristinamanum
Copy link
Contributor

NuGet Gallery PROD DB currently experiences a high load in constant intervals due crawlers that replicate the packages table daily, using V2 OData endpoint.

The first stage in the effort to improve DB performance is to block additional crawlers from joining, while allowing the existing ones to continue operating. The suggestion is to allow only a subset of OData query formats.
@cristinamanum cristinamanum self-assigned this Dec 7, 2016
@shishirx34
Copy link
Contributor

Should this be moved to Engineering, @skofman1 ?

@skofman1
Copy link
Contributor

skofman1 commented Dec 7, 2016

Nope.. this is the place

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@cristinamanum cristinamanum

Labels
Area: Gallery UI Area: Performance Type:Feature Verified-Dev Verified-Int Verified-Prod
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@shishirx34 @cristinamanum @skofman1