Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

more seldon quickstarts #24

Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
seldon explainer quickstart
ryandawsonuk committed Mar 22, 2021

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
commit ad3e0ae116a9427a568e05665f289faaa3a23906
13 changes: 8 additions & 5 deletions data/quickstarts/seldon-deploy-canary-quickstart.yaml
Original file line number Diff line number Diff line change
@@ -10,21 +10,24 @@ spec:
introduction: |-
### This quick start shows you how to launch a SKLearn model and update model by canarying.
Seldon Deploy is a specialist set of tools designed to simplify and accelerate the process of deploying and managing your machine learning models.

This quick start is a short version of https://deploy.seldon.io/docs/demos/seldon-core/canary/
tasks:
- title: Deploy a pretrained sklearn iris model
description: |-
### Deploy a pretrained sklearn iris model
1. Open Seldon Console and click create. Deployment creation wizard appears.
2. Put the location of the model url. For example: gs://seldon-models/sklearn/iris
2. Choose type SeldonDeployment and click next.
3. Choose toolkit scikit-learn and enter the model url gs://seldon-models/sklearn/iris
4. Click through wizard to deploy the model
summary:
success: You have deployed a pretrained sklearn iris model
failed: Try the steps again.
failed: Try the steps again or see https://deploy.seldon.io/docs/demos/seldon-core/canary/
- title: Start Load Test
description: |-
### Complete the load test wizard:
1. Use the request.json file in this folder:
2 {"data": {"names": ["Sepal length","Sepal width","Petal length", "Petal Width"], "ndarray": [[6.8, 2.8, 4.8, 1.4], [6.0, 3.4, 4.5, 1.6]]}}
3. When running you should see metrics on dashboard. Enter the request logs screen to view request payloads.
1. Use this request payload to make a prediction {"data": {"names": ["Sepal length","Sepal width","Petal length","Petal Width"], "ndarray": [[6.8, 2.8, 4.8, 1.4], [6.0, 3.4, 4.5, 1.6]]}}
2. When running you should see metrics on dashboard. Enter the request logs screen to view request payloads.
summary:
success: You successfully performed a load test against the pre-trained iris model.
failed: Try the steps again.
44 changes: 44 additions & 0 deletions data/quickstarts/seldon-deploy-explainer-quickstart.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
kind: ConsoleQuickStart
metadata:
name: seldon-deploy-model-explainer
spec:
displayName: See predictions and explanations for a deployed SKLearn model
durationMinutes: 10
icon: 'images/seldon.svg'
description: See predictions and explanations for deployed income classifier model
introduction: |-
### This quick start shows you how to launch an income classifier model and see explanations.
Seldon Deploy is a specialist set of tools designed to simplify and accelerate the process of deploying and managing your machine learning models.

This quick start is a short version of https://deploy.seldon.io/docs/demos/seldon-core/explainer-anchortabular/
tasks:
- title: Deploy a pretrained income classifier model
description: |-
### Deploy a pretrained income classifier model
1. Open Seldon Console and click create. Deployment creation wizard appears.
2. Choose type SeldonDeployment and click next.
3. Choose toolkit scikit-learn and enter the model url gs://seldon-models/sklearn/income/model-0.23.2
4. Click through wizard to deploy the model
summary:
success: You have deployed a pretrained sklearn iris model
failed: Try the steps again or see https://deploy.seldon.io/docs/demos/seldon-core/explainer-anchortabular/
- title: Add an explainer
description: |-
### Deploy a pretrained explainer model for the income classifier
1. From the income classifier model's page, go to the alibi explainer wizard
2. Enter the model url gs://seldon-models/sklearn/income/explainer-py36-0.5.2 for an Anchor Tabular explainer and use the defaults
3. Click through wizard to deploy the explainer
summary:
success: The explainer shows as loaded
failed: Try the steps again or see https://deploy.seldon.io/docs/demos/seldon-core/explainer-anchortabular/
- title: Make a prediction and see explanations
description: |-
### Make a prediction:
1. Use this request payload to make a prediction {"data": {"names": ["Age","Workclass","Education","Marital Status","Occupation","Relationship","Race","Sex","Capital Gain","Capital Loss","Hours per week","Country"], "ndarray": [[53,4,0,2,8,4,2,0,0,0,60,9]]}}
2. You should get a successful result back from the prediction.
3. Click explain under the prediction to understand why this result was given by seeing anchors of most influential features
summary:
success: You see anchor-style explanations for income classifier model.
failed: Try the steps again or see https://deploy.seldon.io/docs/demos/seldon-core/explainer-anchortabular/
conclusion: You are now able to understand the predictoins of the model.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
conclusion: You are now able to understand the predictoins of the model.
conclusion: You are now able to understand the predictions of the model.

nextQuickStart: []