Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NIM on GKE Tutorial #737

Merged
merged 16 commits into from
Jul 29, 2024
Merged

NIM on GKE Tutorial #737

Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
1fa4973
Merge pull request #4 from GoogleCloudPlatform/main
brandonroyal Jul 15, 2024
291f353
.gitignore
brandonroyal Jul 15, 2024
d7bf2e1
added README.md
brandonroyal Jul 15, 2024
e428eed
added pvc.yaml
brandonroyal Jul 15, 2024
fe7e05f
fixed markdown mismatch
brandonroyal Jul 15, 2024
c933269
cleanup
brandonroyal Jul 22, 2024
cf8a9ee
updated prerequisites
brandonroyal Jul 22, 2024
50dbce9
cleanup .gitignore
brandonroyal Jul 23, 2024
c3cc063
fixed incorrect jq reference
brandonroyal Jul 23, 2024
e734565
added ngc prerequisite
brandonroyal Jul 23, 2024
7af8dea
fixed ZONE references
brandonroyal Jul 23, 2024
365d573
removed redundant secrets
brandonroyal Jul 23, 2024
0672094
added namespace and removed context setting command
brandonroyal Jul 23, 2024
d081f4b
cleanup pvc + explaination
brandonroyal Jul 23, 2024
e04ca10
cleanup pvc file save
brandonroyal Jul 23, 2024
b53c8a9
cleanup language reference to local files and delete pvc file
brandonroyal Jul 29, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
cleanup pvc + explaination
  • Loading branch information
@brandonroyal
brandonroyal committed Jul 23, 2024
commit d081f4bd99b3d1cdd9e160535695f0c6a49231aa
8 changes: 4 additions & 4 deletions tutorials-and-examples/nvidia-nim/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -88,9 +88,7 @@ kubectl create namespace nim
```

## Deploy a PVC to persist the model
1. Clone this repository

2. Create a PVC to persist the model weights - recommended for deployments with more than one (1) replica. Save the following yaml as `pvc.yaml` or use existing file in this repository
1. Create a PVC to persist the model weights - recommended for deployments with more than one (1) replica. Save the following yaml as `pvc.yaml` or use existing file in this repository
```yaml
apiVersion: v1
kind: PersistentVolumeClaim
Expand All @@ -106,10 +104,12 @@ spec:
storageClassName: standard-rwx
```

3. Apply PVC
2. Apply PVC
```bash
kubectl apply -f pvc.yaml
```
> [!NOTE]
> This PVC will [dynamically provision a PV](https://cloud.google.com/kubernetes-engine/docs/concepts/persistent-volumes#dynamic_provisioning) with the necessary storage to persist model weights across replicas of your pods.

## Deploy the NIM with the generated engine using a Helm chart

Expand Down