2023-01-13T02:54:52.1650721Z Requested labels: macOS-latest 2023-01-13T02:54:52.1650780Z Job defined at: pytorch/serve/.github/workflows/regression_tests_cpu.yml@refs/heads/feature/upgrade_pytorch1.13.1 2023-01-13T02:54:52.1650809Z Waiting for a runner to pick up this job... 2023-01-13T02:54:53.5213513Z Job is waiting for a hosted runner to come online. 2023-01-13T02:55:00.5424762Z Job is about to start running on the hosted runner: GitHub Actions 64 (hosted) 2023-01-13T02:55:11.1143560Z Current runner version: '2.299.1' 2023-01-13T02:55:11.1191410Z ##[group]Operating System 2023-01-13T02:55:11.1192130Z macOS 2023-01-13T02:55:11.1192450Z 12.6.2 2023-01-13T02:55:11.1192830Z 21G320 2023-01-13T02:55:11.1193120Z ##[endgroup] 2023-01-13T02:55:11.1193460Z ##[group]Runner Image 2023-01-13T02:55:11.1193840Z Image: macos-12 2023-01-13T02:55:11.1194120Z Version: 20221215.1 2023-01-13T02:55:11.1194710Z Included Software: https://github.com/actions/runner-images/blob/macOS-12/20221215.1/images/macos/macos-12-Readme.md 2023-01-13T02:55:11.1195380Z Image Release: https://github.com/actions/runner-images/releases/tag/macOS-12%2F20221215.1 2023-01-13T02:55:11.1195800Z ##[endgroup] 2023-01-13T02:55:11.1196160Z ##[group]Runner Image Provisioner 2023-01-13T02:55:11.1196520Z 2.0.98.1 2023-01-13T02:55:11.1196860Z ##[endgroup] 2023-01-13T02:55:11.1198090Z ##[group]GITHUB_TOKEN Permissions 2023-01-13T02:55:11.1198750Z Actions: write 2023-01-13T02:55:11.1199090Z Checks: write 2023-01-13T02:55:11.1199640Z Contents: write 2023-01-13T02:55:11.1200080Z Deployments: write 2023-01-13T02:55:11.1200430Z Discussions: write 2023-01-13T02:55:11.1200710Z Issues: write 2023-01-13T02:55:11.1201120Z Metadata: read 2023-01-13T02:55:11.1201460Z Packages: write 2023-01-13T02:55:11.1201740Z Pages: write 2023-01-13T02:55:11.1202070Z PullRequests: write 2023-01-13T02:55:11.1202560Z RepositoryProjects: write 2023-01-13T02:55:11.1202900Z SecurityEvents: write 2023-01-13T02:55:11.1203250Z Statuses: write 2023-01-13T02:55:11.1203600Z ##[endgroup] 2023-01-13T02:55:11.1208360Z Secret source: Actions 2023-01-13T02:55:11.1209040Z Prepare workflow directory 2023-01-13T02:55:11.2294190Z Prepare all required actions 2023-01-13T02:55:11.2542640Z Getting action download info 2023-01-13T02:55:11.5287680Z Download action repository 'actions/setup-python@v3' (SHA:98f2ad02fd48d057ee3b4d4f66525b231c3e52b6) 2023-01-13T02:55:12.8256260Z Download action repository 'actions/setup-java@v3' (SHA:1df8dbefe2a8cbc99770194893dd902763bee34b) 2023-01-13T02:55:13.5825370Z Download action repository 'actions/checkout@v3' (SHA:ac593985615ec2ede58e132d2e21d2b1cbd6127c) 2023-01-13T02:55:14.5047740Z ##[group]Run actions/setup-python@v3 2023-01-13T02:55:14.5048300Z with: 2023-01-13T02:55:14.5048610Z python-version: 3.8 2023-01-13T02:55:14.5049210Z architecture: x64 2023-01-13T02:55:14.5049830Z token: *** 2023-01-13T02:55:14.5050110Z ##[endgroup] 2023-01-13T02:55:16.2728790Z ##[warning]The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/ 2023-01-13T02:55:16.2744910Z Successfully setup CPython (3.8.15) 2023-01-13T02:55:16.3287260Z ##[group]Run actions/setup-java@v3 2023-01-13T02:55:16.3287630Z with: 2023-01-13T02:55:16.3287870Z distribution: zulu 2023-01-13T02:55:16.3288140Z java-version: 17 2023-01-13T02:55:16.3288410Z java-package: jdk 2023-01-13T02:55:16.3288650Z check-latest: false 2023-01-13T02:55:16.3288960Z server-id: github 2023-01-13T02:55:16.3289240Z server-username: GITHUB_ACTOR 2023-01-13T02:55:16.3289520Z server-password: GITHUB_TOKEN 2023-01-13T02:55:16.3289810Z overwrite-settings: true 2023-01-13T02:55:16.3290060Z job-status: success 2023-01-13T02:55:16.3290490Z token: *** 2023-01-13T02:55:16.3290750Z env: 2023-01-13T02:55:16.3291090Z pythonLocation: /Users/runner/hostedtoolcache/Python/3.8.15/x64 2023-01-13T02:55:16.3291390Z ##[endgroup] 2023-01-13T02:55:16.6266290Z ##[group]Installed distributions 2023-01-13T02:55:16.6384220Z Trying to resolve the latest version from remote 2023-01-13T02:55:16.7249360Z Resolved latest version as 17.0.5+8 2023-01-13T02:55:16.7249900Z Trying to download... 2023-01-13T02:55:16.7250860Z Downloading Java 17.0.5+8 (Zulu) from https://cdn.azul.com/zulu/bin/zulu17.38.21-ca-jdk17.0.5-macosx_x64.tar.gz ... 2023-01-13T02:55:23.6449180Z Extracting Java archive... 2023-01-13T02:55:23.7461080Z [command]/usr/bin/tar xz -C /Users/runner/work/_temp/bb1d26b7-87e4-4c09-9dff-4ead530f54e0 -f /Users/runner/work/_temp/f7836f55-2088-4e9c-9811-c6898a586714 2023-01-13T02:55:45.2957590Z Java 17.0.5+8 was downloaded 2023-01-13T02:55:45.2966900Z Setting Java 17.0.5+8 as the default 2023-01-13T02:55:45.3395850Z Creating toolchains.xml for JDK version 17 from zulu 2023-01-13T02:55:45.3546600Z Writing to /Users/runner/.m2/toolchains.xml 2023-01-13T02:55:45.3550670Z 2023-01-13T02:55:45.3550850Z Java configuration: 2023-01-13T02:55:45.3551490Z Distribution: zulu 2023-01-13T02:55:45.3551890Z Version: 17.0.5+8 2023-01-13T02:55:45.3553250Z Path: /Users/runner/hostedtoolcache/Java_Zulu_jdk/17.0.5-8/x64 2023-01-13T02:55:45.3553910Z 2023-01-13T02:55:45.3557630Z ##[endgroup] 2023-01-13T02:55:45.3573940Z Creating settings.xml with server-id: github 2023-01-13T02:55:45.3597160Z Writing to /Users/runner/.m2/settings.xml 2023-01-13T02:55:45.3820100Z ##[group]Run actions/checkout@v3 2023-01-13T02:55:45.3820400Z with: 2023-01-13T02:55:45.3820680Z repository: pytorch/serve 2023-01-13T02:55:45.3821260Z token: *** 2023-01-13T02:55:45.3821650Z ssh-strict: true 2023-01-13T02:55:45.3821910Z persist-credentials: true 2023-01-13T02:55:45.3822900Z clean: true 2023-01-13T02:55:45.3823200Z fetch-depth: 1 2023-01-13T02:55:45.3823500Z lfs: false 2023-01-13T02:55:45.3823860Z submodules: false 2023-01-13T02:55:45.3861790Z set-safe-directory: true 2023-01-13T02:55:45.3862200Z env: 2023-01-13T02:55:45.3862500Z pythonLocation: /Users/runner/hostedtoolcache/Python/3.8.15/x64 2023-01-13T02:55:45.3862850Z JAVA_HOME: /Users/runner/hostedtoolcache/Java_Zulu_jdk/17.0.5-8/x64 2023-01-13T02:55:45.3863200Z JAVA_HOME_17_X64: /Users/runner/hostedtoolcache/Java_Zulu_jdk/17.0.5-8/x64 2023-01-13T02:55:45.3863510Z ##[endgroup] 2023-01-13T02:55:45.5631880Z Syncing repository: pytorch/serve 2023-01-13T02:55:45.5642830Z ##[group]Getting Git version info 2023-01-13T02:55:45.5643990Z Working directory is '/Users/runner/work/serve/serve' 2023-01-13T02:55:45.5720150Z [command]/usr/local/bin/git version 2023-01-13T02:55:45.8076280Z git version 2.39.0 2023-01-13T02:55:45.8118290Z ##[endgroup] 2023-01-13T02:55:45.8144170Z Copying '/Users/runner/.gitconfig' to '/Users/runner/work/_temp/909a3f36-0562-4692-bdf3-c8e6925ff36c/.gitconfig' 2023-01-13T02:55:45.8162110Z Temporarily overriding HOME='/Users/runner/work/_temp/909a3f36-0562-4692-bdf3-c8e6925ff36c' before making global git config changes 2023-01-13T02:55:45.8163890Z Adding repository directory to the temporary git global config as a safe directory 2023-01-13T02:55:45.8171030Z [command]/usr/local/bin/git config --global --add safe.directory /Users/runner/work/serve/serve 2023-01-13T02:55:45.8414570Z Deleting the contents of '/Users/runner/work/serve/serve' 2023-01-13T02:55:45.8415530Z ##[group]Initializing the repository 2023-01-13T02:55:45.8415970Z [command]/usr/local/bin/git init /Users/runner/work/serve/serve 2023-01-13T02:55:45.8745010Z hint: Using 'master' as the name for the initial branch. This default branch name 2023-01-13T02:55:45.8746620Z hint: is subject to change. To configure the initial branch name to use in all 2023-01-13T02:55:45.8747500Z hint: of your new repositories, which will suppress this warning, call: 2023-01-13T02:55:45.8748110Z hint: 2023-01-13T02:55:45.8750140Z hint: git config --global init.defaultBranch 2023-01-13T02:55:45.8752740Z hint: 2023-01-13T02:55:45.8753940Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-01-13T02:55:45.8754540Z hint: 'development'. The just-created branch can be renamed via this command: 2023-01-13T02:55:45.8754870Z hint: 2023-01-13T02:55:45.8755420Z hint: git branch -m 2023-01-13T02:55:45.8788490Z Initialized empty Git repository in /Users/runner/work/serve/serve/.git/ 2023-01-13T02:55:45.8802670Z [command]/usr/local/bin/git remote add origin https://github.com/pytorch/serve 2023-01-13T02:55:45.8955040Z ##[endgroup] 2023-01-13T02:55:45.8957300Z ##[group]Disabling automatic garbage collection 2023-01-13T02:55:45.8962910Z [command]/usr/local/bin/git config --local gc.auto 0 2023-01-13T02:55:45.9077420Z ##[endgroup] 2023-01-13T02:55:45.9078330Z ##[group]Setting up auth 2023-01-13T02:55:45.9091270Z [command]/usr/local/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-01-13T02:55:45.9200950Z [command]/usr/local/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2023-01-13T02:55:46.1196240Z [command]/usr/local/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-01-13T02:55:46.1296330Z [command]/usr/local/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2023-01-13T02:55:46.2731470Z [command]/usr/local/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2023-01-13T02:55:46.3039800Z ##[endgroup] 2023-01-13T02:55:46.3141350Z ##[group]Fetching the repository 2023-01-13T02:55:46.3243720Z [command]/usr/local/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +9d21339cfcfb9c4a1406a62d9f7f85fe31374e09:refs/remotes/origin/feature/upgrade_pytorch1.13.1 2023-01-13T02:55:46.6573590Z remote: Enumerating objects: 1297, done. 2023-01-13T02:55:46.6581200Z remote: Counting objects: 0% (1/1297) 2023-01-13T02:55:46.6584310Z remote: Counting objects: 1% (13/1297) 2023-01-13T02:55:46.6589850Z remote: Counting objects: 2% (26/1297) 2023-01-13T02:55:46.6590730Z remote: Counting objects: 3% (39/1297) 2023-01-13T02:55:46.6591420Z remote: Counting objects: 4% (52/1297) 2023-01-13T02:55:46.6591970Z remote: Counting objects: 5% (65/1297) 2023-01-13T02:55:46.6592400Z remote: Counting objects: 6% (78/1297) 2023-01-13T02:55:46.6592680Z remote: Counting objects: 7% (91/1297) 2023-01-13T02:55:46.6593000Z remote: Counting objects: 8% (104/1297) 2023-01-13T02:55:46.6593490Z remote: Counting objects: 9% (117/1297) 2023-01-13T02:55:46.6593800Z remote: Counting objects: 10% (130/1297) 2023-01-13T02:55:46.6594110Z remote: Counting objects: 11% (143/1297) 2023-01-13T02:55:46.6594430Z remote: Counting objects: 12% (156/1297) 2023-01-13T02:55:46.6594730Z remote: Counting objects: 13% (169/1297) 2023-01-13T02:55:46.6595190Z remote: Counting objects: 14% (182/1297) 2023-01-13T02:55:46.6595520Z remote: Counting objects: 15% (195/1297) 2023-01-13T02:55:46.6595830Z remote: Counting objects: 16% (208/1297) 2023-01-13T02:55:46.6596100Z remote: Counting objects: 17% (221/1297) 2023-01-13T02:55:46.6596410Z remote: Counting objects: 18% (234/1297) 2023-01-13T02:55:46.6596910Z remote: Counting objects: 19% (247/1297) 2023-01-13T02:55:46.6597190Z remote: Counting objects: 20% (260/1297) 2023-01-13T02:55:46.6597510Z remote: Counting objects: 21% (273/1297) 2023-01-13T02:55:46.6597820Z remote: Counting objects: 22% (286/1297) 2023-01-13T02:55:46.6598290Z remote: Counting objects: 23% (299/1297) 2023-01-13T02:55:46.6598600Z remote: Counting objects: 24% (312/1297) 2023-01-13T02:55:46.6598900Z remote: Counting objects: 25% (325/1297) 2023-01-13T02:55:46.6599200Z remote: Counting objects: 26% (338/1297) 2023-01-13T02:55:46.6599470Z remote: Counting objects: 27% (351/1297) 2023-01-13T02:55:46.6599920Z remote: Counting objects: 28% (364/1297) 2023-01-13T02:55:46.6600260Z remote: Counting objects: 29% (377/1297) 2023-01-13T02:55:46.6600570Z remote: Counting objects: 30% (390/1297) 2023-01-13T02:55:46.6600840Z remote: Counting objects: 31% (403/1297) 2023-01-13T02:55:46.6601150Z remote: Counting objects: 32% (416/1297) 2023-01-13T02:55:46.6601630Z remote: Counting objects: 33% (429/1297) 2023-01-13T02:55:46.6602600Z remote: Counting objects: 34% (441/1297) 2023-01-13T02:55:46.6602910Z remote: Counting objects: 35% (454/1297) 2023-01-13T02:55:46.6603220Z remote: Counting objects: 36% (467/1297) 2023-01-13T02:55:46.6603510Z remote: Counting objects: 37% (480/1297) 2023-01-13T02:55:46.6604020Z remote: Counting objects: 38% (493/1297) 2023-01-13T02:55:46.6604330Z remote: Counting objects: 39% (506/1297) 2023-01-13T02:55:46.6604630Z remote: Counting objects: 40% (519/1297) 2023-01-13T02:55:46.6604900Z remote: Counting objects: 41% (532/1297) 2023-01-13T02:55:46.6605360Z remote: Counting objects: 42% (545/1297) 2023-01-13T02:55:46.6605700Z remote: Counting objects: 43% (558/1297) 2023-01-13T02:55:46.6605980Z remote: Counting objects: 44% (571/1297) 2023-01-13T02:55:46.6606660Z remote: Counting objects: 45% (584/1297) 2023-01-13T02:55:46.6607030Z remote: Counting objects: 46% (597/1297) 2023-01-13T02:55:46.6607530Z remote: Counting objects: 47% (610/1297) 2023-01-13T02:55:46.6607820Z remote: Counting objects: 48% (623/1297) 2023-01-13T02:55:46.6608120Z remote: Counting objects: 49% (636/1297) 2023-01-13T02:55:46.6608420Z remote: Counting objects: 50% (649/1297) 2023-01-13T02:55:46.6608690Z remote: Counting objects: 51% (662/1297) 2023-01-13T02:55:46.6609150Z remote: Counting objects: 52% (675/1297) 2023-01-13T02:55:46.6693920Z remote: Counting objects: 53% (688/1297) 2023-01-13T02:55:46.6694310Z remote: Counting objects: 54% (701/1297) 2023-01-13T02:55:46.6694730Z remote: Counting objects: 55% (714/1297) 2023-01-13T02:55:46.6695320Z remote: Counting objects: 56% (727/1297) 2023-01-13T02:55:46.6695630Z remote: Counting objects: 57% (740/1297) 2023-01-13T02:55:46.6695970Z remote: Counting objects: 58% (753/1297) 2023-01-13T02:55:46.6696330Z remote: Counting objects: 59% (766/1297) 2023-01-13T02:55:46.6697120Z remote: Counting objects: 60% (779/1297) 2023-01-13T02:55:46.6697480Z remote: Counting objects: 61% (792/1297) 2023-01-13T02:55:46.6697760Z remote: Counting objects: 62% (805/1297) 2023-01-13T02:55:46.6698250Z remote: Counting objects: 63% (818/1297) 2023-01-13T02:55:46.6698800Z remote: Counting objects: 64% (831/1297) 2023-01-13T02:55:46.6699310Z remote: Counting objects: 65% (844/1297) 2023-01-13T02:55:46.6699920Z remote: Counting objects: 66% (857/1297) 2023-01-13T02:55:46.6700230Z remote: Counting objects: 67% (869/1297) 2023-01-13T02:55:46.6700540Z remote: Counting objects: 68% (882/1297) 2023-01-13T02:55:46.6700810Z remote: Counting objects: 69% (895/1297) 2023-01-13T02:55:46.6701330Z remote: Counting objects: 70% (908/1297) 2023-01-13T02:55:46.6701650Z remote: Counting objects: 71% (921/1297) 2023-01-13T02:55:46.6701960Z remote: Counting objects: 72% (934/1297) 2023-01-13T02:55:46.6702240Z remote: Counting objects: 73% (947/1297) 2023-01-13T02:55:46.6702730Z remote: Counting objects: 74% (960/1297) 2023-01-13T02:55:46.6703070Z remote: Counting objects: 75% (973/1297) 2023-01-13T02:55:46.6703340Z remote: Counting objects: 76% (986/1297) 2023-01-13T02:55:46.6703640Z remote: Counting objects: 77% (999/1297) 2023-01-13T02:55:46.6703950Z remote: Counting objects: 78% (1012/1297) 2023-01-13T02:55:46.6704460Z remote: Counting objects: 79% (1025/1297) 2023-01-13T02:55:46.6704740Z remote: Counting objects: 80% (1038/1297) 2023-01-13T02:55:46.6705060Z remote: Counting objects: 81% (1051/1297) 2023-01-13T02:55:46.6705360Z remote: Counting objects: 82% (1064/1297) 2023-01-13T02:55:46.6705900Z remote: Counting objects: 83% (1077/1297) 2023-01-13T02:55:46.6706420Z remote: Counting objects: 84% (1090/1297) 2023-01-13T02:55:46.6706740Z remote: Counting objects: 85% (1103/1297) 2023-01-13T02:55:46.6708090Z remote: Counting objects: 86% (1116/1297) 2023-01-13T02:55:46.6708570Z remote: Counting objects: 87% (1129/1297) 2023-01-13T02:55:46.6709210Z remote: Counting objects: 88% (1142/1297) 2023-01-13T02:55:46.6709560Z remote: Counting objects: 89% (1155/1297) 2023-01-13T02:55:46.6709840Z remote: Counting objects: 90% (1168/1297) 2023-01-13T02:55:46.6710160Z remote: Counting objects: 91% (1181/1297) 2023-01-13T02:55:46.6710500Z remote: Counting objects: 92% (1194/1297) 2023-01-13T02:55:46.6710960Z remote: Counting objects: 93% (1207/1297) 2023-01-13T02:55:46.6711280Z remote: Counting objects: 94% (1220/1297) 2023-01-13T02:55:46.6711590Z remote: Counting objects: 95% (1233/1297) 2023-01-13T02:55:46.6712280Z remote: Counting objects: 96% (1246/1297) 2023-01-13T02:55:46.6712680Z remote: Counting objects: 97% (1259/1297) 2023-01-13T02:55:46.6713140Z remote: Counting objects: 98% (1272/1297) 2023-01-13T02:55:46.6713460Z remote: Counting objects: 99% (1285/1297) 2023-01-13T02:55:46.6713730Z remote: Counting objects: 100% (1297/1297) 2023-01-13T02:55:46.6714050Z remote: Counting objects: 100% (1297/1297), done. 2023-01-13T02:55:46.6714510Z remote: Compressing objects: 0% (1/1081) 2023-01-13T02:55:46.6714820Z remote: Compressing objects: 1% (11/1081) 2023-01-13T02:55:46.6715150Z remote: Compressing objects: 2% (22/1081) 2023-01-13T02:55:46.6715470Z remote: Compressing objects: 3% (33/1081) 2023-01-13T02:55:46.6715790Z remote: Compressing objects: 4% (44/1081) 2023-01-13T02:55:46.6716230Z remote: Compressing objects: 5% (55/1081) 2023-01-13T02:55:46.6716570Z remote: Compressing objects: 6% (65/1081) 2023-01-13T02:55:46.6716890Z remote: Compressing objects: 7% (76/1081) 2023-01-13T02:55:46.6717180Z remote: Compressing objects: 8% (87/1081) 2023-01-13T02:55:46.6717510Z remote: Compressing objects: 9% (98/1081) 2023-01-13T02:55:46.6717980Z remote: Compressing objects: 10% (109/1081) 2023-01-13T02:55:46.6718320Z remote: Compressing objects: 11% (119/1081) 2023-01-13T02:55:46.6752220Z remote: Compressing objects: 12% (130/1081) 2023-01-13T02:55:46.6767860Z remote: Compressing objects: 13% (141/1081) 2023-01-13T02:55:46.6784860Z remote: Compressing objects: 14% (152/1081) 2023-01-13T02:55:46.6805640Z remote: Compressing objects: 15% (163/1081) 2023-01-13T02:55:46.6812380Z remote: Compressing objects: 16% (173/1081) 2023-01-13T02:55:46.6838110Z remote: Compressing objects: 17% (184/1081) 2023-01-13T02:55:46.6845750Z remote: Compressing objects: 18% (195/1081) 2023-01-13T02:55:46.6846470Z remote: Compressing objects: 19% (206/1081) 2023-01-13T02:55:46.6861880Z remote: Compressing objects: 20% (217/1081) 2023-01-13T02:55:46.6870500Z remote: Compressing objects: 21% (228/1081) 2023-01-13T02:55:46.6885040Z remote: Compressing objects: 22% (238/1081) 2023-01-13T02:55:46.6898870Z remote: Compressing objects: 23% (249/1081) 2023-01-13T02:55:46.6908210Z remote: Compressing objects: 24% (260/1081) 2023-01-13T02:55:46.6910000Z remote: Compressing objects: 25% (271/1081) 2023-01-13T02:55:46.6960010Z remote: Compressing objects: 26% (282/1081) 2023-01-13T02:55:46.6961670Z remote: Compressing objects: 27% (292/1081) 2023-01-13T02:55:46.6962070Z remote: Compressing objects: 28% (303/1081) 2023-01-13T02:55:46.6962360Z remote: Compressing objects: 29% (314/1081) 2023-01-13T02:55:46.6962690Z remote: Compressing objects: 30% (325/1081) 2023-01-13T02:55:46.6982130Z remote: Compressing objects: 31% (336/1081) 2023-01-13T02:55:46.6992420Z remote: Compressing objects: 32% (346/1081) 2023-01-13T02:55:46.6998630Z remote: Compressing objects: 33% (357/1081) 2023-01-13T02:55:46.7018100Z remote: Compressing objects: 34% (368/1081) 2023-01-13T02:55:46.7019520Z remote: Compressing objects: 35% (379/1081) 2023-01-13T02:55:46.8348920Z remote: Compressing objects: 36% (390/1081) 2023-01-13T02:55:46.8450150Z remote: Compressing objects: 37% (400/1081) 2023-01-13T02:55:46.8555380Z remote: Compressing objects: 38% (411/1081) 2023-01-13T02:55:46.8656980Z remote: Compressing objects: 39% (422/1081) 2023-01-13T02:55:46.8758350Z remote: Compressing objects: 40% (433/1081) 2023-01-13T02:55:46.8859770Z remote: Compressing objects: 41% (444/1081) 2023-01-13T02:55:46.8962710Z remote: Compressing objects: 42% (455/1081) 2023-01-13T02:55:46.9064160Z remote: Compressing objects: 43% (465/1081) 2023-01-13T02:55:46.9166180Z remote: Compressing objects: 44% (476/1081) 2023-01-13T02:55:46.9270150Z remote: Compressing objects: 45% (487/1081) 2023-01-13T02:55:46.9372510Z remote: Compressing objects: 46% (498/1081) 2023-01-13T02:55:46.9474010Z remote: Compressing objects: 47% (509/1081) 2023-01-13T02:55:46.9575760Z remote: Compressing objects: 48% (519/1081) 2023-01-13T02:55:46.9677230Z remote: Compressing objects: 49% (530/1081) 2023-01-13T02:55:46.9778760Z remote: Compressing objects: 50% (541/1081) 2023-01-13T02:55:46.9833770Z remote: Compressing objects: 51% (552/1081) 2023-01-13T02:55:46.9875350Z remote: Compressing objects: 52% (563/1081) 2023-01-13T02:55:46.9919640Z remote: Compressing objects: 53% (573/1081) 2023-01-13T02:55:46.9946290Z remote: Compressing objects: 54% (584/1081) 2023-01-13T02:55:46.9971030Z remote: Compressing objects: 55% (595/1081) 2023-01-13T02:55:46.9977160Z remote: Compressing objects: 56% (606/1081) 2023-01-13T02:55:46.9988910Z remote: Compressing objects: 57% (617/1081) 2023-01-13T02:55:47.0006850Z remote: Compressing objects: 58% (627/1081) 2023-01-13T02:55:47.0012670Z remote: Compressing objects: 59% (638/1081) 2023-01-13T02:55:47.0019110Z remote: Compressing objects: 60% (649/1081) 2023-01-13T02:55:47.0022580Z remote: Compressing objects: 61% (660/1081) 2023-01-13T02:55:47.0050890Z remote: Compressing objects: 62% (671/1081) 2023-01-13T02:55:47.0058370Z remote: Compressing objects: 63% (682/1081) 2023-01-13T02:55:47.0067200Z remote: Compressing objects: 64% (692/1081) 2023-01-13T02:55:47.0079380Z remote: Compressing objects: 65% (703/1081) 2023-01-13T02:55:47.0100600Z remote: Compressing objects: 66% (714/1081) 2023-01-13T02:55:47.0101060Z remote: Compressing objects: 67% (725/1081) 2023-01-13T02:55:47.0107270Z remote: Compressing objects: 68% (736/1081) 2023-01-13T02:55:47.0136630Z remote: Compressing objects: 69% (746/1081) 2023-01-13T02:55:47.0137730Z remote: Compressing objects: 70% (757/1081) 2023-01-13T02:55:47.0139480Z remote: Compressing objects: 71% (768/1081) 2023-01-13T02:55:47.0140280Z remote: Compressing objects: 72% (779/1081) 2023-01-13T02:55:47.0141280Z remote: Compressing objects: 73% (790/1081) 2023-01-13T02:55:47.0142420Z remote: Compressing objects: 74% (800/1081) 2023-01-13T02:55:47.0143210Z remote: Compressing objects: 75% (811/1081) 2023-01-13T02:55:47.0143950Z remote: Compressing objects: 76% (822/1081) 2023-01-13T02:55:47.0144850Z remote: Compressing objects: 77% (833/1081) 2023-01-13T02:55:47.0145720Z remote: Compressing objects: 78% (844/1081) 2023-01-13T02:55:47.0158420Z remote: Compressing objects: 79% (854/1081) 2023-01-13T02:55:47.0161030Z remote: Compressing objects: 80% (865/1081) 2023-01-13T02:55:47.0161850Z remote: Compressing objects: 81% (876/1081) 2023-01-13T02:55:47.0168200Z remote: Compressing objects: 82% (887/1081) 2023-01-13T02:55:47.0169010Z remote: Compressing objects: 83% (898/1081) 2023-01-13T02:55:47.0170290Z remote: Compressing objects: 84% (909/1081) 2023-01-13T02:55:47.0171040Z remote: Compressing objects: 85% (919/1081) 2023-01-13T02:55:47.0171900Z remote: Compressing objects: 86% (930/1081) 2023-01-13T02:55:47.0172680Z remote: Compressing objects: 87% (941/1081) 2023-01-13T02:55:47.0173490Z remote: Compressing objects: 88% (952/1081) 2023-01-13T02:55:47.0174370Z remote: Compressing objects: 89% (963/1081) 2023-01-13T02:55:47.0175660Z remote: Compressing objects: 90% (973/1081) 2023-01-13T02:55:47.0176660Z remote: Compressing objects: 91% (984/1081) 2023-01-13T02:55:47.0177540Z remote: Compressing objects: 92% (995/1081) 2023-01-13T02:55:47.0178310Z remote: Compressing objects: 93% (1006/1081) 2023-01-13T02:55:47.0179520Z remote: Compressing objects: 94% (1017/1081) 2023-01-13T02:55:47.0180460Z remote: Compressing objects: 95% (1027/1081) 2023-01-13T02:55:47.0181260Z remote: Compressing objects: 96% (1038/1081) 2023-01-13T02:55:47.0182210Z remote: Compressing objects: 97% (1049/1081) 2023-01-13T02:55:47.0182930Z remote: Compressing objects: 98% (1060/1081) 2023-01-13T02:55:47.0183570Z remote: Compressing objects: 99% (1071/1081) 2023-01-13T02:55:47.0184450Z remote: Compressing objects: 100% (1081/1081) 2023-01-13T02:55:47.0185220Z remote: Compressing objects: 100% (1081/1081), done. 2023-01-13T02:55:47.0185990Z Receiving objects: 0% (1/1297) 2023-01-13T02:55:47.0187160Z Receiving objects: 1% (13/1297) 2023-01-13T02:55:47.0189320Z Receiving objects: 2% (26/1297) 2023-01-13T02:55:47.2026420Z Receiving objects: 3% (39/1297) 2023-01-13T02:55:47.2685070Z Receiving objects: 4% (52/1297) 2023-01-13T02:55:47.2689020Z Receiving objects: 5% (65/1297) 2023-01-13T02:55:47.2821740Z Receiving objects: 6% (78/1297) 2023-01-13T02:55:47.2822220Z Receiving objects: 7% (91/1297) 2023-01-13T02:55:47.2849600Z Receiving objects: 8% (104/1297) 2023-01-13T02:55:47.2866800Z Receiving objects: 9% (117/1297) 2023-01-13T02:55:47.2933940Z Receiving objects: 10% (130/1297) 2023-01-13T02:55:47.2945970Z Receiving objects: 11% (143/1297) 2023-01-13T02:55:47.3079960Z Receiving objects: 12% (156/1297) 2023-01-13T02:55:47.3868640Z Receiving objects: 13% (169/1297) 2023-01-13T02:55:47.3971890Z Receiving objects: 14% (182/1297) 2023-01-13T02:55:47.4072320Z Receiving objects: 15% (195/1297) 2023-01-13T02:55:47.4171680Z Receiving objects: 16% (208/1297) 2023-01-13T02:55:47.4273300Z Receiving objects: 17% (221/1297) 2023-01-13T02:55:47.4374670Z Receiving objects: 18% (234/1297) 2023-01-13T02:55:47.4475100Z Receiving objects: 19% (247/1297) 2023-01-13T02:55:47.4576260Z Receiving objects: 20% (260/1297) 2023-01-13T02:55:47.4675660Z Receiving objects: 21% (273/1297) 2023-01-13T02:55:47.4777070Z Receiving objects: 22% (286/1297) 2023-01-13T02:55:47.4878360Z Receiving objects: 23% (299/1297) 2023-01-13T02:55:47.4979650Z Receiving objects: 24% (312/1297) 2023-01-13T02:55:47.5080630Z Receiving objects: 25% (325/1297) 2023-01-13T02:55:47.5182190Z Receiving objects: 26% (338/1297) 2023-01-13T02:55:47.6086060Z Receiving objects: 27% (351/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.6186290Z Receiving objects: 28% (364/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.6287560Z Receiving objects: 29% (377/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7208210Z Receiving objects: 30% (390/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7748490Z Receiving objects: 31% (403/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7757440Z Receiving objects: 32% (416/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7819740Z Receiving objects: 33% (429/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7822350Z Receiving objects: 34% (441/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7849140Z Receiving objects: 35% (454/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7857060Z Receiving objects: 36% (467/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7869630Z Receiving objects: 37% (480/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7871540Z Receiving objects: 38% (493/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7881060Z Receiving objects: 39% (506/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7886490Z Receiving objects: 40% (519/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:47.7890650Z Receiving objects: 41% (532/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:48.1145370Z Receiving objects: 42% (545/1297), 3.98 MiB | 7.95 MiB/s 2023-01-13T02:55:48.2334140Z Receiving objects: 42% (555/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2335240Z Receiving objects: 43% (558/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2336920Z Receiving objects: 44% (571/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2347750Z Receiving objects: 45% (584/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2353210Z Receiving objects: 46% (597/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2356720Z Receiving objects: 47% (610/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2359490Z Receiving objects: 48% (623/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2364110Z Receiving objects: 49% (636/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2368640Z Receiving objects: 50% (649/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2375660Z Receiving objects: 51% (662/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2378110Z Receiving objects: 52% (675/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2384900Z Receiving objects: 53% (688/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2389220Z Receiving objects: 54% (701/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2394930Z Receiving objects: 55% (714/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2400320Z Receiving objects: 56% (727/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2403080Z Receiving objects: 57% (740/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2411670Z Receiving objects: 58% (753/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2414950Z Receiving objects: 59% (766/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2417020Z Receiving objects: 60% (779/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2420660Z Receiving objects: 61% (792/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2423720Z Receiving objects: 62% (805/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2492820Z Receiving objects: 63% (818/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2495800Z Receiving objects: 64% (831/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2499530Z Receiving objects: 65% (844/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2505170Z Receiving objects: 66% (857/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2507880Z Receiving objects: 67% (869/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2511860Z Receiving objects: 68% (882/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2515650Z Receiving objects: 69% (895/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2517270Z Receiving objects: 70% (908/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2519580Z Receiving objects: 71% (921/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2521900Z Receiving objects: 72% (934/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2527000Z Receiving objects: 73% (947/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2528450Z Receiving objects: 74% (960/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2530820Z Receiving objects: 75% (973/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2533370Z Receiving objects: 76% (986/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2535580Z Receiving objects: 77% (999/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2551310Z Receiving objects: 78% (1012/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2552130Z Receiving objects: 79% (1025/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2561000Z Receiving objects: 80% (1038/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2616540Z Receiving objects: 81% (1051/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2623920Z Receiving objects: 82% (1064/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2624990Z Receiving objects: 83% (1077/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2636420Z Receiving objects: 84% (1090/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2636860Z Receiving objects: 85% (1103/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2637160Z Receiving objects: 86% (1116/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2637690Z Receiving objects: 87% (1129/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2637990Z Receiving objects: 88% (1142/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2638290Z Receiving objects: 89% (1155/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2638750Z Receiving objects: 90% (1168/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2639290Z Receiving objects: 91% (1181/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2640690Z remote: Total 1297 (delta 206), reused 704 (delta 108), pack-reused 0 2023-01-13T02:55:48.2641480Z Receiving objects: 92% (1194/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2642790Z Receiving objects: 93% (1207/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2645940Z Receiving objects: 94% (1220/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2649030Z Receiving objects: 95% (1233/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2653240Z Receiving objects: 96% (1246/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2658660Z Receiving objects: 97% (1259/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2661030Z Receiving objects: 98% (1272/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2663270Z Receiving objects: 99% (1285/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2664000Z Receiving objects: 100% (1297/1297), 17.78 MiB | 17.23 MiB/s 2023-01-13T02:55:48.2664550Z Receiving objects: 100% (1297/1297), 27.49 MiB | 20.38 MiB/s, done. 2023-01-13T02:55:48.2672130Z Resolving deltas: 0% (0/206) 2023-01-13T02:55:48.2674530Z Resolving deltas: 1% (3/206) 2023-01-13T02:55:48.2675610Z Resolving deltas: 2% (5/206) 2023-01-13T02:55:48.2676590Z Resolving deltas: 3% (7/206) 2023-01-13T02:55:48.2676870Z Resolving deltas: 4% (9/206) 2023-01-13T02:55:48.2679350Z Resolving deltas: 5% (11/206) 2023-01-13T02:55:48.2681070Z Resolving deltas: 6% (14/206) 2023-01-13T02:55:48.2681430Z Resolving deltas: 7% (15/206) 2023-01-13T02:55:48.2683280Z Resolving deltas: 8% (17/206) 2023-01-13T02:55:48.2683690Z Resolving deltas: 9% (19/206) 2023-01-13T02:55:48.2686090Z Resolving deltas: 10% (21/206) 2023-01-13T02:55:48.2687020Z Resolving deltas: 11% (23/206) 2023-01-13T02:55:48.2687400Z Resolving deltas: 12% (25/206) 2023-01-13T02:55:48.2689310Z Resolving deltas: 13% (27/206) 2023-01-13T02:55:48.2689630Z Resolving deltas: 14% (29/206) 2023-01-13T02:55:48.2690420Z Resolving deltas: 15% (32/206) 2023-01-13T02:55:48.2693710Z Resolving deltas: 16% (33/206) 2023-01-13T02:55:48.2695700Z Resolving deltas: 17% (36/206) 2023-01-13T02:55:48.2697370Z Resolving deltas: 18% (38/206) 2023-01-13T02:55:48.2697710Z Resolving deltas: 19% (40/206) 2023-01-13T02:55:48.2698900Z Resolving deltas: 20% (42/206) 2023-01-13T02:55:48.2699200Z Resolving deltas: 21% (44/206) 2023-01-13T02:55:48.2699460Z Resolving deltas: 22% (46/206) 2023-01-13T02:55:48.2699730Z Resolving deltas: 23% (49/206) 2023-01-13T02:55:48.2699950Z Resolving deltas: 24% (50/206) 2023-01-13T02:55:48.2700190Z Resolving deltas: 25% (52/206) 2023-01-13T02:55:48.2700420Z Resolving deltas: 26% (54/206) 2023-01-13T02:55:48.2700680Z Resolving deltas: 27% (56/206) 2023-01-13T02:55:48.2700920Z Resolving deltas: 28% (58/206) 2023-01-13T02:55:48.2701190Z Resolving deltas: 29% (60/206) 2023-01-13T02:55:48.2701480Z Resolving deltas: 30% (62/206) 2023-01-13T02:55:48.2701720Z Resolving deltas: 31% (64/206) 2023-01-13T02:55:48.2701990Z Resolving deltas: 32% (66/206) 2023-01-13T02:55:48.2702290Z Resolving deltas: 33% (68/206) 2023-01-13T02:55:48.2703940Z Resolving deltas: 34% (71/206) 2023-01-13T02:55:48.2704890Z Resolving deltas: 35% (73/206) 2023-01-13T02:55:48.2707600Z Resolving deltas: 36% (75/206) 2023-01-13T02:55:48.2708120Z Resolving deltas: 37% (77/206) 2023-01-13T02:55:48.2710340Z Resolving deltas: 38% (79/206) 2023-01-13T02:55:48.2713400Z Resolving deltas: 39% (82/206) 2023-01-13T02:55:48.2715500Z Resolving deltas: 40% (83/206) 2023-01-13T02:55:48.2716340Z Resolving deltas: 41% (85/206) 2023-01-13T02:55:48.2719880Z Resolving deltas: 42% (87/206) 2023-01-13T02:55:48.2721170Z Resolving deltas: 43% (89/206) 2023-01-13T02:55:48.2722980Z Resolving deltas: 44% (91/206) 2023-01-13T02:55:48.2724380Z Resolving deltas: 45% (93/206) 2023-01-13T02:55:48.2725080Z Resolving deltas: 46% (95/206) 2023-01-13T02:55:48.2727350Z Resolving deltas: 47% (98/206) 2023-01-13T02:55:48.2728450Z Resolving deltas: 48% (99/206) 2023-01-13T02:55:48.2731020Z Resolving deltas: 49% (101/206) 2023-01-13T02:55:48.2732520Z Resolving deltas: 50% (103/206) 2023-01-13T02:55:48.2732860Z Resolving deltas: 51% (106/206) 2023-01-13T02:55:48.2734620Z Resolving deltas: 52% (108/206) 2023-01-13T02:55:48.2736600Z Resolving deltas: 53% (110/206) 2023-01-13T02:55:48.2738810Z Resolving deltas: 54% (112/206) 2023-01-13T02:55:48.2740180Z Resolving deltas: 55% (114/206) 2023-01-13T02:55:48.2740980Z Resolving deltas: 56% (116/206) 2023-01-13T02:55:48.2741510Z Resolving deltas: 57% (118/206) 2023-01-13T02:55:48.2742040Z Resolving deltas: 58% (120/206) 2023-01-13T02:55:48.2742510Z Resolving deltas: 59% (122/206) 2023-01-13T02:55:48.2743010Z Resolving deltas: 60% (124/206) 2023-01-13T02:55:48.2743480Z Resolving deltas: 61% (126/206) 2023-01-13T02:55:48.2743720Z Resolving deltas: 62% (128/206) 2023-01-13T02:55:48.2744210Z Resolving deltas: 63% (130/206) 2023-01-13T02:55:48.2744700Z Resolving deltas: 64% (132/206) 2023-01-13T02:55:48.2745150Z Resolving deltas: 65% (134/206) 2023-01-13T02:55:48.2745620Z Resolving deltas: 66% (136/206) 2023-01-13T02:55:48.2746600Z Resolving deltas: 67% (139/206) 2023-01-13T02:55:48.2747090Z Resolving deltas: 68% (141/206) 2023-01-13T02:55:48.2747340Z Resolving deltas: 69% (143/206) 2023-01-13T02:55:48.2747820Z Resolving deltas: 70% (145/206) 2023-01-13T02:55:48.2748300Z Resolving deltas: 71% (147/206) 2023-01-13T02:55:48.2748770Z Resolving deltas: 72% (149/206) 2023-01-13T02:55:48.2749250Z Resolving deltas: 73% (151/206) 2023-01-13T02:55:48.2749780Z Resolving deltas: 74% (153/206) 2023-01-13T02:55:48.2750260Z Resolving deltas: 75% (155/206) 2023-01-13T02:55:48.2750780Z Resolving deltas: 76% (157/206) 2023-01-13T02:55:48.2751280Z Resolving deltas: 77% (160/206) 2023-01-13T02:55:48.2751720Z Resolving deltas: 78% (162/206) 2023-01-13T02:55:48.2752230Z Resolving deltas: 79% (163/206) 2023-01-13T02:55:48.2752890Z Resolving deltas: 80% (165/206) 2023-01-13T02:55:48.2753490Z Resolving deltas: 81% (167/206) 2023-01-13T02:55:48.2753710Z Resolving deltas: 82% (169/206) 2023-01-13T02:55:48.2753930Z Resolving deltas: 83% (171/206) 2023-01-13T02:55:48.2754150Z Resolving deltas: 84% (174/206) 2023-01-13T02:55:48.2754360Z Resolving deltas: 85% (176/206) 2023-01-13T02:55:48.2754580Z Resolving deltas: 86% (178/206) 2023-01-13T02:55:48.2754800Z Resolving deltas: 87% (180/206) 2023-01-13T02:55:48.2755000Z Resolving deltas: 88% (182/206) 2023-01-13T02:55:48.2755220Z Resolving deltas: 89% (185/206) 2023-01-13T02:55:48.2755430Z Resolving deltas: 90% (186/206) 2023-01-13T02:55:48.2755640Z Resolving deltas: 91% (188/206) 2023-01-13T02:55:48.2755860Z Resolving deltas: 92% (190/206) 2023-01-13T02:55:48.2756070Z Resolving deltas: 93% (192/206) 2023-01-13T02:55:48.2756280Z Resolving deltas: 94% (194/206) 2023-01-13T02:55:48.2756490Z Resolving deltas: 95% (196/206) 2023-01-13T02:55:48.2756700Z Resolving deltas: 96% (198/206) 2023-01-13T02:55:48.2756920Z Resolving deltas: 97% (201/206) 2023-01-13T02:55:48.2757120Z Resolving deltas: 98% (202/206) 2023-01-13T02:55:48.2757340Z Resolving deltas: 99% (204/206) 2023-01-13T02:55:48.2757560Z Resolving deltas: 100% (206/206) 2023-01-13T02:55:48.2757780Z Resolving deltas: 100% (206/206), done. 2023-01-13T02:55:48.5146170Z From https://github.com/pytorch/serve 2023-01-13T02:55:48.5148580Z * [new ref] 9d21339cfcfb9c4a1406a62d9f7f85fe31374e09 -> origin/feature/upgrade_pytorch1.13.1 2023-01-13T02:55:48.5257340Z ##[endgroup] 2023-01-13T02:55:48.5258010Z ##[group]Determining the checkout info 2023-01-13T02:55:48.5261240Z ##[endgroup] 2023-01-13T02:55:48.5262500Z ##[group]Checking out the ref 2023-01-13T02:55:48.5269810Z [command]/usr/local/bin/git checkout --progress --force -B feature/upgrade_pytorch1.13.1 refs/remotes/origin/feature/upgrade_pytorch1.13.1 2023-01-13T02:55:49.3489940Z Switched to a new branch 'feature/upgrade_pytorch1.13.1' 2023-01-13T02:55:49.3496080Z branch 'feature/upgrade_pytorch1.13.1' set up to track 'origin/feature/upgrade_pytorch1.13.1'. 2023-01-13T02:55:49.3512240Z ##[endgroup] 2023-01-13T02:55:49.3649670Z [command]/usr/local/bin/git log -1 --format='%H' 2023-01-13T02:55:49.3752480Z '9d21339cfcfb9c4a1406a62d9f7f85fe31374e09' 2023-01-13T02:55:49.4057620Z ##[group]Run python ts_scripts/install_dependencies.py --environment=dev 2023-01-13T02:55:49.4058150Z python ts_scripts/install_dependencies.py --environment=dev 2023-01-13T02:55:49.4270240Z shell: /bin/bash -e {0} 2023-01-13T02:55:49.4270480Z env: 2023-01-13T02:55:49.4270750Z pythonLocation: /Users/runner/hostedtoolcache/Python/3.8.15/x64 2023-01-13T02:55:49.4271080Z JAVA_HOME: /Users/runner/hostedtoolcache/Java_Zulu_jdk/17.0.5-8/x64 2023-01-13T02:55:49.4271400Z JAVA_HOME_17_X64: /Users/runner/hostedtoolcache/Java_Zulu_jdk/17.0.5-8/x64 2023-01-13T02:55:49.4271660Z ##[endgroup] 2023-01-13T02:55:49.9156990Z GNU Wget 1.21.3 built on darwin21.3.0. 2023-01-13T02:55:49.9157830Z 2023-01-13T02:55:49.9159000Z -cares +digest -gpgme +https +ipv6 +iri +large-file -metalink +nls 2023-01-13T02:55:49.9160040Z +ntlm +opie -psl +ssl/openssl 2023-01-13T02:55:49.9160590Z 2023-01-13T02:55:49.9161000Z Wgetrc: 2023-01-13T02:55:49.9161620Z /usr/local/etc/wgetrc (system) 2023-01-13T02:55:49.9162460Z Locale: 2023-01-13T02:55:49.9163100Z /usr/local/Cellar/wget/1.21.3/share/locale 2023-01-13T02:55:49.9164060Z Compile: 2023-01-13T02:55:49.9164990Z clang -DHAVE_CONFIG_H -DSYSTEM_WGETRC="/usr/local/etc/wgetrc" 2023-01-13T02:55:49.9166140Z -DLOCALEDIR="/usr/local/Cellar/wget/1.21.3/share/locale" -I. 2023-01-13T02:55:49.9167070Z -I../lib -I../lib -I/usr/local/opt/openssl@1.1/include 2023-01-13T02:55:49.9168030Z -I/usr/local/Cellar/libidn2/2.3.2/include -DNDEBUG -g -O2 2023-01-13T02:55:49.9168680Z Link: 2023-01-13T02:55:49.9169570Z clang -I/usr/local/Cellar/libidn2/2.3.2/include -DNDEBUG -g -O2 2023-01-13T02:55:49.9170610Z -L/usr/local/Cellar/libidn2/2.3.2/lib -lidn2 2023-01-13T02:55:49.9171510Z -L/usr/local/opt/openssl@1.1/lib -lssl -lcrypto -ldl -lz 2023-01-13T02:55:49.9172400Z ../lib/libgnu.a -liconv -lintl -Wl,-framework -Wl,CoreFoundation 2023-01-13T02:55:49.9173120Z -lunistring 2023-01-13T02:55:49.9173630Z 2023-01-13T02:55:49.9174110Z Copyright (C) 2015 Free Software Foundation, Inc. 2023-01-13T02:55:49.9175360Z License GPLv3+: GNU GPL version 3 or later 2023-01-13T02:55:49.9175780Z . 2023-01-13T02:55:49.9176110Z This is free software: you are free to change and redistribute it. 2023-01-13T02:55:49.9176500Z There is NO WARRANTY, to the extent permitted by law. 2023-01-13T02:55:49.9177230Z 2023-01-13T02:55:49.9178040Z Originally written by Hrvoje Niksic . 2023-01-13T02:55:49.9179230Z Please send bug reports and questions to . 2023-01-13T02:56:02.0861480Z Error: No such keg: /usr/local/Cellar/node 2023-01-13T02:56:04.3291170Z ==> Fetching dependencies for node@14: macos-term-size 2023-01-13T02:56:04.3309580Z ==> Fetching macos-term-size 2023-01-13T02:56:04.3535950Z ==> Downloading https://ghcr.io/v2/homebrew/core/macos-term-size/manifests/1.0.0 2023-01-13T02:56:05.6937430Z ==> Downloading https://ghcr.io/v2/homebrew/core/macos-term-size/blobs/sha256:c9171245cbf3ba0231147e961ae6cb2e4d8e13a8c7abc64bad1a0e57a4274efb 2023-01-13T02:56:06.0412480Z ==> Downloading from https://pkg-containers.githubusercontent.com/ghcr1/blobs/sha256:c9171245cbf3ba0231147e961ae6cb2e4d8e13a8c7abc64bad1a0e57a4274efb?se=2023-01-13T03%3A05%3A00Z&sig=FAUc9wADgLQ9YIPdk1m6D5feTyn%2Fhr8%2FE9BFEMVbY1M%3D&sp=r&spr=https&sr=b&sv=2019-12-12 2023-01-13T02:56:06.2623880Z ==> Fetching node@14 2023-01-13T02:56:06.2644320Z ==> Downloading https://ghcr.io/v2/homebrew/core/node/14/manifests/14.21.2 2023-01-13T02:56:07.4579080Z ==> Downloading https://ghcr.io/v2/homebrew/core/node/14/blobs/sha256:5ccd16398ead0cabb0a7b32a61e17a59b2ff5f7b8ec9860c1d54d8c588bead12 2023-01-13T02:56:07.8733900Z ==> Downloading from https://pkg-containers.githubusercontent.com/ghcr1/blobs/sha256:5ccd16398ead0cabb0a7b32a61e17a59b2ff5f7b8ec9860c1d54d8c588bead12?se=2023-01-13T03%3A05%3A00Z&sig=jPQ%2Fs38H5hwF4PpZTZk5uoKaKFGXVRi7tWXgPrID%2BzM%3D&sp=r&spr=https&sr=b&sv=2019-12-12 2023-01-13T02:56:09.0312940Z ==> Installing dependencies for node@14: macos-term-size 2023-01-13T02:56:09.0348590Z ==> Installing node@14 dependency: macos-term-size 2023-01-13T02:56:09.1527580Z ==> Pouring macos-term-size--1.0.0.monterey.bottle.tar.gz 2023-01-13T02:56:11.3770340Z ๐Ÿบ /usr/local/Cellar/macos-term-size/1.0.0: 5 files, 52.6KB 2023-01-13T02:56:11.3773960Z ==> Installing node@14 2023-01-13T02:56:11.3780360Z ==> Pouring node@14--14.21.2.monterey.bottle.tar.gz 2023-01-13T02:56:27.9990130Z ==> Caveats 2023-01-13T02:56:27.9990750Z node@14 is keg-only, which means it was not symlinked into /usr/local, 2023-01-13T02:56:27.9991500Z because this is an alternate version of another formula. 2023-01-13T02:56:27.9991770Z 2023-01-13T02:56:27.9991990Z If you need to have node@14 first in your PATH, run: 2023-01-13T02:56:27.9992520Z echo 'export PATH="/usr/local/opt/node@14/bin:$PATH"' >> /Users/runner/.bash_profile 2023-01-13T02:56:27.9992790Z 2023-01-13T02:56:27.9993140Z For compilers to find node@14 you may need to set: 2023-01-13T02:56:27.9993650Z export LDFLAGS="-L/usr/local/opt/node@14/lib" 2023-01-13T02:56:27.9994120Z export CPPFLAGS="-I/usr/local/opt/node@14/include" 2023-01-13T02:56:27.9994320Z 2023-01-13T02:56:27.9994490Z ==> Summary 2023-01-13T02:56:28.2078030Z ๐Ÿบ /usr/local/Cellar/node@14/14.21.2: 3,954 files, 55.8MB 2023-01-13T02:56:28.2179770Z ==> Running `brew cleanup node@14`... 2023-01-13T02:56:28.2282010Z Disable this behaviour by setting HOMEBREW_NO_INSTALL_CLEANUP. 2023-01-13T02:56:28.2332580Z Hide these hints with HOMEBREW_NO_ENV_HINTS (see `man brew`). 2023-01-13T02:56:30.3502740Z ==> Caveats 2023-01-13T02:56:30.3593940Z ==> node@14 2023-01-13T02:56:30.3678150Z node@14 is keg-only, which means it was not symlinked into /usr/local, 2023-01-13T02:56:30.3779580Z because this is an alternate version of another formula. 2023-01-13T02:56:30.3880590Z 2023-01-13T02:56:30.3963060Z If you need to have node@14 first in your PATH, run: 2023-01-13T02:56:30.4041820Z echo 'export PATH="/usr/local/opt/node@14/bin:$PATH"' >> /Users/runner/.bash_profile 2023-01-13T02:56:30.4126610Z 2023-01-13T02:56:30.4223200Z For compilers to find node@14 you may need to set: 2023-01-13T02:56:30.4324240Z export LDFLAGS="-L/usr/local/opt/node@14/lib" 2023-01-13T02:56:30.4373640Z export CPPFLAGS="-I/usr/local/opt/node@14/include" 2023-01-13T02:56:30.4396010Z 2023-01-13T02:56:33.6654180Z Unlinking /usr/local/Cellar/node@16/16.19.0... 1866 symlinks removed. 2023-01-13T02:56:36.6383110Z Linking /usr/local/Cellar/node@14/14.21.2... 3899 symlinks created. 2023-01-13T02:56:36.6468290Z 2023-01-13T02:56:36.6573240Z If you need to have this software first in your PATH instead consider running: 2023-01-13T02:56:36.6613050Z echo 'export PATH="/usr/local/opt/node@14/bin:$PATH"' >> /Users/runner/.bash_profile 2023-01-13T02:56:43.4186890Z npm WARN deprecated har-validator@5.1.5: this library is no longer supported 2023-01-13T02:56:43.5807090Z npm WARN deprecated uuid@3.4.0: Please upgrade to version 7 or higher. Older versions may use Math.random() in certain circumstances, which is known to be problematic. See https://v8.dev/blog/math-random for details. 2023-01-13T02:56:54.2144520Z /usr/local/bin/markdown-link-check -> /usr/local/lib/node_modules/markdown-link-check/markdown-link-check 2023-01-13T02:56:54.2251010Z /usr/local/bin/newman -> /usr/local/lib/node_modules/newman/bin/newman.js 2023-01-13T02:56:54.3140010Z npm WARN newman-reporter-html@1.0.5 requires a peer of newman@4 but none is installed. You must install peer dependencies yourself. 2023-01-13T02:56:54.3140940Z 2023-01-13T02:56:54.3154250Z + newman@5.3.2 2023-01-13T02:56:54.3155290Z + markdown-link-check@3.10.3 2023-01-13T02:56:54.3156810Z + newman-reporter-html@1.0.5 2023-01-13T02:56:54.3157250Z added 163 packages from 180 contributors in 16.231s 2023-01-13T02:56:55.8220460Z javac 17.0.5 2023-01-13T02:56:55.8561110Z /usr/local/bin/conda 2023-01-13T02:57:03.5544650Z Collecting package metadata (current_repodata.json): ...working... done 2023-01-13T02:57:04.5363720Z Solving environment: ...working... failed with initial frozen solve. Retrying with flexible solve. 2023-01-13T02:57:05.6813790Z Solving environment: ...working... failed with repodata from current_repodata.json, will retry with next repodata source. 2023-01-13T02:57:16.9513070Z Collecting package metadata (repodata.json): ...working... done 2023-01-13T02:57:21.8016240Z Solving environment: ...working... done 2023-01-13T02:57:22.2311230Z 2023-01-13T02:57:22.2311660Z ## Package Plan ## 2023-01-13T02:57:22.2312490Z 2023-01-13T02:57:22.2312920Z environment location: /usr/local/miniconda 2023-01-13T02:57:22.2313160Z 2023-01-13T02:57:22.2313300Z added / updated specs: 2023-01-13T02:57:22.2313840Z - conda-build 2023-01-13T02:57:22.2314010Z 2023-01-13T02:57:22.2314030Z 2023-01-13T02:57:22.2314150Z The following packages will be downloaded: 2023-01-13T02:57:22.2314360Z 2023-01-13T02:57:22.2314500Z package | build 2023-01-13T02:57:22.2315170Z ---------------------------|----------------- 2023-01-13T02:57:22.2315680Z beautifulsoup4-4.11.1 | py39hecd8cb5_0 189 KB 2023-01-13T02:57:22.2316120Z bzip2-1.0.8 | h1de35cc_0 75 KB 2023-01-13T02:57:22.2316590Z ca-certificates-2022.10.11 | hecd8cb5_0 125 KB 2023-01-13T02:57:22.2317230Z cctools-949.0.1 | h9abeeb2_25 18 KB 2023-01-13T02:57:22.2317680Z cctools_osx-64-949.0.1 | hc7db93f_25 1.3 MB 2023-01-13T02:57:22.2318160Z certifi-2022.12.7 | py39hecd8cb5_0 151 KB 2023-01-13T02:57:22.2318640Z chardet-4.0.0 |py39hecd8cb5_1003 195 KB 2023-01-13T02:57:22.2319140Z conda-22.11.1 | py39hecd8cb5_4 941 KB 2023-01-13T02:57:22.2319740Z conda-build-3.23.3 | py39hecd8cb5_0 568 KB 2023-01-13T02:57:22.2320260Z filelock-3.9.0 | py39hecd8cb5_0 19 KB 2023-01-13T02:57:22.2320720Z glob2-0.7 | pyhd3eb1b0_0 12 KB 2023-01-13T02:57:22.2321120Z icu-58.2 | h0a44026_3 10.1 MB 2023-01-13T02:57:22.2321580Z jinja2-2.11.3 | pyhd3eb1b0_0 101 KB 2023-01-13T02:57:22.2322230Z ld64-530 | h20443b4_25 16 KB 2023-01-13T02:57:22.2322680Z ld64_osx-64-530 | h70f3046_25 920 KB 2023-01-13T02:57:22.2323090Z ldid-2.1.2 | h2d21305_2 54 KB 2023-01-13T02:57:22.2341300Z libarchive-3.6.1 | he336d3b_0 718 KB 2023-01-13T02:57:22.2342010Z libiconv-1.16 | hca72f7f_2 695 KB 2023-01-13T02:57:22.2342610Z liblief-0.11.5 | he9d5cce_1 1.6 MB 2023-01-13T02:57:22.2344130Z libllvm14-14.0.6 | he552d86_0 21.3 MB 2023-01-13T02:57:22.2344590Z libxml2-2.9.14 | hbf8cd5e_0 641 KB 2023-01-13T02:57:22.2345040Z lz4-c-1.9.3 | h23ab428_1 140 KB 2023-01-13T02:57:22.2345460Z markupsafe-2.0.1 | py39h9ed2024_0 20 KB 2023-01-13T02:57:22.2346640Z openssl-1.1.1s | hca72f7f_0 2.8 MB 2023-01-13T02:57:22.2347360Z patch-2.7.6 | h1de35cc_1001 128 KB 2023-01-13T02:57:22.2347920Z pkginfo-1.8.3 | py39hecd8cb5_0 47 KB 2023-01-13T02:57:22.2348420Z pluggy-1.0.0 | py39hecd8cb5_1 29 KB 2023-01-13T02:57:22.2349050Z psutil-5.9.0 | py39hca72f7f_0 339 KB 2023-01-13T02:57:22.2350190Z py-lief-0.11.5 | py39he9d5cce_1 996 KB 2023-01-13T02:57:22.2350740Z python-libarchive-c-2.9 | pyhd3eb1b0_1 47 KB 2023-01-13T02:57:22.2351220Z pytz-2022.7 | py39hecd8cb5_0 210 KB 2023-01-13T02:57:22.2351670Z pyyaml-6.0 | py39h6c40b1e_1 172 KB 2023-01-13T02:57:22.2352240Z ripgrep-13.0.0 | hc2228c6_0 1.1 MB 2023-01-13T02:57:22.2352830Z ruamel.yaml-0.17.21 | py39hca72f7f_0 179 KB 2023-01-13T02:57:22.2353300Z ruamel.yaml.clib-0.2.6 | py39hca72f7f_1 126 KB 2023-01-13T02:57:22.2353780Z soupsieve-2.3.2.post1 | py39hecd8cb5_0 66 KB 2023-01-13T02:57:22.2354210Z tapi-1000.10.8 | ha1b3eb9_0 4.2 MB 2023-01-13T02:57:22.2354820Z toml-0.10.2 | pyhd3eb1b0_0 20 KB 2023-01-13T02:57:22.2355350Z toolz-0.12.0 | py39hecd8cb5_0 106 KB 2023-01-13T02:57:22.2355780Z zstd-1.5.2 | hcb37349_0 473 KB 2023-01-13T02:57:22.2356240Z ------------------------------------------------------------ 2023-01-13T02:57:22.2356740Z Total: 50.8 MB 2023-01-13T02:57:22.2356930Z 2023-01-13T02:57:22.2357090Z The following NEW packages will be INSTALLED: 2023-01-13T02:57:22.2357250Z 2023-01-13T02:57:22.2357730Z beautifulsoup4 pkgs/main/osx-64::beautifulsoup4-4.11.1-py39hecd8cb5_0 2023-01-13T02:57:22.2358320Z bzip2 pkgs/main/osx-64::bzip2-1.0.8-h1de35cc_0 2023-01-13T02:57:22.2358860Z cctools pkgs/main/osx-64::cctools-949.0.1-h9abeeb2_25 2023-01-13T02:57:22.2359630Z cctools_osx-64 pkgs/main/osx-64::cctools_osx-64-949.0.1-hc7db93f_25 2023-01-13T02:57:22.2360180Z chardet pkgs/main/osx-64::chardet-4.0.0-py39hecd8cb5_1003 2023-01-13T02:57:22.2360770Z conda-build pkgs/main/osx-64::conda-build-3.23.3-py39hecd8cb5_0 2023-01-13T02:57:22.2361370Z filelock pkgs/main/osx-64::filelock-3.9.0-py39hecd8cb5_0 2023-01-13T02:57:22.2361840Z glob2 pkgs/main/noarch::glob2-0.7-pyhd3eb1b0_0 2023-01-13T02:57:22.2362400Z icu pkgs/main/osx-64::icu-58.2-h0a44026_3 2023-01-13T02:57:22.2362890Z jinja2 pkgs/main/noarch::jinja2-2.11.3-pyhd3eb1b0_0 2023-01-13T02:57:22.2363420Z ld64 pkgs/main/osx-64::ld64-530-h20443b4_25 2023-01-13T02:57:22.2363920Z ld64_osx-64 pkgs/main/osx-64::ld64_osx-64-530-h70f3046_25 2023-01-13T02:57:22.2364600Z ldid pkgs/main/osx-64::ldid-2.1.2-h2d21305_2 2023-01-13T02:57:22.2365190Z libarchive pkgs/main/osx-64::libarchive-3.6.1-he336d3b_0 2023-01-13T02:57:22.2365750Z libiconv pkgs/main/osx-64::libiconv-1.16-hca72f7f_2 2023-01-13T02:57:22.2366260Z liblief pkgs/main/osx-64::liblief-0.11.5-he9d5cce_1 2023-01-13T02:57:22.2366810Z libllvm14 pkgs/main/osx-64::libllvm14-14.0.6-he552d86_0 2023-01-13T02:57:22.2367540Z libxml2 pkgs/main/osx-64::libxml2-2.9.14-hbf8cd5e_0 2023-01-13T02:57:22.2368030Z lz4-c pkgs/main/osx-64::lz4-c-1.9.3-h23ab428_1 2023-01-13T02:57:22.2369650Z markupsafe pkgs/main/osx-64::markupsafe-2.0.1-py39h9ed2024_0 2023-01-13T02:57:22.2370250Z patch pkgs/main/osx-64::patch-2.7.6-h1de35cc_1001 2023-01-13T02:57:22.2370960Z pkginfo pkgs/main/osx-64::pkginfo-1.8.3-py39hecd8cb5_0 2023-01-13T02:57:22.2371530Z pluggy pkgs/main/osx-64::pluggy-1.0.0-py39hecd8cb5_1 2023-01-13T02:57:22.2372150Z psutil pkgs/main/osx-64::psutil-5.9.0-py39hca72f7f_0 2023-01-13T02:57:22.2372740Z py-lief pkgs/main/osx-64::py-lief-0.11.5-py39he9d5cce_1 2023-01-13T02:57:22.2373370Z python-libarchive~ pkgs/main/noarch::python-libarchive-c-2.9-pyhd3eb1b0_1 2023-01-13T02:57:22.2374070Z pytz pkgs/main/osx-64::pytz-2022.7-py39hecd8cb5_0 2023-01-13T02:57:22.2374660Z pyyaml pkgs/main/osx-64::pyyaml-6.0-py39h6c40b1e_1 2023-01-13T02:57:22.2375940Z ripgrep pkgs/main/osx-64::ripgrep-13.0.0-hc2228c6_0 2023-01-13T02:57:22.2376580Z ruamel.yaml pkgs/main/osx-64::ruamel.yaml-0.17.21-py39hca72f7f_0 2023-01-13T02:57:22.2377230Z ruamel.yaml.clib pkgs/main/osx-64::ruamel.yaml.clib-0.2.6-py39hca72f7f_1 2023-01-13T02:57:22.2378040Z soupsieve pkgs/main/osx-64::soupsieve-2.3.2.post1-py39hecd8cb5_0 2023-01-13T02:57:22.2378850Z tapi pkgs/main/osx-64::tapi-1000.10.8-ha1b3eb9_0 2023-01-13T02:57:22.2379300Z toml pkgs/main/noarch::toml-0.10.2-pyhd3eb1b0_0 2023-01-13T02:57:22.2379860Z toolz pkgs/main/osx-64::toolz-0.12.0-py39hecd8cb5_0 2023-01-13T02:57:22.2380530Z zstd pkgs/main/osx-64::zstd-1.5.2-hcb37349_0 2023-01-13T02:57:22.2380750Z 2023-01-13T02:57:22.2380900Z The following packages will be UPDATED: 2023-01-13T02:57:22.2381090Z 2023-01-13T02:57:22.2381490Z ca-certificates 2022.3.29-hecd8cb5_1 --> 2022.10.11-hecd8cb5_0 2023-01-13T02:57:22.2382060Z certifi 2021.10.8-py39hecd8cb5_2 --> 2022.12.7-py39hecd8cb5_0 2023-01-13T02:57:22.2382590Z conda 4.12.0-py39hecd8cb5_0 --> 22.11.1-py39hecd8cb5_4 2023-01-13T02:57:22.2383270Z openssl 1.1.1n-hca72f7f_0 --> 1.1.1s-hca72f7f_0 2023-01-13T02:57:22.2383440Z 2023-01-13T02:57:22.2383490Z 2023-01-13T02:57:22.2383490Z 2023-01-13T02:57:22.2383600Z Downloading and Extracting Packages 2023-01-13T02:57:22.2383790Z 2023-01-13T02:57:22.6481550Z openssl-1.1.1s | 2.8 MB | | 0% 2023-01-13T02:57:22.6485760Z openssl-1.1.1s | 2.8 MB | ########## | 100% 2023-01-13T02:57:22.6490470Z openssl-1.1.1s | 2.8 MB | ########## | 100% 2023-01-13T02:57:22.6491040Z 2023-01-13T02:57:22.7655040Z ripgrep-13.0.0 | 1.1 MB | | 0% 2023-01-13T02:57:22.7660550Z ripgrep-13.0.0 | 1.1 MB | ########## | 100% 2023-01-13T02:57:22.7665860Z ripgrep-13.0.0 | 1.1 MB | ########## | 100% 2023-01-13T02:57:22.7666110Z 2023-01-13T02:57:23.0709310Z conda-22.11.1 | 941 KB | | 0% 2023-01-13T02:57:23.0763840Z conda-22.11.1 | 941 KB | ########## | 100% 2023-01-13T02:57:23.0770780Z conda-22.11.1 | 941 KB | ########## | 100% 2023-01-13T02:57:23.0771380Z 2023-01-13T02:57:23.1065250Z glob2-0.7 | 12 KB | | 0% 2023-01-13T02:57:23.1067400Z glob2-0.7 | 12 KB | ########## | 100% 2023-01-13T02:57:23.1067610Z 2023-01-13T02:57:23.1747010Z ld64-530 | 16 KB | | 0% 2023-01-13T02:57:23.1752040Z ld64-530 | 16 KB | ########## | 100% 2023-01-13T02:57:23.1752260Z 2023-01-13T02:57:23.2672390Z certifi-2022.12.7 | 151 KB | | 0% 2023-01-13T02:57:23.2677070Z certifi-2022.12.7 | 151 KB | ########## | 100% 2023-01-13T02:57:23.2677290Z 2023-01-13T02:57:23.3518620Z soupsieve-2.3.2.post | 66 KB | | 0% 2023-01-13T02:57:23.3594910Z soupsieve-2.3.2.post | 66 KB | ########## | 100% 2023-01-13T02:57:23.3601050Z 2023-01-13T02:57:23.4657780Z psutil-5.9.0 | 339 KB | | 0% 2023-01-13T02:57:23.4662180Z psutil-5.9.0 | 339 KB | ########## | 100% 2023-01-13T02:57:23.4667860Z psutil-5.9.0 | 339 KB | ########## | 100% 2023-01-13T02:57:23.4668060Z 2023-01-13T02:57:23.5353090Z ldid-2.1.2 | 54 KB | | 0% 2023-01-13T02:57:23.5356930Z ldid-2.1.2 | 54 KB | ########## | 100% 2023-01-13T02:57:23.5357340Z 2023-01-13T02:57:23.9836550Z pytz-2022.7 | 210 KB | | 0% 2023-01-13T02:57:23.9841550Z pytz-2022.7 | 210 KB | ########## | 100% 2023-01-13T02:57:23.9847440Z pytz-2022.7 | 210 KB | ########## | 100% 2023-01-13T02:57:23.9847690Z 2023-01-13T02:57:24.5066590Z tapi-1000.10.8 | 4.2 MB | | 0% 2023-01-13T02:57:24.5070560Z tapi-1000.10.8 | 4.2 MB | ########## | 100% 2023-01-13T02:57:24.5076280Z tapi-1000.10.8 | 4.2 MB | ########## | 100% 2023-01-13T02:57:24.5076710Z 2023-01-13T02:57:24.6577070Z libarchive-3.6.1 | 718 KB | | 0% 2023-01-13T02:57:24.6580990Z libarchive-3.6.1 | 718 KB | ########## | 100% 2023-01-13T02:57:24.6586990Z libarchive-3.6.1 | 718 KB | ########## | 100% 2023-01-13T02:57:24.6587200Z 2023-01-13T02:57:24.7263340Z toml-0.10.2 | 20 KB | | 0% 2023-01-13T02:57:24.7268250Z toml-0.10.2 | 20 KB | ########## | 100% 2023-01-13T02:57:24.7268460Z 2023-01-13T02:57:24.8115910Z ca-certificates-2022 | 125 KB | | 0% 2023-01-13T02:57:24.8120410Z ca-certificates-2022 | 125 KB | ########## | 100% 2023-01-13T02:57:24.8121040Z 2023-01-13T02:57:24.9086870Z toolz-0.12.0 | 106 KB | | 0% 2023-01-13T02:57:24.9090490Z toolz-0.12.0 | 106 KB | ########## | 100% 2023-01-13T02:57:24.9091630Z 2023-01-13T02:57:24.9975830Z pluggy-1.0.0 | 29 KB | | 0% 2023-01-13T02:57:24.9979860Z pluggy-1.0.0 | 29 KB | ########## | 100% 2023-01-13T02:57:24.9980490Z 2023-01-13T02:57:25.1472660Z ld64_osx-64-530 | 920 KB | | 0% 2023-01-13T02:57:25.1476910Z ld64_osx-64-530 | 920 KB | ########## | 100% 2023-01-13T02:57:25.1482290Z ld64_osx-64-530 | 920 KB | ########## | 100% 2023-01-13T02:57:25.1482490Z 2023-01-13T02:57:25.2315360Z jinja2-2.11.3 | 101 KB | | 0% 2023-01-13T02:57:25.2320260Z jinja2-2.11.3 | 101 KB | ########## | 100% 2023-01-13T02:57:25.2320900Z 2023-01-13T02:57:25.4549310Z cctools_osx-64-949.0 | 1.3 MB | | 0% 2023-01-13T02:57:25.4553510Z cctools_osx-64-949.0 | 1.3 MB | ########## | 100% 2023-01-13T02:57:25.4559630Z cctools_osx-64-949.0 | 1.3 MB | ########## | 100% 2023-01-13T02:57:25.4559810Z 2023-01-13T02:57:25.5740810Z libxml2-2.9.14 | 641 KB | | 0% 2023-01-13T02:57:25.5744580Z libxml2-2.9.14 | 641 KB | ########## | 100% 2023-01-13T02:57:25.5749630Z libxml2-2.9.14 | 641 KB | ########## | 100% 2023-01-13T02:57:25.5750190Z 2023-01-13T02:57:25.6776670Z zstd-1.5.2 | 473 KB | | 0% 2023-01-13T02:57:25.6781330Z zstd-1.5.2 | 473 KB | ########## | 100% 2023-01-13T02:57:25.6786350Z zstd-1.5.2 | 473 KB | ########## | 100% 2023-01-13T02:57:25.6786580Z 2023-01-13T02:57:25.7923230Z filelock-3.9.0 | 19 KB | | 0% 2023-01-13T02:57:25.7927780Z filelock-3.9.0 | 19 KB | ########## | 100% 2023-01-13T02:57:25.7933260Z filelock-3.9.0 | 19 KB | ########## | 100% 2023-01-13T02:57:25.7935380Z 2023-01-13T02:57:25.8818350Z pkginfo-1.8.3 | 47 KB | | 0% 2023-01-13T02:57:25.8822460Z pkginfo-1.8.3 | 47 KB | ########## | 100% 2023-01-13T02:57:25.8822680Z 2023-01-13T02:57:25.9899410Z ruamel.yaml-0.17.21 | 179 KB | | 0% 2023-01-13T02:57:25.9903450Z ruamel.yaml-0.17.21 | 179 KB | ########## | 100% 2023-01-13T02:57:25.9908600Z ruamel.yaml-0.17.21 | 179 KB | ########## | 100% 2023-01-13T02:57:25.9909830Z 2023-01-13T02:57:26.0745130Z ruamel.yaml.clib-0.2 | 126 KB | | 0% 2023-01-13T02:57:26.0749980Z ruamel.yaml.clib-0.2 | 126 KB | ########## | 100% 2023-01-13T02:57:26.0759940Z 2023-01-13T02:57:26.2430930Z conda-build-3.23.3 | 568 KB | | 0% 2023-01-13T02:57:26.2439740Z conda-build-3.23.3 | 568 KB | ########## | 100% 2023-01-13T02:57:26.2442280Z conda-build-3.23.3 | 568 KB | ########## | 100% 2023-01-13T02:57:26.2442940Z 2023-01-13T02:57:26.3201760Z markupsafe-2.0.1 | 20 KB | | 0% 2023-01-13T02:57:26.3205010Z markupsafe-2.0.1 | 20 KB | ########## | 100% 2023-01-13T02:57:26.3205680Z 2023-01-13T02:57:26.4216570Z libllvm14-14.0.6 | 21.3 MB | | 0% 2023-01-13T02:57:26.5584200Z libllvm14-14.0.6 | 21.3 MB | #3 | 13% 2023-01-13T02:57:26.6589310Z libllvm14-14.0.6 | 21.3 MB | ##6 | 27% 2023-01-13T02:57:26.7544050Z libllvm14-14.0.6 | 21.3 MB | #####6 | 57% 2023-01-13T02:57:29.1445020Z libllvm14-14.0.6 | 21.3 MB | #######7 | 77% 2023-01-13T02:57:29.1449480Z libllvm14-14.0.6 | 21.3 MB | ########## | 100% 2023-01-13T02:57:29.1450350Z libllvm14-14.0.6 | 21.3 MB | ########## | 100% 2023-01-13T02:57:29.1451210Z 2023-01-13T02:57:29.3156890Z libiconv-1.16 | 695 KB | | 0% 2023-01-13T02:57:29.3161230Z libiconv-1.16 | 695 KB | ########## | 100% 2023-01-13T02:57:29.3166500Z libiconv-1.16 | 695 KB | ########## | 100% 2023-01-13T02:57:29.3166670Z 2023-01-13T02:57:29.4490800Z chardet-4.0.0 | 195 KB | | 0% 2023-01-13T02:57:29.4495110Z chardet-4.0.0 | 195 KB | ########## | 100% 2023-01-13T02:57:29.4500060Z chardet-4.0.0 | 195 KB | ########## | 100% 2023-01-13T02:57:29.4500300Z 2023-01-13T02:57:29.5564710Z pyyaml-6.0 | 172 KB | | 0% 2023-01-13T02:57:29.5568710Z pyyaml-6.0 | 172 KB | ########## | 100% 2023-01-13T02:57:29.5574780Z pyyaml-6.0 | 172 KB | ########## | 100% 2023-01-13T02:57:29.5575440Z 2023-01-13T02:57:29.6560710Z beautifulsoup4-4.11. | 189 KB | | 0% 2023-01-13T02:57:29.6565370Z beautifulsoup4-4.11. | 189 KB | ########## | 100% 2023-01-13T02:57:29.6565590Z 2023-01-13T02:57:29.7463230Z lz4-c-1.9.3 | 140 KB | | 0% 2023-01-13T02:57:29.7467490Z lz4-c-1.9.3 | 140 KB | ########## | 100% 2023-01-13T02:57:29.7467660Z 2023-01-13T02:57:30.0079100Z py-lief-0.11.5 | 996 KB | | 0% 2023-01-13T02:57:30.0084180Z py-lief-0.11.5 | 996 KB | ########## | 100% 2023-01-13T02:57:30.0088910Z py-lief-0.11.5 | 996 KB | ########## | 100% 2023-01-13T02:57:30.0089090Z 2023-01-13T02:57:30.1001690Z python-libarchive-c- | 47 KB | | 0% 2023-01-13T02:57:30.1008780Z python-libarchive-c- | 47 KB | ########## | 100% 2023-01-13T02:57:30.1008980Z 2023-01-13T02:57:30.2012400Z icu-58.2 | 10.1 MB | | 0% 2023-01-13T02:57:32.8156750Z icu-58.2 | 10.1 MB | #####6 | 56% 2023-01-13T02:57:32.8161080Z icu-58.2 | 10.1 MB | ########## | 100% 2023-01-13T02:57:32.8161450Z 2023-01-13T02:57:32.9245050Z liblief-0.11.5 | 1.6 MB | | 0% 2023-01-13T02:57:33.3971920Z liblief-0.11.5 | 1.6 MB | ######7 | 68% 2023-01-13T02:57:33.3976270Z liblief-0.11.5 | 1.6 MB | ########## | 100% 2023-01-13T02:57:33.3976450Z 2023-01-13T02:57:33.4778710Z cctools-949.0.1 | 18 KB | | 0% 2023-01-13T02:57:33.4782800Z cctools-949.0.1 | 18 KB | ########## | 100% 2023-01-13T02:57:33.4782980Z 2023-01-13T02:57:33.5564900Z bzip2-1.0.8 | 75 KB | | 0% 2023-01-13T02:57:33.5569030Z bzip2-1.0.8 | 75 KB | ########## | 100% 2023-01-13T02:57:33.5569200Z 2023-01-13T02:57:33.6293880Z patch-2.7.6 | 128 KB | | 0% 2023-01-13T02:57:33.6303830Z patch-2.7.6 | 128 KB | ########## | 100% 2023-01-13T02:57:33.8364380Z Preparing transaction: ...working... done 2023-01-13T02:57:36.4582860Z Verifying transaction: ...working... done 2023-01-13T02:57:41.8901540Z Executing transaction: ...working... done 2023-01-13T02:57:45.2470710Z Collecting torch==1.13.1 2023-01-13T02:57:45.2922200Z Downloading torch-1.13.1-cp38-none-macosx_10_9_x86_64.whl (135.4 MB) 2023-01-13T02:57:53.5991710Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 135.4/135.4 MB 2.7 MB/s eta 0:00:00 2023-01-13T02:57:54.4841640Z Collecting torchvision==0.14.1 2023-01-13T02:57:54.4974140Z Downloading torchvision-0.14.1-cp38-cp38-macosx_10_9_x86_64.whl (1.4 MB) 2023-01-13T02:57:54.5923270Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 1.4/1.4 MB 15.6 MB/s eta 0:00:00 2023-01-13T02:57:54.7240230Z Collecting torchtext==0.14.1 2023-01-13T02:57:54.7987880Z Downloading torchtext-0.14.1-cp38-cp38-macosx_10_9_x86_64.whl (1.8 MB) 2023-01-13T02:57:55.0244740Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 1.8/1.8 MB 8.3 MB/s eta 0:00:00 2023-01-13T02:57:55.1706030Z Collecting torchaudio==0.13.1 2023-01-13T02:57:55.1817960Z Downloading torchaudio-0.13.1-cp38-cp38-macosx_10_9_x86_64.whl (3.3 MB) 2023-01-13T02:57:55.3351130Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 3.3/3.3 MB 21.9 MB/s eta 0:00:00 2023-01-13T02:57:55.4346760Z Collecting typing-extensions 2023-01-13T02:57:55.4427510Z Downloading typing_extensions-4.4.0-py3-none-any.whl (26 kB) 2023-01-13T02:57:56.1059200Z Collecting pillow!=8.3.*,>=5.3.0 2023-01-13T02:57:56.1300140Z Downloading Pillow-9.4.0-1-cp38-cp38-macosx_10_10_x86_64.whl (3.3 MB) 2023-01-13T02:57:56.2842570Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 3.3/3.3 MB 21.1 MB/s eta 0:00:00 2023-01-13T02:57:56.4254670Z Collecting requests 2023-01-13T02:57:56.4327740Z Downloading requests-2.28.2-py3-none-any.whl (62 kB) 2023-01-13T02:57:56.4483480Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 62.8/62.8 kB 4.3 MB/s eta 0:00:00 2023-01-13T02:57:57.1581100Z Collecting numpy 2023-01-13T02:57:57.2058560Z Downloading numpy-1.24.1-cp38-cp38-macosx_10_9_x86_64.whl (19.8 MB) 2023-01-13T02:57:58.4093640Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 19.8/19.8 MB 11.9 MB/s eta 0:00:00 2023-01-13T02:57:58.7576020Z Collecting tqdm 2023-01-13T02:57:58.7663240Z Downloading tqdm-4.64.1-py2.py3-none-any.whl (78 kB) 2023-01-13T02:57:58.8122710Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 78.5/78.5 kB 1.6 MB/s eta 0:00:00 2023-01-13T02:57:58.9829850Z Collecting urllib3<1.27,>=1.21.1 2023-01-13T02:57:59.0102590Z Downloading urllib3-1.26.14-py2.py3-none-any.whl (140 kB) 2023-01-13T02:57:59.0371330Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 140.6/140.6 kB 5.6 MB/s eta 0:00:00 2023-01-13T02:57:59.2002700Z Collecting charset-normalizer<4,>=2 2023-01-13T02:57:59.2105080Z Downloading charset_normalizer-3.0.1-cp38-cp38-macosx_10_9_x86_64.whl (122 kB) 2023-01-13T02:57:59.2664600Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 122.9/122.9 kB 2.1 MB/s eta 0:00:00 2023-01-13T02:57:59.3366300Z Collecting certifi>=2017.4.17 2023-01-13T02:57:59.3442340Z Using cached certifi-2022.12.7-py3-none-any.whl (155 kB) 2023-01-13T02:57:59.4210750Z Collecting idna<4,>=2.5 2023-01-13T02:57:59.4288710Z Downloading idna-3.4-py3-none-any.whl (61 kB) 2023-01-13T02:57:59.4480960Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 61.5/61.5 kB 3.3 MB/s eta 0:00:00 2023-01-13T02:57:59.7350600Z Installing collected packages: charset-normalizer, urllib3, typing-extensions, tqdm, pillow, numpy, idna, certifi, torch, requests, torchvision, torchtext, torchaudio 2023-01-13T02:58:19.9522740Z Successfully installed certifi-2022.12.7 charset-normalizer-3.0.1 idna-3.4 numpy-1.24.1 pillow-9.4.0 requests-2.28.2 torch-1.13.1 torchaudio-0.13.1 torchtext-0.14.1 torchvision-0.14.1 tqdm-4.64.1 typing-extensions-4.4.0 urllib3-1.26.14 2023-01-13T02:58:21.2977130Z Requirement already satisfied: pip in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (22.3.1) 2023-01-13T02:58:21.4441640Z Requirement already satisfied: setuptools in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (56.0.0) 2023-01-13T02:58:21.9446640Z Collecting setuptools 2023-01-13T02:58:21.9867480Z Downloading setuptools-65.7.0-py3-none-any.whl (1.2 MB) 2023-01-13T02:58:22.0549950Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 1.2/1.2 MB 18.1 MB/s eta 0:00:00 2023-01-13T02:58:22.3006350Z Installing collected packages: setuptools 2023-01-13T02:58:22.3107730Z Attempting uninstall: setuptools 2023-01-13T02:58:22.3108170Z Found existing installation: setuptools 56.0.0 2023-01-13T02:58:22.4617640Z Uninstalling setuptools-56.0.0: 2023-01-13T02:58:22.6061500Z Successfully uninstalled setuptools-56.0.0 2023-01-13T02:58:23.4220560Z Successfully installed setuptools-65.7.0 2023-01-13T02:58:24.4834690Z Ignoring numpy: markers 'sys_platform == "win32"' don't match your environment 2023-01-13T02:58:24.4838790Z Ignoring nvgpu: markers 'sys_platform == "win32"' don't match your environment 2023-01-13T02:58:24.4845410Z Ignoring intel_extension_for_pytorch: markers 'sys_platform != "win32" and sys_platform != "darwin"' don't match your environment 2023-01-13T02:58:24.5623350Z Collecting future 2023-01-13T02:58:24.5985790Z Downloading future-0.18.2.tar.gz (829 kB) 2023-01-13T02:58:24.6496430Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 829.2/829.2 kB 18.5 MB/s eta 0:00:00 2023-01-13T02:58:24.9094040Z Preparing metadata (setup.py): started 2023-01-13T02:58:25.4451240Z Preparing metadata (setup.py): finished with status 'done' 2023-01-13T02:58:25.7401760Z Collecting psutil 2023-01-13T02:58:25.7602730Z Downloading psutil-5.9.4-cp36-abi3-macosx_10_9_x86_64.whl (243 kB) 2023-01-13T02:58:25.8073110Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 243.5/243.5 kB 5.3 MB/s eta 0:00:00 2023-01-13T02:58:26.5723520Z Collecting cython 2023-01-13T02:58:26.6573530Z Downloading Cython-0.29.33-py2.py3-none-any.whl (987 kB) 2023-01-13T02:58:26.9720190Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 987.3/987.3 kB 3.3 MB/s eta 0:00:00 2023-01-13T02:58:27.0414820Z Collecting wheel 2023-01-13T02:58:27.0471560Z Using cached wheel-0.38.4-py3-none-any.whl (36 kB) 2023-01-13T02:58:27.0506270Z Requirement already satisfied: requests in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from -r requirements/common.txt (line 5)) (2.28.2) 2023-01-13T02:58:27.6575600Z Collecting pillow==9.3.0 2023-01-13T02:58:27.6675890Z Downloading Pillow-9.3.0-cp38-cp38-macosx_10_10_x86_64.whl (3.3 MB) 2023-01-13T02:58:27.8877410Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 3.3/3.3 MB 15.0 MB/s eta 0:00:00 2023-01-13T02:58:28.0039830Z Collecting captum 2023-01-13T02:58:28.0720530Z Downloading captum-0.6.0-py3-none-any.whl (1.3 MB) 2023-01-13T02:58:28.1752920Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 1.3/1.3 MB 13.7 MB/s eta 0:00:00 2023-01-13T02:58:28.2678270Z Collecting packaging 2023-01-13T02:58:28.2775980Z Downloading packaging-23.0-py3-none-any.whl (42 kB) 2023-01-13T02:58:28.3028170Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 42.7/42.7 kB 1.3 MB/s eta 0:00:00 2023-01-13T02:58:28.3063260Z Requirement already satisfied: numpy in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from -r requirements/common.txt (line 9)) (1.24.1) 2023-01-13T02:58:28.9291610Z Collecting nvgpu 2023-01-13T02:58:28.9372100Z Downloading nvgpu-0.9.0-py2.py3-none-any.whl (9.4 kB) 2023-01-13T02:58:29.0591670Z Collecting pyyaml 2023-01-13T02:58:29.0825670Z Downloading PyYAML-6.0-cp38-cp38-macosx_10_9_x86_64.whl (192 kB) 2023-01-13T02:58:29.1014720Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 192.2/192.2 kB 11.9 MB/s eta 0:00:00 2023-01-13T02:58:29.1495540Z Collecting mock 2023-01-13T02:58:29.1619640Z Downloading mock-5.0.1-py3-none-any.whl (30 kB) 2023-01-13T02:58:29.3051510Z Collecting pytest 2023-01-13T02:58:29.3147270Z Downloading pytest-7.2.0-py3-none-any.whl (316 kB) 2023-01-13T02:58:29.3670280Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 316.8/316.8 kB 6.4 MB/s eta 0:00:00 2023-01-13T02:58:29.5270110Z Collecting pylint==2.6.0 2023-01-13T02:58:29.5378580Z Downloading pylint-2.6.0-py3-none-any.whl (325 kB) 2023-01-13T02:58:29.6040860Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 325.7/325.7 kB 5.8 MB/s eta 0:00:00 2023-01-13T02:58:29.6678590Z Collecting pytest-mock 2023-01-13T02:58:29.6778800Z Downloading pytest_mock-3.10.0-py3-none-any.whl (9.3 kB) 2023-01-13T02:58:29.7432600Z Collecting pytest-cov 2023-01-13T02:58:29.7528890Z Downloading pytest_cov-4.0.0-py3-none-any.whl (21 kB) 2023-01-13T02:58:32.3654340Z Collecting grpcio 2023-01-13T02:58:32.3860240Z Downloading grpcio-1.51.1-cp38-cp38-macosx_10_10_x86_64.whl (4.6 MB) 2023-01-13T02:58:32.6837030Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 4.6/4.6 MB 15.4 MB/s eta 0:00:00 2023-01-13T02:58:33.2801010Z Collecting protobuf 2023-01-13T02:58:33.2986790Z Downloading protobuf-4.21.12-cp37-abi3-macosx_10_9_universal2.whl (486 kB) 2023-01-13T02:58:33.3408180Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 486.2/486.2 kB 11.3 MB/s eta 0:00:00 2023-01-13T02:58:35.9279700Z Collecting grpcio-tools 2023-01-13T02:58:35.9649150Z Downloading grpcio_tools-1.51.1-cp38-cp38-macosx_10_10_x86_64.whl (2.0 MB) 2023-01-13T02:58:36.0957720Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 2.0/2.0 MB 16.2 MB/s eta 0:00:00 2023-01-13T02:58:36.2707840Z Collecting transformers==4.25.1 2023-01-13T02:58:36.2870570Z Downloading transformers-4.25.1-py3-none-any.whl (5.8 MB) 2023-01-13T02:58:36.5819970Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 5.8/5.8 MB 20.0 MB/s eta 0:00:00 2023-01-13T02:58:36.7706300Z Collecting pyspelling 2023-01-13T02:58:36.7789990Z Downloading pyspelling-2.8.1-py3-none-any.whl (45 kB) 2023-01-13T02:58:36.7928780Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 45.3/45.3 kB 3.3 MB/s eta 0:00:00 2023-01-13T02:58:37.0028450Z Collecting pygit2 2023-01-13T02:58:37.0333970Z Downloading pygit2-1.11.1-cp38-cp38-macosx_10_9_x86_64.whl (5.4 MB) 2023-01-13T02:58:37.3611530Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 5.4/5.4 MB 16.2 MB/s eta 0:00:00 2023-01-13T02:58:37.6051870Z Collecting pre-commit 2023-01-13T02:58:37.6194170Z Downloading pre_commit-2.21.0-py2.py3-none-any.whl (201 kB) 2023-01-13T02:58:37.6416360Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 201.9/201.9 kB 10.3 MB/s eta 0:00:00 2023-01-13T02:58:37.6993620Z Collecting twine 2023-01-13T02:58:37.7076840Z Downloading twine-4.0.2-py3-none-any.whl (36 kB) 2023-01-13T02:58:37.9525840Z Collecting mypy 2023-01-13T02:58:37.9737980Z Downloading mypy-0.991-cp38-cp38-macosx_10_9_x86_64.whl (11.1 MB) 2023-01-13T02:58:38.5897590Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 11.1/11.1 MB 17.0 MB/s eta 0:00:00 2023-01-13T02:58:38.8353860Z Collecting mccabe<0.7,>=0.6 2023-01-13T02:58:38.8438090Z Downloading mccabe-0.6.1-py2.py3-none-any.whl (8.6 kB) 2023-01-13T02:58:38.9814150Z Collecting isort<6,>=4.2.5 2023-01-13T02:58:38.9899760Z Downloading isort-5.11.4-py3-none-any.whl (104 kB) 2023-01-13T02:58:39.0109230Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 104.1/104.1 kB 5.5 MB/s eta 0:00:00 2023-01-13T02:58:39.1425050Z Collecting astroid<=2.5,>=2.4.0 2023-01-13T02:58:39.1526170Z Downloading astroid-2.5-py3-none-any.whl (220 kB) 2023-01-13T02:58:39.1757060Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 220.3/220.3 kB 10.9 MB/s eta 0:00:00 2023-01-13T02:58:39.2157170Z Collecting toml>=0.7.1 2023-01-13T02:58:39.2461830Z Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2023-01-13T02:58:41.5194650Z Collecting regex!=2019.12.17 2023-01-13T02:58:41.5659940Z Downloading regex-2022.10.31-cp38-cp38-macosx_10_9_x86_64.whl (294 kB) 2023-01-13T02:58:41.6304160Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 294.0/294.0 kB 5.3 MB/s eta 0:00:00 2023-01-13T02:58:42.0785790Z Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 2023-01-13T02:58:42.0909160Z Downloading tokenizers-0.13.2-cp38-cp38-macosx_10_11_x86_64.whl (3.8 MB) 2023-01-13T02:58:42.3740360Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 3.8/3.8 MB 13.6 MB/s eta 0:00:00 2023-01-13T02:58:42.4479410Z Requirement already satisfied: tqdm>=4.27 in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from transformers==4.25.1->-r requirements/developer.txt (line 10)) (4.64.1) 2023-01-13T02:58:42.5217670Z Collecting huggingface-hub<1.0,>=0.10.0 2023-01-13T02:58:42.5314820Z Downloading huggingface_hub-0.11.1-py3-none-any.whl (182 kB) 2023-01-13T02:58:42.5494020Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 182.4/182.4 kB 12.2 MB/s eta 0:00:00 2023-01-13T02:58:42.6105010Z Collecting filelock 2023-01-13T02:58:42.6185260Z Downloading filelock-3.9.0-py3-none-any.whl (9.7 kB) 2023-01-13T02:58:42.6702550Z Requirement already satisfied: idna<4,>=2.5 in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from requests->-r requirements/common.txt (line 5)) (3.4) 2023-01-13T02:58:42.6711480Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from requests->-r requirements/common.txt (line 5)) (1.26.14) 2023-01-13T02:58:42.6721680Z Requirement already satisfied: charset-normalizer<4,>=2 in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from requests->-r requirements/common.txt (line 5)) (3.0.1) 2023-01-13T02:58:42.6730340Z Requirement already satisfied: certifi>=2017.4.17 in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from requests->-r requirements/common.txt (line 5)) (2022.12.7) 2023-01-13T02:58:43.1272570Z Collecting matplotlib 2023-01-13T02:58:43.1697470Z Downloading matplotlib-3.6.3-cp38-cp38-macosx_10_12_x86_64.whl (7.3 MB) 2023-01-13T02:58:43.6663740Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 7.3/7.3 MB 14.9 MB/s eta 0:00:00 2023-01-13T02:58:43.8860280Z Requirement already satisfied: torch>=1.6 in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from captum->-r requirements/common.txt (line 7)) (1.13.1) 2023-01-13T02:58:43.9477330Z Collecting termcolor 2023-01-13T02:58:43.9610930Z Downloading termcolor-2.2.0-py3-none-any.whl (6.6 kB) 2023-01-13T02:58:44.0113930Z Collecting tabulate 2023-01-13T02:58:44.0200270Z Downloading tabulate-0.9.0-py3-none-any.whl (35 kB) 2023-01-13T02:58:44.0885970Z Collecting flask 2023-01-13T02:58:44.0972790Z Downloading Flask-2.2.2-py3-none-any.whl (101 kB) 2023-01-13T02:58:44.1157490Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 101.5/101.5 kB 6.1 MB/s eta 0:00:00 2023-01-13T02:58:44.5006630Z Collecting pandas 2023-01-13T02:58:44.5156030Z Downloading pandas-1.5.2-cp38-cp38-macosx_10_9_x86_64.whl (11.9 MB) 2023-01-13T02:58:45.3893690Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 11.9/11.9 MB 12.2 MB/s eta 0:00:00 2023-01-13T02:58:45.6246630Z Collecting six 2023-01-13T02:58:45.6319010Z Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-01-13T02:58:45.6874690Z Collecting pynvml 2023-01-13T02:58:45.6954480Z Downloading pynvml-11.4.1-py3-none-any.whl (46 kB) 2023-01-13T02:58:45.7102680Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 47.0/47.0 kB 3.2 MB/s eta 0:00:00 2023-01-13T02:58:45.7738900Z Collecting arrow 2023-01-13T02:58:45.7823180Z Downloading arrow-1.2.3-py3-none-any.whl (66 kB) 2023-01-13T02:58:45.8040950Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 66.4/66.4 kB 3.1 MB/s eta 0:00:00 2023-01-13T02:58:45.8473100Z Collecting flask-restful 2023-01-13T02:58:45.8550450Z Downloading Flask_RESTful-0.3.9-py2.py3-none-any.whl (25 kB) 2023-01-13T02:58:45.9229670Z Collecting ansi2html 2023-01-13T02:58:45.9322050Z Downloading ansi2html-1.8.0-py3-none-any.whl (16 kB) 2023-01-13T02:58:46.0296590Z Collecting attrs>=19.2.0 2023-01-13T02:58:46.0396000Z Downloading attrs-22.2.0-py3-none-any.whl (60 kB) 2023-01-13T02:58:46.0514350Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 60.0/60.0 kB 5.8 MB/s eta 0:00:00 2023-01-13T02:58:46.0757380Z Collecting iniconfig 2023-01-13T02:58:46.0839880Z Downloading iniconfig-2.0.0-py3-none-any.whl (5.9 kB) 2023-01-13T02:58:46.1378450Z Collecting tomli>=1.0.0 2023-01-13T02:58:46.1457880Z Downloading tomli-2.0.1-py3-none-any.whl (12 kB) 2023-01-13T02:58:46.2067710Z Collecting pluggy<2.0,>=0.12 2023-01-13T02:58:46.2135560Z Downloading pluggy-1.0.0-py2.py3-none-any.whl (13 kB) 2023-01-13T02:58:46.2745580Z Collecting exceptiongroup>=1.0.0rc8 2023-01-13T02:58:46.2824120Z Downloading exceptiongroup-1.1.0-py3-none-any.whl (14 kB) 2023-01-13T02:58:47.2970530Z Collecting coverage[toml]>=5.2.1 2023-01-13T02:58:47.3123170Z Downloading coverage-7.0.5-cp38-cp38-macosx_10_9_x86_64.whl (197 kB) 2023-01-13T02:58:47.3594310Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 197.9/197.9 kB 4.4 MB/s eta 0:00:00 2023-01-13T02:58:47.4232200Z Requirement already satisfied: setuptools in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from grpcio-tools->-r requirements/developer.txt (line 9)) (65.7.0) 2023-01-13T02:58:47.9598210Z Collecting lxml 2023-01-13T02:58:47.9940700Z Downloading lxml-4.9.2-cp38-cp38-macosx_10_15_x86_64.whl (4.7 MB) 2023-01-13T02:58:48.5849800Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 4.7/4.7 MB 8.1 MB/s eta 0:00:00 2023-01-13T02:58:48.8358810Z Collecting markdown 2023-01-13T02:58:48.8639740Z Downloading Markdown-3.4.1-py3-none-any.whl (93 kB) 2023-01-13T02:58:48.8825550Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 93.3/93.3 kB 5.5 MB/s eta 0:00:00 2023-01-13T02:58:48.9622820Z Collecting wcmatch>=6.0.3 2023-01-13T02:58:48.9717550Z Downloading wcmatch-8.4.1-py3-none-any.whl (39 kB) 2023-01-13T02:58:49.0365460Z Collecting beautifulsoup4 2023-01-13T02:58:49.0493160Z Downloading beautifulsoup4-4.11.1-py3-none-any.whl (128 kB) 2023-01-13T02:58:49.0642880Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 128.2/128.2 kB 10.4 MB/s eta 0:00:00 2023-01-13T02:58:49.0958380Z Collecting html5lib 2023-01-13T02:58:49.1043570Z Downloading html5lib-1.1-py2.py3-none-any.whl (112 kB) 2023-01-13T02:58:49.1274350Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 112.2/112.2 kB 5.3 MB/s eta 0:00:00 2023-01-13T02:58:49.1793560Z Collecting soupsieve>=1.8 2023-01-13T02:58:49.2286820Z Downloading soupsieve-2.3.2.post1-py3-none-any.whl (37 kB) 2023-01-13T02:58:49.6855660Z Collecting cffi>=1.9.1 2023-01-13T02:58:49.6957620Z Downloading cffi-1.15.1-cp38-cp38-macosx_10_9_x86_64.whl (178 kB) 2023-01-13T02:58:49.7260570Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 178.9/178.9 kB 5.2 MB/s eta 0:00:00 2023-01-13T02:58:49.9061440Z Collecting identify>=1.0.0 2023-01-13T02:58:49.9142300Z Downloading identify-2.5.13-py2.py3-none-any.whl (98 kB) 2023-01-13T02:58:49.9350380Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 98.7/98.7 kB 5.1 MB/s eta 0:00:00 2023-01-13T02:58:49.9740870Z Collecting nodeenv>=0.11.1 2023-01-13T02:58:49.9824170Z Downloading nodeenv-1.7.0-py2.py3-none-any.whl (21 kB) 2023-01-13T02:58:50.1674330Z Collecting virtualenv>=20.10.0 2023-01-13T02:58:50.1775870Z Downloading virtualenv-20.17.1-py3-none-any.whl (8.8 MB) 2023-01-13T02:58:50.7016440Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 8.8/8.8 MB 16.9 MB/s eta 0:00:00 2023-01-13T02:58:50.9205500Z Collecting cfgv>=2.0.0 2023-01-13T02:58:50.9282680Z Downloading cfgv-3.3.1-py2.py3-none-any.whl (7.3 kB) 2023-01-13T02:58:50.9973200Z Collecting rfc3986>=1.4.0 2023-01-13T02:58:51.0057250Z Downloading rfc3986-2.0.0-py2.py3-none-any.whl (31 kB) 2023-01-13T02:58:51.1352030Z Collecting importlib-metadata>=3.6 2023-01-13T02:58:51.1430650Z Downloading importlib_metadata-6.0.0-py3-none-any.whl (21 kB) 2023-01-13T02:58:51.2252220Z Collecting readme-renderer>=35.0 2023-01-13T02:58:51.2327860Z Downloading readme_renderer-37.3-py3-none-any.whl (14 kB) 2023-01-13T02:58:51.2929910Z Collecting requests-toolbelt!=0.9.0,>=0.8.0 2023-01-13T02:58:51.2998180Z Downloading requests_toolbelt-0.10.1-py2.py3-none-any.whl (54 kB) 2023-01-13T02:58:51.3135910Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 54.5/54.5 kB 4.2 MB/s eta 0:00:00 2023-01-13T02:58:51.4396680Z Collecting keyring>=15.1 2023-01-13T02:58:51.4485510Z Downloading keyring-23.13.1-py3-none-any.whl (37 kB) 2023-01-13T02:58:51.5188730Z Collecting pkginfo>=1.8.1 2023-01-13T02:58:51.5290910Z Downloading pkginfo-1.9.6-py3-none-any.whl (30 kB) 2023-01-13T02:58:51.7140070Z Collecting rich>=12.0.0 2023-01-13T02:58:51.7342180Z Downloading rich-13.0.1-py3-none-any.whl (238 kB) 2023-01-13T02:58:51.7887650Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 238.1/238.1 kB 3.9 MB/s eta 0:00:00 2023-01-13T02:58:51.8405370Z Collecting mypy-extensions>=0.4.3 2023-01-13T02:58:51.8513800Z Downloading mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB) 2023-01-13T02:58:51.8743740Z Requirement already satisfied: typing-extensions>=3.10 in /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages (from mypy->-r requirements/developer.txt (line 16)) (4.4.0) 2023-01-13T02:58:52.1223550Z Collecting wrapt<1.13,>=1.11 2023-01-13T02:58:52.1324300Z Downloading wrapt-1.12.1.tar.gz (27 kB) 2023-01-13T02:58:52.1843150Z Preparing metadata (setup.py): started 2023-01-13T02:58:52.5635640Z Preparing metadata (setup.py): finished with status 'done' 2023-01-13T02:58:52.9834730Z Collecting lazy-object-proxy>=1.4.0 2023-01-13T02:58:52.9935230Z Downloading lazy_object_proxy-1.9.0-cp38-cp38-macosx_10_9_x86_64.whl (22 kB) 2023-01-13T02:58:53.2322770Z Collecting pycparser 2023-01-13T02:58:53.2401160Z Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB) 2023-01-13T02:58:53.2625720Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 118.7/118.7 kB 6.0 MB/s eta 0:00:00 2023-01-13T02:58:53.5421050Z Collecting zipp>=0.5 2023-01-13T02:58:53.5496900Z Downloading zipp-3.11.0-py3-none-any.whl (6.6 kB) 2023-01-13T02:58:53.6482940Z Collecting jaraco.classes 2023-01-13T02:58:53.6560950Z Downloading jaraco.classes-3.2.3-py3-none-any.whl (6.0 kB) 2023-01-13T02:58:53.7651010Z Collecting importlib-resources 2023-01-13T02:58:53.7738400Z Downloading importlib_resources-5.10.2-py3-none-any.whl (34 kB) 2023-01-13T02:58:54.1657630Z Collecting docutils>=0.13.1 2023-01-13T02:58:54.2060110Z Downloading docutils-0.19-py3-none-any.whl (570 kB) 2023-01-13T02:58:54.2493870Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 570.5/570.5 kB 12.0 MB/s eta 0:00:00 2023-01-13T02:58:54.3324910Z Collecting Pygments>=2.5.1 2023-01-13T02:58:54.3491520Z Downloading Pygments-2.14.0-py3-none-any.whl (1.1 MB) 2023-01-13T02:58:54.4032050Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 1.1/1.1 MB 22.3 MB/s eta 0:00:00 2023-01-13T02:58:54.4953600Z Collecting bleach>=2.1.0 2023-01-13T02:58:54.5042580Z Downloading bleach-5.0.1-py3-none-any.whl (160 kB) 2023-01-13T02:58:54.5308820Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 160.9/160.9 kB 6.5 MB/s eta 0:00:00 2023-01-13T02:58:54.6658480Z Collecting commonmark<0.10.0,>=0.9.0 2023-01-13T02:58:54.6766010Z Downloading commonmark-0.9.1-py2.py3-none-any.whl (51 kB) 2023-01-13T02:58:54.7843380Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 51.1/51.1 kB 393.4 kB/s eta 0:00:00 2023-01-13T02:58:55.1096560Z Collecting platformdirs<3,>=2.4 2023-01-13T02:58:55.1172510Z Downloading platformdirs-2.6.2-py3-none-any.whl (14 kB) 2023-01-13T02:58:55.2041910Z Collecting distlib<1,>=0.3.6 2023-01-13T02:58:55.2113170Z Downloading distlib-0.3.6-py2.py3-none-any.whl (468 kB) 2023-01-13T02:58:55.2375640Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 468.5/468.5 kB 20.5 MB/s eta 0:00:00 2023-01-13T02:58:55.3277440Z Collecting bracex>=2.1.1 2023-01-13T02:58:55.3361760Z Downloading bracex-2.3.post1-py3-none-any.whl (12 kB) 2023-01-13T02:58:55.4248390Z Collecting python-dateutil>=2.7.0 2023-01-13T02:58:55.4401690Z Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-01-13T02:58:55.4558470Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 247.7/247.7 kB 19.7 MB/s eta 0:00:00 2023-01-13T02:58:55.5590010Z Collecting click>=8.0 2023-01-13T02:58:55.5686520Z Downloading click-8.1.3-py3-none-any.whl (96 kB) 2023-01-13T02:58:55.5927830Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 96.6/96.6 kB 4.2 MB/s eta 0:00:00 2023-01-13T02:58:55.6271500Z Collecting itsdangerous>=2.0 2023-01-13T02:58:55.6372330Z Downloading itsdangerous-2.1.2-py3-none-any.whl (15 kB) 2023-01-13T02:58:55.7000070Z Collecting Jinja2>=3.0 2023-01-13T02:58:55.7082840Z Downloading Jinja2-3.1.2-py3-none-any.whl (133 kB) 2023-01-13T02:58:55.7293450Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 133.1/133.1 kB 7.0 MB/s eta 0:00:00 2023-01-13T02:58:55.7984860Z Collecting Werkzeug>=2.2.2 2023-01-13T02:58:55.8063470Z Downloading Werkzeug-2.2.2-py3-none-any.whl (232 kB) 2023-01-13T02:58:55.8392670Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 232.7/232.7 kB 7.7 MB/s eta 0:00:00 2023-01-13T02:58:56.0178600Z Collecting pytz 2023-01-13T02:58:56.0273890Z Downloading pytz-2022.7-py2.py3-none-any.whl (499 kB) 2023-01-13T02:58:56.0545890Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 499.4/499.4 kB 21.9 MB/s eta 0:00:00 2023-01-13T02:58:56.1099210Z Collecting aniso8601>=0.82 2023-01-13T02:58:56.1180470Z Downloading aniso8601-9.0.1-py2.py3-none-any.whl (52 kB) 2023-01-13T02:58:56.1360970Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 52.8/52.8 kB 2.9 MB/s eta 0:00:00 2023-01-13T02:58:56.2043590Z Collecting webencodings 2023-01-13T02:58:56.2125490Z Downloading webencodings-0.5.1-py2.py3-none-any.whl (11 kB) 2023-01-13T02:58:56.4790400Z Collecting kiwisolver>=1.0.1 2023-01-13T02:58:56.4992370Z Downloading kiwisolver-1.4.4-cp38-cp38-macosx_10_9_x86_64.whl (65 kB) 2023-01-13T02:58:56.6052000Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 65.4/65.4 kB 499.8 kB/s eta 0:00:00 2023-01-13T02:58:56.8384100Z Collecting contourpy>=1.0.1 2023-01-13T02:58:56.8503580Z Downloading contourpy-1.0.6-cp38-cp38-macosx_10_9_x86_64.whl (240 kB) 2023-01-13T02:58:56.9426490Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 240.6/240.6 kB 2.6 MB/s eta 0:00:00 2023-01-13T02:58:57.1201150Z Collecting fonttools>=4.22.0 2023-01-13T02:58:57.1403900Z Downloading fonttools-4.38.0-py3-none-any.whl (965 kB) 2023-01-13T02:58:57.1857960Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 965.4/965.4 kB 18.6 MB/s eta 0:00:00 2023-01-13T02:58:57.2487060Z Collecting cycler>=0.10 2023-01-13T02:58:57.2572640Z Downloading cycler-0.11.0-py3-none-any.whl (6.4 kB) 2023-01-13T02:58:57.3576350Z Collecting pyparsing>=2.2.1 2023-01-13T02:58:57.3650790Z Downloading pyparsing-3.0.9-py3-none-any.whl (98 kB) 2023-01-13T02:58:57.3844200Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 98.3/98.3 kB 5.5 MB/s eta 0:00:00 2023-01-13T02:58:57.9553060Z Collecting MarkupSafe>=2.0 2023-01-13T02:58:57.9635010Z Downloading MarkupSafe-2.1.1-cp38-cp38-macosx_10_9_x86_64.whl (13 kB) 2023-01-13T02:58:58.4774160Z Collecting more-itertools 2023-01-13T02:58:58.4865520Z Downloading more_itertools-9.0.0-py3-none-any.whl (52 kB) 2023-01-13T02:58:58.5109290Z โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” 52.8/52.8 kB 2.0 MB/s eta 0:00:00 2023-01-13T02:59:00.3944440Z Installing collected packages: wrapt, webencodings, tokenizers, pytz, mypy-extensions, mccabe, distlib, commonmark, aniso8601, zipp, wheel, tomli, toml, termcolor, tabulate, soupsieve, six, rfc3986, regex, pyyaml, pyparsing, pynvml, Pygments, pycparser, psutil, protobuf, pluggy, platformdirs, pkginfo, pillow, packaging, nodeenv, more-itertools, mock, MarkupSafe, lxml, lazy-object-proxy, kiwisolver, itsdangerous, isort, iniconfig, identify, grpcio, future, fonttools, filelock, exceptiongroup, docutils, cython, cycler, coverage, contourpy, click, cfgv, bracex, attrs, ansi2html, Werkzeug, wcmatch, virtualenv, rich, requests-toolbelt, python-dateutil, pytest, mypy, Jinja2, jaraco.classes, importlib-resources, importlib-metadata, huggingface-hub, html5lib, grpcio-tools, cffi, bleach, beautifulsoup4, astroid, transformers, readme-renderer, pytest-mock, pytest-cov, pylint, pygit2, pre-commit, pandas, matplotlib, markdown, keyring, flask, arrow, twine, pyspelling, flask-restful, captum, nvgpu 2023-01-13T02:59:00.3960750Z DEPRECATION: wrapt is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559 2023-01-13T02:59:00.3969700Z Running setup.py install for wrapt: started 2023-01-13T02:59:09.7385760Z Running setup.py install for wrapt: finished with status 'done' 2023-01-13T02:59:51.5274330Z Attempting uninstall: pillow 2023-01-13T02:59:51.5287080Z Found existing installation: Pillow 9.4.0 2023-01-13T02:59:51.6104320Z Uninstalling Pillow-9.4.0: 2023-01-13T02:59:51.6137020Z Successfully uninstalled Pillow-9.4.0 2023-01-13T02:59:57.2675900Z DEPRECATION: future is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559 2023-01-13T02:59:57.2682840Z Running setup.py install for future: started 2023-01-13T03:00:07.4672360Z Running setup.py install for future: finished with status 'done' 2023-01-13T03:02:18.8038160Z Successfully installed Jinja2-3.1.2 MarkupSafe-2.1.1 Pygments-2.14.0 Werkzeug-2.2.2 aniso8601-9.0.1 ansi2html-1.8.0 arrow-1.2.3 astroid-2.5 attrs-22.2.0 beautifulsoup4-4.11.1 bleach-5.0.1 bracex-2.3.post1 captum-0.6.0 cffi-1.15.1 cfgv-3.3.1 click-8.1.3 commonmark-0.9.1 contourpy-1.0.6 coverage-7.0.5 cycler-0.11.0 cython-0.29.33 distlib-0.3.6 docutils-0.19 exceptiongroup-1.1.0 filelock-3.9.0 flask-2.2.2 flask-restful-0.3.9 fonttools-4.38.0 future-0.18.2 grpcio-1.51.1 grpcio-tools-1.51.1 html5lib-1.1 huggingface-hub-0.11.1 identify-2.5.13 importlib-metadata-6.0.0 importlib-resources-5.10.2 iniconfig-2.0.0 isort-5.11.4 itsdangerous-2.1.2 jaraco.classes-3.2.3 keyring-23.13.1 kiwisolver-1.4.4 lazy-object-proxy-1.9.0 lxml-4.9.2 markdown-3.4.1 matplotlib-3.6.3 mccabe-0.6.1 mock-5.0.1 more-itertools-9.0.0 mypy-0.991 mypy-extensions-0.4.3 nodeenv-1.7.0 nvgpu-0.9.0 packaging-23.0 pandas-1.5.2 pillow-9.3.0 pkginfo-1.9.6 platformdirs-2.6.2 pluggy-1.0.0 pre-commit-2.21.0 protobuf-4.21.12 psutil-5.9.4 pycparser-2.21 pygit2-1.11.1 pylint-2.6.0 pynvml-11.4.1 pyparsing-3.0.9 pyspelling-2.8.1 pytest-7.2.0 pytest-cov-4.0.0 pytest-mock-3.10.0 python-dateutil-2.8.2 pytz-2022.7 pyyaml-6.0 readme-renderer-37.3 regex-2022.10.31 requests-toolbelt-0.10.1 rfc3986-2.0.0 rich-13.0.1 six-1.16.0 soupsieve-2.3.2.post1 tabulate-0.9.0 termcolor-2.2.0 tokenizers-0.13.2 toml-0.10.2 tomli-2.0.1 transformers-4.25.1 twine-4.0.2 virtualenv-20.17.1 wcmatch-8.4.1 webencodings-0.5.1 wheel-0.38.4 wrapt-1.12.1 zipp-3.11.0 2023-01-13T03:02:20.3302700Z ##[group]Run python test/regression_tests.py 2023-01-13T03:02:20.3303070Z python test/regression_tests.py 2023-01-13T03:02:20.3467390Z shell: /bin/bash -e {0} 2023-01-13T03:02:20.3467930Z env: 2023-01-13T03:02:20.3468250Z pythonLocation: /Users/runner/hostedtoolcache/Python/3.8.15/x64 2023-01-13T03:02:20.3468580Z JAVA_HOME: /Users/runner/hostedtoolcache/Java_Zulu_jdk/17.0.5-8/x64 2023-01-13T03:02:20.3468890Z JAVA_HOME_17_X64: /Users/runner/hostedtoolcache/Java_Zulu_jdk/17.0.5-8/x64 2023-01-13T03:02:20.3469140Z ##[endgroup] 2023-01-13T03:02:47.2427020Z Processing /Users/runner/work/serve/serve 2023-01-13T03:02:47.2556470Z Preparing metadata (setup.py): started 2023-01-13T03:02:47.8528070Z Preparing metadata (setup.py): finished with status 'done' 2023-01-13T03:02:48.4442680Z Collecting Pillow 2023-01-13T03:02:48.4744170Z Using cached Pillow-9.4.0-1-cp38-cp38-macosx_10_10_x86_64.whl (3.3 MB) 2023-01-13T03:02:48.8056060Z Collecting psutil 2023-01-13T03:02:48.8158380Z Using cached psutil-5.9.4-cp36-abi3-macosx_10_9_x86_64.whl (243 kB) 2023-01-13T03:02:48.8460670Z Collecting future 2023-01-13T03:02:48.8564360Z Using cached future-0.18.2.tar.gz (829 kB) 2023-01-13T03:02:49.1111160Z Preparing metadata (setup.py): started 2023-01-13T03:02:49.8062870Z Preparing metadata (setup.py): finished with status 'done' 2023-01-13T03:02:49.8565200Z Collecting packaging 2023-01-13T03:02:49.8610870Z Using cached packaging-23.0-py3-none-any.whl (42 kB) 2023-01-13T03:02:49.9196860Z Collecting wheel 2023-01-13T03:02:49.9240330Z Using cached wheel-0.38.4-py3-none-any.whl (36 kB) 2023-01-13T03:02:49.9680240Z Building wheels for collected packages: torchserve, future 2023-01-13T03:02:49.9711920Z Building wheel for torchserve (setup.py): started 2023-01-13T03:03:53.8071570Z Building wheel for torchserve (setup.py): still running... 2023-01-13T03:03:57.7233640Z Building wheel for torchserve (setup.py): finished with status 'done' 2023-01-13T03:03:57.7961300Z Created wheel for torchserve: filename=torchserve-0.7.0b20230113-py3-none-any.whl size=22673092 sha256=49cee1a0d1395906c228009672014b62beb67e2794a2353e198abd9170d0761a 2023-01-13T03:03:57.8065380Z Stored in directory: /private/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/pip-ephem-wheel-cache-g1u_wncq/wheels/7f/c1/8a/9f4f6d8396b2839068087916e751e57bcbb0d9fcc69b75e0c6 2023-01-13T03:03:57.8167340Z Building wheel for future (setup.py): started 2023-01-13T03:03:59.3089860Z Building wheel for future (setup.py): finished with status 'done' 2023-01-13T03:03:59.3120930Z Created wheel for future: filename=future-0.18.2-py3-none-any.whl size=491059 sha256=9f37012048df67ddd88e95eb66543aae013ce015f5a3d934643a7d41c7dab59a 2023-01-13T03:03:59.3122880Z Stored in directory: /Users/runner/Library/Caches/pip/wheels/01/49/0c/4e0a697824c7bd6516afb22e1af9d51427ccd36c74b05a297e 2023-01-13T03:03:59.3197780Z Successfully built torchserve future 2023-01-13T03:04:00.9880420Z Installing collected packages: wheel, psutil, Pillow, packaging, future, torchserve 2023-01-13T03:04:00.9981920Z Attempting uninstall: wheel 2023-01-13T03:04:01.0083330Z Found existing installation: wheel 0.38.4 2023-01-13T03:04:01.0184330Z Uninstalling wheel-0.38.4: 2023-01-13T03:04:01.0258910Z Successfully uninstalled wheel-0.38.4 2023-01-13T03:04:01.0752160Z Attempting uninstall: psutil 2023-01-13T03:04:01.0776900Z Found existing installation: psutil 5.9.4 2023-01-13T03:04:01.1041560Z Uninstalling psutil-5.9.4: 2023-01-13T03:04:01.1064330Z Successfully uninstalled psutil-5.9.4 2023-01-13T03:04:01.4453290Z Attempting uninstall: Pillow 2023-01-13T03:04:01.4466560Z Found existing installation: Pillow 9.3.0 2023-01-13T03:04:01.5265250Z Uninstalling Pillow-9.3.0: 2023-01-13T03:04:01.5298310Z Successfully uninstalled Pillow-9.3.0 2023-01-13T03:04:02.1141730Z Attempting uninstall: packaging 2023-01-13T03:04:02.1153550Z Found existing installation: packaging 23.0 2023-01-13T03:04:02.1300260Z Uninstalling packaging-23.0: 2023-01-13T03:04:02.1317860Z Successfully uninstalled packaging-23.0 2023-01-13T03:04:02.1819690Z Attempting uninstall: future 2023-01-13T03:04:02.1833220Z Found existing installation: future 0.18.2 2023-01-13T03:04:02.3047980Z Uninstalling future-0.18.2: 2023-01-13T03:04:02.6757880Z Successfully uninstalled future-0.18.2 2023-01-13T03:04:03.9674420Z Successfully installed Pillow-9.4.0 future-0.18.2 packaging-23.0 psutil-5.9.4 torchserve-0.7.0b20230113 wheel-0.38.4 2023-01-13T03:04:05.5327660Z Processing ./model-archiver 2023-01-13T03:04:05.5403690Z Preparing metadata (setup.py): started 2023-01-13T03:04:06.1045960Z Preparing metadata (setup.py): finished with status 'done' 2023-01-13T03:04:06.1723580Z Collecting future 2023-01-13T03:04:06.1725190Z Using cached future-0.18.2-py3-none-any.whl 2023-01-13T03:04:06.2811280Z Collecting enum-compat 2023-01-13T03:04:06.3142480Z Downloading enum_compat-0.0.3-py3-none-any.whl (1.3 kB) 2023-01-13T03:04:06.3301830Z Building wheels for collected packages: torch-model-archiver 2023-01-13T03:04:06.3311230Z Building wheel for torch-model-archiver (setup.py): started 2023-01-13T03:04:07.2453500Z Building wheel for torch-model-archiver (setup.py): finished with status 'done' 2023-01-13T03:04:07.2466270Z Created wheel for torch-model-archiver: filename=torch_model_archiver-0.7.0b20230113-py3-none-any.whl size=14591 sha256=145a3bf04796ddabec9d59b179f49a81d7fcf7acc51b4e40062d6d07b84c8d37 2023-01-13T03:04:07.2469020Z Stored in directory: /Users/runner/Library/Caches/pip/wheels/fc/ad/e8/f3100f3ba2e5be18747e48cf5557c7ef7be2a3c22f185e6b08 2023-01-13T03:04:07.2515680Z Successfully built torch-model-archiver 2023-01-13T03:04:09.6791930Z Installing collected packages: enum-compat, future, torch-model-archiver 2023-01-13T03:04:09.6951000Z Attempting uninstall: future 2023-01-13T03:04:09.6963820Z Found existing installation: future 0.18.2 2023-01-13T03:04:09.9724370Z Uninstalling future-0.18.2: 2023-01-13T03:04:09.9826200Z Successfully uninstalled future-0.18.2 2023-01-13T03:04:10.7340710Z Successfully installed enum-compat-0.0.3 future-0.18.2 torch-model-archiver-0.7.0b20230113 2023-01-13T03:04:12.0514790Z Processing ./workflow-archiver 2023-01-13T03:04:12.0616430Z Preparing metadata (setup.py): started 2023-01-13T03:04:12.7107470Z Preparing metadata (setup.py): finished with status 'done' 2023-01-13T03:04:12.7188250Z Building wheels for collected packages: torch-workflow-archiver 2023-01-13T03:04:12.7200770Z Building wheel for torch-workflow-archiver (setup.py): started 2023-01-13T03:04:13.8946740Z Building wheel for torch-workflow-archiver (setup.py): finished with status 'done' 2023-01-13T03:04:13.8956600Z Created wheel for torch-workflow-archiver: filename=torch_workflow_archiver-0.2.6b20230113-py3-none-any.whl size=12701 sha256=dd43c3bdb57368cb3cda54cadc64b0e8a85d186bda6dc8c40c64b9f0ba1536d5 2023-01-13T03:04:13.8959440Z Stored in directory: /Users/runner/Library/Caches/pip/wheels/2b/f6/68/a6789e5ff71ac0d2055e4dc9f66eea70b9c2e25d51abbf84f0 2023-01-13T03:04:13.9013190Z Successfully built torch-workflow-archiver 2023-01-13T03:04:16.6773350Z Installing collected packages: torch-workflow-archiver 2023-01-13T03:04:16.8601950Z Successfully installed torch-workflow-archiver-0.2.6b20230113 2023-01-13T03:07:42.3145590Z newman: could not find "htmlextra" reporter 2023-01-13T03:07:42.3151020Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:07:42.3151510Z please install reporter using npm 2023-01-13T03:07:42.3151980Z 2023-01-13T03:07:42.6012020Z newman 2023-01-13T03:07:42.6113240Z 2023-01-13T03:07:42.6214620Z management_api_collection 2023-01-13T03:07:42.6321390Z 2023-01-13T03:07:42.6422610Z Iteration 1/82 2023-01-13T03:07:42.6523650Z 2023-01-13T03:07:42.6625390Z โ†’ management request 2023-01-13T03:07:43.6839050Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:07:43.6941900Z 200 OK โ˜… 952ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:43.7042550Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:07:43.7144550Z โ”‚ { 2023-01-13T03:07:43.7245050Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:07:43.7345460Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:07:43.7401710Z โ”‚ o add workers for the model." 2023-01-13T03:07:43.7462410Z โ”‚ } 2023-01-13T03:07:43.7562760Z โ”” 2023-01-13T03:07:43.7663640Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:43.7764960Z 54ms 7ms 2ms 566ยตs 931ms 10ms 580ยตs 1007ms 2023-01-13T03:07:43.7866090Z 2023-01-13T03:07:43.7967210Z โœ“ Successful request 2023-01-13T03:07:43.8066640Z 2023-01-13T03:07:43.8168000Z Iteration 2/82 2023-01-13T03:07:43.8270130Z 2023-01-13T03:07:43.8371130Z โ†’ management request 2023-01-13T03:07:44.5981810Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist 2023-01-13T03:07:44.6083220Z 200 OK โ˜… 845ms time โ˜… 283Bโ†‘ 401Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:44.6184250Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 134B 2023-01-13T03:07:44.6285750Z โ”‚ { 2023-01-13T03:07:44.6386690Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:07:44.6488380Z โ”‚ ith 0 initial workers. Use scale workers API to add wo 2023-01-13T03:07:44.6589060Z โ”‚ rkers for the model." 2023-01-13T03:07:44.6690860Z โ”‚ } 2023-01-13T03:07:44.6792240Z โ”” 2023-01-13T03:07:44.6909720Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:44.6995260Z 2ms 1ms (cache) (cache) 841ms 2ms 103ยตs 847ms 2023-01-13T03:07:44.7096410Z 2023-01-13T03:07:44.7198290Z โœ“ Successful request 2023-01-13T03:07:44.7299370Z 2023-01-13T03:07:44.7400590Z Iteration 3/82 2023-01-13T03:07:44.7501700Z 2023-01-13T03:07:44.7603150Z โ†’ management request 2023-01-13T03:07:58.1571450Z POST http://localhost:8081/models?url=densenet161.mar&model_name=densenet161 2023-01-13T03:07:58.1673370Z 200 OK โ˜… 13.5s time โ˜… 295Bโ†‘ 407Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:58.1746700Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 140B 2023-01-13T03:07:58.1777510Z โ”‚ { 2023-01-13T03:07:58.1778430Z โ”‚ "status": "Model \"densenet161\" Version: 1.0 regist 2023-01-13T03:07:58.1780600Z โ”‚ ered with 0 initial workers. Use scale workers API to 2023-01-13T03:07:58.1781320Z โ”‚ add workers for the model." 2023-01-13T03:07:58.1781870Z โ”‚ } 2023-01-13T03:07:58.1782370Z โ”” 2023-01-13T03:07:58.1783090Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:58.1783910Z 2ms 516ยตs (cache) (cache) 13.5s 2ms 92ยตs 13.5s 2023-01-13T03:07:58.1784320Z 2023-01-13T03:07:58.1784850Z โœ“ Successful request 2023-01-13T03:07:58.1785230Z 2023-01-13T03:07:58.1785480Z Iteration 4/82 2023-01-13T03:07:58.1785810Z 2023-01-13T03:07:58.1786200Z โ†’ management request 2023-01-13T03:07:58.1941740Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/densenet161.mar&model_name=densenet161 2023-01-13T03:07:58.1943080Z 500 Internal Server Error โ˜… 7ms time โ˜… 336Bโ†‘ 394Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:58.1943840Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 113B 2023-01-13T03:07:58.1944430Z โ”‚ { 2023-01-13T03:07:58.1944970Z โ”‚ "code": 500, 2023-01-13T03:07:58.1945600Z โ”‚ "type": "InternalServerException", 2023-01-13T03:07:58.1946270Z โ”‚ "message": "Model file already exists densenet161.ma 2023-01-13T03:07:58.1946870Z โ”‚ r" 2023-01-13T03:07:58.1947380Z โ”‚ } 2023-01-13T03:07:58.1968500Z โ”” 2023-01-13T03:07:58.1969500Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:58.1970440Z 1ms 381ยตs (cache) (cache) 3ms 2ms 81ยตs 8ms 2023-01-13T03:07:58.1970890Z 2023-01-13T03:07:58.2054130Z โœ“ Successful request 2023-01-13T03:07:58.2138000Z 2023-01-13T03:07:58.2138600Z Iteration 5/82 2023-01-13T03:07:58.2146320Z 2023-01-13T03:07:58.2147760Z โ†’ management request 2023-01-13T03:07:58.2474170Z DELETE http://localhost:8081/models/densenet161 2023-01-13T03:07:58.2481930Z 200 OK โ˜… 24ms time โ˜… 247Bโ†‘ 319Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:58.2482700Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 53B 2023-01-13T03:07:58.2483390Z โ”‚ { 2023-01-13T03:07:58.2484030Z โ”‚ "status": "Model \"densenet161\" unregistered" 2023-01-13T03:07:58.2484690Z โ”‚ } 2023-01-13T03:07:58.2502850Z โ”” 2023-01-13T03:07:58.2509100Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:58.2510540Z 1ms 866ยตs 257ยตs 237ยตs 20ms 1ms 92ยตs 25ms 2023-01-13T03:07:58.2510930Z 2023-01-13T03:07:58.2586630Z โœ“ Successful request 2023-01-13T03:07:58.2648860Z 2023-01-13T03:07:58.2649360Z Iteration 6/82 2023-01-13T03:07:58.3260240Z 2023-01-13T03:07:58.3262070Z โ†’ management request 2023-01-13T03:07:58.3684610Z POST http://localhost:8081/models 2023-01-13T03:07:58.3787610Z 400 Bad Request โ˜… 31ms time โ˜… 252Bโ†‘ 364Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:58.3889450Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 94B 2023-01-13T03:07:58.3990890Z โ”‚ { 2023-01-13T03:07:58.4092490Z โ”‚ "code": 400, 2023-01-13T03:07:58.4194100Z โ”‚ "type": "BadRequestException", 2023-01-13T03:07:58.4330500Z โ”‚ "message": "Parameter url is required." 2023-01-13T03:07:58.4963350Z โ”‚ } 2023-01-13T03:07:58.5065050Z โ”” 2023-01-13T03:07:58.5333400Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:58.5480020Z 1ms 291ยตs (cache) (cache) 2ms 27ms 144ยตs 31ms 2023-01-13T03:07:58.5581380Z 2023-01-13T03:07:58.5692620Z โœ“ Successful request 2023-01-13T03:07:58.5794050Z 2023-01-13T03:07:58.5895320Z Iteration 7/82 2023-01-13T03:07:58.6207290Z 2023-01-13T03:07:58.6308820Z โ†’ management request 2023-01-13T03:07:58.6397950Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:07:58.6445020Z 200 OK โ˜… 19ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:58.6665980Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:07:58.6768130Z โ”‚ { 2023-01-13T03:07:58.6970480Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:07:58.7038340Z โ”‚ } 2023-01-13T03:07:58.7079860Z โ”” 2023-01-13T03:07:58.7118460Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:58.7165890Z 1ms 839ยตs 263ยตs 243ยตs 15ms 1ms 76ยตs 20ms 2023-01-13T03:07:58.7217080Z 2023-01-13T03:07:58.7266250Z โœ“ Successful request 2023-01-13T03:07:58.7292030Z 2023-01-13T03:07:58.7295280Z Iteration 8/82 2023-01-13T03:07:58.7297040Z 2023-01-13T03:07:58.7317970Z โ†’ management request 2023-01-13T03:07:58.8037700Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&handler=invalidHandler 2023-01-13T03:07:58.8039060Z 200 OK โ˜… 355ms time โ˜… 306Bโ†‘ 401Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:58.8039870Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 134B 2023-01-13T03:07:58.8040530Z โ”‚ { 2023-01-13T03:07:58.8041190Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:07:58.8041890Z โ”‚ ith 0 initial workers. Use scale workers API to add wo 2023-01-13T03:07:58.8042520Z โ”‚ rkers for the model." 2023-01-13T03:07:58.8043050Z โ”‚ } 2023-01-13T03:07:58.8081440Z โ”” 2023-01-13T03:07:58.8083150Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:58.8083880Z 1ms 414ยตs (cache) (cache) 349ms 3ms 93ยตs 356ms 2023-01-13T03:07:58.8084070Z 2023-01-13T03:07:58.8186300Z โœ“ Successful request 2023-01-13T03:07:58.8256370Z 2023-01-13T03:07:58.8257210Z Iteration 9/82 2023-01-13T03:07:58.8275690Z 2023-01-13T03:07:58.8276610Z โ†’ management request 2023-01-13T03:07:58.8441910Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:07:58.8443180Z 200 OK โ˜… 7ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:58.8443670Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:07:58.8443960Z โ”‚ { 2023-01-13T03:07:58.8444270Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:07:58.8444550Z โ”‚ } 2023-01-13T03:07:58.8477720Z โ”” 2023-01-13T03:07:58.8478450Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:58.8478970Z 2ms 418ยตs (cache) (cache) 4ms 2ms 57ยตs 9ms 2023-01-13T03:07:58.8479750Z 2023-01-13T03:07:58.8558350Z โœ“ Successful request 2023-01-13T03:07:58.8625010Z 2023-01-13T03:07:58.8625360Z Iteration 10/82 2023-01-13T03:07:58.8643140Z 2023-01-13T03:07:58.8643740Z โ†’ management request 2023-01-13T03:07:59.1432080Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&handler=invalidHandler 2023-01-13T03:07:59.1444040Z 200 OK โ˜… 269ms time โ˜… 306Bโ†‘ 401Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:07:59.1545040Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 134B 2023-01-13T03:07:59.1592300Z โ”‚ { 2023-01-13T03:07:59.1599710Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:07:59.1655450Z โ”‚ ith 0 initial workers. Use scale workers API to add wo 2023-01-13T03:07:59.1722900Z โ”‚ rkers for the model." 2023-01-13T03:07:59.1764620Z โ”‚ } 2023-01-13T03:07:59.1827610Z โ”” 2023-01-13T03:07:59.1833090Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:07:59.1899900Z 1ms 352ยตs (cache) (cache) 265ms 2ms 46ยตs 270ms 2023-01-13T03:07:59.1906930Z 2023-01-13T03:07:59.1948960Z โœ“ Successful request 2023-01-13T03:07:59.1955900Z 2023-01-13T03:07:59.1993440Z Iteration 11/82 2023-01-13T03:07:59.2000800Z 2023-01-13T03:07:59.2035380Z โ†’ management request 2023-01-13T03:08:01.5110770Z PUT http://localhost:8081/models/mnist?min_worker=1&synchronous=true 2023-01-13T03:08:01.5112940Z 500 Internal Server Error โ˜… 2.3s time โ˜… 287Bโ†‘ 406Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:01.5113400Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 125B 2023-01-13T03:08:01.5113740Z โ”‚ { 2023-01-13T03:08:01.5113990Z โ”‚ "code": 500, 2023-01-13T03:08:01.5114320Z โ”‚ "type": "InternalServerException", 2023-01-13T03:08:01.5114700Z โ”‚ "message": "Failed to start workers for model mnist 2023-01-13T03:08:01.5115130Z โ”‚ version: null" 2023-01-13T03:08:01.5115380Z โ”‚ } 2023-01-13T03:08:01.5115610Z โ”” 2023-01-13T03:08:01.5116030Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:01.5116520Z 1ms 304ยตs (cache) (cache) 2.3s 1ms 47ยตs 2.3s 2023-01-13T03:08:01.5116700Z 2023-01-13T03:08:01.5188870Z โœ“ Successful request 2023-01-13T03:08:01.5258840Z 2023-01-13T03:08:01.5259580Z Iteration 12/82 2023-01-13T03:08:01.5277090Z 2023-01-13T03:08:01.5278190Z โ†’ management request 2023-01-13T03:08:01.5560290Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:08:01.5561730Z 200 OK โ˜… 19ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:01.5562450Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:01.5563230Z โ”‚ { 2023-01-13T03:08:01.5563900Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:08:01.5564480Z โ”‚ } 2023-01-13T03:08:01.5577610Z โ”” 2023-01-13T03:08:01.5578600Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:01.5579520Z 1ms 957ยตs 325ยตs 208ยตs 15ms 1ms 57ยตs 20ms 2023-01-13T03:08:01.5579720Z 2023-01-13T03:08:01.5671470Z โœ“ Successful request 2023-01-13T03:08:01.5716340Z 2023-01-13T03:08:01.5716810Z Iteration 13/82 2023-01-13T03:08:01.5734270Z 2023-01-13T03:08:01.5734890Z โ†’ management request 2023-01-13T03:08:01.5873260Z GET http://localhost:8081/models/squeezenet1_1/all 2023-01-13T03:08:01.5874010Z 200 OK โ˜… 8ms time โ˜… 250Bโ†‘ 538Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:01.5874550Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 271B 2023-01-13T03:08:01.5874870Z โ”‚ [ 2023-01-13T03:08:01.5875090Z โ”‚ { 2023-01-13T03:08:01.5875380Z โ”‚ "modelName": "squeezenet1_1", 2023-01-13T03:08:01.5875750Z โ”‚ "modelVersion": "1.0", 2023-01-13T03:08:01.5876130Z โ”‚ "modelUrl": "squeezenet1_1.mar", 2023-01-13T03:08:01.5876460Z โ”‚ "runtime": "python", 2023-01-13T03:08:01.5876750Z โ”‚ "minWorkers": 0, 2023-01-13T03:08:01.5877800Z โ”‚ "maxWorkers": 0, 2023-01-13T03:08:01.5878170Z โ”‚ "batchSize": 1, 2023-01-13T03:08:01.5878470Z โ”‚ "maxBatchDelay": 100, 2023-01-13T03:08:01.5878790Z โ”‚ "loadedAtStartup": false, 2023-01-13T03:08:01.5879070Z โ”‚ "workers": [] 2023-01-13T03:08:01.5879330Z โ”‚ } 2023-01-13T03:08:01.5879670Z โ”‚ ] 2023-01-13T03:08:01.5902410Z โ”” 2023-01-13T03:08:01.5902990Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:01.5903500Z 1ms 264ยตs (cache) (cache) 5ms 2ms 50ยตs 9ms 2023-01-13T03:08:01.5903670Z 2023-01-13T03:08:01.5966940Z โœ“ Successful request 2023-01-13T03:08:01.6022710Z 2023-01-13T03:08:01.6023550Z Iteration 14/82 2023-01-13T03:08:01.6040000Z 2023-01-13T03:08:01.6041270Z โ†’ management request 2023-01-13T03:08:01.6182960Z GET http://localhost:8081/models/squeezenet1_1/1.0 2023-01-13T03:08:01.6214090Z 200 OK โ˜… 5ms time โ˜… 250Bโ†‘ 538Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:01.6214960Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 271B 2023-01-13T03:08:01.6215680Z โ”‚ [ 2023-01-13T03:08:01.6216210Z โ”‚ { 2023-01-13T03:08:01.6216790Z โ”‚ "modelName": "squeezenet1_1", 2023-01-13T03:08:01.6217420Z โ”‚ "modelVersion": "1.0", 2023-01-13T03:08:01.6218150Z โ”‚ "modelUrl": "squeezenet1_1.mar", 2023-01-13T03:08:01.6218800Z โ”‚ "runtime": "python", 2023-01-13T03:08:01.6219840Z โ”‚ "minWorkers": 0, 2023-01-13T03:08:01.6220440Z โ”‚ "maxWorkers": 0, 2023-01-13T03:08:01.6221010Z โ”‚ "batchSize": 1, 2023-01-13T03:08:01.6221660Z โ”‚ "maxBatchDelay": 100, 2023-01-13T03:08:01.6222280Z โ”‚ "loadedAtStartup": false, 2023-01-13T03:08:01.6222880Z โ”‚ "workers": [] 2023-01-13T03:08:01.6223410Z โ”‚ } 2023-01-13T03:08:01.6223910Z โ”‚ ] 2023-01-13T03:08:01.6224630Z โ”” 2023-01-13T03:08:01.6225360Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:01.6226180Z 1ms 325ยตs (cache) (cache) 2ms 1ms 57ยตs 6ms 2023-01-13T03:08:01.6226610Z 2023-01-13T03:08:01.6318970Z โœ“ Successful request 2023-01-13T03:08:01.6400450Z 2023-01-13T03:08:01.6400840Z Iteration 15/82 2023-01-13T03:08:01.6415550Z 2023-01-13T03:08:01.6416300Z โ†’ management request 2023-01-13T03:08:01.6554310Z GET http://localhost:8081/models/squeezenet1_1 2023-01-13T03:08:01.6555550Z 200 OK โ˜… 5ms time โ˜… 246Bโ†‘ 538Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:01.6557130Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 271B 2023-01-13T03:08:01.6557890Z โ”‚ [ 2023-01-13T03:08:01.6559040Z โ”‚ { 2023-01-13T03:08:01.6559670Z โ”‚ "modelName": "squeezenet1_1", 2023-01-13T03:08:01.6560310Z โ”‚ "modelVersion": "1.0", 2023-01-13T03:08:01.6560950Z โ”‚ "modelUrl": "squeezenet1_1.mar", 2023-01-13T03:08:01.6561590Z โ”‚ "runtime": "python", 2023-01-13T03:08:01.6562180Z โ”‚ "minWorkers": 0, 2023-01-13T03:08:01.6562770Z โ”‚ "maxWorkers": 0, 2023-01-13T03:08:01.6563390Z โ”‚ "batchSize": 1, 2023-01-13T03:08:01.6563980Z โ”‚ "maxBatchDelay": 100, 2023-01-13T03:08:01.6564620Z โ”‚ "loadedAtStartup": false, 2023-01-13T03:08:01.6565210Z โ”‚ "workers": [] 2023-01-13T03:08:01.6567260Z โ”‚ } 2023-01-13T03:08:01.6568370Z โ”‚ ] 2023-01-13T03:08:01.6582120Z โ”” 2023-01-13T03:08:01.6583010Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:01.6583810Z 1ms 293ยตs (cache) (cache) 2ms 2ms 40ยตs 6ms 2023-01-13T03:08:01.6584930Z 2023-01-13T03:08:01.6653140Z โœ“ Successful request 2023-01-13T03:08:01.6728040Z 2023-01-13T03:08:01.6728640Z Iteration 16/82 2023-01-13T03:08:01.6745240Z 2023-01-13T03:08:01.6746940Z โ†’ management request 2023-01-13T03:08:01.6911710Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:08:01.7016000Z 200 OK โ˜… 9ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:01.7119120Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:08:01.7220890Z โ”‚ { 2023-01-13T03:08:01.7322970Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:08:01.7424480Z โ”‚ } 2023-01-13T03:08:01.7525890Z โ”” 2023-01-13T03:08:01.7627830Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:01.7729590Z 2ms 318ยตs (cache) (cache) 6ms 2ms 42ยตs 11ms 2023-01-13T03:08:01.7830760Z 2023-01-13T03:08:01.7931980Z โœ“ Successful request 2023-01-13T03:08:01.8033390Z 2023-01-13T03:08:01.8134590Z Iteration 17/82 2023-01-13T03:08:01.8235630Z 2023-01-13T03:08:01.8337040Z โ†’ management request 2023-01-13T03:08:01.8438710Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&runtime=python4 2023-01-13T03:08:01.8540620Z 400 Bad Request โ˜… 5ms time โ˜… 315Bโ†‘ 373Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:01.8587190Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 102B 2023-01-13T03:08:01.8620960Z โ”‚ { 2023-01-13T03:08:01.8653940Z โ”‚ "code": 400, 2023-01-13T03:08:01.8681680Z โ”‚ "type": "BadRequestException", 2023-01-13T03:08:01.8707780Z โ”‚ "message": "Invalid RuntimeType value: python4" 2023-01-13T03:08:01.8733750Z โ”‚ } 2023-01-13T03:08:01.8759570Z โ”” 2023-01-13T03:08:01.8785850Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:01.8813600Z 1ms 298ยตs (cache) (cache) 2ms 1ms 44ยตs 5ms 2023-01-13T03:08:01.8841500Z 2023-01-13T03:08:01.8867580Z โœ“ Successful request 2023-01-13T03:08:01.8890370Z 2023-01-13T03:08:01.8890540Z Iteration 18/82 2023-01-13T03:08:01.8890730Z 2023-01-13T03:08:01.8890990Z โ†’ management request 2023-01-13T03:08:01.8899360Z GET http://localhost:8081/models?limit=&next_page_token= 2023-01-13T03:08:01.8903500Z 200 OK โ˜… 16ms time โ˜… 256Bโ†‘ 285Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:01.8912120Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 19B 2023-01-13T03:08:01.8930450Z โ”‚ { 2023-01-13T03:08:01.8941380Z โ”‚ "models": [] 2023-01-13T03:08:01.8962540Z โ”‚ } 2023-01-13T03:08:01.8988710Z โ”” 2023-01-13T03:08:01.9015080Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:01.9040480Z 1ms 829ยตs 229ยตs 228ยตs 12ms 1ms 39ยตs 16ms 2023-01-13T03:08:01.9046880Z 2023-01-13T03:08:01.9073040Z โœ“ Successful request 2023-01-13T03:08:01.9086500Z 2023-01-13T03:08:01.9086950Z Iteration 19/82 2023-01-13T03:08:01.9087310Z 2023-01-13T03:08:01.9087780Z โ†’ management request 2023-01-13T03:08:02.0363020Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:08:02.0363850Z 200 OK โ˜… 239ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.0364280Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:08:02.0364560Z โ”‚ { 2023-01-13T03:08:02.0365790Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:08:02.0366200Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:08:02.0366530Z โ”‚ o add workers for the model." 2023-01-13T03:08:02.0366790Z โ”‚ } 2023-01-13T03:08:02.0389310Z โ”” 2023-01-13T03:08:02.0390240Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.0390850Z 1ms 332ยตs (cache) (cache) 237ms 1ms 38ยตs 240ms 2023-01-13T03:08:02.0391030Z 2023-01-13T03:08:02.0460730Z โœ“ Successful request 2023-01-13T03:08:02.0511050Z 2023-01-13T03:08:02.0511510Z Iteration 20/82 2023-01-13T03:08:02.0527500Z 2023-01-13T03:08:02.0528200Z โ†’ management request 2023-01-13T03:08:02.0654980Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1 2023-01-13T03:08:02.0681870Z 202 Accepted โ˜… 5ms time โ˜… 278Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.0682700Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:02.0683310Z โ”‚ { 2023-01-13T03:08:02.0683910Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:02.0684450Z โ”‚ } 2023-01-13T03:08:02.0685070Z โ”” 2023-01-13T03:08:02.0685870Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.0688700Z 1ms 244ยตs (cache) (cache) 2ms 1ms 49ยตs 5ms 2023-01-13T03:08:02.0689180Z 2023-01-13T03:08:02.0745390Z โœ“ Successful request 2023-01-13T03:08:02.0794410Z 2023-01-13T03:08:02.0794780Z Iteration 21/82 2023-01-13T03:08:02.0811220Z 2023-01-13T03:08:02.0811890Z โ†’ management request 2023-01-13T03:08:02.0937910Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1&synchronous=true 2023-01-13T03:08:02.0939110Z 200 OK โ˜… 5ms time โ˜… 295Bโ†‘ 329Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.0939830Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 63B 2023-01-13T03:08:02.0940420Z โ”‚ { 2023-01-13T03:08:02.0941080Z โ”‚ "status": "Workers scaled to 1 for model: squeezenet 2023-01-13T03:08:02.0941660Z โ”‚ 1_1" 2023-01-13T03:08:02.0942160Z โ”‚ } 2023-01-13T03:08:02.0958660Z โ”” 2023-01-13T03:08:02.0959450Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.0960250Z 2ms 253ยตs (cache) (cache) 2ms 1ms 42ยตs 6ms 2023-01-13T03:08:02.0960660Z 2023-01-13T03:08:02.1031460Z โœ“ Successful request 2023-01-13T03:08:02.1100700Z 2023-01-13T03:08:02.1101090Z Iteration 22/82 2023-01-13T03:08:02.1117400Z 2023-01-13T03:08:02.1118070Z โ†’ management request 2023-01-13T03:08:02.1254830Z PUT http://localhost:8081/models/squeezenet1_1/1.0?min_worker=1&synchronous=true 2023-01-13T03:08:02.1256000Z 200 OK โ˜… 5ms time โ˜… 299Bโ†‘ 343Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.1256740Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 77B 2023-01-13T03:08:02.1257320Z โ”‚ { 2023-01-13T03:08:02.1257960Z โ”‚ "status": "Workers scaled to 1 for model: squeezenet 2023-01-13T03:08:02.1258610Z โ”‚ 1_1, version: 1.0" 2023-01-13T03:08:02.1259130Z โ”‚ } 2023-01-13T03:08:02.1266880Z โ”” 2023-01-13T03:08:02.1267670Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.1269180Z 1ms 300ยตs (cache) (cache) 2ms 2ms 41ยตs 6ms 2023-01-13T03:08:02.1269690Z 2023-01-13T03:08:02.1361480Z โœ“ Successful request 2023-01-13T03:08:02.1426800Z 2023-01-13T03:08:02.1543150Z Iteration 23/82 2023-01-13T03:08:02.1644460Z 2023-01-13T03:08:02.1746220Z โ†’ management request 2023-01-13T03:08:02.1847970Z PUT http://localhost:8081/models/squeezenet1_1/0.0?min_worker=1&synchronous=true 2023-01-13T03:08:02.1949730Z 404 Not Found โ˜… 5ms time โ˜… 299Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.2051370Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 136B 2023-01-13T03:08:02.2152890Z โ”‚ { 2023-01-13T03:08:02.2254430Z โ”‚ "code": 404, 2023-01-13T03:08:02.2356550Z โ”‚ "type": "ModelVersionNotFoundException", 2023-01-13T03:08:02.2458200Z โ”‚ "message": "Model version: 0.0 does not exist for mo 2023-01-13T03:08:02.2559890Z โ”‚ del: squeezenet1_1" 2023-01-13T03:08:02.2661470Z โ”‚ } 2023-01-13T03:08:02.2762930Z โ”” 2023-01-13T03:08:02.2864750Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.2966640Z 1ms 402ยตs (cache) (cache) 2ms 1ms 38ยตs 6ms 2023-01-13T03:08:02.3067630Z 2023-01-13T03:08:02.3169100Z โœ“ Successful request 2023-01-13T03:08:02.3270060Z 2023-01-13T03:08:02.3371570Z Iteration 24/82 2023-01-13T03:08:02.3472490Z 2023-01-13T03:08:02.3573990Z โ†’ management request 2023-01-13T03:08:02.3676530Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1&number_gpu=1 2023-01-13T03:08:02.3778610Z 202 Accepted โ˜… 7ms time โ˜… 291Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.3880390Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:02.3982030Z โ”‚ { 2023-01-13T03:08:02.4031230Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:02.4036550Z โ”‚ } 2023-01-13T03:08:02.4041650Z โ”” 2023-01-13T03:08:02.4042530Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.4043980Z 2ms 865ยตs 236ยตs 204ยตs 3ms 1ms 42ยตs 9ms 2023-01-13T03:08:02.4044470Z 2023-01-13T03:08:02.4044890Z โœ“ Successful request 2023-01-13T03:08:02.4045280Z 2023-01-13T03:08:02.4045560Z Iteration 25/82 2023-01-13T03:08:02.4046910Z 2023-01-13T03:08:02.4047550Z โ†’ management request 2023-01-13T03:08:02.4048120Z PUT http://localhost:8081/models/squeezenet1_1/1.0/set-default 2023-01-13T03:08:02.4048660Z 200 OK โ˜… 5ms time โ˜… 281Bโ†‘ 359Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.4049330Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 93B 2023-01-13T03:08:02.4049620Z โ”‚ { 2023-01-13T03:08:02.4050220Z โ”‚ "status": "Default vesion succsesfully updated for m 2023-01-13T03:08:02.4050640Z โ”‚ odel \"squeezenet1_1\" to \"1.0\"" 2023-01-13T03:08:02.4050900Z โ”‚ } 2023-01-13T03:08:02.4051100Z โ”” 2023-01-13T03:08:02.4051540Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.4052030Z 1ms 369ยตs (cache) (cache) 2ms 1ms 45ยตs 6ms 2023-01-13T03:08:02.4052200Z 2023-01-13T03:08:02.4052360Z โœ“ Successful request 2023-01-13T03:08:02.4052500Z 2023-01-13T03:08:02.4052580Z Iteration 26/82 2023-01-13T03:08:02.4052710Z 2023-01-13T03:08:02.4052870Z โ†’ management request 2023-01-13T03:08:02.4053270Z PUT http://localhost:8081/models/squeezenet1_1/0.0/set-default 2023-01-13T03:08:02.4053730Z 404 Not Found โ˜… 5ms time โ˜… 281Bโ†‘ 403Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.4054130Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 134B 2023-01-13T03:08:02.4054410Z โ”‚ { 2023-01-13T03:08:02.4054660Z โ”‚ "code": 404, 2023-01-13T03:08:02.4055000Z โ”‚ "type": "ModelVersionNotFoundException", 2023-01-13T03:08:02.4055400Z โ”‚ "message": "Model version 0.0 does not exist for mod 2023-01-13T03:08:02.4055700Z โ”‚ el squeezenet1_1" 2023-01-13T03:08:02.4055950Z โ”‚ } 2023-01-13T03:08:02.4056620Z โ”” 2023-01-13T03:08:02.4057140Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.4057620Z 3ms 358ยตs (cache) (cache) 2ms 1ms 45ยตs 7ms 2023-01-13T03:08:02.4057790Z 2023-01-13T03:08:02.4057960Z โœ“ Successful request 2023-01-13T03:08:02.4058090Z 2023-01-13T03:08:02.4058170Z Iteration 27/82 2023-01-13T03:08:02.4058300Z 2023-01-13T03:08:02.4058440Z โ†’ management request 2023-01-13T03:08:02.4059320Z PUT http://localhost:8081/models/squeezenet0_1/1.0/set-default 2023-01-13T03:08:02.4059780Z 404 Not Found โ˜… 5ms time โ˜… 281Bโ†‘ 370Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.4060550Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 101B 2023-01-13T03:08:02.4060840Z โ”‚ { 2023-01-13T03:08:02.4061080Z โ”‚ "code": 404, 2023-01-13T03:08:02.4061390Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:08:02.4061760Z โ”‚ "message": "Model not found: squeezenet0_1" 2023-01-13T03:08:02.4062040Z โ”‚ } 2023-01-13T03:08:02.4062240Z โ”” 2023-01-13T03:08:02.4062660Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.4063130Z 1ms 772ยตs 214ยตs 204ยตs 2ms 1ms 38ยตs 6ms 2023-01-13T03:08:02.4063300Z 2023-01-13T03:08:02.4063450Z โœ“ Successful request 2023-01-13T03:08:02.4063590Z 2023-01-13T03:08:02.4063670Z Iteration 28/82 2023-01-13T03:08:02.4063790Z 2023-01-13T03:08:02.4063950Z โ†’ management request 2023-01-13T03:08:02.4064250Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:08:02.4064670Z 200 OK โ˜… 38ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.4065080Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:08:02.4065360Z โ”‚ { 2023-01-13T03:08:02.4065670Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:08:02.4065950Z โ”‚ } 2023-01-13T03:08:02.4066150Z โ”” 2023-01-13T03:08:02.4066560Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.4067040Z 1ms 735ยตs 215ยตs 203ยตs 35ms 1ms 37ยตs 39ms 2023-01-13T03:08:02.4067200Z 2023-01-13T03:08:02.4067360Z โœ“ Successful request 2023-01-13T03:08:02.4067500Z 2023-01-13T03:08:02.4067580Z Iteration 29/82 2023-01-13T03:08:02.4067690Z 2023-01-13T03:08:02.4067840Z โ†’ management request 2023-01-13T03:08:02.6348070Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&handler=serve/ts/torch_handler/image_classifier.py:handle 2023-01-13T03:08:02.6361360Z 200 OK โ˜… 259ms time โ˜… 357Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.6362460Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:08:02.6363490Z โ”‚ { 2023-01-13T03:08:02.6364240Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:08:02.6365090Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:08:02.6365930Z โ”‚ o add workers for the model." 2023-01-13T03:08:02.6366740Z โ”‚ } 2023-01-13T03:08:02.6367370Z โ”” 2023-01-13T03:08:02.6368250Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.6369200Z 1ms 324ยตs (cache) (cache) 256ms 1ms 47ยตs 259ms 2023-01-13T03:08:02.6369690Z 2023-01-13T03:08:02.6427020Z โœ“ Successful request 2023-01-13T03:08:02.6491390Z 2023-01-13T03:08:02.6492450Z Iteration 30/82 2023-01-13T03:08:02.6508650Z 2023-01-13T03:08:02.6509580Z โ†’ management request 2023-01-13T03:08:02.6706530Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:08:02.6732730Z 200 OK โ˜… 8ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:02.6757860Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:08:02.6772480Z โ”‚ { 2023-01-13T03:08:02.6780610Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:08:02.6786370Z โ”‚ } 2023-01-13T03:08:02.6888600Z โ”” 2023-01-13T03:08:02.6909380Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:02.6948010Z 1ms 366ยตs (cache) (cache) 4ms 2ms 45ยตs 9ms 2023-01-13T03:08:02.7007440Z 2023-01-13T03:08:02.7045390Z โœ“ Successful request 2023-01-13T03:08:02.7146240Z 2023-01-13T03:08:02.7247350Z Iteration 31/82 2023-01-13T03:08:02.7269750Z 2023-01-13T03:08:02.7270970Z โ†’ management request 2023-01-13T03:08:06.2184700Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&batch_size=3&initial_workers=3&response_timeout=0 2023-01-13T03:08:06.2211700Z 500 Internal Server Error โ˜… 3.5s time โ˜… 349Bโ†‘ 413Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:06.2314200Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 132B 2023-01-13T03:08:06.2363180Z โ”‚ { 2023-01-13T03:08:06.2385290Z โ”‚ "code": 500, 2023-01-13T03:08:06.2396040Z โ”‚ "type": "InternalServerException", 2023-01-13T03:08:06.2397310Z โ”‚ "message": "Failed to start workers for model squeez 2023-01-13T03:08:06.2397770Z โ”‚ enet1_1 version: 1.0" 2023-01-13T03:08:06.2398030Z โ”‚ } 2023-01-13T03:08:06.2398270Z โ”” 2023-01-13T03:08:06.2398690Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:06.2399190Z 2ms 322ยตs (cache) (cache) 3.5s 1ms 36ยตs 3.5s 2023-01-13T03:08:06.2399360Z 2023-01-13T03:08:06.2399530Z โœ“ Successful request 2023-01-13T03:08:06.2399670Z 2023-01-13T03:08:06.2399750Z Iteration 32/82 2023-01-13T03:08:06.2399860Z 2023-01-13T03:08:06.2400020Z โ†’ management request 2023-01-13T03:08:06.4864210Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&response_timeout=0 2023-01-13T03:08:06.4865060Z 200 OK โ˜… 240ms time โ˜… 318Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:06.4865470Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:08:06.4865750Z โ”‚ { 2023-01-13T03:08:06.4866120Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:08:06.4866520Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:08:06.4866860Z โ”‚ o add workers for the model." 2023-01-13T03:08:06.4867120Z โ”‚ } 2023-01-13T03:08:06.4884360Z โ”” 2023-01-13T03:08:06.4884830Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:06.4885330Z 2ms 767ยตs 219ยตs 230ยตs 236ms 1ms 41ยตs 241ms 2023-01-13T03:08:06.4885500Z 2023-01-13T03:08:06.4950270Z โœ“ Successful request 2023-01-13T03:08:06.5003460Z 2023-01-13T03:08:06.5003760Z Iteration 33/82 2023-01-13T03:08:06.5020450Z 2023-01-13T03:08:06.5021210Z โ†’ management request 2023-01-13T03:08:06.5172490Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:08:06.5173910Z 200 OK โ˜… 7ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:06.5174820Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:08:06.5175480Z โ”‚ { 2023-01-13T03:08:06.5176220Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:08:06.5176880Z โ”‚ } 2023-01-13T03:08:06.5193560Z โ”” 2023-01-13T03:08:06.5194110Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:06.5194610Z 1ms 295ยตs (cache) (cache) 4ms 1ms 48ยตs 7ms 2023-01-13T03:08:06.5194780Z 2023-01-13T03:08:06.5263890Z โœ“ Successful request 2023-01-13T03:08:06.5315730Z 2023-01-13T03:08:06.5316370Z Iteration 34/82 2023-01-13T03:08:06.5331890Z 2023-01-13T03:08:06.5332570Z โ†’ management request 2023-01-13T03:08:15.7884790Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=2 2023-01-13T03:08:15.7885420Z 200 OK โ˜… 9.2s time โ˜… 311Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:15.7886480Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 138B 2023-01-13T03:08:15.7887620Z โ”‚ { 2023-01-13T03:08:15.7888070Z โ”‚ "status": "Model \"resnet152\" Version: 1.0 register 2023-01-13T03:08:15.7888480Z โ”‚ ed with 0 initial workers. Use scale workers API to ad 2023-01-13T03:08:15.7888820Z โ”‚ d workers for the model." 2023-01-13T03:08:15.7889070Z โ”‚ } 2023-01-13T03:08:15.7905130Z โ”” 2023-01-13T03:08:15.7905640Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:15.7906140Z 2ms 303ยตs (cache) (cache) 9.2s 1ms 38ยตs 9.2s 2023-01-13T03:08:15.7906300Z 2023-01-13T03:08:15.7973330Z โœ“ Successful request 2023-01-13T03:08:15.8016070Z 2023-01-13T03:08:15.8017000Z Iteration 35/82 2023-01-13T03:08:15.8033090Z 2023-01-13T03:08:15.8033740Z โ†’ management request 2023-01-13T03:08:15.8242110Z DELETE http://localhost:8081/models/resnet152 2023-01-13T03:08:15.8242910Z 200 OK โ˜… 15ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:15.8243360Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:08:15.8243660Z โ”‚ { 2023-01-13T03:08:15.8243970Z โ”‚ "status": "Model \"resnet152\" unregistered" 2023-01-13T03:08:15.8244240Z โ”‚ } 2023-01-13T03:08:15.8275640Z โ”” 2023-01-13T03:08:15.8276170Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:15.8276660Z 1ms 321ยตs (cache) (cache) 12ms 1ms 35ยตs 15ms 2023-01-13T03:08:15.8276830Z 2023-01-13T03:08:15.8356980Z โœ“ Successful request 2023-01-13T03:08:15.8412620Z 2023-01-13T03:08:15.8412950Z Iteration 36/82 2023-01-13T03:08:15.8428900Z 2023-01-13T03:08:15.8429300Z โ†’ management request 2023-01-13T03:08:35.9970080Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=dd&initial_workers=1 2023-01-13T03:08:35.9971670Z 200 OK โ˜… 20.1s time โ˜… 330Bโ†‘ 351Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:35.9972610Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 85B 2023-01-13T03:08:35.9973450Z โ”‚ { 2023-01-13T03:08:35.9974260Z โ”‚ "status": "Model \"resnet152\" Version: 1.0 register 2023-01-13T03:08:35.9975020Z โ”‚ ed with 1 initial workers" 2023-01-13T03:08:35.9975710Z โ”‚ } 2023-01-13T03:08:36.0008580Z โ”” 2023-01-13T03:08:36.0009600Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:36.0010150Z 1ms 307ยตs (cache) (cache) 20.1s 4ms 101ยตs 20.1s 2023-01-13T03:08:36.0010330Z 2023-01-13T03:08:36.0124930Z โœ“ Successful request 2023-01-13T03:08:36.0189560Z 2023-01-13T03:08:36.0189910Z Iteration 37/82 2023-01-13T03:08:36.0208460Z 2023-01-13T03:08:36.0209220Z โ†’ management request 2023-01-13T03:08:36.0557800Z DELETE http://localhost:8081/models/resnet152 2023-01-13T03:08:36.0559270Z 200 OK โ˜… 24ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:36.0560200Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:08:36.0560930Z โ”‚ { 2023-01-13T03:08:36.0561730Z โ”‚ "status": "Model \"resnet152\" unregistered" 2023-01-13T03:08:36.0562450Z โ”‚ } 2023-01-13T03:08:36.0594080Z โ”” 2023-01-13T03:08:36.0595260Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:36.0596260Z 2ms 568ยตs (cache) (cache) 21ms 1ms 51ยตs 26ms 2023-01-13T03:08:36.0596700Z 2023-01-13T03:08:36.0683530Z โœ“ Successful request 2023-01-13T03:08:36.0741570Z 2023-01-13T03:08:36.0742080Z Iteration 38/82 2023-01-13T03:08:36.0765730Z 2023-01-13T03:08:36.0766610Z โ†’ management request 2023-01-13T03:08:50.9556460Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=2&initial_workers=1&max_batch_delay=junk 2023-01-13T03:08:50.9557170Z 200 OK โ˜… 14.8s time โ˜… 350Bโ†‘ 351Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:50.9557570Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 85B 2023-01-13T03:08:50.9557860Z โ”‚ { 2023-01-13T03:08:50.9558990Z โ”‚ "status": "Model \"resnet152\" Version: 1.0 register 2023-01-13T03:08:50.9559440Z โ”‚ ed with 1 initial workers" 2023-01-13T03:08:50.9559700Z โ”‚ } 2023-01-13T03:08:50.9583820Z โ”” 2023-01-13T03:08:50.9584380Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:50.9584860Z 1ms 352ยตs (cache) (cache) 14.8s 2ms 48ยตs 14.8s 2023-01-13T03:08:50.9585040Z 2023-01-13T03:08:50.9670270Z โœ“ Successful request 2023-01-13T03:08:50.9722130Z 2023-01-13T03:08:50.9722590Z Iteration 39/82 2023-01-13T03:08:50.9739070Z 2023-01-13T03:08:50.9739790Z โ†’ management request 2023-01-13T03:08:50.9999100Z DELETE http://localhost:8081/models/resnet152 2023-01-13T03:08:51.0000530Z 200 OK โ˜… 20ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:51.0001470Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:08:51.0002180Z โ”‚ { 2023-01-13T03:08:51.0002960Z โ”‚ "status": "Model \"resnet152\" unregistered" 2023-01-13T03:08:51.0003650Z โ”‚ } 2023-01-13T03:08:51.0030000Z โ”” 2023-01-13T03:08:51.0031410Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:51.0032380Z 2ms 259ยตs (cache) (cache) 17ms 1ms 43ยตs 21ms 2023-01-13T03:08:51.0032930Z 2023-01-13T03:08:51.0131480Z โœ“ Successful request 2023-01-13T03:08:51.0180720Z 2023-01-13T03:08:51.0181210Z Iteration 40/82 2023-01-13T03:08:51.0197320Z 2023-01-13T03:08:51.0197980Z โ†’ management request 2023-01-13T03:08:51.2484270Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&initial_workers=-1 2023-01-13T03:08:51.2484970Z 200 OK โ˜… 221ms time โ˜… 318Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:51.2485390Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:08:51.2485670Z โ”‚ { 2023-01-13T03:08:51.2486010Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:08:51.2486430Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:08:51.2486780Z โ”‚ o add workers for the model." 2023-01-13T03:08:51.2487030Z โ”‚ } 2023-01-13T03:08:51.2517980Z โ”” 2023-01-13T03:08:51.2518600Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:51.2519100Z 2ms 285ยตs (cache) (cache) 218ms 1ms 44ยตs 222ms 2023-01-13T03:08:51.2519280Z 2023-01-13T03:08:51.2603680Z โœ“ Successful request 2023-01-13T03:08:51.2662080Z 2023-01-13T03:08:51.2662390Z Iteration 41/82 2023-01-13T03:08:51.2685170Z 2023-01-13T03:08:51.2685840Z โ†’ management request 2023-01-13T03:08:51.2805780Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:08:51.2806580Z 200 OK โ˜… 6ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:51.2806990Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:08:51.2807290Z โ”‚ { 2023-01-13T03:08:51.2807640Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:08:51.2807970Z โ”‚ } 2023-01-13T03:08:51.2839620Z โ”” 2023-01-13T03:08:51.2840420Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:51.2840940Z 1ms 263ยตs (cache) (cache) 3ms 1ms 37ยตs 7ms 2023-01-13T03:08:51.2841110Z 2023-01-13T03:08:51.3078120Z โœ“ Successful request 2023-01-13T03:08:51.3453810Z 2023-01-13T03:08:51.3555960Z Iteration 42/82 2023-01-13T03:08:51.3657220Z 2023-01-13T03:08:51.3758660Z โ†’ management request 2023-01-13T03:08:53.2056170Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=true 2023-01-13T03:08:53.2158750Z 200 OK โ˜… 1852ms time โ˜… 308Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:53.2205500Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 138B 2023-01-13T03:08:53.2209790Z โ”‚ { 2023-01-13T03:08:53.2212740Z โ”‚ "status": "Model \"resnet-18\" Version: 1.0 register 2023-01-13T03:08:53.2301530Z โ”‚ ed with 0 initial workers. Use scale workers API to ad 2023-01-13T03:08:53.2312110Z โ”‚ d workers for the model." 2023-01-13T03:08:53.2413010Z โ”‚ } 2023-01-13T03:08:53.2510660Z โ”” 2023-01-13T03:08:53.2514230Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:53.2515230Z 1ms 282ยตs (cache) (cache) 1848ms 2ms 46ยตs 1853ms 2023-01-13T03:08:53.2515790Z 2023-01-13T03:08:53.2516490Z โœ“ Successful request 2023-01-13T03:08:53.2517010Z 2023-01-13T03:08:53.2517400Z Iteration 43/82 2023-01-13T03:08:53.2517860Z 2023-01-13T03:08:53.2518370Z โ†’ management request 2023-01-13T03:08:53.2519200Z DELETE http://localhost:8081/models/resnet-18 2023-01-13T03:08:53.2520100Z 200 OK โ˜… 7ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:53.2520930Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:08:53.2521650Z โ”‚ { 2023-01-13T03:08:53.2522400Z โ”‚ "status": "Model \"resnet-18\" unregistered" 2023-01-13T03:08:53.2523120Z โ”‚ } 2023-01-13T03:08:53.2523740Z โ”” 2023-01-13T03:08:53.2524600Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:53.2525500Z 2ms 269ยตs (cache) (cache) 4ms 1ms 42ยตs 9ms 2023-01-13T03:08:53.2530730Z 2023-01-13T03:08:53.2531360Z โœ“ Successful request 2023-01-13T03:08:53.2531900Z 2023-01-13T03:08:53.2532300Z Iteration 44/82 2023-01-13T03:08:53.2532860Z 2023-01-13T03:08:53.2533380Z โ†’ management request 2023-01-13T03:08:55.2109670Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=-1 2023-01-13T03:08:55.2127510Z 200 OK โ˜… 1951ms time โ˜… 306Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:55.2139730Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 138B 2023-01-13T03:08:55.2140530Z โ”‚ { 2023-01-13T03:08:55.2141360Z โ”‚ "status": "Model \"resnet-18\" Version: 1.0 register 2023-01-13T03:08:55.2142460Z โ”‚ ed with 0 initial workers. Use scale workers API to ad 2023-01-13T03:08:55.2143210Z โ”‚ d workers for the model." 2023-01-13T03:08:55.2143900Z โ”‚ } 2023-01-13T03:08:55.2145370Z โ”” 2023-01-13T03:08:55.2146270Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:55.2147160Z 1ms 226ยตs (cache) (cache) 1948ms 1ms 45ยตs 1951ms 2023-01-13T03:08:55.2155930Z 2023-01-13T03:08:55.2208200Z โœ“ Successful request 2023-01-13T03:08:55.2257740Z 2023-01-13T03:08:55.2258250Z Iteration 45/82 2023-01-13T03:08:55.2273840Z 2023-01-13T03:08:55.2274860Z โ†’ management request 2023-01-13T03:08:55.2404750Z DELETE http://localhost:8081/models/resnet-18 2023-01-13T03:08:55.2406170Z 200 OK โ˜… 7ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:55.2407250Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:08:55.2408160Z โ”‚ { 2023-01-13T03:08:55.2409670Z โ”‚ "status": "Model \"resnet-18\" unregistered" 2023-01-13T03:08:55.2415360Z โ”‚ } 2023-01-13T03:08:55.2425970Z โ”” 2023-01-13T03:08:55.2426930Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:55.2428120Z 1ms 242ยตs (cache) (cache) 4ms 1ms 35ยตs 7ms 2023-01-13T03:08:55.2428670Z 2023-01-13T03:08:55.2495450Z โœ“ Successful request 2023-01-13T03:08:55.2525550Z 2023-01-13T03:08:55.2526210Z Iteration 46/82 2023-01-13T03:08:55.2539450Z 2023-01-13T03:08:55.2540320Z โ†’ management request 2023-01-13T03:08:57.1673150Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=false 2023-01-13T03:08:57.1674580Z 200 OK โ˜… 1906ms time โ˜… 309Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.1674990Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 138B 2023-01-13T03:08:57.1675270Z โ”‚ { 2023-01-13T03:08:57.1675620Z โ”‚ "status": "Model \"resnet-18\" Version: 1.0 register 2023-01-13T03:08:57.1676020Z โ”‚ ed with 0 initial workers. Use scale workers API to ad 2023-01-13T03:08:57.1676360Z โ”‚ d workers for the model." 2023-01-13T03:08:57.1676600Z โ”‚ } 2023-01-13T03:08:57.1693710Z โ”” 2023-01-13T03:08:57.1694510Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.1695050Z 1ms 247ยตs (cache) (cache) 1902ms 1ms 49ยตs 1907ms 2023-01-13T03:08:57.1695230Z 2023-01-13T03:08:57.1774100Z โœ“ Successful request 2023-01-13T03:08:57.1820420Z 2023-01-13T03:08:57.1820770Z Iteration 47/82 2023-01-13T03:08:57.1837280Z 2023-01-13T03:08:57.1837850Z โ†’ management request 2023-01-13T03:08:57.1948100Z GET http://localhost:8081/models?limit=1 2023-01-13T03:08:57.1948890Z 200 OK โ˜… 4ms time โ˜… 240Bโ†‘ 391Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.1949340Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 124B 2023-01-13T03:08:57.1949630Z โ”‚ { 2023-01-13T03:08:57.1949940Z โ”‚ "nextPageToken": "1", 2023-01-13T03:08:57.1950210Z โ”‚ "models": [ 2023-01-13T03:08:57.1950460Z โ”‚ { 2023-01-13T03:08:57.1950760Z โ”‚ "modelName": "resnet-18", 2023-01-13T03:08:57.1951080Z โ”‚ "modelUrl": "resnet-18.mar" 2023-01-13T03:08:57.1951350Z โ”‚ } 2023-01-13T03:08:57.1951570Z โ”‚ ] 2023-01-13T03:08:57.1951780Z โ”‚ } 2023-01-13T03:08:57.1970950Z โ”” 2023-01-13T03:08:57.1971650Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.1972150Z 1ms 241ยตs (cache) (cache) 1ms 1ms 36ยตs 5ms 2023-01-13T03:08:57.1972340Z 2023-01-13T03:08:57.2041430Z โœ“ Successful request 2023-01-13T03:08:57.2088220Z 2023-01-13T03:08:57.2088550Z Iteration 48/82 2023-01-13T03:08:57.2102930Z 2023-01-13T03:08:57.2103750Z โ†’ management request 2023-01-13T03:08:57.2212930Z GET http://localhost:8081/models?limit=-1 2023-01-13T03:08:57.2213540Z 200 OK โ˜… 4ms time โ˜… 241Bโ†‘ 367Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.2213970Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 100B 2023-01-13T03:08:57.2214260Z โ”‚ { 2023-01-13T03:08:57.2214500Z โ”‚ "models": [ 2023-01-13T03:08:57.2214750Z โ”‚ { 2023-01-13T03:08:57.2215050Z โ”‚ "modelName": "resnet-18", 2023-01-13T03:08:57.2215360Z โ”‚ "modelUrl": "resnet-18.mar" 2023-01-13T03:08:57.2215630Z โ”‚ } 2023-01-13T03:08:57.2215860Z โ”‚ ] 2023-01-13T03:08:57.2216070Z โ”‚ } 2023-01-13T03:08:57.2247800Z โ”” 2023-01-13T03:08:57.2248760Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.2249590Z 1ms 233ยตs (cache) (cache) 1ms 1ms 41ยตs 4ms 2023-01-13T03:08:57.2250290Z 2023-01-13T03:08:57.2329680Z โœ“ Successful request 2023-01-13T03:08:57.2366990Z 2023-01-13T03:08:57.2367580Z Iteration 49/82 2023-01-13T03:08:57.2383530Z 2023-01-13T03:08:57.2384340Z โ†’ management request 2023-01-13T03:08:57.2504620Z GET http://localhost:8081/models?limit=1&next_page_token=1 2023-01-13T03:08:57.2505470Z 200 OK โ˜… 5ms time โ˜… 258Bโ†‘ 285Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.2505870Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 19B 2023-01-13T03:08:57.2506160Z โ”‚ { 2023-01-13T03:08:57.2506410Z โ”‚ "models": [] 2023-01-13T03:08:57.2506640Z โ”‚ } 2023-01-13T03:08:57.2524790Z โ”” 2023-01-13T03:08:57.2525360Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.2525860Z 1ms 262ยตs (cache) (cache) 1ms 2ms 41ยตs 5ms 2023-01-13T03:08:57.2526050Z 2023-01-13T03:08:57.2594170Z โœ“ Successful request 2023-01-13T03:08:57.2643120Z 2023-01-13T03:08:57.2644070Z Iteration 50/82 2023-01-13T03:08:57.2660300Z 2023-01-13T03:08:57.2661050Z โ†’ management request 2023-01-13T03:08:57.2782130Z GET http://localhost:8081/models?limit=1&next_page_token=-1 2023-01-13T03:08:57.2783070Z 200 OK โ˜… 5ms time โ˜… 259Bโ†‘ 391Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.2783900Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 124B 2023-01-13T03:08:57.2784480Z โ”‚ { 2023-01-13T03:08:57.2785030Z โ”‚ "nextPageToken": "1", 2023-01-13T03:08:57.2785590Z โ”‚ "models": [ 2023-01-13T03:08:57.2786120Z โ”‚ { 2023-01-13T03:08:57.2786700Z โ”‚ "modelName": "resnet-18", 2023-01-13T03:08:57.2787300Z โ”‚ "modelUrl": "resnet-18.mar" 2023-01-13T03:08:57.2788200Z โ”‚ } 2023-01-13T03:08:57.2788850Z โ”‚ ] 2023-01-13T03:08:57.2789080Z โ”‚ } 2023-01-13T03:08:57.2802160Z โ”” 2023-01-13T03:08:57.2802710Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.2803240Z 1ms 267ยตs (cache) (cache) 1ms 2ms 38ยตs 5ms 2023-01-13T03:08:57.2803420Z 2023-01-13T03:08:57.2864020Z โœ“ Successful request 2023-01-13T03:08:57.2908830Z 2023-01-13T03:08:57.2909540Z Iteration 51/82 2023-01-13T03:08:57.2926400Z 2023-01-13T03:08:57.2926960Z โ†’ management request 2023-01-13T03:08:57.3069370Z PUT http://localhost:8081/models/resnet-18?number_gpu=10 2023-01-13T03:08:57.3173630Z 202 Accepted โ˜… 5ms time โ˜… 275Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.3275480Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:57.3352280Z โ”‚ { 2023-01-13T03:08:57.3353150Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:57.3353730Z โ”‚ } 2023-01-13T03:08:57.3363310Z โ”” 2023-01-13T03:08:57.3364180Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.3365010Z 1ms 342ยตs (cache) (cache) 2ms 1ms 44ยตs 5ms 2023-01-13T03:08:57.3365510Z 2023-01-13T03:08:57.3365910Z โœ“ Successful request 2023-01-13T03:08:57.3467820Z 2023-01-13T03:08:57.3569050Z Iteration 52/82 2023-01-13T03:08:57.3670210Z 2023-01-13T03:08:57.3783470Z โ†’ management request 2023-01-13T03:08:57.3885390Z PUT http://localhost:8081/models/resnet-18?number_gpu=-1 2023-01-13T03:08:57.3960600Z 202 Accepted โ˜… 4ms time โ˜… 275Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.3966840Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:57.3967480Z โ”‚ { 2023-01-13T03:08:57.3968150Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:57.3968450Z โ”‚ } 2023-01-13T03:08:57.3968650Z โ”” 2023-01-13T03:08:57.3969080Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.3969730Z 1ms 245ยตs (cache) (cache) 1ms 1ms 38ยตs 5ms 2023-01-13T03:08:57.3969900Z 2023-01-13T03:08:57.3970110Z โœ“ Successful request 2023-01-13T03:08:57.3970290Z 2023-01-13T03:08:57.3970370Z Iteration 53/82 2023-01-13T03:08:57.3970490Z 2023-01-13T03:08:57.3970650Z โ†’ management request 2023-01-13T03:08:57.3971120Z PUT http://localhost:8081/models/resnet-18?min_worker=1&max_worker=1&synchronous=true 2023-01-13T03:08:57.3972130Z 200 OK โ˜… 5ms time โ˜… 304Bโ†‘ 325Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.3972640Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 59B 2023-01-13T03:08:57.3972920Z โ”‚ { 2023-01-13T03:08:57.3973250Z โ”‚ "status": "Workers scaled to 1 for model: resnet-18" 2023-01-13T03:08:57.3973530Z โ”‚ } 2023-01-13T03:08:57.3973730Z โ”” 2023-01-13T03:08:57.3974140Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.3974620Z 1ms 304ยตs (cache) (cache) 2ms 1ms 38ยตs 6ms 2023-01-13T03:08:57.3974780Z 2023-01-13T03:08:57.3974950Z โœ“ Successful request 2023-01-13T03:08:57.3975090Z 2023-01-13T03:08:57.3975520Z Iteration 54/82 2023-01-13T03:08:57.3975640Z 2023-01-13T03:08:57.3975840Z โ†’ management request 2023-01-13T03:08:57.3976280Z PUT http://localhost:8081/models/resnet-18?min_worker=1&max_worker=1&synchronous=false 2023-01-13T03:08:57.3976780Z 202 Accepted โ˜… 4ms time โ˜… 305Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.3977170Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:57.3977460Z โ”‚ { 2023-01-13T03:08:57.3977770Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:57.3978160Z โ”‚ } 2023-01-13T03:08:57.3978370Z โ”” 2023-01-13T03:08:57.3978780Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.3979270Z 1ms 254ยตs (cache) (cache) 2ms 1ms 37ยตs 5ms 2023-01-13T03:08:57.3979420Z 2023-01-13T03:08:57.4030330Z โœ“ Successful request 2023-01-13T03:08:57.4131210Z 2023-01-13T03:08:57.4232290Z Iteration 55/82 2023-01-13T03:08:57.4333200Z 2023-01-13T03:08:57.4397090Z โ†’ management request 2023-01-13T03:08:57.4434980Z PUT http://localhost:8081/models/resnet-18?timeout=-1 2023-01-13T03:08:57.4445430Z 202 Accepted โ˜… 4ms time โ˜… 272Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.4446270Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:57.4446920Z โ”‚ { 2023-01-13T03:08:57.4447560Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:57.4448130Z โ”‚ } 2023-01-13T03:08:57.4448640Z โ”” 2023-01-13T03:08:57.4449370Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.4450160Z 1ms 251ยตs (cache) (cache) 1ms 1ms 40ยตs 5ms 2023-01-13T03:08:57.4450590Z 2023-01-13T03:08:57.4451000Z โœ“ Successful request 2023-01-13T03:08:57.4451390Z 2023-01-13T03:08:57.4451670Z Iteration 56/82 2023-01-13T03:08:57.4452000Z 2023-01-13T03:08:57.4452380Z โ†’ management request 2023-01-13T03:08:57.4471540Z PUT http://localhost:8081/models/resnet-18?timeout=0 2023-01-13T03:08:57.4473610Z 202 Accepted โ˜… 4ms time โ˜… 271Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.4474390Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:57.4474990Z โ”‚ { 2023-01-13T03:08:57.4475660Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:57.4476240Z โ”‚ } 2023-01-13T03:08:57.4491510Z โ”” 2023-01-13T03:08:57.4492430Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.4493260Z 1ms 256ยตs (cache) (cache) 1ms 1ms 40ยตs 4ms 2023-01-13T03:08:57.4493700Z 2023-01-13T03:08:57.4540200Z โœ“ Successful request 2023-01-13T03:08:57.4566110Z 2023-01-13T03:08:57.4566750Z Iteration 57/82 2023-01-13T03:08:57.4582930Z 2023-01-13T03:08:57.4583720Z โ†’ management request 2023-01-13T03:08:57.4699620Z POST http://localhost:8081/models?url=&model_name=resnet-18 2023-01-13T03:08:57.4801700Z 404 Not Found โ˜… 5ms time โ˜… 278Bโ†‘ 348Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:57.4903560Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 80B 2023-01-13T03:08:57.5005060Z โ”‚ { 2023-01-13T03:08:57.5261690Z โ”‚ "code": 404, 2023-01-13T03:08:57.5277910Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:08:57.5279210Z โ”‚ "message": "empty url" 2023-01-13T03:08:57.5279640Z โ”‚ } 2023-01-13T03:08:57.5279850Z โ”” 2023-01-13T03:08:57.5280290Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:57.5280780Z 1ms 250ยตs (cache) (cache) 1ms 1ms 50ยตs 5ms 2023-01-13T03:08:57.5280960Z 2023-01-13T03:08:57.5281160Z โœ“ Successful request 2023-01-13T03:08:57.5281300Z 2023-01-13T03:08:57.5281370Z Iteration 58/82 2023-01-13T03:08:57.5281490Z 2023-01-13T03:08:57.5281650Z โ†’ management request 2023-01-13T03:08:58.3920420Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/invalid-resnet-18.mar&model_name=invalid-resnet18 2023-01-13T03:08:58.4023240Z 400 Bad Request โ˜… 891ms time โ˜… 347Bโ†‘ 439Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.4125180Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 168B 2023-01-13T03:08:58.4226900Z โ”‚ { 2023-01-13T03:08:58.4328660Z โ”‚ "code": 400, 2023-01-13T03:08:58.4430530Z โ”‚ "type": "DownloadArchiveException", 2023-01-13T03:08:58.4532490Z โ”‚ "message": "Failed to download archive from: https:/ 2023-01-13T03:08:58.4634400Z โ”‚ /torchserve.pytorch.org/mar_files/invalid-resnet-18.ma 2023-01-13T03:08:58.4736080Z โ”‚ r" 2023-01-13T03:08:58.4837710Z โ”‚ } 2023-01-13T03:08:58.4939420Z โ”” 2023-01-13T03:08:58.5041650Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.5109240Z 4ms 2ms 328ยตs 339ยตs 885ms 1ms 58ยตs 894ms 2023-01-13T03:08:58.5113440Z 2023-01-13T03:08:58.5146130Z โœ“ Successful request 2023-01-13T03:08:58.5176010Z 2023-01-13T03:08:58.5211470Z Iteration 59/82 2023-01-13T03:08:58.5312540Z 2023-01-13T03:08:58.5367520Z โ†’ management request 2023-01-13T03:08:58.5371220Z GET http://localhost:8081/models/invalid_squeezenet1_1 2023-01-13T03:08:58.5372060Z 404 Not Found โ˜… 5ms time โ˜… 254Bโ†‘ 378Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.5372930Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 109B 2023-01-13T03:08:58.5373670Z โ”‚ { 2023-01-13T03:08:58.5374360Z โ”‚ "code": 404, 2023-01-13T03:08:58.5375070Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:08:58.5413180Z โ”‚ "message": "Model not found: invalid_squeezenet1_1" 2023-01-13T03:08:58.5473220Z โ”‚ } 2023-01-13T03:08:58.5546880Z โ”” 2023-01-13T03:08:58.5608920Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.5610060Z 2ms 718ยตs 222ยตs 211ยตs 2ms 1ms 51ยตs 6ms 2023-01-13T03:08:58.5610490Z 2023-01-13T03:08:58.5611090Z โœ“ Successful request 2023-01-13T03:08:58.5611520Z 2023-01-13T03:08:58.5611780Z Iteration 60/82 2023-01-13T03:08:58.5612120Z 2023-01-13T03:08:58.5612500Z โ†’ management request 2023-01-13T03:08:58.5613060Z GET http://localhost:8081/models/squeezenet1_1/0.0 2023-01-13T03:08:58.5613840Z 404 Not Found โ˜… 5ms time โ˜… 250Bโ†‘ 370Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.5614550Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 101B 2023-01-13T03:08:58.5615130Z โ”‚ { 2023-01-13T03:08:58.5615670Z โ”‚ "code": 404, 2023-01-13T03:08:58.5616280Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:08:58.5616930Z โ”‚ "message": "Model not found: squeezenet1_1" 2023-01-13T03:08:58.5617520Z โ”‚ } 2023-01-13T03:08:58.5618010Z โ”” 2023-01-13T03:08:58.5618720Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.5619480Z 1ms 668ยตs 221ยตs 204ยตs 1ms 1ms 41ยตs 5ms 2023-01-13T03:08:58.5619890Z 2023-01-13T03:08:58.5620300Z โœ“ Successful request 2023-01-13T03:08:58.5620670Z 2023-01-13T03:08:58.5620940Z Iteration 61/82 2023-01-13T03:08:58.5621270Z 2023-01-13T03:08:58.5621640Z โ†’ management request 2023-01-13T03:08:58.5628250Z GET http://localhost:8081/models?next_page_token=12 2023-01-13T03:08:58.5662310Z 200 OK โ˜… 5ms time โ˜… 251Bโ†‘ 285Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.5691010Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 19B 2023-01-13T03:08:58.5696300Z โ”‚ { 2023-01-13T03:08:58.5697090Z โ”‚ "models": [] 2023-01-13T03:08:58.5697640Z โ”‚ } 2023-01-13T03:08:58.5698150Z โ”” 2023-01-13T03:08:58.5699050Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.5699830Z 2ms 701ยตs 221ยตs 211ยตs 1ms 1ms 41ยตs 6ms 2023-01-13T03:08:58.5700230Z 2023-01-13T03:08:58.5700630Z โœ“ Successful request 2023-01-13T03:08:58.5701000Z 2023-01-13T03:08:58.5701270Z Iteration 62/82 2023-01-13T03:08:58.5702360Z 2023-01-13T03:08:58.5702770Z โ†’ management request 2023-01-13T03:08:58.5703490Z PUT http://localhost:8081/models/resnet-18?min_worker=1&synchronous=Nan 2023-01-13T03:08:58.5704290Z 202 Accepted โ˜… 4ms time โ˜… 290Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.5705010Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:58.5705590Z โ”‚ { 2023-01-13T03:08:58.5706190Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:58.5706760Z โ”‚ } 2023-01-13T03:08:58.5707250Z โ”” 2023-01-13T03:08:58.5707960Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.5708720Z 1ms 259ยตs (cache) (cache) 2ms 1ms 58ยตs 5ms 2023-01-13T03:08:58.5709200Z 2023-01-13T03:08:58.5715730Z โœ“ Successful request 2023-01-13T03:08:58.5716310Z 2023-01-13T03:08:58.5716600Z Iteration 63/82 2023-01-13T03:08:58.5716930Z 2023-01-13T03:08:58.5717320Z โ†’ management request 2023-01-13T03:08:58.5718090Z PUT http://localhost:8081/models/resnet-18?min_worker=nan&synchronous=nan 2023-01-13T03:08:58.5718860Z 202 Accepted โ˜… 4ms time โ˜… 292Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.5719790Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:58.5720370Z โ”‚ { 2023-01-13T03:08:58.5720980Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:58.5721570Z โ”‚ } 2023-01-13T03:08:58.5722070Z โ”” 2023-01-13T03:08:58.5722780Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.5723540Z 1ms 230ยตs (cache) (cache) 2ms 1ms 38ยตs 5ms 2023-01-13T03:08:58.5723960Z 2023-01-13T03:08:58.5724340Z โœ“ Successful request 2023-01-13T03:08:58.5724710Z 2023-01-13T03:08:58.5724990Z Iteration 64/82 2023-01-13T03:08:58.5725310Z 2023-01-13T03:08:58.5725680Z โ†’ management request 2023-01-13T03:08:58.5726330Z PUT http://localhost:8081/models/resnet-18 2023-01-13T03:08:58.5727080Z 202 Accepted โ˜… 4ms time โ˜… 261Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.5727780Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:58.5728350Z โ”‚ { 2023-01-13T03:08:58.5729690Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:58.5737660Z โ”‚ } 2023-01-13T03:08:58.5738420Z โ”” 2023-01-13T03:08:58.5739180Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.5739950Z 1ms 255ยตs (cache) (cache) 1ms 1ms 38ยตs 5ms 2023-01-13T03:08:58.5740390Z 2023-01-13T03:08:58.5740940Z โœ“ Successful request 2023-01-13T03:08:58.5741340Z 2023-01-13T03:08:58.5741610Z Iteration 65/82 2023-01-13T03:08:58.5741940Z 2023-01-13T03:08:58.5742310Z โ†’ management request 2023-01-13T03:08:58.5809970Z PUT http://localhost:8081/models/resnet181?min_worker=1 2023-01-13T03:08:58.5859560Z 404 Not Found โ˜… 4ms time โ˜… 274Bโ†‘ 365Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.5893450Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 97B 2023-01-13T03:08:58.5927630Z โ”‚ { 2023-01-13T03:08:58.5928500Z โ”‚ "code": 404, 2023-01-13T03:08:58.5929210Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:08:58.5929900Z โ”‚ "message": "Model not found: resnet181" 2023-01-13T03:08:58.5930990Z โ”‚ } 2023-01-13T03:08:58.5931570Z โ”” 2023-01-13T03:08:58.5932320Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.5933120Z 1ms 249ยตs (cache) (cache) 1ms 1ms 41ยตs 4ms 2023-01-13T03:08:58.5933530Z 2023-01-13T03:08:58.5934050Z โœ“ Successful request 2023-01-13T03:08:58.5943000Z 2023-01-13T03:08:58.5943790Z Iteration 66/82 2023-01-13T03:08:58.5960910Z 2023-01-13T03:08:58.5961960Z โ†’ management request 2023-01-13T03:08:58.6138550Z PUT http://localhost:8081/models/resnet-18?min_worker=2&max_worker=1 2023-01-13T03:08:58.6240370Z 400 Bad Request โ˜… 8ms time โ˜… 287Bโ†‘ 381Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.6342080Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 110B 2023-01-13T03:08:58.6362480Z โ”‚ { 2023-01-13T03:08:58.6401810Z โ”‚ "code": 400, 2023-01-13T03:08:58.6477100Z โ”‚ "type": "BadRequestException", 2023-01-13T03:08:58.6564390Z โ”‚ "message": "max_worker cannot be less than min_worke 2023-01-13T03:08:58.6565160Z โ”‚ r." 2023-01-13T03:08:58.6565700Z โ”‚ } 2023-01-13T03:08:58.6566380Z โ”” 2023-01-13T03:08:58.6567130Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.6568140Z 3ms 657ยตs 278ยตs 742ยตs 4ms 1ms 44ยตs 10ms 2023-01-13T03:08:58.6568580Z 2023-01-13T03:08:58.6568990Z โœ“ Successful request 2023-01-13T03:08:58.6569370Z 2023-01-13T03:08:58.6569640Z Iteration 67/82 2023-01-13T03:08:58.6569970Z 2023-01-13T03:08:58.6570330Z โ†’ management request 2023-01-13T03:08:58.6667620Z PUT http://localhost:8081/models/resnet-18?min_worker=1 2023-01-13T03:08:58.6704530Z 202 Accepted โ˜… 5ms time โ˜… 274Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.6705370Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:58.6705960Z โ”‚ { 2023-01-13T03:08:58.6706610Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:58.6707220Z โ”‚ } 2023-01-13T03:08:58.6708050Z โ”” 2023-01-13T03:08:58.6708940Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.6709750Z 1ms 639ยตs 209ยตs 242ยตs 2ms 1ms 37ยตs 5ms 2023-01-13T03:08:58.6710180Z 2023-01-13T03:08:58.6749010Z โœ“ Successful request 2023-01-13T03:08:58.6794590Z 2023-01-13T03:08:58.6795370Z Iteration 68/82 2023-01-13T03:08:58.6814430Z 2023-01-13T03:08:58.6821590Z โ†’ management request 2023-01-13T03:08:58.7270490Z PUT http://localhost:8081/models/resnet-18?min_worker=0 2023-01-13T03:08:58.7271090Z 202 Accepted โ˜… 24ms time โ˜… 274Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.7271640Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:08:58.7272620Z โ”‚ { 2023-01-13T03:08:58.7273050Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:08:58.7273340Z โ”‚ } 2023-01-13T03:08:58.7295760Z โ”” 2023-01-13T03:08:58.7296840Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.7297460Z 1ms 272ยตs (cache) (cache) 21ms 1ms 43ยตs 25ms 2023-01-13T03:08:58.7297640Z 2023-01-13T03:08:58.7364880Z โœ“ Successful request 2023-01-13T03:08:58.7413130Z 2023-01-13T03:08:58.7413460Z Iteration 69/82 2023-01-13T03:08:58.7530010Z 2023-01-13T03:08:58.7530900Z โ†’ management request 2023-01-13T03:08:58.8194320Z PUT http://localhost:8081/models/resnet-18?min_worker=-1 2023-01-13T03:08:58.8296430Z 500 Internal Server Error โ˜… 52ms time โ˜… 275Bโ†‘ 390Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.8398230Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 109B 2023-01-13T03:08:58.8500430Z โ”‚ { 2023-01-13T03:08:58.8542360Z โ”‚ "code": 500, 2023-01-13T03:08:58.8543200Z โ”‚ "type": "IndexOutOfBoundsException", 2023-01-13T03:08:58.8543910Z โ”‚ "message": "Index -1 out of bounds for length 0" 2023-01-13T03:08:58.8545040Z โ”‚ } 2023-01-13T03:08:58.8545660Z โ”” 2023-01-13T03:08:58.8546440Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.8547840Z 1ms 260ยตs (cache) (cache) 49ms 1ms 40ยตs 52ms 2023-01-13T03:08:58.8549290Z 2023-01-13T03:08:58.8549750Z โœ“ Successful request 2023-01-13T03:08:58.8550150Z 2023-01-13T03:08:58.8550440Z Iteration 70/82 2023-01-13T03:08:58.8550790Z 2023-01-13T03:08:58.8551180Z โ†’ management request 2023-01-13T03:08:58.8552140Z PUT http://localhost:8081/models/resnet-18?max_worker=-1 2023-01-13T03:08:58.8552940Z 400 Bad Request โ˜… 6ms time โ˜… 275Bโ†‘ 381Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.8553940Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 110B 2023-01-13T03:08:58.8554310Z โ”‚ { 2023-01-13T03:08:58.8554990Z โ”‚ "code": 400, 2023-01-13T03:08:58.8555330Z โ”‚ "type": "BadRequestException", 2023-01-13T03:08:58.8555720Z โ”‚ "message": "max_worker cannot be less than min_worke 2023-01-13T03:08:58.8556020Z โ”‚ r." 2023-01-13T03:08:58.8556250Z โ”‚ } 2023-01-13T03:08:58.8556460Z โ”” 2023-01-13T03:08:58.8556870Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.8557350Z 1ms 624ยตs 214ยตs 421ยตs 1ms 2ms 47ยตs 6ms 2023-01-13T03:08:58.8557520Z 2023-01-13T03:08:58.8557690Z โœ“ Successful request 2023-01-13T03:08:58.8557830Z 2023-01-13T03:08:58.8557910Z Iteration 71/82 2023-01-13T03:08:58.8558030Z 2023-01-13T03:08:58.8558180Z โ†’ management request 2023-01-13T03:08:58.8754460Z PUT http://localhost:8081/models/invalid_squeezenet1_1/1.0/set-default 2023-01-13T03:08:58.8856360Z 404 Not Found โ˜… 10ms time โ˜… 289Bโ†‘ 378Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.8929450Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 109B 2023-01-13T03:08:58.8930140Z โ”‚ { 2023-01-13T03:08:58.8930720Z โ”‚ "code": 404, 2023-01-13T03:08:58.8931380Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:08:58.8932090Z โ”‚ "message": "Model not found: invalid_squeezenet1_1" 2023-01-13T03:08:58.8932660Z โ”‚ } 2023-01-13T03:08:58.8933160Z โ”” 2023-01-13T03:08:58.8933880Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.8934650Z 1ms 776ยตs 214ยตs 229ยตs 1ms 6ms 48ยตs 10ms 2023-01-13T03:08:58.8935070Z 2023-01-13T03:08:58.8935470Z โœ“ Successful request 2023-01-13T03:08:58.8935970Z 2023-01-13T03:08:58.8936250Z Iteration 72/82 2023-01-13T03:08:58.8936580Z 2023-01-13T03:08:58.8940430Z โ†’ management request 2023-01-13T03:08:58.9080100Z DELETE http://localhost:8081/models/resnet-18 2023-01-13T03:08:58.9181910Z 200 OK โ˜… 9ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.9263750Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:08:58.9277680Z โ”‚ { 2023-01-13T03:08:58.9280810Z โ”‚ "status": "Model \"resnet-18\" unregistered" 2023-01-13T03:08:58.9334610Z โ”‚ } 2023-01-13T03:08:58.9578550Z โ”” 2023-01-13T03:08:58.9688460Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.9790230Z 1ms 723ยตs 919ยตs 372ยตs 5ms 1ms 45ยตs 10ms 2023-01-13T03:08:58.9795910Z 2023-01-13T03:08:58.9800850Z โœ“ Successful request 2023-01-13T03:08:58.9802040Z 2023-01-13T03:08:58.9803230Z Iteration 73/82 2023-01-13T03:08:58.9803410Z 2023-01-13T03:08:58.9803670Z โ†’ management request 2023-01-13T03:08:58.9804000Z DELETE http://localhost:8081/models/squeezenet1_1/0.0 2023-01-13T03:08:58.9804490Z 404 Not Found โ˜… 7ms time โ˜… 253Bโ†‘ 370Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:58.9805410Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 101B 2023-01-13T03:08:58.9805700Z โ”‚ { 2023-01-13T03:08:58.9805950Z โ”‚ "code": 404, 2023-01-13T03:08:58.9806270Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:08:58.9806650Z โ”‚ "message": "Model not found: squeezenet1_1" 2023-01-13T03:08:58.9806930Z โ”‚ } 2023-01-13T03:08:58.9807140Z โ”” 2023-01-13T03:08:58.9807560Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:58.9808050Z 1ms 453ยตs (cache) (cache) 2ms 3ms 45ยตs 8ms 2023-01-13T03:08:58.9808220Z 2023-01-13T03:08:58.9808390Z โœ“ Successful request 2023-01-13T03:08:58.9808530Z 2023-01-13T03:08:58.9808610Z Iteration 74/82 2023-01-13T03:08:58.9808720Z 2023-01-13T03:08:58.9808880Z โ†’ management request 2023-01-13T03:08:59.2093030Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:08:59.2095150Z 200 OK โ˜… 244ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:59.2096100Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:08:59.2096800Z โ”‚ { 2023-01-13T03:08:59.2097570Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:08:59.2098410Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:08:59.2099170Z โ”‚ o add workers for the model." 2023-01-13T03:08:59.2099860Z โ”‚ } 2023-01-13T03:08:59.2120980Z โ”” 2023-01-13T03:08:59.2122040Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:59.2122590Z 1ms 632ยตs 212ยตs 719ยตs 240ms 1ms 41ยตs 245ms 2023-01-13T03:08:59.2122770Z 2023-01-13T03:08:59.2192840Z โœ“ Successful request 2023-01-13T03:08:59.2236290Z 2023-01-13T03:08:59.2236850Z Iteration 75/82 2023-01-13T03:08:59.2252400Z 2023-01-13T03:08:59.2253110Z โ†’ management request 2023-01-13T03:08:59.2382970Z DELETE http://localhost:8081/models/squeezenet1_1/?synchronous=true 2023-01-13T03:08:59.2383840Z 200 OK โ˜… 6ms time โ˜… 267Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:59.2384250Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:08:59.2384550Z โ”‚ { 2023-01-13T03:08:59.2385380Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:08:59.2385700Z โ”‚ } 2023-01-13T03:08:59.2404280Z โ”” 2023-01-13T03:08:59.2404850Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:59.2405350Z 1ms 253ยตs (cache) (cache) 3ms 1ms 37ยตs 6ms 2023-01-13T03:08:59.2405530Z 2023-01-13T03:08:59.2465830Z โœ“ Successful request 2023-01-13T03:08:59.2515870Z 2023-01-13T03:08:59.2516590Z Iteration 76/82 2023-01-13T03:08:59.2532430Z 2023-01-13T03:08:59.2533420Z โ†’ management request 2023-01-13T03:08:59.5059640Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:08:59.5060480Z 200 OK โ˜… 246ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:59.5060900Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:08:59.5061180Z โ”‚ { 2023-01-13T03:08:59.5061510Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:08:59.5062510Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:08:59.5062950Z โ”‚ o add workers for the model." 2023-01-13T03:08:59.5063220Z โ”‚ } 2023-01-13T03:08:59.5076900Z โ”” 2023-01-13T03:08:59.5077410Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:59.5078110Z 1ms 316ยตs (cache) (cache) 243ms 1ms 36ยตs 246ms 2023-01-13T03:08:59.5078310Z 2023-01-13T03:08:59.5136300Z โœ“ Successful request 2023-01-13T03:08:59.5175200Z 2023-01-13T03:08:59.5175920Z Iteration 77/82 2023-01-13T03:08:59.5191470Z 2023-01-13T03:08:59.5192300Z โ†’ management request 2023-01-13T03:08:59.5318330Z DELETE http://localhost:8081/models/squeezenet1_1/?synchronous=nan 2023-01-13T03:08:59.5319670Z 200 OK โ˜… 6ms time โ˜… 266Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:59.5320490Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:08:59.5321150Z โ”‚ { 2023-01-13T03:08:59.5321900Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:08:59.5322550Z โ”‚ } 2023-01-13T03:08:59.5337020Z โ”” 2023-01-13T03:08:59.5337600Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:59.5338340Z 1ms 224ยตs (cache) (cache) 3ms 1ms 40ยตs 6ms 2023-01-13T03:08:59.5338540Z 2023-01-13T03:08:59.5394730Z โœ“ Successful request 2023-01-13T03:08:59.5431410Z 2023-01-13T03:08:59.5431760Z Iteration 78/82 2023-01-13T03:08:59.5445750Z 2023-01-13T03:08:59.5448450Z โ†’ management request 2023-01-13T03:08:59.7657670Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:08:59.7659080Z 200 OK โ˜… 215ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:59.7659930Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:08:59.7660600Z โ”‚ { 2023-01-13T03:08:59.7661330Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:08:59.7662110Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:08:59.7662860Z โ”‚ o add workers for the model." 2023-01-13T03:08:59.7663500Z โ”‚ } 2023-01-13T03:08:59.7677500Z โ”” 2023-01-13T03:08:59.7678610Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:59.7679530Z 1ms 258ยตs (cache) (cache) 212ms 1ms 44ยตs 215ms 2023-01-13T03:08:59.7680040Z 2023-01-13T03:08:59.7738340Z โœ“ Successful request 2023-01-13T03:08:59.7778760Z 2023-01-13T03:08:59.7779040Z Iteration 79/82 2023-01-13T03:08:59.7796130Z 2023-01-13T03:08:59.7796750Z โ†’ management request 2023-01-13T03:08:59.7958000Z DELETE http://localhost:8081/models/squeezenet1_1/?timeout=true 2023-01-13T03:08:59.7959250Z 200 OK โ˜… 8ms time โ˜… 263Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:08:59.7960280Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:08:59.7960600Z โ”‚ { 2023-01-13T03:08:59.7960970Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:08:59.7961270Z โ”‚ } 2023-01-13T03:08:59.7961470Z โ”” 2023-01-13T03:08:59.7961900Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:08:59.7962390Z 1ms 254ยตs (cache) (cache) 5ms 1ms 39ยตs 8ms 2023-01-13T03:08:59.7962560Z 2023-01-13T03:08:59.8017270Z โœ“ Successful request 2023-01-13T03:08:59.8058000Z 2023-01-13T03:08:59.8058340Z Iteration 80/82 2023-01-13T03:08:59.8075170Z 2023-01-13T03:08:59.8075810Z โ†’ management request 2023-01-13T03:09:00.0287870Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:09:00.0288760Z 200 OK โ˜… 212ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:00.0289170Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:09:00.0289460Z โ”‚ { 2023-01-13T03:09:00.0290410Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:09:00.0290910Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:09:00.0291270Z โ”‚ o add workers for the model." 2023-01-13T03:09:00.0291540Z โ”‚ } 2023-01-13T03:09:00.0291750Z โ”” 2023-01-13T03:09:00.0292160Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:00.0292650Z 1ms 244ยตs (cache) (cache) 209ms 1ms 62ยตs 213ms 2023-01-13T03:09:00.0292820Z 2023-01-13T03:09:00.0346870Z โœ“ Successful request 2023-01-13T03:09:00.0386940Z 2023-01-13T03:09:00.0387830Z Iteration 81/82 2023-01-13T03:09:00.0405590Z 2023-01-13T03:09:00.0406770Z โ†’ management request 2023-01-13T03:09:00.0527090Z DELETE http://localhost:8081/models/squeezenet1_1/?timeout=true&synchronous=-1 2023-01-13T03:09:00.0528230Z 200 OK โ˜… 6ms time โ˜… 278Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:00.0529040Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:09:00.0529730Z โ”‚ { 2023-01-13T03:09:00.0530460Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:09:00.0531110Z โ”‚ } 2023-01-13T03:09:00.0555870Z โ”” 2023-01-13T03:09:00.0558980Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:00.0559910Z 1ms 237ยตs (cache) (cache) 3ms 1ms 40ยตs 6ms 2023-01-13T03:09:00.0560430Z 2023-01-13T03:09:00.0621470Z โœ“ Successful request 2023-01-13T03:09:00.0659510Z 2023-01-13T03:09:00.0659910Z Iteration 82/82 2023-01-13T03:09:00.0676820Z 2023-01-13T03:09:00.0677700Z โ†’ management request 2023-01-13T03:09:00.0792440Z DELETE http://localhost:8081/models/invalid_squeezenet1_1 2023-01-13T03:09:00.0793790Z 404 Not Found โ˜… 4ms time โ˜… 257Bโ†‘ 378Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:00.0794640Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 109B 2023-01-13T03:09:00.0795290Z โ”‚ { 2023-01-13T03:09:00.0795920Z โ”‚ "code": 404, 2023-01-13T03:09:00.0796640Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:09:00.0797430Z โ”‚ "message": "Model not found: invalid_squeezenet1_1" 2023-01-13T03:09:00.0798080Z โ”‚ } 2023-01-13T03:09:00.0811300Z โ”” 2023-01-13T03:09:00.0812260Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:00.0813160Z 1ms 241ยตs (cache) (cache) 2ms 1ms 43ยตs 5ms 2023-01-13T03:09:00.0813640Z 2023-01-13T03:09:00.0865450Z โœ“ Successful request 2023-01-13T03:09:00.0973620Z 2023-01-13T03:09:00.0974770Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:09:00.0975600Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:09:00.0976380Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0977150Z โ”‚ iterations โ”‚ 82 โ”‚ 0 โ”‚ 2023-01-13T03:09:00.0978980Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0979840Z โ”‚ requests โ”‚ 82 โ”‚ 0 โ”‚ 2023-01-13T03:09:00.0980630Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0981380Z โ”‚ test-scripts โ”‚ 82 โ”‚ 0 โ”‚ 2023-01-13T03:09:00.0982170Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0982930Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:09:00.0983680Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0984380Z โ”‚ assertions โ”‚ 82 โ”‚ 0 โ”‚ 2023-01-13T03:09:00.0985500Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0986240Z โ”‚ total run duration: 1m 17.4s โ”‚ 2023-01-13T03:09:00.0987040Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0987800Z โ”‚ total data received: 7.75kB (approx) โ”‚ 2023-01-13T03:09:00.0988580Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0989350Z โ”‚ average response time: 915ms [min: 4ms, max: 20.1s, s.d.: 3.2s] โ”‚ 2023-01-13T03:09:00.0990130Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0990880Z โ”‚ average DNS lookup time: 1ms [min: 209ยตs, max: 2ms, s.d.: 940ยตs] โ”‚ 2023-01-13T03:09:00.0991650Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:09:00.0992400Z โ”‚ average first byte time: 912ms [min: 1ms, max: 20.1s, s.d.: 3.2s] โ”‚ 2023-01-13T03:09:00.0993190Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:09:00.2853850Z TorchServe has stopped. 2023-01-13T03:09:21.9964490Z newman: could not find "htmlextra" reporter 2023-01-13T03:09:22.0065070Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:09:22.0098290Z please install reporter using npm 2023-01-13T03:09:22.0199310Z 2023-01-13T03:09:22.2886820Z newman 2023-01-13T03:09:22.2986830Z 2023-01-13T03:09:22.3087630Z inference 2023-01-13T03:09:22.3188140Z 2023-01-13T03:09:22.3289510Z Iteration 1/24 2023-01-13T03:09:22.3389580Z 2023-01-13T03:09:22.3491330Z โ†’ Model Zoo - Register Model 2023-01-13T03:09:40.2247960Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/my_text_classifier_v4.mar&model_name=my_text_classifier&initial_workers=1&synchronous=true 2023-01-13T03:09:40.2311200Z 200 OK โ˜… 17.8s time โ˜… 388Bโ†‘ 360Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:40.2395330Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 94B 2023-01-13T03:09:40.2462460Z โ”‚ { 2023-01-13T03:09:40.2536590Z โ”‚ "status": "Model \"my_text_classifier\" Version: 1.0 2023-01-13T03:09:40.2581900Z โ”‚ registered with 1 initial workers" 2023-01-13T03:09:40.2627190Z โ”‚ } 2023-01-13T03:09:40.2653360Z โ”” 2023-01-13T03:09:40.2681310Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:40.2719470Z 77ms 16ms 2ms 2ms 17.7s 10ms 674ยตs 17.8s 2023-01-13T03:09:40.2725650Z 2023-01-13T03:09:40.2750490Z โœ“ Successful POST request 2023-01-13T03:09:40.2781080Z 2023-01-13T03:09:40.2812520Z โ†’ Model Zoo - Inference Model 2023-01-13T03:09:40.3434240Z POST http://localhost:8080/predictions/my_text_classifier 2023-01-13T03:09:40.3435520Z 200 OK โ˜… 42ms time โ˜… 353Bโ†‘ 372Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:40.3436350Z โ”Œ โ†‘ file โ˜… 76B 2023-01-13T03:09:40.3437090Z โ”‚ 2023-01-13T03:09:40.3437730Z โ”” 2023-01-13T03:09:40.3439320Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 137B 2023-01-13T03:09:40.3440010Z โ”‚ { 2023-01-13T03:09:40.3440710Z โ”‚ "World": 0.02911965921521187, 2023-01-13T03:09:40.3441450Z โ”‚ "Sports": 2.943157232948579e-05, 2023-01-13T03:09:40.3442190Z โ”‚ "Business": 0.9074352383613586, 2023-01-13T03:09:40.3442940Z โ”‚ "Sci/Tec": 0.06341567635536194 2023-01-13T03:09:40.3443590Z โ”‚ } 2023-01-13T03:09:40.3496460Z โ”” 2023-01-13T03:09:40.3497020Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:40.3497520Z 12ms 1ms 834ยตs 392ยตs 35ms 3ms 72ยตs 54ms 2023-01-13T03:09:40.3497670Z 2023-01-13T03:09:40.3629270Z โœ“ Successful POST request 2023-01-13T03:09:40.3645830Z โœ“ Test expected JSON response 2023-01-13T03:09:40.3791800Z 2023-01-13T03:09:40.3792800Z โ†’ Model Zoo - Unregister model 2023-01-13T03:09:40.4309980Z DELETE http://localhost:8081/models/my_text_classifier 2023-01-13T03:09:40.4311060Z 200 OK โ˜… 43ms time โ˜… 254Bโ†‘ 326Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:40.4311660Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 60B 2023-01-13T03:09:40.4318290Z โ”‚ { 2023-01-13T03:09:40.4318670Z โ”‚ "status": "Model \"my_text_classifier\" unregistered 2023-01-13T03:09:40.4318990Z โ”‚ " 2023-01-13T03:09:40.4319210Z โ”‚ } 2023-01-13T03:09:40.4351910Z โ”” 2023-01-13T03:09:40.4352390Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:40.4352870Z 2ms 767ยตs (cache) (cache) 38ms 2ms 124ยตs 44ms 2023-01-13T03:09:40.4353050Z 2023-01-13T03:09:40.4450190Z โœ“ Successful DELETE request 2023-01-13T03:09:40.4539510Z 2023-01-13T03:09:40.4540610Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:09:40.4821490Z GET http://localhost:8082/metrics 2023-01-13T03:09:40.4822270Z 200 OK โ˜… 20ms time โ˜… 233Bโ†‘ 1.08kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:40.4822950Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 792B 2023-01-13T03:09:40.4823410Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:09:40.4823750Z โ”‚ erence requests. 2023-01-13T03:09:40.4824080Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:09:40.4824490Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:09:40.4824900Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:09:40.4825220Z โ”‚ l_version="default",} 1.0 2023-01-13T03:09:40.4825590Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:09:40.4825930Z โ”‚ duration in microseconds 2023-01-13T03:09:40.4826290Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:09:40.4826670Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:09:40.4827060Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier",mo 2023-01-13T03:09:40.4827400Z โ”‚ del_version="default",} 163.804 2023-01-13T03:09:40.4827770Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:09:40.4828130Z โ”‚ ference duration in microseconds 2023-01-13T03:09:40.4828500Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:09:40.4828890Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:09:40.4829800Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="my_text_classifier 2023-01-13T03:09:40.4830250Z โ”‚ ",model_version="default",} 7778.34 2023-01-13T03:09:40.4859810Z โ”” 2023-01-13T03:09:40.4860420Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:40.4860990Z 1ms 800ยตs 627ยตs 211ยตs 16ms 1ms 80ยตs 21ms 2023-01-13T03:09:40.4861160Z 2023-01-13T03:09:40.4933970Z โœ“ Successful GET request 2023-01-13T03:09:40.5001420Z 2023-01-13T03:09:40.5002150Z Iteration 2/24 2023-01-13T03:09:40.5021180Z 2023-01-13T03:09:40.5022040Z โ†’ Model Zoo - Register Model 2023-01-13T03:09:57.3464300Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/my_text_classifier_scripted_v3.mar&model_name=my_text_classifier_scripted&initial_workers=1&synchronous=true 2023-01-13T03:09:57.3567840Z 200 OK โ˜… 16.8s time โ˜… 406Bโ†‘ 370Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:57.3667980Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 103B 2023-01-13T03:09:57.3770100Z โ”‚ { 2023-01-13T03:09:57.3872040Z โ”‚ "status": "Model \"my_text_classifier_scripted\" Ver 2023-01-13T03:09:57.3972410Z โ”‚ sion: 1.0 registered with 1 initial workers" 2023-01-13T03:09:57.4073900Z โ”‚ } 2023-01-13T03:09:57.4119100Z โ”” 2023-01-13T03:09:57.4220000Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:57.4320990Z 2ms 336ยตs (cache) (cache) 16.8s 1ms 83ยตs 16.8s 2023-01-13T03:09:57.4421230Z 2023-01-13T03:09:57.4522540Z โœ“ Successful POST request 2023-01-13T03:09:57.4622950Z 2023-01-13T03:09:57.4724320Z โ†’ Model Zoo - Inference Model 2023-01-13T03:09:57.4824990Z POST http://localhost:8080/predictions/my_text_classifier_scripted 2023-01-13T03:09:57.4927810Z 200 OK โ˜… 79ms time โ˜… 362Bโ†‘ 372Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:57.5029490Z โ”Œ โ†‘ file โ˜… 76B 2023-01-13T03:09:57.5130630Z โ”‚ 2023-01-13T03:09:57.5232110Z โ”” 2023-01-13T03:09:57.5333750Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 137B 2023-01-13T03:09:57.5435350Z โ”‚ { 2023-01-13T03:09:57.5535790Z โ”‚ "World": 0.04559723287820816, 2023-01-13T03:09:57.5637350Z โ”‚ "Sports": 0.0003771767660509795, 2023-01-13T03:09:57.5739170Z โ”‚ "Business": 0.08623101562261581, 2023-01-13T03:09:57.5840790Z โ”‚ "Sci/Tec": 0.8677946329116821 2023-01-13T03:09:57.5941130Z โ”‚ } 2023-01-13T03:09:57.6042820Z โ”” 2023-01-13T03:09:57.6143340Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:57.6245240Z 3ms 402ยตs (cache) (cache) 75ms 2ms 75ยตs 82ms 2023-01-13T03:09:57.6346230Z 2023-01-13T03:09:57.6447760Z โœ“ Successful POST request 2023-01-13T03:09:57.6548110Z โœ“ Test expected JSON response 2023-01-13T03:09:57.6649070Z 2023-01-13T03:09:57.6750260Z โ†’ Model Zoo - Unregister model 2023-01-13T03:09:57.6850530Z DELETE http://localhost:8081/models/my_text_classifier_scripted 2023-01-13T03:09:57.6952390Z 200 OK โ˜… 50ms time โ˜… 263Bโ†‘ 335Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:57.7020980Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 69B 2023-01-13T03:09:57.7122570Z โ”‚ { 2023-01-13T03:09:57.7223080Z โ”‚ "status": "Model \"my_text_classifier_scripted\" unr 2023-01-13T03:09:57.7319360Z โ”‚ egistered" 2023-01-13T03:09:57.7420790Z โ”‚ } 2023-01-13T03:09:57.7489840Z โ”” 2023-01-13T03:09:57.7591590Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:57.7692060Z 2ms 337ยตs (cache) (cache) 46ms 2ms 57ยตs 51ms 2023-01-13T03:09:57.7801320Z 2023-01-13T03:09:57.7902970Z โœ“ Successful DELETE request 2023-01-13T03:09:57.8002910Z 2023-01-13T03:09:57.8052730Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:09:57.8153860Z GET http://localhost:8082/metrics 2023-01-13T03:09:57.8254840Z 200 OK โ˜… 6ms time โ˜… 233Bโ†‘ 1.53kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:09:57.8356330Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 1.24kB 2023-01-13T03:09:57.8456850Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:09:57.8558210Z โ”‚ erence requests. 2023-01-13T03:09:57.8657310Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:09:57.8732450Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:09:57.8794680Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:09:57.8888940Z โ”‚ l_version="default",} 1.0 2023-01-13T03:09:57.8978210Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:09:57.9060680Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:09:57.9130510Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:09:57.9232680Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:09:57.9328550Z โ”‚ duration in microseconds 2023-01-13T03:09:57.9430550Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:09:57.9528450Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:09:57.9630210Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier",mo 2023-01-13T03:09:57.9731730Z โ”‚ del_version="default",} 163.804 2023-01-13T03:09:57.9833860Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:09:57.9935580Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier_scr 2023-01-13T03:09:58.0034350Z โ”‚ ipted",model_version="default",} 101.152 2023-01-13T03:09:58.0136220Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:09:58.0238950Z โ”‚ ference duration in microseconds 2023-01-13T03:09:58.0340610Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:09:58.0442250Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:09:58.0500540Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="my_text_classifier 2023-01-13T03:09:58.0602130Z โ”‚ ",model_version="default",} 7778.34 2023-01-13T03:09:58.0701480Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:09:58.0803190Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="my_text_classifier 2023-01-13T03:09:58.0879420Z โ”‚ _scripted",model_version="default",} 73592.371 2023-01-13T03:09:58.0976420Z โ”” 2023-01-13T03:09:58.1046350Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:09:58.1118080Z 2ms 382ยตs (cache) (cache) 2ms 1ms 71ยตs 7ms 2023-01-13T03:09:58.1218940Z 2023-01-13T03:09:58.1293760Z โœ“ Successful GET request 2023-01-13T03:09:58.1394670Z 2023-01-13T03:09:58.1497350Z Iteration 3/24 2023-01-13T03:09:58.1598220Z 2023-01-13T03:09:58.1699570Z โ†’ Model Zoo - Register Model 2023-01-13T03:10:01.2425980Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&initial_workers=1&synchronous=true 2023-01-13T03:10:01.2458830Z 200 OK โ˜… 3.6s time โ˜… 334Bโ†‘ 355Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:01.2461700Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 89B 2023-01-13T03:10:01.2467980Z โ”‚ { 2023-01-13T03:10:01.2489800Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:10:01.2517960Z โ”‚ stered with 1 initial workers" 2023-01-13T03:10:01.2583550Z โ”‚ } 2023-01-13T03:10:01.2610360Z โ”” 2023-01-13T03:10:01.2613520Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:01.2614530Z 3ms 375ยตs (cache) (cache) 3.6s 2ms 54ยตs 3.6s 2023-01-13T03:10:01.2615100Z 2023-01-13T03:10:01.2615790Z โœ“ Successful POST request 2023-01-13T03:10:01.2644830Z 2023-01-13T03:10:01.2646170Z โ†’ Model Zoo - Inference Model 2023-01-13T03:10:01.3646260Z POST http://localhost:8080/predictions/squeezenet1_1 2023-01-13T03:10:01.3686190Z 200 OK โ˜… 91ms time โ˜… 111.25kBโ†‘ 408Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:01.3687380Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:10:01.3688090Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:10:01.3789350Z โ”” 2023-01-13T03:10:01.3867780Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 173B 2023-01-13T03:10:01.3869170Z โ”‚ { 2023-01-13T03:10:01.3870210Z โ”‚ "tabby": 0.27850812673568726, 2023-01-13T03:10:01.3878460Z โ”‚ "lynx": 0.252991259098053, 2023-01-13T03:10:01.3879350Z โ”‚ "tiger_cat": 0.24496448040008545, 2023-01-13T03:10:01.3880260Z โ”‚ "Egyptian_cat": 0.21722444891929626, 2023-01-13T03:10:01.3881120Z โ”‚ "cougar": 0.0022175461053848267 2023-01-13T03:10:01.3882150Z โ”‚ } 2023-01-13T03:10:01.3883120Z โ”” 2023-01-13T03:10:01.3893770Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:01.3895140Z 3ms 515ยตs (cache) (cache) 88ms 1ms 45ยตs 94ms 2023-01-13T03:10:01.3896710Z 2023-01-13T03:10:01.3898120Z โœ“ Successful POST request 2023-01-13T03:10:01.3903370Z โœ“ Test expected JSON response 2023-01-13T03:10:01.4032460Z 2023-01-13T03:10:01.4132500Z โ†’ Model Zoo - Unregister model 2023-01-13T03:10:01.4339930Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:10:01.4427080Z 200 OK โ˜… 30ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:01.4429090Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:10:01.4430270Z โ”‚ { 2023-01-13T03:10:01.4431490Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:10:01.4432380Z โ”‚ } 2023-01-13T03:10:01.4433300Z โ”” 2023-01-13T03:10:01.4434480Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:01.4445720Z 1ms 324ยตs (cache) (cache) 27ms 1ms 44ยตs 31ms 2023-01-13T03:10:01.4446430Z 2023-01-13T03:10:01.4447430Z โœ“ Successful DELETE request 2023-01-13T03:10:01.4456730Z 2023-01-13T03:10:01.4458850Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:10:01.4585790Z GET http://localhost:8082/metrics 2023-01-13T03:10:01.4701040Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 1.93kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:01.4803140Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 1.64kB 2023-01-13T03:10:01.4911320Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:10:01.5013120Z โ”‚ erence requests. 2023-01-13T03:10:01.5114370Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:10:01.5214480Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:01.5258410Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:10:01.5305880Z โ”‚ sion="default",} 1.0 2023-01-13T03:10:01.5407570Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:01.5509530Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:10:01.5601250Z โ”‚ l_version="default",} 1.0 2023-01-13T03:10:01.5617810Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:01.5625360Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:10:01.5659990Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:10:01.5678540Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:10:01.5687150Z โ”‚ duration in microseconds 2023-01-13T03:10:01.5688900Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:10:01.5692920Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:01.5693460Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:10:01.5694280Z โ”‚ ersion="default",} 91.28 2023-01-13T03:10:01.5694730Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:01.5695950Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier",mo 2023-01-13T03:10:01.5696320Z โ”‚ del_version="default",} 163.804 2023-01-13T03:10:01.5696700Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:01.5697680Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier_scr 2023-01-13T03:10:01.5698750Z โ”‚ ipted",model_version="default",} 101.152 2023-01-13T03:10:01.5699970Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:10:01.5700340Z โ”‚ ference duration in microseconds 2023-01-13T03:10:01.5701130Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:10:01.5701650Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:01.5702190Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="squeezenet1_1",mod 2023-01-13T03:10:01.5709610Z โ”‚ el_version="default",} 83065.296 2023-01-13T03:10:01.5737080Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:01.5781610Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="my_text_classifier 2023-01-13T03:10:01.5813130Z โ”‚ ",model_version="default",} 7778.34 2023-01-13T03:10:01.5813570Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:01.5814070Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="my_text_classifier 2023-01-13T03:10:01.5836400Z โ”‚ _scripted",model_version="default",} 73592.371 2023-01-13T03:10:01.5841190Z โ”” 2023-01-13T03:10:01.5845360Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:01.5849970Z 1ms 293ยตs (cache) (cache) 2ms 1ms 49ยตs 6ms 2023-01-13T03:10:01.5851910Z 2023-01-13T03:10:01.5854170Z โœ“ Successful GET request 2023-01-13T03:10:01.5856960Z 2023-01-13T03:10:01.5860630Z Iteration 4/24 2023-01-13T03:10:01.5876090Z 2023-01-13T03:10:01.5881020Z โ†’ Model Zoo - Register Model 2023-01-13T03:10:06.6433130Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/squeezenet1_1_scripted.mar&model_name=squeezenet1_1_scripted&initial_workers=1&synchronous=true 2023-01-13T03:10:06.6535740Z 200 OK โ˜… 5.1s time โ˜… 393Bโ†‘ 364Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:06.6637720Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 98B 2023-01-13T03:10:06.6738880Z โ”‚ { 2023-01-13T03:10:06.6862910Z โ”‚ "status": "Model \"squeezenet1_1_scripted\" Version: 2023-01-13T03:10:06.6964870Z โ”‚ 1.0 registered with 1 initial workers" 2023-01-13T03:10:06.7080440Z โ”‚ } 2023-01-13T03:10:06.7182020Z โ”” 2023-01-13T03:10:06.7283150Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:06.7384260Z 1ms 392ยตs (cache) (cache) 5.1s 2ms 48ยตs 5.1s 2023-01-13T03:10:06.7484290Z 2023-01-13T03:10:06.7585440Z โœ“ Successful POST request 2023-01-13T03:10:06.7685510Z 2023-01-13T03:10:06.7786750Z โ†’ Model Zoo - Inference Model 2023-01-13T03:10:07.0984130Z POST http://localhost:8080/predictions/squeezenet1_1_scripted 2023-01-13T03:10:07.1086130Z 200 OK โ˜… 422ms time โ˜… 111.25kBโ†‘ 408Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:07.1186880Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:10:07.1287200Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:10:07.1402010Z โ”” 2023-01-13T03:10:07.1503800Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 173B 2023-01-13T03:10:07.1606090Z โ”‚ { 2023-01-13T03:10:07.1707550Z โ”‚ "tabby": 0.27850812673568726, 2023-01-13T03:10:07.1809350Z โ”‚ "lynx": 0.252991259098053, 2023-01-13T03:10:07.1911230Z โ”‚ "tiger_cat": 0.24496448040008545, 2023-01-13T03:10:07.2012770Z โ”‚ "Egyptian_cat": 0.21722444891929626, 2023-01-13T03:10:07.2111980Z โ”‚ "cougar": 0.0022175461053848267 2023-01-13T03:10:07.2212450Z โ”‚ } 2023-01-13T03:10:07.2313950Z โ”” 2023-01-13T03:10:07.2415610Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:07.2517150Z 2ms 338ยตs (cache) (cache) 419ms 2ms 53ยตs 424ms 2023-01-13T03:10:07.2617790Z 2023-01-13T03:10:07.2718960Z โœ“ Successful POST request 2023-01-13T03:10:07.2819640Z โœ“ Test expected JSON response 2023-01-13T03:10:07.2919350Z 2023-01-13T03:10:07.3021150Z โ†’ Model Zoo - Unregister model 2023-01-13T03:10:07.3121250Z DELETE http://localhost:8081/models/squeezenet1_1_scripted 2023-01-13T03:10:07.3222440Z 200 OK โ˜… 37ms time โ˜… 258Bโ†‘ 330Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:07.3323140Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 64B 2023-01-13T03:10:07.3423920Z โ”‚ { 2023-01-13T03:10:07.3525930Z โ”‚ "status": "Model \"squeezenet1_1_scripted\" unregist 2023-01-13T03:10:07.3611950Z โ”‚ ered" 2023-01-13T03:10:07.3714630Z โ”‚ } 2023-01-13T03:10:07.3816950Z โ”” 2023-01-13T03:10:07.3918400Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:07.4018820Z 3ms 458ยตs (cache) (cache) 34ms 2ms 54ยตs 40ms 2023-01-13T03:10:07.4118480Z 2023-01-13T03:10:07.4219610Z โœ“ Successful DELETE request 2023-01-13T03:10:07.4320040Z 2023-01-13T03:10:07.4421470Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:10:07.4521890Z GET http://localhost:8082/metrics 2023-01-13T03:10:07.4623790Z 200 OK โ˜… 6ms time โ˜… 233Bโ†‘ 2.37kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:07.4725530Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 2.07kB 2023-01-13T03:10:07.4827150Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:10:07.4932520Z โ”‚ erence requests. 2023-01-13T03:10:07.5034300Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:10:07.5136400Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:07.5238150Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:10:07.5339830Z โ”‚ sion="default",} 1.0 2023-01-13T03:10:07.5441640Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:07.5544070Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:10:07.5645910Z โ”‚ model_version="default",} 1.0 2023-01-13T03:10:07.5747660Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:07.5849380Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:10:07.5951040Z โ”‚ l_version="default",} 1.0 2023-01-13T03:10:07.6052770Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:07.6154820Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:10:07.6256550Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:10:07.6358390Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:10:07.6460320Z โ”‚ duration in microseconds 2023-01-13T03:10:07.6562210Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:10:07.6664390Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:07.6766240Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:10:07.6868430Z โ”‚ ersion="default",} 91.28 2023-01-13T03:10:07.6970300Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:07.7072140Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1_scripted 2023-01-13T03:10:07.7173880Z โ”‚ ",model_version="default",} 85.468 2023-01-13T03:10:07.7275750Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:07.7369670Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier",mo 2023-01-13T03:10:07.7471360Z โ”‚ del_version="default",} 163.804 2023-01-13T03:10:07.7574330Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:07.7634330Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier_scr 2023-01-13T03:10:07.7736290Z โ”‚ ipted",model_version="default",} 101.152 2023-01-13T03:10:07.7838020Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:10:07.7939740Z โ”‚ ference duration in microseconds 2023-01-13T03:10:07.8041530Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:10:07.8143340Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:07.8245120Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="squeezenet1_1",mod 2023-01-13T03:10:07.8346930Z โ”‚ el_version="default",} 83065.296 2023-01-13T03:10:07.8448680Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:07.8550480Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="squeezenet1_1_scri 2023-01-13T03:10:07.8652620Z โ”‚ pted",model_version="default",} 413430.427 2023-01-13T03:10:07.8754940Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:07.8856770Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="my_text_classifier 2023-01-13T03:10:07.8958550Z โ”‚ ",model_version="default",} 7778.34 2023-01-13T03:10:07.9060370Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:07.9162130Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="my_text_classifier 2023-01-13T03:10:07.9263790Z โ”‚ _scripted",model_vers 2023-01-13T03:10:07.9365420Z โ”‚ (showing 2.05kB/2.07kB) 2023-01-13T03:10:07.9467120Z โ”” 2023-01-13T03:10:07.9569050Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:07.9670990Z 2ms 404ยตs (cache) (cache) 3ms 2ms 96ยตs 7ms 2023-01-13T03:10:07.9772030Z 2023-01-13T03:10:07.9873450Z โœ“ Successful GET request 2023-01-13T03:10:07.9923290Z 2023-01-13T03:10:08.0024320Z Iteration 5/24 2023-01-13T03:10:08.0125180Z 2023-01-13T03:10:08.0226590Z โ†’ Model Zoo - Register Model 2023-01-13T03:10:16.7891590Z POST http://localhost:8081/models?url=densenet161.mar&model_name=densenet161&initial_workers=1&synchronous=true 2023-01-13T03:10:16.7993360Z 200 OK โ˜… 9.5s time โ˜… 330Bโ†‘ 353Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:16.8095050Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 87B 2023-01-13T03:10:16.8196740Z โ”‚ { 2023-01-13T03:10:16.8298450Z โ”‚ "status": "Model \"densenet161\" Version: 1.0 regist 2023-01-13T03:10:16.8401300Z โ”‚ ered with 1 initial workers" 2023-01-13T03:10:16.8503140Z โ”‚ } 2023-01-13T03:10:16.8604610Z โ”” 2023-01-13T03:10:16.8706360Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:16.8808440Z 3ms 323ยตs (cache) (cache) 9.5s 1ms 42ยตs 9.5s 2023-01-13T03:10:16.8909410Z 2023-01-13T03:10:16.9011120Z โœ“ Successful POST request 2023-01-13T03:10:16.9112090Z 2023-01-13T03:10:16.9213640Z โ†’ Model Zoo - Inference Model 2023-01-13T03:10:17.4189840Z POST http://localhost:8080/predictions/densenet161 2023-01-13T03:10:17.4292230Z 200 OK โ˜… 595ms time โ˜… 111.24kBโ†‘ 417Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:17.4393530Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:10:17.4514460Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:10:17.4616330Z โ”” 2023-01-13T03:10:17.4718290Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 182B 2023-01-13T03:10:17.4821580Z โ”‚ { 2023-01-13T03:10:17.4922320Z โ”‚ "tabby": 0.4666196405887604, 2023-01-13T03:10:17.5024110Z โ”‚ "tiger_cat": 0.46448981761932373, 2023-01-13T03:10:17.5061050Z โ”‚ "Egyptian_cat": 0.06614061444997787, 2023-01-13T03:10:17.5161650Z โ”‚ "lynx": 0.0012924396432936192, 2023-01-13T03:10:17.5263570Z โ”‚ "plastic_bag": 0.00022909772815182805 2023-01-13T03:10:17.5363510Z โ”‚ } 2023-01-13T03:10:17.5464960Z โ”” 2023-01-13T03:10:17.5567620Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:17.5619090Z 2ms 319ยตs (cache) (cache) 592ms 1ms 49ยตs 597ms 2023-01-13T03:10:17.5718720Z 2023-01-13T03:10:17.5820390Z โœ“ Successful POST request 2023-01-13T03:10:17.5922720Z โœ“ Test expected JSON response 2023-01-13T03:10:17.6023770Z 2023-01-13T03:10:17.6125250Z โ†’ Model Zoo - Unregister model 2023-01-13T03:10:17.6226700Z DELETE http://localhost:8081/models/densenet161 2023-01-13T03:10:17.6327570Z 200 OK โ˜… 37ms time โ˜… 247Bโ†‘ 319Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:17.6428650Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 53B 2023-01-13T03:10:17.6529400Z โ”‚ { 2023-01-13T03:10:17.6631200Z โ”‚ "status": "Model \"densenet161\" unregistered" 2023-01-13T03:10:17.6668110Z โ”‚ } 2023-01-13T03:10:17.6713220Z โ”” 2023-01-13T03:10:17.6762780Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:17.6765760Z 2ms 380ยตs (cache) (cache) 34ms 1ms 56ยตs 38ms 2023-01-13T03:10:17.6790610Z 2023-01-13T03:10:17.6810870Z โœ“ Successful DELETE request 2023-01-13T03:10:17.6816540Z 2023-01-13T03:10:17.6834860Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:10:17.6855160Z GET http://localhost:8082/metrics 2023-01-13T03:10:17.6867270Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 2.77kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:17.6874660Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 2.47kB 2023-01-13T03:10:17.6881530Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:10:17.6908250Z โ”‚ erence requests. 2023-01-13T03:10:17.6933490Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:10:17.6934750Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:17.6960110Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:10:17.6970530Z โ”‚ sion="default",} 1.0 2023-01-13T03:10:17.6984700Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:17.7053450Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:10:17.7088860Z โ”‚ model_version="default",} 1.0 2023-01-13T03:10:17.7121200Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:17.7131180Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:10:17.7132260Z โ”‚ l_version="default",} 1.0 2023-01-13T03:10:17.7133330Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:17.7134410Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:10:17.7135440Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:10:17.7136500Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:17.7137570Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:10:17.7140850Z โ”‚ on="default",} 1.0 2023-01-13T03:10:17.7141900Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:10:17.7142910Z โ”‚ duration in microseconds 2023-01-13T03:10:17.7143960Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:10:17.7145000Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:17.7146090Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:10:17.7147090Z โ”‚ ersion="default",} 91.28 2023-01-13T03:10:17.7147900Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:17.7149000Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1_scripted 2023-01-13T03:10:17.7150070Z โ”‚ ",model_version="default",} 85.468 2023-01-13T03:10:17.7151150Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:17.7152270Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier",mo 2023-01-13T03:10:17.7153330Z โ”‚ del_version="default",} 163.804 2023-01-13T03:10:17.7154430Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:17.7155520Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier_scr 2023-01-13T03:10:17.7156600Z โ”‚ ipted",model_version="default",} 101.152 2023-01-13T03:10:17.7157790Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:17.7158910Z โ”‚ -8966-f7a8f1df27fc",model_name="densenet161",model_ver 2023-01-13T03:10:17.7159940Z โ”‚ sion="default",} 87.044 2023-01-13T03:10:17.7161620Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:10:17.7162790Z โ”‚ ference duration in microseconds 2023-01-13T03:10:17.7164070Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:10:17.7165160Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:17.7166450Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="squeezenet1_1",mod 2023-01-13T03:10:17.7167460Z โ”‚ el_version="default",} 83065.296 2023-01-13T03:10:17.7168520Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:17.7169580Z โ”‚ 4e7f-8966-f7a8f1df27fc",model_name="squeezenet1_1_scri 2023-01-13T03:10:17.7170630Z โ”‚ pted",model_version="default",} 413430.427 2023-01-13T03:10:17.7171590Z โ”‚ ts_inference_l 2023-01-13T03:10:17.7172960Z โ”‚ (showing 2.05kB/2.47kB) 2023-01-13T03:10:17.7173800Z โ”” 2023-01-13T03:10:17.7174680Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:17.7175610Z 1ms 316ยตs (cache) (cache) 2ms 1ms 62ยตs 6ms 2023-01-13T03:10:17.7176170Z 2023-01-13T03:10:17.7176690Z โœ“ Successful GET request 2023-01-13T03:10:17.7177280Z 2023-01-13T03:10:17.7177660Z Iteration 6/24 2023-01-13T03:10:17.7178130Z 2023-01-13T03:10:17.7178650Z โ†’ Model Zoo - Register Model 2023-01-13T03:10:31.6751740Z POST http://localhost:8081/models?url=alexnet.mar&model_name=alexnet&initial_workers=1&synchronous=true 2023-01-13T03:10:31.6853850Z 200 OK โ˜… 14.1s time โ˜… 322Bโ†‘ 349Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:31.6926350Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 83B 2023-01-13T03:10:31.7033940Z โ”‚ { 2023-01-13T03:10:31.7129780Z โ”‚ "status": "Model \"alexnet\" Version: 1.0 registered 2023-01-13T03:10:31.7175570Z โ”‚ with 1 initial workers" 2023-01-13T03:10:31.7185290Z โ”‚ } 2023-01-13T03:10:31.7214820Z โ”” 2023-01-13T03:10:31.7249490Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:31.7271830Z 4ms 389ยตs (cache) (cache) 14.1s 2ms 47ยตs 14.1s 2023-01-13T03:10:31.7301900Z 2023-01-13T03:10:31.7312320Z โœ“ Successful POST request 2023-01-13T03:10:31.7355120Z 2023-01-13T03:10:31.7374770Z โ†’ Model Zoo - Inference Model 2023-01-13T03:10:31.8987420Z POST http://localhost:8080/predictions/alexnet 2023-01-13T03:10:31.9089430Z 200 OK โ˜… 198ms time โ˜… 111.24kBโ†‘ 407Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:31.9191050Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:10:31.9292610Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:10:31.9394200Z โ”” 2023-01-13T03:10:31.9603740Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 172B 2023-01-13T03:10:31.9727350Z โ”‚ { 2023-01-13T03:10:31.9853620Z โ”‚ "tabby": 0.31847384572029114, 2023-01-13T03:10:31.9962160Z โ”‚ "tiger_cat": 0.2579399645328522, 2023-01-13T03:10:32.0064550Z โ”‚ "Egyptian_cat": 0.24254800379276276, 2023-01-13T03:10:32.0166390Z โ”‚ "lynx": 0.16879341006278992, 2023-01-13T03:10:32.0268000Z โ”‚ "tiger": 0.006487956270575523 2023-01-13T03:10:32.0369610Z โ”‚ } 2023-01-13T03:10:32.0471060Z โ”” 2023-01-13T03:10:32.0573460Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:32.0675280Z 3ms 341ยตs (cache) (cache) 194ms 2ms 50ยตs 201ms 2023-01-13T03:10:32.0776600Z 2023-01-13T03:10:32.0878030Z โœ“ Successful POST request 2023-01-13T03:10:32.0986320Z โœ“ Test expected JSON response 2023-01-13T03:10:32.1087340Z 2023-01-13T03:10:32.1190700Z โ†’ Model Zoo - Unregister model 2023-01-13T03:10:32.1292180Z DELETE http://localhost:8081/models/alexnet 2023-01-13T03:10:32.1394010Z 200 OK โ˜… 62ms time โ˜… 243Bโ†‘ 315Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:32.1496220Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 49B 2023-01-13T03:10:32.1597800Z โ”‚ { 2023-01-13T03:10:32.1802260Z โ”‚ "status": "Model \"alexnet\" unregistered" 2023-01-13T03:10:32.1903080Z โ”‚ } 2023-01-13T03:10:32.2004160Z โ”” 2023-01-13T03:10:32.2106360Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:32.2206430Z 2ms 355ยตs (cache) (cache) 59ms 1ms 58ยตs 64ms 2023-01-13T03:10:32.2307720Z 2023-01-13T03:10:32.2409010Z โœ“ Successful DELETE request 2023-01-13T03:10:32.2510090Z 2023-01-13T03:10:32.2611140Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:10:32.2679130Z GET http://localhost:8082/metrics 2023-01-13T03:10:32.2781070Z 200 OK โ˜… 7ms time โ˜… 233Bโ†‘ 3.15kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:32.2843910Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 2.86kB 2023-01-13T03:10:32.2915740Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:10:32.2945130Z โ”‚ erence requests. 2023-01-13T03:10:32.3000890Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:10:32.3027540Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:32.3074120Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:10:32.3104770Z โ”‚ default",} 1.0 2023-01-13T03:10:32.3146700Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:32.3171450Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:10:32.3202800Z โ”‚ sion="default",} 1.0 2023-01-13T03:10:32.3213460Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:32.3226330Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:10:32.3237160Z โ”‚ model_version="default",} 1.0 2023-01-13T03:10:32.3271390Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:32.3295650Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:10:32.3302280Z โ”‚ l_version="default",} 1.0 2023-01-13T03:10:32.3339460Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:32.3362560Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:10:32.3392820Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:10:32.3424260Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:32.3454530Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:10:32.3498650Z โ”‚ on="default",} 1.0 2023-01-13T03:10:32.3539260Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:10:32.3552510Z โ”‚ duration in microseconds 2023-01-13T03:10:32.3654980Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:10:32.3756960Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:32.3858840Z โ”‚ -8966-f7a8f1df27fc",model_name="alexnet",model_version 2023-01-13T03:10:32.3959600Z โ”‚ ="default",} 186.84 2023-01-13T03:10:32.4060510Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:32.4161860Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:10:32.4262550Z โ”‚ ersion="default",} 91.28 2023-01-13T03:10:32.4363210Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:32.4464380Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1_scripted 2023-01-13T03:10:32.4565020Z โ”‚ ",model_version="default",} 85.468 2023-01-13T03:10:32.4665350Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:32.4765810Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier",mo 2023-01-13T03:10:32.4831800Z โ”‚ del_version="default",} 163.804 2023-01-13T03:10:32.4933570Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:32.5037190Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier_scr 2023-01-13T03:10:32.5139470Z โ”‚ ipted",model_version="default",} 101.152 2023-01-13T03:10:32.5241530Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:32.5366060Z โ”‚ -8966-f7a8f1df27fc",model_name="densenet161",model_ver 2023-01-13T03:10:32.5468250Z โ”‚ sion="default",} 87.044 2023-01-13T03:10:32.5567890Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:10:32.5668240Z โ”‚ ference duration in microseconds 2023-01-13T03:10:32.5769910Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:10:32.5871230Z โ”‚ ts_inference_latency_microseconds{uuid="15fe81f8-6953- 2023-01-13T03:10:32.5971230Z โ”‚ 4 2023-01-13T03:10:32.6072290Z โ”‚ (showing 2.05kB/2.86kB) 2023-01-13T03:10:32.6172460Z โ”” 2023-01-13T03:10:32.6273880Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:32.6374450Z 11ms 508ยตs (cache) (cache) 3ms 2ms 48ยตs 18ms 2023-01-13T03:10:32.6474170Z 2023-01-13T03:10:32.6575160Z โœ“ Successful GET request 2023-01-13T03:10:32.6675260Z 2023-01-13T03:10:32.6776220Z Iteration 7/24 2023-01-13T03:10:32.6876460Z 2023-01-13T03:10:32.6973630Z โ†’ Model Zoo - Register Model 2023-01-13T03:10:50.1607490Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/alexnet_scripted.mar&model_name=alexnet_scripted&initial_workers=1&synchronous=true 2023-01-13T03:10:50.1647040Z 200 OK โ˜… 18s time โ˜… 381Bโ†‘ 358Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:50.1677450Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 92B 2023-01-13T03:10:50.1758700Z โ”‚ { 2023-01-13T03:10:50.1794550Z โ”‚ "status": "Model \"alexnet_scripted\" Version: 1.0 r 2023-01-13T03:10:50.1827860Z โ”‚ egistered with 1 initial workers" 2023-01-13T03:10:50.1848870Z โ”‚ } 2023-01-13T03:10:50.1875710Z โ”” 2023-01-13T03:10:50.1878180Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:50.1893740Z 2ms 500ยตs (cache) (cache) 18s 2ms 53ยตs 18s 2023-01-13T03:10:50.1905200Z 2023-01-13T03:10:50.1944830Z โœ“ Successful POST request 2023-01-13T03:10:50.1995880Z 2023-01-13T03:10:50.2025160Z โ†’ Model Zoo - Inference Model 2023-01-13T03:10:50.5352070Z POST http://localhost:8080/predictions/alexnet_scripted 2023-01-13T03:10:50.5454010Z 200 OK โ˜… 339ms time โ˜… 111.25kBโ†‘ 407Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:50.5556840Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:10:50.5660660Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:10:50.5762270Z โ”” 2023-01-13T03:10:50.5864120Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 172B 2023-01-13T03:10:50.5965880Z โ”‚ { 2023-01-13T03:10:50.6067640Z โ”‚ "tabby": 0.31847384572029114, 2023-01-13T03:10:50.6169410Z โ”‚ "tiger_cat": 0.2579399645328522, 2023-01-13T03:10:50.6271240Z โ”‚ "Egyptian_cat": 0.24254800379276276, 2023-01-13T03:10:50.6372960Z โ”‚ "lynx": 0.16879341006278992, 2023-01-13T03:10:50.6474820Z โ”‚ "tiger": 0.006487956270575523 2023-01-13T03:10:50.6576810Z โ”‚ } 2023-01-13T03:10:50.6678450Z โ”” 2023-01-13T03:10:50.6783300Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:50.6885250Z 2ms 313ยตs (cache) (cache) 335ms 2ms 64ยตs 341ms 2023-01-13T03:10:50.6986330Z 2023-01-13T03:10:50.7087770Z โœ“ Successful POST request 2023-01-13T03:10:50.7186900Z โœ“ Test expected JSON response 2023-01-13T03:10:50.7238430Z 2023-01-13T03:10:50.7374570Z โ†’ Model Zoo - Unregister model 2023-01-13T03:10:50.7444320Z DELETE http://localhost:8081/models/alexnet_scripted 2023-01-13T03:10:50.7536580Z 200 OK โ˜… 51ms time โ˜… 252Bโ†‘ 324Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:50.7620500Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 58B 2023-01-13T03:10:50.7684740Z โ”‚ { 2023-01-13T03:10:50.7766630Z โ”‚ "status": "Model \"alexnet_scripted\" unregistered" 2023-01-13T03:10:50.7838640Z โ”‚ } 2023-01-13T03:10:50.7905330Z โ”” 2023-01-13T03:10:50.7945850Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:50.8123960Z 2ms 365ยตs (cache) (cache) 48ms 1ms 43ยตs 53ms 2023-01-13T03:10:50.8150960Z 2023-01-13T03:10:50.8395180Z โœ“ Successful DELETE request 2023-01-13T03:10:50.8431960Z 2023-01-13T03:10:50.8481480Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:10:50.8583210Z GET http://localhost:8082/metrics 2023-01-13T03:10:50.8584460Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 3.57kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:50.8686080Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 3.27kB 2023-01-13T03:10:50.8788050Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:10:50.8889590Z โ”‚ erence requests. 2023-01-13T03:10:50.8951530Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:10:50.9021190Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:50.9089140Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:10:50.9144800Z โ”‚ default",} 1.0 2023-01-13T03:10:50.9227980Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:50.9279480Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:10:50.9306500Z โ”‚ sion="default",} 1.0 2023-01-13T03:10:50.9344220Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:50.9386920Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:10:50.9427730Z โ”‚ model_version="default",} 1.0 2023-01-13T03:10:50.9481600Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:50.9550220Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:10:50.9591010Z โ”‚ l_version="default",} 1.0 2023-01-13T03:10:50.9637970Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:50.9667440Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:10:50.9721820Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:10:50.9827960Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:50.9993710Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:10:51.0386110Z โ”‚ on="default",} 1.0 2023-01-13T03:10:51.0387350Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:51.0490740Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:10:51.0592380Z โ”‚ version="default",} 1.0 2023-01-13T03:10:51.0694990Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:10:51.0796580Z โ”‚ duration in microseconds 2023-01-13T03:10:51.0898280Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:10:51.1000120Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:51.1101810Z โ”‚ -8966-f7a8f1df27fc",model_name="alexnet",model_version 2023-01-13T03:10:51.1203420Z โ”‚ ="default",} 186.84 2023-01-13T03:10:51.1293800Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:51.1395430Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:10:51.1496950Z โ”‚ ersion="default",} 91.28 2023-01-13T03:10:51.1564610Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:51.1666150Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1_scripted 2023-01-13T03:10:51.1724730Z โ”‚ ",model_version="default",} 85.468 2023-01-13T03:10:51.1786740Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:51.1888960Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier",mo 2023-01-13T03:10:51.1952840Z โ”‚ del_version="default",} 163.804 2023-01-13T03:10:51.2018900Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:51.2053440Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier_scr 2023-01-13T03:10:51.2116440Z โ”‚ ipted",model_version="default",} 101.152 2023-01-13T03:10:51.2173290Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:51.2206930Z โ”‚ -8966-f7a8f1df27fc",model_name="densenet161",model_ver 2023-01-13T03:10:51.2308520Z โ”‚ sion="default",} 87.044 2023-01-13T03:10:51.2363630Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:51.2420330Z โ”‚ -8966 2023-01-13T03:10:51.2451260Z โ”‚ (showing 2.05kB/3.27kB) 2023-01-13T03:10:51.2497190Z โ”” 2023-01-13T03:10:51.2540430Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:51.2573840Z 3ms 347ยตs (cache) (cache) 2ms 1ms 59ยตs 8ms 2023-01-13T03:10:51.2634210Z 2023-01-13T03:10:51.2662560Z โœ“ Successful GET request 2023-01-13T03:10:51.2677190Z 2023-01-13T03:10:51.2677910Z Iteration 8/24 2023-01-13T03:10:51.2678070Z 2023-01-13T03:10:51.2678400Z โ†’ Model Zoo - Register Model 2023-01-13T03:10:56.4146580Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&initial_workers=1&synchronous=true 2023-01-13T03:10:56.4251390Z 200 OK โ˜… 5.7s time โ˜… 326Bโ†‘ 351Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:56.4353160Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 85B 2023-01-13T03:10:56.4460420Z โ”‚ { 2023-01-13T03:10:56.4562230Z โ”‚ "status": "Model \"resnet-18\" Version: 1.0 register 2023-01-13T03:10:56.4664300Z โ”‚ ed with 1 initial workers" 2023-01-13T03:10:56.4765970Z โ”‚ } 2023-01-13T03:10:56.4867540Z โ”” 2023-01-13T03:10:56.4969830Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:56.5071800Z 3ms 356ยตs (cache) (cache) 5.7s 3ms 115ยตs 5.7s 2023-01-13T03:10:56.5172730Z 2023-01-13T03:10:56.5275020Z โœ“ Successful POST request 2023-01-13T03:10:56.5376010Z 2023-01-13T03:10:56.5477480Z โ†’ Model Zoo - Inference Model 2023-01-13T03:10:56.8560000Z POST http://localhost:8080/predictions/resnet-18 2023-01-13T03:10:56.8662200Z 200 OK โ˜… 410ms time โ˜… 111.24kBโ†‘ 407Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:56.8766240Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:10:56.8862990Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:10:56.8964470Z โ”” 2023-01-13T03:10:56.9048790Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 172B 2023-01-13T03:10:56.9137320Z โ”‚ { 2023-01-13T03:10:56.9184480Z โ”‚ "tabby": 0.4096633791923523, 2023-01-13T03:10:56.9286280Z โ”‚ "tiger_cat": 0.3467046618461609, 2023-01-13T03:10:56.9286870Z โ”‚ "Egyptian_cat": 0.13002875447273254, 2023-01-13T03:10:56.9389230Z โ”‚ "lynx": 0.023919541388750076, 2023-01-13T03:10:56.9492400Z โ”‚ "bucket": 0.01153218187391758 2023-01-13T03:10:56.9592700Z โ”‚ } 2023-01-13T03:10:56.9694180Z โ”” 2023-01-13T03:10:56.9816480Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:56.9931290Z 3ms 661ยตs (cache) (cache) 406ms 1ms 47ยตs 412ms 2023-01-13T03:10:57.0032410Z 2023-01-13T03:10:57.0134070Z โœ“ Successful POST request 2023-01-13T03:10:57.0237970Z โœ“ Test expected JSON response 2023-01-13T03:10:57.0339090Z 2023-01-13T03:10:57.0454220Z โ†’ Model Zoo - Unregister model 2023-01-13T03:10:57.0505930Z DELETE http://localhost:8081/models/resnet-18 2023-01-13T03:10:57.0647220Z 200 OK โ˜… 40ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:57.0747900Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:10:57.0849510Z โ”‚ { 2023-01-13T03:10:57.0925630Z โ”‚ "status": "Model \"resnet-18\" unregistered" 2023-01-13T03:10:57.1027360Z โ”‚ } 2023-01-13T03:10:57.1095810Z โ”” 2023-01-13T03:10:57.1128490Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:57.1155170Z 2ms 562ยตs (cache) (cache) 35ms 2ms 52ยตs 41ms 2023-01-13T03:10:57.1178600Z 2023-01-13T03:10:57.1237400Z โœ“ Successful DELETE request 2023-01-13T03:10:57.1292300Z 2023-01-13T03:10:57.1321710Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:10:57.1384910Z GET http://localhost:8082/metrics 2023-01-13T03:10:57.1432320Z 200 OK โ˜… 12ms time โ˜… 233Bโ†‘ 3.96kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:10:57.1473370Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 3.67kB 2023-01-13T03:10:57.1510250Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:10:57.1556820Z โ”‚ erence requests. 2023-01-13T03:10:57.1636140Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:10:57.1679190Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:57.1705270Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:10:57.1734320Z โ”‚ default",} 1.0 2023-01-13T03:10:57.1741760Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:57.1779330Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:10:57.1820470Z โ”‚ sion="default",} 1.0 2023-01-13T03:10:57.1852360Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:57.1907850Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:10:57.1939540Z โ”‚ model_version="default",} 1.0 2023-01-13T03:10:57.1948150Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:57.1975000Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:10:57.1981840Z โ”‚ ="default",} 1.0 2023-01-13T03:10:57.1985430Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:57.2016080Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:10:57.2041500Z โ”‚ l_version="default",} 1.0 2023-01-13T03:10:57.2072650Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:57.2109500Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:10:57.2143170Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:10:57.2176330Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:57.2209960Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:10:57.2265430Z โ”‚ on="default",} 1.0 2023-01-13T03:10:57.2281010Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:10:57.2316290Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:10:57.2337150Z โ”‚ version="default",} 1.0 2023-01-13T03:10:57.2390630Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:10:57.2435100Z โ”‚ duration in microseconds 2023-01-13T03:10:57.2475730Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:10:57.2504800Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:57.2546210Z โ”‚ -8966-f7a8f1df27fc",model_name="alexnet",model_version 2023-01-13T03:10:57.2562330Z โ”‚ ="default",} 186.84 2023-01-13T03:10:57.2578330Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:57.2605760Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:10:57.2627100Z โ”‚ ersion="default",} 91.28 2023-01-13T03:10:57.2645170Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:57.2688960Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1_scripted 2023-01-13T03:10:57.2763210Z โ”‚ ",model_version="default",} 85.468 2023-01-13T03:10:57.2834640Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:57.2925080Z โ”‚ -8966-f7a8f1df27fc",model_name="resnet-18",model_versi 2023-01-13T03:10:57.3028080Z โ”‚ on="default",} 248.069 2023-01-13T03:10:57.3117160Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:57.3152030Z โ”‚ -8966-f7a8f1df27fc",model_name="my_text_classifier",mo 2023-01-13T03:10:57.3200720Z โ”‚ del_version="default",} 163.804 2023-01-13T03:10:57.3204570Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:10:57.3208170Z โ”‚ -8966-f7a8f1df27fc",model_name 2023-01-13T03:10:57.3258690Z โ”‚ (showing 2.05kB/3.67kB) 2023-01-13T03:10:57.3268900Z โ”” 2023-01-13T03:10:57.3294050Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:10:57.3309170Z 7ms 355ยตs (cache) (cache) 7ms 2ms 50ยตs 18ms 2023-01-13T03:10:57.3312260Z 2023-01-13T03:10:57.3316730Z โœ“ Successful GET request 2023-01-13T03:10:57.3330470Z 2023-01-13T03:10:57.3357150Z Iteration 9/24 2023-01-13T03:10:57.3363530Z 2023-01-13T03:10:57.3390640Z โ†’ Model Zoo - Register Model 2023-01-13T03:11:02.8892310Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/resnet-18_scripted.mar&model_name=resnet-18_scripted&initial_workers=1&synchronous=true 2023-01-13T03:11:02.8994610Z 200 OK โ˜… 5.8s time โ˜… 385Bโ†‘ 360Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:11:02.8995220Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 94B 2023-01-13T03:11:02.9096750Z โ”‚ { 2023-01-13T03:11:02.9199030Z โ”‚ "status": "Model \"resnet-18_scripted\" Version: 1.0 2023-01-13T03:11:02.9300630Z โ”‚ registered with 1 initial workers" 2023-01-13T03:11:02.9402430Z โ”‚ } 2023-01-13T03:11:02.9497410Z โ”” 2023-01-13T03:11:02.9581800Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:11:02.9654080Z 16ms 373ยตs (cache) (cache) 5.8s 2ms 72ยตs 5.8s 2023-01-13T03:11:02.9729320Z 2023-01-13T03:11:02.9811410Z โœ“ Successful POST request 2023-01-13T03:11:02.9847420Z 2023-01-13T03:11:02.9892590Z โ†’ Model Zoo - Inference Model 2023-01-13T03:11:03.3337830Z POST http://localhost:8080/predictions/resnet-18_scripted 2023-01-13T03:11:03.3391010Z 200 OK โ˜… 425ms time โ˜… 111.25kBโ†‘ 407Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:11:03.3425870Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:11:03.3475730Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:11:03.3516500Z โ”” 2023-01-13T03:11:03.3522490Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 172B 2023-01-13T03:11:03.3558540Z โ”‚ { 2023-01-13T03:11:03.3604170Z โ”‚ "tabby": 0.4096633791923523, 2023-01-13T03:11:03.3605670Z โ”‚ "tiger_cat": 0.3467046618461609, 2023-01-13T03:11:03.3652280Z โ”‚ "Egyptian_cat": 0.13002875447273254, 2023-01-13T03:11:03.3692070Z โ”‚ "lynx": 0.023919541388750076, 2023-01-13T03:11:03.3732760Z โ”‚ "bucket": 0.01153218187391758 2023-01-13T03:11:03.3783690Z โ”‚ } 2023-01-13T03:11:03.3818920Z โ”” 2023-01-13T03:11:03.3830510Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:11:03.3860900Z 3ms 307ยตs (cache) (cache) 422ms 1ms 47ยตs 428ms 2023-01-13T03:11:03.3917750Z 2023-01-13T03:11:03.3981020Z โœ“ Successful POST request 2023-01-13T03:11:03.4021310Z โœ“ Test expected JSON response 2023-01-13T03:11:03.4087270Z 2023-01-13T03:11:03.4129160Z โ†’ Model Zoo - Unregister model 2023-01-13T03:11:03.4135100Z DELETE http://localhost:8081/models/resnet-18_scripted 2023-01-13T03:11:03.4150800Z 200 OK โ˜… 35ms time โ˜… 254Bโ†‘ 326Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:11:03.4177280Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 60B 2023-01-13T03:11:03.4265410Z โ”‚ { 2023-01-13T03:11:03.4344430Z โ”‚ "status": "Model \"resnet-18_scripted\" unregistered 2023-01-13T03:11:03.4374750Z โ”‚ " 2023-01-13T03:11:03.4451130Z โ”‚ } 2023-01-13T03:11:03.4512430Z โ”” 2023-01-13T03:11:03.4556220Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:11:03.4639480Z 1ms 297ยตs (cache) (cache) 32ms 1ms 50ยตs 36ms 2023-01-13T03:11:03.4722390Z 2023-01-13T03:11:03.4780620Z โœ“ Successful DELETE request 2023-01-13T03:11:03.4832410Z 2023-01-13T03:11:03.4891910Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:11:03.4928320Z GET http://localhost:8082/metrics 2023-01-13T03:11:03.4951230Z 200 OK โ˜… 6ms time โ˜… 233Bโ†‘ 4.38kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:11:03.4985500Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 4.09kB 2023-01-13T03:11:03.5028360Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:11:03.5079250Z โ”‚ erence requests. 2023-01-13T03:11:03.5081900Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:11:03.5109110Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:03.5127340Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:11:03.5129750Z โ”‚ default",} 1.0 2023-01-13T03:11:03.5134740Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:03.5149050Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:11:03.5150680Z โ”‚ sion="default",} 1.0 2023-01-13T03:11:03.5159890Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:03.5160410Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:11:03.5170050Z โ”‚ model_version="default",} 1.0 2023-01-13T03:11:03.5170560Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:03.5188230Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:11:03.5197130Z โ”‚ ="default",} 1.0 2023-01-13T03:11:03.5212890Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:03.5237010Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:11:03.5246480Z โ”‚ l_version="default",} 1.0 2023-01-13T03:11:03.5254640Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:03.5257170Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:11:03.5261820Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:11:03.5269160Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:03.5274740Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:11:03.5282640Z โ”‚ on="default",} 1.0 2023-01-13T03:11:03.5295130Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:03.5332790Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:11:03.5379190Z โ”‚ version="default",} 1.0 2023-01-13T03:11:03.5391430Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:03.5405270Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:11:03.5407550Z โ”‚ l_version="default",} 1.0 2023-01-13T03:11:03.5418920Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:11:03.5424530Z โ”‚ duration in microseconds 2023-01-13T03:11:03.5484510Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:11:03.5520420Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:11:03.5543330Z โ”‚ -8966-f7a8f1df27fc",model_name="alexnet",model_version 2023-01-13T03:11:03.5565380Z โ”‚ ="default",} 186.84 2023-01-13T03:11:03.5592200Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:11:03.5606080Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:11:03.5609440Z โ”‚ ersion="default",} 91.28 2023-01-13T03:11:03.5612540Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:11:03.5617200Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1_scripted 2023-01-13T03:11:03.5618180Z โ”‚ ",model_version="default",} 85.468 2023-01-13T03:11:03.5619110Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:11:03.5620060Z โ”‚ -8966-f7a8f1df27fc",model_name="resnet-18",model_versi 2023-01-13T03:11:03.5620920Z โ”‚ on="default",} 248.069 2023-01-13T03:11:03.5621830Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:11:03.5622730Z โ”‚ -8966-f7a8f1df27fc",model_name="my_t 2023-01-13T03:11:03.5623610Z โ”‚ (showing 2.05kB/4.09kB) 2023-01-13T03:11:03.5624360Z โ”” 2023-01-13T03:11:03.5625340Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:11:03.5626730Z 5ms 300ยตs (cache) (cache) 2ms 2ms 66ยตs 10ms 2023-01-13T03:11:03.5627470Z 2023-01-13T03:11:03.5628330Z โœ“ Successful GET request 2023-01-13T03:11:03.5629020Z 2023-01-13T03:11:03.5629560Z Iteration 10/24 2023-01-13T03:11:03.5630020Z 2023-01-13T03:11:03.5630560Z โ†’ Model Zoo - Register Model 2023-01-13T03:11:30.1724380Z POST http://localhost:8081/models?url=vgg16.mar&model_name=vgg16&initial_workers=1&synchronous=true 2023-01-13T03:11:30.1754660Z 200 OK โ˜… 26.7s time โ˜… 318Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:11:30.1759770Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:11:30.1790950Z โ”‚ { 2023-01-13T03:11:30.1849910Z โ”‚ "status": "Model \"vgg16\" Version: 1.0 registered w 2023-01-13T03:11:30.1857930Z โ”‚ ith 1 initial workers" 2023-01-13T03:11:30.1873780Z โ”‚ } 2023-01-13T03:11:30.1877400Z โ”” 2023-01-13T03:11:30.1878310Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:11:30.1879200Z 1ms 277ยตs (cache) (cache) 26.7s 1ms 38ยตs 26.7s 2023-01-13T03:11:30.1879690Z 2023-01-13T03:11:30.1880330Z โœ“ Successful POST request 2023-01-13T03:11:30.1905570Z 2023-01-13T03:11:30.1915400Z โ†’ Model Zoo - Inference Model 2023-01-13T03:11:31.2542650Z POST http://localhost:8080/predictions/vgg16 2023-01-13T03:11:31.2632400Z 200 OK โ˜… 1055ms time โ˜… 111.24kBโ†‘ 408Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:11:31.2687220Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:11:31.2726610Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:11:31.2742630Z โ”” 2023-01-13T03:11:31.2751880Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 173B 2023-01-13T03:11:31.2760480Z โ”‚ { 2023-01-13T03:11:31.2889180Z โ”‚ "tiger_cat": 0.44697335362434387, 2023-01-13T03:11:31.2992170Z โ”‚ "tabby": 0.4408791661262512, 2023-01-13T03:11:31.3069850Z โ”‚ "Egyptian_cat": 0.05904553830623627, 2023-01-13T03:11:31.3172070Z โ”‚ "tiger": 0.020596353337168694, 2023-01-13T03:11:31.3277600Z โ”‚ "lynx": 0.009934578090906143 2023-01-13T03:11:31.3381130Z โ”‚ } 2023-01-13T03:11:31.3483360Z โ”” 2023-01-13T03:11:31.3563260Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:11:31.3666820Z 2ms 281ยตs (cache) (cache) 1051ms 2ms 46ยตs 1057ms 2023-01-13T03:11:31.3788120Z 2023-01-13T03:11:31.3896860Z โœ“ Successful POST request 2023-01-13T03:11:31.3993650Z โœ“ Test expected JSON response 2023-01-13T03:11:31.4031030Z 2023-01-13T03:11:31.4039530Z โ†’ Model Zoo - Unregister model 2023-01-13T03:11:31.4094770Z DELETE http://localhost:8081/models/vgg16 2023-01-13T03:11:31.4104390Z 200 OK โ˜… 64ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:11:31.4137970Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:11:31.4145860Z โ”‚ { 2023-01-13T03:11:31.4180100Z โ”‚ "status": "Model \"vgg16\" unregistered" 2023-01-13T03:11:31.4187470Z โ”‚ } 2023-01-13T03:11:31.4190280Z โ”” 2023-01-13T03:11:31.4225490Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:11:31.4233340Z 2ms 315ยตs (cache) (cache) 61ms 1ms 44ยตs 65ms 2023-01-13T03:11:31.4234350Z 2023-01-13T03:11:31.4237920Z โœ“ Successful DELETE request 2023-01-13T03:11:31.4265500Z 2023-01-13T03:11:31.4270520Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:11:31.4296560Z GET http://localhost:8082/metrics 2023-01-13T03:11:31.4400740Z 200 OK โ˜… 8ms time โ˜… 233Bโ†‘ 4.76kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:11:31.4505750Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 4.47kB 2023-01-13T03:11:31.4607540Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:11:31.4710150Z โ”‚ erence requests. 2023-01-13T03:11:31.4752790Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:11:31.4814040Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.4915700Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:11:31.5017790Z โ”‚ default",} 1.0 2023-01-13T03:11:31.5207950Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.5278800Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:11:31.5312130Z โ”‚ sion="default",} 1.0 2023-01-13T03:11:31.5380090Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.5431170Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:11:31.5462190Z โ”‚ model_version="default",} 1.0 2023-01-13T03:11:31.5517590Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.5571890Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:11:31.5609340Z โ”‚ ="default",} 1.0 2023-01-13T03:11:31.5647120Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.5690540Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:11:31.5725120Z โ”‚ fault",} 1.0 2023-01-13T03:11:31.5770880Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.5805910Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:11:31.5862140Z โ”‚ l_version="default",} 1.0 2023-01-13T03:11:31.5894070Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.5937790Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:11:31.5981640Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:11:31.6008640Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.6067170Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:11:31.6118080Z โ”‚ on="default",} 1.0 2023-01-13T03:11:31.6179870Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.6225460Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:11:31.6271290Z โ”‚ version="default",} 1.0 2023-01-13T03:11:31.6321530Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:11:31.6370900Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:11:31.6402230Z โ”‚ l_version="default",} 1.0 2023-01-13T03:11:31.6450440Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:11:31.6493800Z โ”‚ duration in microseconds 2023-01-13T03:11:31.6545270Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:11:31.6595740Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:11:31.6636170Z โ”‚ -8966-f7a8f1df27fc",model_name="alexnet",model_version 2023-01-13T03:11:31.6693780Z โ”‚ ="default",} 186.84 2023-01-13T03:11:31.6744600Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:11:31.6784890Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:11:31.6835360Z โ”‚ ersion="default",} 91.28 2023-01-13T03:11:31.6895110Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:11:31.6931660Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1_scripted 2023-01-13T03:11:31.6974910Z โ”‚ ",model_version="default",} 85.468 2023-01-13T03:11:31.7050100Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:11:31.7134640Z โ”‚ -8966-f7a8f1df27fc",model_name="resnet-18",mod 2023-01-13T03:11:31.7203960Z โ”‚ (showing 2.05kB/4.47kB) 2023-01-13T03:11:31.7277710Z โ”” 2023-01-13T03:11:31.7332700Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:11:31.7393750Z 1ms 278ยตs (cache) (cache) 2ms 4ms 60ยตs 8ms 2023-01-13T03:11:31.7472040Z 2023-01-13T03:11:31.7508930Z โœ“ Successful GET request 2023-01-13T03:11:31.7551830Z 2023-01-13T03:11:31.7570960Z Iteration 11/24 2023-01-13T03:11:31.7622670Z 2023-01-13T03:11:31.7683450Z โ†’ Model Zoo - Register Model 2023-01-13T03:12:06.6883960Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/vgg16_scripted.mar&model_name=vgg16_scripted&initial_workers=1&synchronous=true 2023-01-13T03:12:06.6893120Z 200 OK โ˜… 35.2s time โ˜… 377Bโ†‘ 356Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:06.6894180Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 90B 2023-01-13T03:12:06.6894910Z โ”‚ { 2023-01-13T03:12:06.6897990Z โ”‚ "status": "Model \"vgg16_scripted\" Version: 1.0 reg 2023-01-13T03:12:06.6898900Z โ”‚ istered with 1 initial workers" 2023-01-13T03:12:06.6899570Z โ”‚ } 2023-01-13T03:12:06.6921310Z โ”” 2023-01-13T03:12:06.6922370Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:06.6923330Z 2ms 375ยตs (cache) (cache) 35.2s 1ms 48ยตs 35.2s 2023-01-13T03:12:06.6923930Z 2023-01-13T03:12:06.7065940Z โœ“ Successful POST request 2023-01-13T03:12:06.7096960Z 2023-01-13T03:12:06.7190230Z โ†’ Model Zoo - Inference Model 2023-01-13T03:12:08.1562970Z POST http://localhost:8080/predictions/vgg16_scripted 2023-01-13T03:12:08.1674110Z 200 OK โ˜… 1434ms time โ˜… 111.25kBโ†‘ 408Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:08.1676140Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:12:08.1777720Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:12:08.1812780Z โ”” 2023-01-13T03:12:08.1900680Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 173B 2023-01-13T03:12:08.1978000Z โ”‚ { 2023-01-13T03:12:08.2087890Z โ”‚ "tiger_cat": 0.44697335362434387, 2023-01-13T03:12:08.2190550Z โ”‚ "tabby": 0.4408791661262512, 2023-01-13T03:12:08.2297610Z โ”‚ "Egyptian_cat": 0.05904553830623627, 2023-01-13T03:12:08.2305460Z โ”‚ "tiger": 0.020596353337168694, 2023-01-13T03:12:08.2406730Z โ”‚ "lynx": 0.009934578090906143 2023-01-13T03:12:08.2483010Z โ”‚ } 2023-01-13T03:12:08.2546590Z โ”” 2023-01-13T03:12:08.2595620Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:08.2666090Z 2ms 329ยตs (cache) (cache) 1431ms 2ms 53ยตs 1436ms 2023-01-13T03:12:08.2745830Z 2023-01-13T03:12:08.2795730Z โœ“ Successful POST request 2023-01-13T03:12:08.2892780Z โœ“ Test expected JSON response 2023-01-13T03:12:08.2950460Z 2023-01-13T03:12:08.2979570Z โ†’ Model Zoo - Unregister model 2023-01-13T03:12:08.2999260Z DELETE http://localhost:8081/models/vgg16_scripted 2023-01-13T03:12:08.3009540Z 200 OK โ˜… 63ms time โ˜… 250Bโ†‘ 322Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:08.3046320Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 56B 2023-01-13T03:12:08.3071280Z โ”‚ { 2023-01-13T03:12:08.3088010Z โ”‚ "status": "Model \"vgg16_scripted\" unregistered" 2023-01-13T03:12:08.3152360Z โ”‚ } 2023-01-13T03:12:08.3181420Z โ”” 2023-01-13T03:12:08.3213780Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:08.3228150Z 2ms 346ยตs (cache) (cache) 60ms 1ms 51ยตs 65ms 2023-01-13T03:12:08.3265260Z 2023-01-13T03:12:08.3270960Z โœ“ Successful DELETE request 2023-01-13T03:12:08.3279530Z 2023-01-13T03:12:08.3297730Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:12:08.3324200Z GET http://localhost:8082/metrics 2023-01-13T03:12:08.3345850Z 200 OK โ˜… 4ms time โ˜… 233Bโ†‘ 5.17kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:08.3373610Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 4.88kB 2023-01-13T03:12:08.3395200Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:12:08.3413350Z โ”‚ erence requests. 2023-01-13T03:12:08.3517660Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:12:08.3619910Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.3694230Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:12:08.3699160Z โ”‚ default",} 1.0 2023-01-13T03:12:08.3736850Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.3785560Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:12:08.3827390Z โ”‚ rsion="default",} 1.0 2023-01-13T03:12:08.3873620Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.3921070Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:12:08.3934930Z โ”‚ sion="default",} 1.0 2023-01-13T03:12:08.3947610Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.3956880Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:12:08.3996470Z โ”‚ model_version="default",} 1.0 2023-01-13T03:12:08.4046720Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.4099820Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:12:08.4130200Z โ”‚ ="default",} 1.0 2023-01-13T03:12:08.4139910Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.4164630Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:12:08.4177430Z โ”‚ fault",} 1.0 2023-01-13T03:12:08.4181690Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.4197810Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:12:08.4227710Z โ”‚ l_version="default",} 1.0 2023-01-13T03:12:08.4258560Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.4270750Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:12:08.4273160Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:12:08.4274490Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.4293550Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:12:08.4312810Z โ”‚ on="default",} 1.0 2023-01-13T03:12:08.4331800Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.4340240Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:12:08.4385530Z โ”‚ version="default",} 1.0 2023-01-13T03:12:08.4407810Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:08.4424130Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:12:08.4457450Z โ”‚ l_version="default",} 1.0 2023-01-13T03:12:08.4537310Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:12:08.4567750Z โ”‚ duration in microseconds 2023-01-13T03:12:08.4579940Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:12:08.4606370Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:12:08.4675540Z โ”‚ -8966-f7a8f1df27fc",model_name="alexnet",model_version 2023-01-13T03:12:08.4691830Z โ”‚ ="default",} 186.84 2023-01-13T03:12:08.4715260Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:12:08.4737630Z โ”‚ -8966-f7a8f1df27fc",model_name="vgg16_scripted",model_ 2023-01-13T03:12:08.4779000Z โ”‚ version="default",} 107.772 2023-01-13T03:12:08.4803020Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:12:08.4830730Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:12:08.4831230Z โ”‚ er 2023-01-13T03:12:08.4856660Z โ”‚ (showing 2.05kB/4.88kB) 2023-01-13T03:12:08.4913580Z โ”” 2023-01-13T03:12:08.4938650Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:08.4968980Z 2ms 295ยตs (cache) (cache) 2ms 1ms 64ยตs 6ms 2023-01-13T03:12:08.5004600Z 2023-01-13T03:12:08.5040960Z โœ“ Successful GET request 2023-01-13T03:12:08.5073600Z 2023-01-13T03:12:08.5107310Z Iteration 12/24 2023-01-13T03:12:08.5138620Z 2023-01-13T03:12:08.5149290Z โ†’ Model Zoo - Register Model 2023-01-13T03:12:12.0469030Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/mnist_v2.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-01-13T03:12:12.0489340Z 200 OK โ˜… 3.7s time โ˜… 362Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:12.0590240Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:12:12.0626180Z โ”‚ { 2023-01-13T03:12:12.0671680Z โ”‚ "status": "Model \"mnist\" Version: 2.0 registered w 2023-01-13T03:12:12.0672580Z โ”‚ ith 1 initial workers" 2023-01-13T03:12:12.0673270Z โ”‚ } 2023-01-13T03:12:12.0674030Z โ”” 2023-01-13T03:12:12.0676360Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:12.0677330Z 2ms 344ยตs (cache) (cache) 3.7s 1ms 55ยตs 3.7s 2023-01-13T03:12:12.0677870Z 2023-01-13T03:12:12.0678390Z โœ“ Successful POST request 2023-01-13T03:12:12.0678890Z 2023-01-13T03:12:12.0679370Z โ†’ Model Zoo - Inference Model 2023-01-13T03:12:12.0889420Z POST http://localhost:8080/predictions/mnist 2023-01-13T03:12:12.0890890Z 200 OK โ˜… 18ms time โ˜… 537Bโ†‘ 234Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:12.0891750Z โ”Œ โ†‘ file โ˜… 272B 2023-01-13T03:12:12.0892400Z โ”‚ 2023-01-13T03:12:12.0893060Z โ”” 2023-01-13T03:12:12.0893890Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 1B 2023-01-13T03:12:12.0896430Z โ”‚ 0 2023-01-13T03:12:12.0911330Z โ”” 2023-01-13T03:12:12.0912270Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:12.0913270Z 2ms 314ยตs (cache) (cache) 15ms 1ms 51ยตs 19ms 2023-01-13T03:12:12.0913970Z 2023-01-13T03:12:12.0986330Z โœ“ Successful POST request 2023-01-13T03:12:12.1003420Z โœ“ Test expected TEXT response 2023-01-13T03:12:12.1073710Z 2023-01-13T03:12:12.1074520Z โ†’ Model Zoo - Unregister model 2023-01-13T03:12:12.1288480Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:12:12.1293390Z 200 OK โ˜… 14ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:12.1294380Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:12:12.1295090Z โ”‚ { 2023-01-13T03:12:12.1295850Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:12:12.1310040Z โ”‚ } 2023-01-13T03:12:12.1310840Z โ”” 2023-01-13T03:12:12.1311860Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:12.1312440Z 1ms 268ยตs (cache) (cache) 12ms 1ms 44ยตs 15ms 2023-01-13T03:12:12.1312620Z 2023-01-13T03:12:12.1427740Z โœ“ Successful DELETE request 2023-01-13T03:12:12.1528840Z 2023-01-13T03:12:12.1556200Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:12:12.1594090Z GET http://localhost:8082/metrics 2023-01-13T03:12:12.1603170Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 5.55kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:12.1604140Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 5.26kB 2023-01-13T03:12:12.1604660Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:12:12.1604990Z โ”‚ erence requests. 2023-01-13T03:12:12.1605320Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:12:12.1605710Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1606100Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:12:12.1606410Z โ”‚ default",} 1.0 2023-01-13T03:12:12.1606800Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1607180Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:12:12.1607500Z โ”‚ sion="default",} 1.0 2023-01-13T03:12:12.1607850Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1608800Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:12:12.1609240Z โ”‚ model_version="default",} 1.0 2023-01-13T03:12:12.1609610Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1610000Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:12:12.1610290Z โ”‚ ="default",} 1.0 2023-01-13T03:12:12.1610640Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1611030Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:12:12.1611310Z โ”‚ fault",} 1.0 2023-01-13T03:12:12.1611650Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1612450Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:12:12.1612790Z โ”‚ l_version="default",} 1.0 2023-01-13T03:12:12.1613140Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1613530Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:12:12.1613870Z โ”‚ l_version="default",} 1.0 2023-01-13T03:12:12.1614220Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1614600Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:12:12.1614890Z โ”‚ fault",} 1.0 2023-01-13T03:12:12.1615220Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1615730Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:12:12.1616080Z โ”‚ rsion="default",} 1.0 2023-01-13T03:12:12.1616430Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1616820Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:12:12.1617170Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:12:12.1617550Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1617930Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:12:12.1618230Z โ”‚ on="default",} 1.0 2023-01-13T03:12:12.1618590Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:12.1618970Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:12:12.1619290Z โ”‚ version="default",} 1.0 2023-01-13T03:12:12.1619650Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:12:12.1619980Z โ”‚ duration in microseconds 2023-01-13T03:12:12.1620330Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:12:12.1620710Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:12:12.1621100Z โ”‚ -8966-f7a8f1df27fc",model_name="alexnet",model_version 2023-01-13T03:12:12.1621410Z โ”‚ ="default",} 186.84 2023-01-13T03:12:12.1621760Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:12:12.1622150Z โ”‚ -8966-f7a8f1df27fc",model_name="squeezenet1_1",model_v 2023-01-13T03:12:12.1622910Z โ”‚ ersion="default", 2023-01-13T03:12:12.1624180Z โ”‚ (showing 2.05kB/5.26kB) 2023-01-13T03:12:12.1624430Z โ”” 2023-01-13T03:12:12.1624850Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:12.1625350Z 1ms 291ยตs (cache) (cache) 2ms 1ms 53ยตs 6ms 2023-01-13T03:12:12.1625520Z 2023-01-13T03:12:12.1724370Z โœ“ Successful GET request 2023-01-13T03:12:12.1739160Z 2023-01-13T03:12:12.1739810Z Iteration 13/24 2023-01-13T03:12:12.1756300Z 2023-01-13T03:12:12.1765490Z โ†’ Model Zoo - Register Model 2023-01-13T03:12:15.8283410Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/mnist_scripted_v2.mar&model_name=mnist_scripted&initial_workers=1&synchronous=true 2023-01-13T03:12:15.8330740Z 200 OK โ˜… 3.6s time โ˜… 380Bโ†‘ 356Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:15.8358800Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 90B 2023-01-13T03:12:15.8391780Z โ”‚ { 2023-01-13T03:12:15.8404880Z โ”‚ "status": "Model \"mnist_scripted\" Version: 2.0 reg 2023-01-13T03:12:15.8430740Z โ”‚ istered with 1 initial workers" 2023-01-13T03:12:15.8459220Z โ”‚ } 2023-01-13T03:12:15.8494590Z โ”” 2023-01-13T03:12:15.8547290Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:15.8601770Z 2ms 304ยตs (cache) (cache) 3.6s 1ms 44ยตs 3.6s 2023-01-13T03:12:15.8634990Z 2023-01-13T03:12:15.8682660Z โœ“ Successful POST request 2023-01-13T03:12:15.8716610Z 2023-01-13T03:12:15.8752360Z โ†’ Model Zoo - Inference Model 2023-01-13T03:12:15.9544150Z POST http://localhost:8080/predictions/mnist_scripted 2023-01-13T03:12:15.9646300Z 200 OK โ˜… 93ms time โ˜… 546Bโ†‘ 234Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:15.9746780Z โ”Œ โ†‘ file โ˜… 272B 2023-01-13T03:12:15.9793970Z โ”‚ 2023-01-13T03:12:15.9815110Z โ”” 2023-01-13T03:12:15.9834020Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 1B 2023-01-13T03:12:15.9834420Z โ”‚ 0 2023-01-13T03:12:15.9876070Z โ”” 2023-01-13T03:12:15.9978040Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:16.0025240Z 2ms 391ยตs (cache) (cache) 91ms 1ms 45ยตs 95ms 2023-01-13T03:12:16.0036850Z 2023-01-13T03:12:16.0073600Z โœ“ Successful POST request 2023-01-13T03:12:16.0096870Z โœ“ Test expected TEXT response 2023-01-13T03:12:16.0105170Z 2023-01-13T03:12:16.0144940Z โ†’ Model Zoo - Unregister model 2023-01-13T03:12:16.0265910Z DELETE http://localhost:8081/models/mnist_scripted 2023-01-13T03:12:16.0368140Z 200 OK โ˜… 32ms time โ˜… 250Bโ†‘ 322Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:16.0398770Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 56B 2023-01-13T03:12:16.0425490Z โ”‚ { 2023-01-13T03:12:16.0442410Z โ”‚ "status": "Model \"mnist_scripted\" unregistered" 2023-01-13T03:12:16.0478970Z โ”‚ } 2023-01-13T03:12:16.0479370Z โ”” 2023-01-13T03:12:16.0491300Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:16.0575840Z 1ms 403ยตs (cache) (cache) 29ms 1ms 79ยตs 33ms 2023-01-13T03:12:16.0610390Z 2023-01-13T03:12:16.0624570Z โœ“ Successful DELETE request 2023-01-13T03:12:16.0643460Z 2023-01-13T03:12:16.0648990Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:12:16.0676520Z GET http://localhost:8082/metrics 2023-01-13T03:12:16.0715670Z 200 OK โ˜… 7ms time โ˜… 233Bโ†‘ 5.96kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:16.0739710Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 5.67kB 2023-01-13T03:12:16.0779580Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:12:16.0808500Z โ”‚ erence requests. 2023-01-13T03:12:16.0828730Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:12:16.0847350Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.0876750Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:12:16.0903010Z โ”‚ default",} 1.0 2023-01-13T03:12:16.0921180Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.0924040Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:12:16.0931910Z โ”‚ sion="default",} 1.0 2023-01-13T03:12:16.0941710Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.0954750Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:12:16.0967740Z โ”‚ model_version="default",} 1.0 2023-01-13T03:12:16.0968240Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.0971010Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:12:16.0974110Z โ”‚ ="default",} 1.0 2023-01-13T03:12:16.0976180Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.0982030Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:12:16.0988970Z โ”‚ fault",} 1.0 2023-01-13T03:12:16.0990980Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.0992550Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:12:16.0993000Z โ”‚ l_version="default",} 1.0 2023-01-13T03:12:16.0995990Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.1001510Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:12:16.1005330Z โ”‚ l_version="default",} 1.0 2023-01-13T03:12:16.1008890Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.1029900Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:12:16.1040610Z โ”‚ fault",} 1.0 2023-01-13T03:12:16.1057680Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.1065780Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:12:16.1073290Z โ”‚ rsion="default",} 1.0 2023-01-13T03:12:16.1083260Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.1102420Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:12:16.1110250Z โ”‚ rsion="default",} 1.0 2023-01-13T03:12:16.1112030Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.1117850Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:12:16.1128220Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:12:16.1129850Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.1140550Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:12:16.1151280Z โ”‚ on="default",} 1.0 2023-01-13T03:12:16.1153180Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:16.1154660Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:12:16.1157510Z โ”‚ version="default",} 1.0 2023-01-13T03:12:16.1159030Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:12:16.1160610Z โ”‚ duration in microseconds 2023-01-13T03:12:16.1162590Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:12:16.1165750Z โ”‚ ts_queue_latency_microseconds{uuid="15fe81f8-6953-4e7f 2023-01-13T03:12:16.1174420Z โ”‚ -8966-f7a8f1df27fc",model_name="alexnet",model_version 2023-01-13T03:12:16.1188800Z โ”‚ ="default",} 18 2023-01-13T03:12:16.1200350Z โ”‚ (showing 2.05kB/5.67kB) 2023-01-13T03:12:16.1220350Z โ”” 2023-01-13T03:12:16.1222690Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:16.1224050Z 1ms 756ยตs (cache) (cache) 4ms 1ms 52ยตs 8ms 2023-01-13T03:12:16.1226790Z 2023-01-13T03:12:16.1228250Z โœ“ Successful GET request 2023-01-13T03:12:16.1228460Z 2023-01-13T03:12:16.1229300Z Iteration 14/24 2023-01-13T03:12:16.1231150Z 2023-01-13T03:12:16.1246610Z โ†’ Model Zoo - Register Model 2023-01-13T03:12:28.7385390Z POST http://localhost:8081/models?url=fastrcnn.mar&model_name=fastrcnn&initial_workers=1&synchronous=true 2023-01-13T03:12:28.7487550Z 200 OK โ˜… 12.6s time โ˜… 324Bโ†‘ 350Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:28.7589330Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 84B 2023-01-13T03:12:28.7690970Z โ”‚ { 2023-01-13T03:12:28.7796290Z โ”‚ "status": "Model \"fastrcnn\" Version: 1.0 registere 2023-01-13T03:12:28.7899990Z โ”‚ d with 1 initial workers" 2023-01-13T03:12:28.8001660Z โ”‚ } 2023-01-13T03:12:28.8103400Z โ”” 2023-01-13T03:12:28.8205670Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:28.8290750Z 1ms 286ยตs (cache) (cache) 12.6s 1ms 46ยตs 12.6s 2023-01-13T03:12:28.8342250Z 2023-01-13T03:12:28.8345990Z โœ“ Successful POST request 2023-01-13T03:12:28.8350360Z 2023-01-13T03:12:28.8360220Z โ†’ Model Zoo - Inference Model 2023-01-13T03:12:39.8182220Z POST http://localhost:8080/predictions/fastrcnn 2023-01-13T03:12:39.8284460Z 200 OK โ˜… 11s time โ˜… 289.21kBโ†‘ 3kBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:39.8389880Z โ”Œ โ†‘ file โ˜… 288.94kB 2023-01-13T03:12:39.8491620Z โ”‚ (showing 2.05kB/288.94kB) 2023-01-13T03:12:39.8591900Z โ”” 2023-01-13T03:12:39.8657600Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 2.77kB 2023-01-13T03:12:39.8694440Z โ”‚ [ 2023-01-13T03:12:39.8788020Z โ”‚ { 2023-01-13T03:12:39.8827270Z โ”‚ "person": [ 2023-01-13T03:12:39.8860350Z โ”‚ 167.39585876464844, 2023-01-13T03:12:39.8899020Z โ”‚ 57.203041076660156, 2023-01-13T03:12:39.8937980Z โ”‚ 301.3599853515625, 2023-01-13T03:12:39.9007560Z โ”‚ 436.7974853515625 2023-01-13T03:12:39.9047080Z โ”‚ ], 2023-01-13T03:12:39.9067320Z โ”‚ "score": 0.9995203018188477 2023-01-13T03:12:39.9090740Z โ”‚ }, 2023-01-13T03:12:39.9121290Z โ”‚ { 2023-01-13T03:12:39.9154930Z โ”‚ "person": [ 2023-01-13T03:12:39.9182640Z โ”‚ 89.54701232910156, 2023-01-13T03:12:39.9187290Z โ”‚ 64.8357162475586, 2023-01-13T03:12:39.9207370Z โ”‚ 191.42431640625, 2023-01-13T03:12:39.9217040Z โ”‚ 446.76068115234375 2023-01-13T03:12:39.9243910Z โ”‚ ], 2023-01-13T03:12:39.9256990Z โ”‚ "score": 0.9994968175888062 2023-01-13T03:12:39.9266510Z โ”‚ }, 2023-01-13T03:12:39.9277660Z โ”‚ { 2023-01-13T03:12:39.9313590Z โ”‚ "person": [ 2023-01-13T03:12:39.9332160Z โ”‚ 362.37823486328125, 2023-01-13T03:12:39.9343640Z โ”‚ 161.84130859375, 2023-01-13T03:12:39.9350310Z โ”‚ 515.5023193359375, 2023-01-13T03:12:39.9356250Z โ”‚ 385.2898254394531 2023-01-13T03:12:39.9362150Z โ”‚ ], 2023-01-13T03:12:39.9375850Z โ”‚ "score": 0.9977061748504639 2023-01-13T03:12:39.9395670Z โ”‚ }, 2023-01-13T03:12:39.9404240Z โ”‚ { 2023-01-13T03:12:39.9407580Z โ”‚ "handbag": [ 2023-01-13T03:12:39.9425350Z โ”‚ 67.3762435913086, 2023-01-13T03:12:39.9428640Z โ”‚ 277.5755920410156, 2023-01-13T03:12:39.9439880Z โ”‚ 111.67390441894531, 2023-01-13T03:12:39.9453130Z โ”‚ 400.2067565917969 2023-01-13T03:12:39.9458060Z โ”‚ ], 2023-01-13T03:12:39.9468940Z โ”‚ "score": 0.9924989342689514 2023-01-13T03:12:39.9485030Z โ”‚ }, 2023-01-13T03:12:39.9495010Z โ”‚ { 2023-01-13T03:12:39.9495830Z โ”‚ "handbag": [ 2023-01-13T03:12:39.9496610Z โ”‚ 228.6824951171875, 2023-01-13T03:12:39.9497450Z โ”‚ 146.00692749023438, 2023-01-13T03:12:39.9506200Z โ”‚ 303.55120849609375, 2023-01-13T03:12:39.9508230Z โ”‚ 231.0885009765625 2023-01-13T03:12:39.9527120Z โ”‚ ], 2023-01-13T03:12:39.9539540Z โ”‚ "score": 0.9922404289245605 2023-01-13T03:12:39.9555660Z โ”‚ }, 2023-01-13T03:12:39.9565290Z โ”‚ { 2023-01-13T03:12:39.9590970Z โ”‚ "handbag": [ 2023-01-13T03:12:39.9597500Z โ”‚ 379.411376953125, 2023-01-13T03:12:39.9613980Z โ”‚ 259.9578552246094, 2023-01-13T03:12:39.9633710Z โ”‚ 419.0797424316406, 2023-01-13T03:12:39.9643650Z โ”‚ 317.9610290527344 2023-01-13T03:12:39.9644410Z โ”‚ ], 2023-01-13T03:12:39.9645150Z โ”‚ "score": 0.9898616075515747 2023-01-13T03:12:39.9645830Z โ”‚ }, 2023-01-13T03:12:39.9646550Z โ”‚ { 2023-01-13T03:12:39.9647250Z โ”‚ "person": [ 2023-01-13T03:12:39.9647970Z โ”‚ 518.4960327148438, 2023-01-13T03:12:39.9648690Z โ”‚ 149.73031616210938, 2023-01-13T03:12:39.9649410Z โ”‚ 636.6343994140625, 2023-01-13T03:12:39.9650130Z โ”‚ 365.4129943847656 2023-01-13T03:12:39.9650810Z โ”‚ ], 2023-01-13T03:12:39.9651550Z โ”‚ "score": 0.9821102023124695 2023-01-13T03:12:39.9652250Z โ”‚ }, 2023-01-13T03:12:39.9652910Z โ”‚ { 2023-01-13T03:12:39.9653580Z โ”‚ "bench": [ 2023-01-13T03:12:39.9654280Z โ”‚ 269.08184814453125, 2023-01-13T03:12:39.9655010Z โ”‚ 217.34210205078125, 2023-01-13T03:12:39.9655710Z โ”‚ 423.7701721191406, 2023-01-13T03:12:39.9656440Z โ”‚ 390.37847900390625 2023-01-13T03:12:39.9657120Z โ”‚ ], 2023-01-13T03:12:39.9657850Z โ”‚ "score": 0.9573417901992798 2023-01-13T03:12:39.9658530Z โ”‚ }, 2023-01-13T03:12:39.9659190Z โ”‚ { 2023-01-13T03:12:39.9659970Z โ”‚ "person": [ 2023-01-13T03:12:39.9660740Z โ”‚ 539.6298217773438, 2023-01-13T03:12:39.9662080Z โ”‚ 157.7587127685547, 2023-01-13T03:12:39.9663060Z โ”‚ 616.1531982421875, 2023-01-13T03:12:39.9663760Z โ”‚ 253.1112823486328 2023-01-13T03:12:39.9664400Z โ”‚ ], 2023-01-13T03:12:39.9665070Z โ”‚ "score": 0.899543046951294 2023-01-13T03:12:39.9666120Z โ”‚ }, 2023-01-13T03:12:39.9666770Z โ”‚ { 2023-01-13T03:12:39.9667400Z โ”‚ "person": [ 2023-01-13T03:12:39.9668020Z โ”‚ 477.0623779296875, 2023-01-13T03:12:39.9668650Z โ”‚ 147.80889892578125, 2023-01-13T03:12:39.9669260Z โ”‚ 610.7774047851562, 2023-01-13T03:12:39.9669890Z โ”‚ 296.8367614746094 2023-01-13T03:12:39.9670480Z โ”‚ ], 2023-01-13T03:12:39.9671090Z โ”‚ "score": 0.87515789270401 2023-01-13T03:12:39.9671700Z โ”‚ }, 2023-01-13T03:12:39.9672400Z โ”‚ { 2023-01-13T03:12:39.9685260Z โ”‚ "bench": [ 2023-01-13T03:12:39.9779570Z โ”‚ 286.0877990722656, 2023-01-13T03:12:39.9803000Z โ”‚ 216.53292846679688, 2023-01-13T03:12:39.9805840Z โ”‚ 550.7698364257812, 2023-01-13T03:12:39.9806510Z โ”‚ 383.1821594238281 2023-01-13T03:12:39.9807090Z โ”‚ ], 2023-01-13T03:12:39.9807700Z โ”‚ "score": 0.8436440825462341 2023-01-13T03:12:39.9808270Z โ”‚ }, 2023-01-13T03:12:39.9808790Z โ”‚ { 2023-01-13T03:12:39.9809340Z โ”‚ "person": [ 2023-01-13T03:12:39.9809950Z โ”‚ 627.4741821289062, 2023-01-13T03:12:39.9810530Z โ”‚ 177.05836486816406, 2023-01-13T03:12:39.9811100Z โ”‚ 640.0, 2023-01-13T03:12:39.9813310Z โ”‚ 247.72146606445312 2023-01-13T03:12:39.9813920Z โ”‚ ], 2023-01-13T03:12:39.9814520Z โ”‚ "score": 0.8257306814193726 2023-01-13T03:12:39.9815070Z โ”‚ }, 2023-01-13T03:12:39.9815590Z โ”‚ { 2023-01-13T03:12:39.9816100Z โ”‚ "bench": [ 2023-01-13T03:12:39.9816680Z โ”‚ 88.76299285888672, 2023-01-13T03:12:39.9817260Z โ”‚ 226.1650390625, 2023-01-13T03:12:39.9817840Z โ”‚ 563.6140747070312, 2023-01-13T03:12:39.9818360Z โ”‚ 2023-01-13T03:12:39.9818930Z โ”‚ (showing 2.05kB/2.77kB) 2023-01-13T03:12:39.9819490Z โ”” 2023-01-13T03:12:39.9820200Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:39.9821000Z 10ms 615ยตs (cache) (cache) 11s 2ms 52ยตs 11s 2023-01-13T03:12:39.9823410Z 2023-01-13T03:12:39.9824130Z โœ“ Successful POST request 2023-01-13T03:12:39.9824550Z 2023-01-13T03:12:39.9824970Z โ†’ Model Zoo - Unregister model 2023-01-13T03:12:39.9825540Z DELETE http://localhost:8081/models/fastrcnn 2023-01-13T03:12:39.9864040Z 200 OK โ˜… 40ms time โ˜… 244Bโ†‘ 316Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:39.9864540Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 50B 2023-01-13T03:12:39.9864830Z โ”‚ { 2023-01-13T03:12:39.9865140Z โ”‚ "status": "Model \"fastrcnn\" unregistered" 2023-01-13T03:12:39.9865420Z โ”‚ } 2023-01-13T03:12:39.9865620Z โ”” 2023-01-13T03:12:39.9866050Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:39.9866570Z 2ms 321ยตs (cache) (cache) 37ms 1ms 45ยตs 41ms 2023-01-13T03:12:39.9866750Z 2023-01-13T03:12:39.9928430Z โœ“ Successful DELETE request 2023-01-13T03:12:39.9928950Z 2023-01-13T03:12:39.9929400Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:12:39.9930290Z GET http://localhost:8082/metrics 2023-01-13T03:12:39.9931120Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 6.35kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:39.9934220Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 6.06kB 2023-01-13T03:12:39.9934950Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:12:39.9935580Z โ”‚ erence requests. 2023-01-13T03:12:39.9936210Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:12:39.9936900Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:39.9937610Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:12:39.9938210Z โ”‚ default",} 1.0 2023-01-13T03:12:39.9938880Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:39.9940020Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:12:39.9942310Z โ”‚ "default",} 1.0 2023-01-13T03:12:39.9942980Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:39.9943710Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:12:39.9944340Z โ”‚ sion="default",} 1.0 2023-01-13T03:12:39.9945020Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:39.9945720Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:12:39.9946360Z โ”‚ model_version="default",} 1.0 2023-01-13T03:12:39.9947040Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:39.9947750Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:12:39.9948360Z โ”‚ ="default",} 1.0 2023-01-13T03:12:39.9949020Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:39.9949710Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:12:39.9952210Z โ”‚ fault",} 1.0 2023-01-13T03:12:39.9983820Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:39.9987190Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:12:39.9989290Z โ”‚ l_version="default",} 1.0 2023-01-13T03:12:39.9990020Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:39.9990770Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:12:39.9991410Z โ”‚ l_version="default",} 1.0 2023-01-13T03:12:39.9992530Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:40.0115420Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:12:40.0217040Z โ”‚ fault",} 1.0 2023-01-13T03:12:40.0318710Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:40.0420450Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:12:40.0522460Z โ”‚ rsion="default",} 1.0 2023-01-13T03:12:40.0624460Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:40.0726280Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:12:40.0828020Z โ”‚ rsion="default",} 1.0 2023-01-13T03:12:40.0929860Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:40.1031840Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:12:40.1133570Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:12:40.1168870Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:40.1243480Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:12:40.1270880Z โ”‚ on="default",} 1.0 2023-01-13T03:12:40.1298530Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:12:40.1325120Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:12:40.1353460Z โ”‚ version="default",} 1.0 2023-01-13T03:12:40.1380170Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:12:40.1408510Z โ”‚ duration in microseconds 2023-01-13T03:12:40.1436970Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:12:40.1463850Z โ”‚ (showing 2.05kB/6.06kB) 2023-01-13T03:12:40.1496370Z โ”” 2023-01-13T03:12:40.1505670Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:40.1573280Z 1ms 455ยตs (cache) (cache) 2ms 1ms 62ยตs 6ms 2023-01-13T03:12:40.1629370Z 2023-01-13T03:12:40.1656660Z โœ“ Successful GET request 2023-01-13T03:12:40.1661520Z 2023-01-13T03:12:40.1670920Z Iteration 15/24 2023-01-13T03:12:40.1674610Z 2023-01-13T03:12:40.1681360Z โ†’ Model Zoo - Register Model 2023-01-13T03:12:50.3208330Z POST http://localhost:8081/models?url=maskrcnn.mar&model_name=maskrcnn&initial_workers=1&synchronous=true 2023-01-13T03:12:50.3255440Z 200 OK โ˜… 10.3s time โ˜… 324Bโ†‘ 350Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:12:50.3285810Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 84B 2023-01-13T03:12:50.3386720Z โ”‚ { 2023-01-13T03:12:50.3416630Z โ”‚ "status": "Model \"maskrcnn\" Version: 1.0 registere 2023-01-13T03:12:50.3449920Z โ”‚ d with 1 initial workers" 2023-01-13T03:12:50.3510800Z โ”‚ } 2023-01-13T03:12:50.3521420Z โ”” 2023-01-13T03:12:50.3575850Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:12:50.3628430Z 2ms 301ยตs (cache) (cache) 10.3s 1ms 57ยตs 10.3s 2023-01-13T03:12:50.3673130Z 2023-01-13T03:12:50.3705860Z โœ“ Successful POST request 2023-01-13T03:12:50.3716030Z 2023-01-13T03:12:50.3743610Z โ†’ Model Zoo - Inference Model 2023-01-13T03:13:02.9603330Z POST http://localhost:8080/predictions/maskrcnn 2023-01-13T03:13:02.9611600Z 200 OK โ˜… 12.6s time โ˜… 289.21kBโ†‘ 2.99kBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:02.9634340Z โ”Œ โ†‘ file โ˜… 288.94kB 2023-01-13T03:13:02.9637760Z โ”‚ (showing 2.05kB/288.94kB) 2023-01-13T03:13:02.9640650Z โ”” 2023-01-13T03:13:02.9663970Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 2.75kB 2023-01-13T03:13:02.9691260Z โ”‚ [ 2023-01-13T03:13:02.9715890Z โ”‚ { 2023-01-13T03:13:02.9734970Z โ”‚ "person": [ 2023-01-13T03:13:02.9749580Z โ”‚ 169.50631713867188, 2023-01-13T03:13:02.9751100Z โ”‚ 49.98546600341797, 2023-01-13T03:13:02.9757300Z โ”‚ 300.8945617675781, 2023-01-13T03:13:02.9764210Z โ”‚ 442.4545593261719 2023-01-13T03:13:02.9772480Z โ”‚ ], 2023-01-13T03:13:02.9774350Z โ”‚ "score": 0.9995434880256653 2023-01-13T03:13:02.9784490Z โ”‚ }, 2023-01-13T03:13:02.9787020Z โ”‚ { 2023-01-13T03:13:02.9787740Z โ”‚ "person": [ 2023-01-13T03:13:02.9789770Z โ”‚ 90.4118423461914, 2023-01-13T03:13:02.9791520Z โ”‚ 66.79052734375, 2023-01-13T03:13:02.9805780Z โ”‚ 194.1930389404297, 2023-01-13T03:13:02.9806610Z โ”‚ 437.2776794433594 2023-01-13T03:13:02.9807540Z โ”‚ ], 2023-01-13T03:13:02.9811220Z โ”‚ "score": 0.9993956089019775 2023-01-13T03:13:02.9812020Z โ”‚ }, 2023-01-13T03:13:02.9816750Z โ”‚ { 2023-01-13T03:13:02.9829350Z โ”‚ "person": [ 2023-01-13T03:13:02.9842320Z โ”‚ 362.3172302246094, 2023-01-13T03:13:02.9846350Z โ”‚ 158.1734161376953, 2023-01-13T03:13:02.9861520Z โ”‚ 521.2589721679688, 2023-01-13T03:13:02.9962950Z โ”‚ 385.7227478027344 2023-01-13T03:13:03.0064720Z โ”‚ ], 2023-01-13T03:13:03.0166300Z โ”‚ "score": 0.9952279329299927 2023-01-13T03:13:03.0261250Z โ”‚ }, 2023-01-13T03:13:03.0262400Z โ”‚ { 2023-01-13T03:13:03.0263070Z โ”‚ "handbag": [ 2023-01-13T03:13:03.0364700Z โ”‚ 68.57540893554688, 2023-01-13T03:13:03.0365160Z โ”‚ 279.3182067871094, 2023-01-13T03:13:03.0374880Z โ”‚ 111.15328979492188, 2023-01-13T03:13:03.0375700Z โ”‚ 400.9166564941406 2023-01-13T03:13:03.0377000Z โ”‚ ], 2023-01-13T03:13:03.0445250Z โ”‚ "score": 0.9938817024230957 2023-01-13T03:13:03.0546890Z โ”‚ }, 2023-01-13T03:13:03.0648230Z โ”‚ { 2023-01-13T03:13:03.0731140Z โ”‚ "person": [ 2023-01-13T03:13:03.0734380Z โ”‚ 474.01568603515625, 2023-01-13T03:13:03.0735200Z โ”‚ 147.3480224609375, 2023-01-13T03:13:03.0735930Z โ”‚ 638.1207275390625, 2023-01-13T03:13:03.0736680Z โ”‚ 364.6508483886719 2023-01-13T03:13:03.0737380Z โ”‚ ], 2023-01-13T03:13:03.0738100Z โ”‚ "score": 0.9897462129592896 2023-01-13T03:13:03.0739460Z โ”‚ }, 2023-01-13T03:13:03.0741770Z โ”‚ { 2023-01-13T03:13:03.0742580Z โ”‚ "handbag": [ 2023-01-13T03:13:03.0844210Z โ”‚ 225.59584045410156, 2023-01-13T03:13:03.0945750Z โ”‚ 142.90003967285156, 2023-01-13T03:13:03.1047280Z โ”‚ 302.48638916015625, 2023-01-13T03:13:03.1148760Z โ”‚ 230.32838439941406 2023-01-13T03:13:03.1250340Z โ”‚ ], 2023-01-13T03:13:03.1351950Z โ”‚ "score": 0.9891214966773987 2023-01-13T03:13:03.1453400Z โ”‚ }, 2023-01-13T03:13:03.1556690Z โ”‚ { 2023-01-13T03:13:03.1658140Z โ”‚ "handbag": [ 2023-01-13T03:13:03.1759720Z โ”‚ 380.2604675292969, 2023-01-13T03:13:03.1860210Z โ”‚ 259.20135498046875, 2023-01-13T03:13:03.1889890Z โ”‚ 419.53656005859375, 2023-01-13T03:13:03.1991960Z โ”‚ 318.27728271484375 2023-01-13T03:13:03.2018010Z โ”‚ ], 2023-01-13T03:13:03.2120020Z โ”‚ "score": 0.9688040614128113 2023-01-13T03:13:03.2221790Z โ”‚ }, 2023-01-13T03:13:03.2323320Z โ”‚ { 2023-01-13T03:13:03.2423790Z โ”‚ "bench": [ 2023-01-13T03:13:03.2524610Z โ”‚ 273.48565673828125, 2023-01-13T03:13:03.2626260Z โ”‚ 217.4885711669922, 2023-01-13T03:13:03.2727830Z โ”‚ 441.06439208984375, 2023-01-13T03:13:03.2829300Z โ”‚ 396.241455078125 2023-01-13T03:13:03.2870460Z โ”‚ ], 2023-01-13T03:13:03.2910250Z โ”‚ "score": 0.9617533683776855 2023-01-13T03:13:03.2961960Z โ”‚ }, 2023-01-13T03:13:03.3028340Z โ”‚ { 2023-01-13T03:13:03.3053920Z โ”‚ "person": [ 2023-01-13T03:13:03.3110300Z โ”‚ 541.289794921875, 2023-01-13T03:13:03.3167860Z โ”‚ 156.66123962402344, 2023-01-13T03:13:03.3222940Z โ”‚ 619.938232421875, 2023-01-13T03:13:03.3252380Z โ”‚ 249.45277404785156 2023-01-13T03:13:03.3295920Z โ”‚ ], 2023-01-13T03:13:03.3358000Z โ”‚ "score": 0.8177030682563782 2023-01-13T03:13:03.3389230Z โ”‚ }, 2023-01-13T03:13:03.3417140Z โ”‚ { 2023-01-13T03:13:03.3436380Z โ”‚ "person": [ 2023-01-13T03:13:03.3459550Z โ”‚ 362.9620666503906, 2023-01-13T03:13:03.3487980Z โ”‚ 163.8992462158203, 2023-01-13T03:13:03.3488320Z โ”‚ 500.7699279785156, 2023-01-13T03:13:03.3488680Z โ”‚ 293.9123840332031 2023-01-13T03:13:03.3515470Z โ”‚ ], 2023-01-13T03:13:03.3542640Z โ”‚ "score": 0.80169278383255 2023-01-13T03:13:03.3546310Z โ”‚ }, 2023-01-13T03:13:03.3573090Z โ”‚ { 2023-01-13T03:13:03.3586220Z โ”‚ "chair": [ 2023-01-13T03:13:03.3588960Z โ”‚ 455.20855712890625, 2023-01-13T03:13:03.3589970Z โ”‚ 207.54006958007812, 2023-01-13T03:13:03.3593590Z โ”‚ 491.0853271484375, 2023-01-13T03:13:03.3608140Z โ”‚ 274.64752197265625 2023-01-13T03:13:03.3621550Z โ”‚ ], 2023-01-13T03:13:03.3684530Z โ”‚ "score": 0.7758278846740723 2023-01-13T03:13:03.3694160Z โ”‚ }, 2023-01-13T03:13:03.3694820Z โ”‚ { 2023-01-13T03:13:03.3697850Z โ”‚ "person": [ 2023-01-13T03:13:03.3698600Z โ”‚ 549.154052734375, 2023-01-13T03:13:03.3699340Z โ”‚ 177.42166137695312, 2023-01-13T03:13:03.3700010Z โ”‚ 640.0, 2023-01-13T03:13:03.3700750Z โ”‚ 364.5394592285156 2023-01-13T03:13:03.3701440Z โ”‚ ], 2023-01-13T03:13:03.3702160Z โ”‚ "score": 0.7176405787467957 2023-01-13T03:13:03.3702840Z โ”‚ }, 2023-01-13T03:13:03.3703500Z โ”‚ { 2023-01-13T03:13:03.3705550Z โ”‚ "person": [ 2023-01-13T03:13:03.3706270Z โ”‚ 626.230712890625, 2023-01-13T03:13:03.3708740Z โ”‚ 178.65342712402344, 2023-01-13T03:13:03.3709520Z โ”‚ 640.0, 2023-01-13T03:13:03.3710230Z โ”‚ 246. 2023-01-13T03:13:03.3711050Z โ”‚ (showing 2.05kB/2.75kB) 2023-01-13T03:13:03.3711930Z โ”” 2023-01-13T03:13:03.3714440Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:03.3715410Z 2ms 310ยตs (cache) (cache) 12.6s 2ms 48ยตs 12.6s 2023-01-13T03:13:03.3716020Z 2023-01-13T03:13:03.3716570Z โœ“ Successful POST request 2023-01-13T03:13:03.3717110Z 2023-01-13T03:13:03.3717660Z โ†’ Model Zoo - Unregister model 2023-01-13T03:13:03.3718730Z DELETE http://localhost:8081/models/maskrcnn 2023-01-13T03:13:03.3719720Z 200 OK โ˜… 38ms time โ˜… 244Bโ†‘ 316Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:03.3720530Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 50B 2023-01-13T03:13:03.3721260Z โ”‚ { 2023-01-13T03:13:03.3722030Z โ”‚ "status": "Model \"maskrcnn\" unregistered" 2023-01-13T03:13:03.3722750Z โ”‚ } 2023-01-13T03:13:03.3724750Z โ”” 2023-01-13T03:13:03.3725860Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:03.3726930Z 2ms 369ยตs (cache) (cache) 35ms 1ms 53ยตs 40ms 2023-01-13T03:13:03.3727370Z 2023-01-13T03:13:03.3727790Z โœ“ Successful DELETE request 2023-01-13T03:13:03.3728610Z 2023-01-13T03:13:03.3729050Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:13:03.3729600Z GET http://localhost:8082/metrics 2023-01-13T03:13:03.3730320Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 6.75kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:03.3731050Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 6.46kB 2023-01-13T03:13:03.3742550Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:13:03.3743390Z โ”‚ erence requests. 2023-01-13T03:13:03.3744060Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:13:03.3746100Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3746860Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:13:03.3747490Z โ”‚ default",} 1.0 2023-01-13T03:13:03.3748150Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3748840Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:13:03.3749470Z โ”‚ "default",} 1.0 2023-01-13T03:13:03.3750140Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3750870Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:13:03.3751480Z โ”‚ sion="default",} 1.0 2023-01-13T03:13:03.3752170Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3754180Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:13:03.3754870Z โ”‚ model_version="default",} 1.0 2023-01-13T03:13:03.3755620Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3756350Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:13:03.3756970Z โ”‚ ="default",} 1.0 2023-01-13T03:13:03.3757640Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3758330Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:13:03.3758940Z โ”‚ fault",} 1.0 2023-01-13T03:13:03.3759600Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3760310Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:13:03.3760960Z โ”‚ l_version="default",} 1.0 2023-01-13T03:13:03.3764260Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3771530Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:13:03.3772270Z โ”‚ l_version="default",} 1.0 2023-01-13T03:13:03.3772970Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3773720Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:13:03.3774350Z โ”‚ fault",} 1.0 2023-01-13T03:13:03.3776490Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3777230Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:13:03.3777890Z โ”‚ rsion="default",} 1.0 2023-01-13T03:13:03.3778570Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3779270Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:13:03.3789750Z โ”‚ rsion="default",} 1.0 2023-01-13T03:13:03.3790510Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3791240Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:13:03.3793310Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:13:03.3794460Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3795370Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:13:03.3796040Z โ”‚ on="default",} 1.0 2023-01-13T03:13:03.3796710Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3797170Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:13:03.3797830Z โ”‚ version="default",} 1.0 2023-01-13T03:13:03.3798500Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:03.3799220Z โ”‚ 966-f7a8f1df27fc",model_name="maskrcnn",model_version= 2023-01-13T03:13:03.3799850Z โ”‚ "default",} 1.0 2023-01-13T03:13:03.3801900Z โ”‚ (showing 2.05kB/6.46kB) 2023-01-13T03:13:03.3802450Z โ”” 2023-01-13T03:13:03.3804070Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:03.3805560Z 2ms 305ยตs (cache) (cache) 2ms 1ms 67ยตs 6ms 2023-01-13T03:13:03.3806040Z 2023-01-13T03:13:03.3806480Z โœ“ Successful GET request 2023-01-13T03:13:03.3806900Z 2023-01-13T03:13:03.3807190Z Iteration 16/24 2023-01-13T03:13:03.3807530Z 2023-01-13T03:13:03.3807960Z โ†’ Model Zoo - Register Model 2023-01-13T03:13:20.6536600Z POST http://localhost:8081/models?url=fcn_resnet_101.mar&model_name=fcn_resnet_101&initial_workers=1&synchronous=true 2023-01-13T03:13:20.6638690Z 200 OK โ˜… 17.5s time โ˜… 336Bโ†‘ 356Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:20.6722910Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 90B 2023-01-13T03:13:20.6778230Z โ”‚ { 2023-01-13T03:13:20.6778860Z โ”‚ "status": "Model \"fcn_resnet_101\" Version: 1.0 reg 2023-01-13T03:13:20.6779620Z โ”‚ istered with 1 initial workers" 2023-01-13T03:13:20.6782180Z โ”‚ } 2023-01-13T03:13:20.6783030Z โ”” 2023-01-13T03:13:20.6783960Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:20.6784910Z 3ms 364ยตs (cache) (cache) 17.5s 1ms 52ยตs 17.5s 2023-01-13T03:13:20.6785520Z 2023-01-13T03:13:20.6786050Z โœ“ Successful POST request 2023-01-13T03:13:20.6886760Z 2023-01-13T03:13:20.6909760Z โ†’ Model Zoo - Inference Model 2023-01-13T03:13:24.2927480Z POST http://localhost:8080/predictions/fcn_resnet_101 2023-01-13T03:13:24.3026050Z 200 OK โ˜… 3.5s time โ˜… 289.22kBโ†‘ 2.47MBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:24.3128570Z โ”Œ โ†‘ file โ˜… 288.94kB 2023-01-13T03:13:24.3230180Z โ”‚ (showing 2.05kB/288.94kB) 2023-01-13T03:13:24.3331860Z โ”” 2023-01-13T03:13:24.3433470Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 2.47MB 2023-01-13T03:13:24.3535090Z โ”‚ [ 2023-01-13T03:13:24.3636640Z โ”‚ [ 2023-01-13T03:13:24.3730200Z โ”‚ [ 2023-01-13T03:13:24.3831640Z โ”‚ 0.0, 2023-01-13T03:13:24.3933310Z โ”‚ 0.9993855953216553 2023-01-13T03:13:24.4034860Z โ”‚ ], 2023-01-13T03:13:24.4136290Z โ”‚ [ 2023-01-13T03:13:24.4237840Z โ”‚ 0.0, 2023-01-13T03:13:24.4327390Z โ”‚ 0.9993855953216553 2023-01-13T03:13:24.4404360Z โ”‚ ], 2023-01-13T03:13:24.4455650Z โ”‚ [ 2023-01-13T03:13:24.4557260Z โ”‚ 0.0, 2023-01-13T03:13:24.4605260Z โ”‚ 0.9993855953216553 2023-01-13T03:13:24.4703920Z โ”‚ ], 2023-01-13T03:13:24.4747040Z โ”‚ [ 2023-01-13T03:13:24.4848820Z โ”‚ 0.0, 2023-01-13T03:13:24.4931660Z โ”‚ 0.9993855953216553 2023-01-13T03:13:24.4987990Z โ”‚ ], 2023-01-13T03:13:24.5085420Z โ”‚ [ 2023-01-13T03:13:24.5187170Z โ”‚ 0.0, 2023-01-13T03:13:24.5288830Z โ”‚ 0.9993864297866821 2023-01-13T03:13:24.5380820Z โ”‚ ], 2023-01-13T03:13:24.5417840Z โ”‚ [ 2023-01-13T03:13:24.5453880Z โ”‚ 0.0, 2023-01-13T03:13:24.5555730Z โ”‚ 0.9993854761123657 2023-01-13T03:13:24.5556720Z โ”‚ ], 2023-01-13T03:13:24.5557520Z โ”‚ [ 2023-01-13T03:13:24.5557750Z โ”‚ 0.0, 2023-01-13T03:13:24.5558040Z โ”‚ 0.9993811845779419 2023-01-13T03:13:24.5558290Z โ”‚ ], 2023-01-13T03:13:24.5558500Z โ”‚ [ 2023-01-13T03:13:24.5558730Z โ”‚ 0.0, 2023-01-13T03:13:24.5558990Z โ”‚ 0.9993742108345032 2023-01-13T03:13:24.5559580Z โ”‚ ], 2023-01-13T03:13:24.5559900Z โ”‚ [ 2023-01-13T03:13:24.5560130Z โ”‚ 0.0, 2023-01-13T03:13:24.5560390Z โ”‚ 0.9993641972541809 2023-01-13T03:13:24.5560630Z โ”‚ ], 2023-01-13T03:13:24.5560850Z โ”‚ [ 2023-01-13T03:13:24.5561070Z โ”‚ 0.0, 2023-01-13T03:13:24.5561330Z โ”‚ 0.9993515610694885 2023-01-13T03:13:24.5561570Z โ”‚ ], 2023-01-13T03:13:24.5561780Z โ”‚ [ 2023-01-13T03:13:24.5562020Z โ”‚ 0.0, 2023-01-13T03:13:24.5562280Z โ”‚ 0.9993364214897156 2023-01-13T03:13:24.5562520Z โ”‚ ], 2023-01-13T03:13:24.5562730Z โ”‚ [ 2023-01-13T03:13:24.5562960Z โ”‚ 0.0, 2023-01-13T03:13:24.5563220Z โ”‚ 0.9993187189102173 2023-01-13T03:13:24.5563470Z โ”‚ ], 2023-01-13T03:13:24.5563700Z โ”‚ [ 2023-01-13T03:13:24.5563920Z โ”‚ 0.0, 2023-01-13T03:13:24.5564170Z โ”‚ 0.9992934465408325 2023-01-13T03:13:24.5564410Z โ”‚ ], 2023-01-13T03:13:24.5564630Z โ”‚ [ 2023-01-13T03:13:24.5564850Z โ”‚ 0.0, 2023-01-13T03:13:24.5565120Z โ”‚ 0.9992607235908508 2023-01-13T03:13:24.5565360Z โ”‚ ], 2023-01-13T03:13:24.5565570Z โ”‚ [ 2023-01-13T03:13:24.5565800Z โ”‚ 0.0, 2023-01-13T03:13:24.5566060Z โ”‚ 0.9992249011993408 2023-01-13T03:13:24.5566290Z โ”‚ ], 2023-01-13T03:13:24.5566510Z โ”‚ [ 2023-01-13T03:13:24.5566960Z โ”‚ 0.0, 2023-01-13T03:13:24.5567220Z โ”‚ 0.9991866946220398 2023-01-13T03:13:24.5567450Z โ”‚ ], 2023-01-13T03:13:24.5567680Z โ”‚ [ 2023-01-13T03:13:24.5567890Z โ”‚ 0.0, 2023-01-13T03:13:24.5568150Z โ”‚ 0.9991452693939209 2023-01-13T03:13:24.5568390Z โ”‚ ], 2023-01-13T03:13:24.5638560Z โ”‚ [ 2023-01-13T03:13:24.5688560Z โ”‚ 0.0, 2023-01-13T03:13:24.5707150Z โ”‚ 0.9991005659103394 2023-01-13T03:13:24.5714690Z โ”‚ ], 2023-01-13T03:13:24.5762680Z โ”‚ [ 2023-01-13T03:13:24.5774520Z โ”‚ 0.0, 2023-01-13T03:13:24.5787170Z โ”‚ 0.9990523457527161 2023-01-13T03:13:24.5799500Z โ”‚ ], 2023-01-13T03:13:24.5831460Z โ”‚ [ 2023-01-13T03:13:24.5847580Z โ”‚ 0.0, 2023-01-13T03:13:24.5883150Z โ”‚ 0.9990004897117615 2023-01-13T03:13:24.5889830Z โ”‚ ], 2023-01-13T03:13:24.5901850Z โ”‚ [ 2023-01-13T03:13:24.5902210Z โ”‚ 0.0, 2023-01-13T03:13:24.5904640Z โ”‚ 0.998968243598938 2023-01-13T03:13:24.5928990Z โ”‚ ], 2023-01-13T03:13:24.5941160Z โ”‚ [ 2023-01-13T03:13:24.5949300Z โ”‚ 0.0, 2023-01-13T03:13:24.5968240Z โ”‚ 0.9989572763442993 2023-01-13T03:13:24.5977770Z โ”‚ ], 2023-01-13T03:13:24.5992720Z โ”‚ [ 2023-01-13T03:13:24.6000930Z โ”‚ 0.0, 2023-01-13T03:13:24.6010180Z โ”‚ 0.9989455342292786 2023-01-13T03:13:24.6015730Z โ”‚ ], 2023-01-13T03:13:24.6092410Z โ”‚ [ 2023-01-13T03:13:24.6123230Z โ”‚ 0.0, 2023-01-13T03:13:24.6152950Z โ”‚ 0.9989331364631653 2023-01-13T03:13:24.6181280Z โ”‚ ], 2023-01-13T03:13:24.6199840Z โ”‚ [ 2023-01-13T03:13:24.6227260Z โ”‚ 0.0, 2023-01-13T03:13:24.6245440Z โ”‚ 0.9989200830459595 2023-01-13T03:13:24.6270560Z โ”‚ ], 2023-01-13T03:13:24.6372250Z โ”‚ [ 2023-01-13T03:13:24.6473900Z โ”‚ 0.0, 2023-01-13T03:13:24.6575540Z โ”‚ 0.9989060163497925 2023-01-13T03:13:24.6642910Z โ”‚ ], 2023-01-13T03:13:24.6657970Z โ”‚ [ 2023-01-13T03:13:24.6682130Z โ”‚ 0.0, 2023-01-13T03:13:24.6692310Z โ”‚ 0.998891294002533 2023-01-13T03:13:24.6789370Z โ”‚ ], 2023-01-13T03:13:24.6813050Z โ”‚ [ 2023-01-13T03:13:24.6914650Z โ”‚ 0.0, 2023-01-13T03:13:24.7017780Z โ”‚ 0.9988754391670227 2023-01-13T03:13:24.7041900Z โ”‚ ], 2023-01-13T03:13:24.7069610Z โ”‚ [ 2023-01-13T03:13:24.7100250Z โ”‚ 0.0, 2023-01-13T03:13:24.7147220Z โ”‚ 0.9988815188407898 2023-01-13T03:13:24.7171130Z โ”‚ ], 2023-01-13T03:13:24.7179990Z โ”‚ [ 2023-01-13T03:13:24.7193750Z โ”‚ 0.0, 2023-01-13T03:13:24.7221080Z โ”‚ 0.9989089965820312 2023-01-13T03:13:24.7249440Z โ”‚ ], 2023-01-13T03:13:24.7351490Z โ”‚ [ 2023-01-13T03:13:24.7453060Z โ”‚ 0.0, 2023-01-13T03:13:24.7554690Z โ”‚ 0.9989352822303772 2023-01-13T03:13:24.7593980Z โ”‚ ], 2023-01-13T03:13:24.7651090Z โ”‚ [ 2023-01-13T03:13:24.7691760Z โ”‚ 0.0, 2023-01-13T03:13:24.7722430Z โ”‚ 0.9989607334136963 2023-01-13T03:13:24.7767250Z โ”‚ ], 2023-01-13T03:13:24.7806660Z โ”‚ [ 2023-01-13T03:13:24.7841470Z โ”‚ 0.0, 2023-01-13T03:13:24.7879770Z โ”‚ 0.9989848732948303 2023-01-13T03:13:24.7915670Z โ”‚ ], 2023-01-13T03:13:24.7930190Z โ”‚ [ 2023-01-13T03:13:24.7953140Z โ”‚ 0.0, 2023-01-13T03:13:24.7964620Z โ”‚ 0.9990076422691345 2023-01-13T03:13:24.7987250Z โ”‚ ], 2023-01-13T03:13:24.8006760Z โ”‚ [ 2023-01-13T03:13:24.8015930Z โ”‚ 0.0, 2023-01-13T03:13:24.8025600Z โ”‚ 0.9990293979644775 2023-01-13T03:13:24.8041610Z โ”‚ ], 2023-01-13T03:13:24.8057980Z โ”‚ [ 2023-01-13T03:13:24.8074240Z โ”‚ 0.0, 2023-01-13T03:13:24.8091040Z โ”‚ 0.9990498423576355 2023-01-13T03:13:24.8123470Z โ”‚ ], 2023-01-13T03:13:24.8133210Z โ”‚ [ 2023-01-13T03:13:24.8154350Z โ”‚ 0.0, 2023-01-13T03:13:24.8157670Z โ”‚ 0.999051034450531 2023-01-13T03:13:24.8174650Z โ”‚ ], 2023-01-13T03:13:24.8192800Z โ”‚ [ 2023-01-13T03:13:24.8213680Z โ”‚ 0.0, 2023-01-13T03:13:24.8227800Z โ”‚ 0.9990313053131104 2023-01-13T03:13:24.8243510Z โ”‚ ], 2023-01-13T03:13:24.8254950Z โ”‚ [ 2023-01-13T03:13:24.8285570Z โ”‚ 0.0, 2023-01-13T03:13:24.8313330Z โ”‚ 0.9990096092224121 2023-01-13T03:13:24.8334550Z โ”‚ ], 2023-01-13T03:13:24.8347360Z โ”‚ [ 2023-01-13T03:13:24.8386710Z โ”‚ 0.0, 2023-01-13T03:13:24.8387180Z โ”‚ 0.9989851117134094 2023-01-13T03:13:24.8413970Z โ”‚ ], 2023-01-13T03:13:24.8436240Z โ”‚ [ 2023-01-13T03:13:24.8473150Z โ”‚ 0.0, 2023-01-13T03:13:24.8507220Z โ”‚ 0.9989587068557739 2023-01-13T03:13:24.8535570Z โ”‚ ], 2023-01-13T03:13:24.8562190Z โ”‚ [ 2023-01-13T03:13:24.8593230Z โ”‚ 0.0, 2023-01-13T03:13:24.8626120Z โ”‚ 0.99892979860 2023-01-13T03:13:24.8662720Z โ”‚ (showing 2.05kB/2.47MB) 2023-01-13T03:13:24.8706930Z โ”” 2023-01-13T03:13:24.8733560Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:24.8766260Z 5ms 513ยตs (cache) (cache) 3.5s 6ms 1ms 3.6s 2023-01-13T03:13:24.8804330Z 2023-01-13T03:13:24.8845690Z โœ“ Successful POST request 2023-01-13T03:13:24.8870560Z 2023-01-13T03:13:24.8880590Z โ†’ Model Zoo - Unregister model 2023-01-13T03:13:24.8915600Z DELETE http://localhost:8081/models/fcn_resnet_101 2023-01-13T03:13:24.8936820Z 200 OK โ˜… 40ms time โ˜… 250Bโ†‘ 322Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:24.8970370Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 56B 2023-01-13T03:13:24.9009250Z โ”‚ { 2023-01-13T03:13:24.9040020Z โ”‚ "status": "Model \"fcn_resnet_101\" unregistered" 2023-01-13T03:13:24.9056050Z โ”‚ } 2023-01-13T03:13:24.9061310Z โ”” 2023-01-13T03:13:24.9097350Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:24.9117740Z 5ms 543ยตs (cache) (cache) 37ms 1ms 79ยตs 45ms 2023-01-13T03:13:24.9134570Z 2023-01-13T03:13:24.9160710Z โœ“ Successful DELETE request 2023-01-13T03:13:24.9196300Z 2023-01-13T03:13:24.9214790Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:13:24.9253400Z GET http://localhost:8082/metrics 2023-01-13T03:13:24.9263000Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 7.16kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:24.9271240Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 6.87kB 2023-01-13T03:13:24.9279230Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:13:24.9288410Z โ”‚ erence requests. 2023-01-13T03:13:24.9321410Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:13:24.9363640Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9403160Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:13:24.9447260Z โ”‚ default",} 1.0 2023-01-13T03:13:24.9504100Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9507890Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:13:24.9518820Z โ”‚ "default",} 1.0 2023-01-13T03:13:24.9520670Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9528530Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:13:24.9548150Z โ”‚ sion="default",} 1.0 2023-01-13T03:13:24.9576470Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9609560Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:13:24.9624870Z โ”‚ model_version="default",} 1.0 2023-01-13T03:13:24.9651380Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9661210Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:13:24.9661660Z โ”‚ ="default",} 1.0 2023-01-13T03:13:24.9663660Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9673570Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:13:24.9675670Z โ”‚ fault",} 1.0 2023-01-13T03:13:24.9687490Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9731610Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:13:24.9758540Z โ”‚ l_version="default",} 1.0 2023-01-13T03:13:24.9785790Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9793880Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:13:24.9822330Z โ”‚ l_version="default",} 1.0 2023-01-13T03:13:24.9851930Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9887510Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:13:24.9931090Z โ”‚ fault",} 1.0 2023-01-13T03:13:24.9942470Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:24.9955550Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:13:24.9982150Z โ”‚ rsion="default",} 1.0 2023-01-13T03:13:25.0005610Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:25.0010630Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:13:25.0019050Z โ”‚ rsion="default",} 1.0 2023-01-13T03:13:25.0024560Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:25.0056490Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:13:25.0134080Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:13:25.0134640Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:25.0161640Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101",model_ve 2023-01-13T03:13:25.0201180Z โ”‚ rsion="default",} 1.0 2023-01-13T03:13:25.0228550Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:25.0257800Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:13:25.0284180Z โ”‚ on="default",} 1.0 2023-01-13T03:13:25.0313480Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:25.0331210Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:13:25.0345330Z โ”‚ version="default" 2023-01-13T03:13:25.0373050Z โ”‚ (showing 2.05kB/6.87kB) 2023-01-13T03:13:25.0396390Z โ”” 2023-01-13T03:13:25.0420170Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:25.0464930Z 1ms 348ยตs (cache) (cache) 2ms 1ms 56ยตs 5ms 2023-01-13T03:13:25.0481830Z 2023-01-13T03:13:25.0514590Z โœ“ Successful GET request 2023-01-13T03:13:25.0547240Z 2023-01-13T03:13:25.0584760Z Iteration 17/24 2023-01-13T03:13:25.0599790Z 2023-01-13T03:13:25.0619190Z โ†’ Model Zoo - Register Model 2023-01-13T03:13:40.7602420Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/fcn_resnet_101_scripted.mar&model_name=fcn_resnet_101_scripted&initial_workers=1&synchronous=true 2023-01-13T03:13:40.7610410Z 200 OK โ˜… 16s time โ˜… 395Bโ†‘ 365Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:40.7625500Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 99B 2023-01-13T03:13:40.7665560Z โ”‚ { 2023-01-13T03:13:40.7687140Z โ”‚ "status": "Model \"fcn_resnet_101_scripted\" Version 2023-01-13T03:13:40.7692640Z โ”‚ : 1.0 registered with 1 initial workers" 2023-01-13T03:13:40.7712400Z โ”‚ } 2023-01-13T03:13:40.7741930Z โ”” 2023-01-13T03:13:40.7762600Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:40.7779320Z 1ms 350ยตs (cache) (cache) 16s 1ms 58ยตs 16s 2023-01-13T03:13:40.7779600Z 2023-01-13T03:13:40.7782720Z โœ“ Successful POST request 2023-01-13T03:13:40.7800590Z 2023-01-13T03:13:40.7821420Z โ†’ Model Zoo - Inference Model 2023-01-13T03:13:44.4089150Z POST http://localhost:8080/predictions/fcn_resnet_101_scripted 2023-01-13T03:13:44.4192650Z 200 OK โ˜… 3.6s time โ˜… 289.23kBโ†‘ 2.47MBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:44.4294480Z โ”Œ โ†‘ file โ˜… 288.94kB 2023-01-13T03:13:44.4401340Z โ”‚ (showing 2.05kB/288.94kB) 2023-01-13T03:13:44.4524970Z โ”” 2023-01-13T03:13:44.4634630Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 2.47MB 2023-01-13T03:13:44.4736710Z โ”‚ [ 2023-01-13T03:13:44.4845670Z โ”‚ [ 2023-01-13T03:13:44.4947320Z โ”‚ [ 2023-01-13T03:13:44.5072520Z โ”‚ 0.0, 2023-01-13T03:13:44.5181440Z โ”‚ 0.9993855953216553 2023-01-13T03:13:44.5287990Z โ”‚ ], 2023-01-13T03:13:44.5391630Z โ”‚ [ 2023-01-13T03:13:44.5493170Z โ”‚ 0.0, 2023-01-13T03:13:44.5593890Z โ”‚ 0.9993855953216553 2023-01-13T03:13:44.5678500Z โ”‚ ], 2023-01-13T03:13:44.5757630Z โ”‚ [ 2023-01-13T03:13:44.5786430Z โ”‚ 0.0, 2023-01-13T03:13:44.5838050Z โ”‚ 0.9993855953216553 2023-01-13T03:13:44.5863020Z โ”‚ ], 2023-01-13T03:13:44.5910080Z โ”‚ [ 2023-01-13T03:13:44.5960020Z โ”‚ 0.0, 2023-01-13T03:13:44.6039310Z โ”‚ 0.9993855953216553 2023-01-13T03:13:44.6104180Z โ”‚ ], 2023-01-13T03:13:44.6158870Z โ”‚ [ 2023-01-13T03:13:44.6193290Z โ”‚ 0.0, 2023-01-13T03:13:44.6239100Z โ”‚ 0.9993864297866821 2023-01-13T03:13:44.6279480Z โ”‚ ], 2023-01-13T03:13:44.6327950Z โ”‚ [ 2023-01-13T03:13:44.6413160Z โ”‚ 0.0, 2023-01-13T03:13:44.6515060Z โ”‚ 0.9993854761123657 2023-01-13T03:13:44.6582510Z โ”‚ ], 2023-01-13T03:13:44.6634480Z โ”‚ [ 2023-01-13T03:13:44.6702490Z โ”‚ 0.0, 2023-01-13T03:13:44.6756470Z โ”‚ 0.9993811845779419 2023-01-13T03:13:44.6791080Z โ”‚ ], 2023-01-13T03:13:44.6830480Z โ”‚ [ 2023-01-13T03:13:44.6873560Z โ”‚ 0.0, 2023-01-13T03:13:44.6878580Z โ”‚ 0.9993742108345032 2023-01-13T03:13:44.6900990Z โ”‚ ], 2023-01-13T03:13:44.6920540Z โ”‚ [ 2023-01-13T03:13:44.6944350Z โ”‚ 0.0, 2023-01-13T03:13:44.6954040Z โ”‚ 0.9993641972541809 2023-01-13T03:13:44.6978000Z โ”‚ ], 2023-01-13T03:13:44.7025120Z โ”‚ [ 2023-01-13T03:13:44.7074420Z โ”‚ 0.0, 2023-01-13T03:13:44.7088260Z โ”‚ 0.9993515610694885 2023-01-13T03:13:44.7102880Z โ”‚ ], 2023-01-13T03:13:44.7115390Z โ”‚ [ 2023-01-13T03:13:44.7143670Z โ”‚ 0.0, 2023-01-13T03:13:44.7155130Z โ”‚ 0.9993364214897156 2023-01-13T03:13:44.7158460Z โ”‚ ], 2023-01-13T03:13:44.7164630Z โ”‚ [ 2023-01-13T03:13:44.7183550Z โ”‚ 0.0, 2023-01-13T03:13:44.7201260Z โ”‚ 0.9993187189102173 2023-01-13T03:13:44.7219470Z โ”‚ ], 2023-01-13T03:13:44.7224490Z โ”‚ [ 2023-01-13T03:13:44.7259280Z โ”‚ 0.0, 2023-01-13T03:13:44.7329540Z โ”‚ 0.9992934465408325 2023-01-13T03:13:44.7335410Z โ”‚ ], 2023-01-13T03:13:44.7343690Z โ”‚ [ 2023-01-13T03:13:44.7384930Z โ”‚ 0.0, 2023-01-13T03:13:44.7389210Z โ”‚ 0.9992607235908508 2023-01-13T03:13:44.7395420Z โ”‚ ], 2023-01-13T03:13:44.7406810Z โ”‚ [ 2023-01-13T03:13:44.7439430Z โ”‚ 0.0, 2023-01-13T03:13:44.7464650Z โ”‚ 0.9992249011993408 2023-01-13T03:13:44.7498930Z โ”‚ ], 2023-01-13T03:13:44.7523810Z โ”‚ [ 2023-01-13T03:13:44.7625460Z โ”‚ 0.0, 2023-01-13T03:13:44.7727330Z โ”‚ 0.9991866946220398 2023-01-13T03:13:44.7829140Z โ”‚ ], 2023-01-13T03:13:44.7933080Z โ”‚ [ 2023-01-13T03:13:44.8034740Z โ”‚ 0.0, 2023-01-13T03:13:44.8136470Z โ”‚ 0.9991452693939209 2023-01-13T03:13:44.8238000Z โ”‚ ], 2023-01-13T03:13:44.8339720Z โ”‚ [ 2023-01-13T03:13:44.8443010Z โ”‚ 0.0, 2023-01-13T03:13:44.8544770Z โ”‚ 0.9991005659103394 2023-01-13T03:13:44.8647130Z โ”‚ ], 2023-01-13T03:13:44.8750770Z โ”‚ [ 2023-01-13T03:13:44.8852550Z โ”‚ 0.0, 2023-01-13T03:13:44.8954210Z โ”‚ 0.9990523457527161 2023-01-13T03:13:44.9055840Z โ”‚ ], 2023-01-13T03:13:44.9157510Z โ”‚ [ 2023-01-13T03:13:44.9259040Z โ”‚ 0.0, 2023-01-13T03:13:44.9360820Z โ”‚ 0.9990004897117615 2023-01-13T03:13:44.9462660Z โ”‚ ], 2023-01-13T03:13:44.9564300Z โ”‚ [ 2023-01-13T03:13:44.9665840Z โ”‚ 0.0, 2023-01-13T03:13:44.9767580Z โ”‚ 0.998968243598938 2023-01-13T03:13:44.9806490Z โ”‚ ], 2023-01-13T03:13:44.9860620Z โ”‚ [ 2023-01-13T03:13:44.9876030Z โ”‚ 0.0, 2023-01-13T03:13:44.9914680Z โ”‚ 0.9989572763442993 2023-01-13T03:13:44.9941660Z โ”‚ ], 2023-01-13T03:13:44.9982190Z โ”‚ [ 2023-01-13T03:13:45.0040510Z โ”‚ 0.0, 2023-01-13T03:13:45.0142620Z โ”‚ 0.9989455342292786 2023-01-13T03:13:45.0227740Z โ”‚ ], 2023-01-13T03:13:45.0306900Z โ”‚ [ 2023-01-13T03:13:45.0392670Z โ”‚ 0.0, 2023-01-13T03:13:45.0436560Z โ”‚ 0.9989331364631653 2023-01-13T03:13:45.0511770Z โ”‚ ], 2023-01-13T03:13:45.0535010Z โ”‚ [ 2023-01-13T03:13:45.0560830Z โ”‚ 0.0, 2023-01-13T03:13:45.0586370Z โ”‚ 0.9989200830459595 2023-01-13T03:13:45.0637120Z โ”‚ ], 2023-01-13T03:13:45.0646080Z โ”‚ [ 2023-01-13T03:13:45.0669680Z โ”‚ 0.0, 2023-01-13T03:13:45.0694330Z โ”‚ 0.9989060163497925 2023-01-13T03:13:45.0709280Z โ”‚ ], 2023-01-13T03:13:45.0747160Z โ”‚ [ 2023-01-13T03:13:45.0772610Z โ”‚ 0.0, 2023-01-13T03:13:45.0806620Z โ”‚ 0.998891294002533 2023-01-13T03:13:45.0832590Z โ”‚ ], 2023-01-13T03:13:45.0843710Z โ”‚ [ 2023-01-13T03:13:45.0858580Z โ”‚ 0.0, 2023-01-13T03:13:45.0889240Z โ”‚ 0.9988754391670227 2023-01-13T03:13:45.0898120Z โ”‚ ], 2023-01-13T03:13:45.0930780Z โ”‚ [ 2023-01-13T03:13:45.0960690Z โ”‚ 0.0, 2023-01-13T03:13:45.0973220Z โ”‚ 0.9988815188407898 2023-01-13T03:13:45.1008840Z โ”‚ ], 2023-01-13T03:13:45.1028830Z โ”‚ [ 2023-01-13T03:13:45.1048380Z โ”‚ 0.0, 2023-01-13T03:13:45.1078070Z โ”‚ 0.9989089965820312 2023-01-13T03:13:45.1113380Z โ”‚ ], 2023-01-13T03:13:45.1133200Z โ”‚ [ 2023-01-13T03:13:45.1141360Z โ”‚ 0.0, 2023-01-13T03:13:45.1142580Z โ”‚ 0.9989352822303772 2023-01-13T03:13:45.1145430Z โ”‚ ], 2023-01-13T03:13:45.1171550Z โ”‚ [ 2023-01-13T03:13:45.1185810Z โ”‚ 0.0, 2023-01-13T03:13:45.1197020Z โ”‚ 0.9989607334136963 2023-01-13T03:13:45.1236200Z โ”‚ ], 2023-01-13T03:13:45.1249770Z โ”‚ [ 2023-01-13T03:13:45.1254850Z โ”‚ 0.0, 2023-01-13T03:13:45.1257700Z โ”‚ 0.9989848732948303 2023-01-13T03:13:45.1272250Z โ”‚ ], 2023-01-13T03:13:45.1291050Z โ”‚ [ 2023-01-13T03:13:45.1293760Z โ”‚ 0.0, 2023-01-13T03:13:45.1294940Z โ”‚ 0.9990076422691345 2023-01-13T03:13:45.1308530Z โ”‚ ], 2023-01-13T03:13:45.1312810Z โ”‚ [ 2023-01-13T03:13:45.1375680Z โ”‚ 0.0, 2023-01-13T03:13:45.1395100Z โ”‚ 0.9990293979644775 2023-01-13T03:13:45.1396610Z โ”‚ ], 2023-01-13T03:13:45.1434060Z โ”‚ [ 2023-01-13T03:13:45.1456600Z โ”‚ 0.0, 2023-01-13T03:13:45.1469770Z โ”‚ 0.9990498423576355 2023-01-13T03:13:45.1471560Z โ”‚ ], 2023-01-13T03:13:45.1479220Z โ”‚ [ 2023-01-13T03:13:45.1484940Z โ”‚ 0.0, 2023-01-13T03:13:45.1494460Z โ”‚ 0.999051034450531 2023-01-13T03:13:45.1530560Z โ”‚ ], 2023-01-13T03:13:45.1547880Z โ”‚ [ 2023-01-13T03:13:45.1585440Z โ”‚ 0.0, 2023-01-13T03:13:45.1593840Z โ”‚ 0.9990313053131104 2023-01-13T03:13:45.1599990Z โ”‚ ], 2023-01-13T03:13:45.1635110Z โ”‚ [ 2023-01-13T03:13:45.1637310Z โ”‚ 0.0, 2023-01-13T03:13:45.1643950Z โ”‚ 0.9990096092224121 2023-01-13T03:13:45.1665650Z โ”‚ ], 2023-01-13T03:13:45.1688700Z โ”‚ [ 2023-01-13T03:13:45.1692420Z โ”‚ 0.0, 2023-01-13T03:13:45.1696190Z โ”‚ 0.9989851117134094 2023-01-13T03:13:45.1711890Z โ”‚ ], 2023-01-13T03:13:45.1721600Z โ”‚ [ 2023-01-13T03:13:45.1751320Z โ”‚ 0.0, 2023-01-13T03:13:45.1760800Z โ”‚ 0.9989587068557739 2023-01-13T03:13:45.1791760Z โ”‚ ], 2023-01-13T03:13:45.1811360Z โ”‚ [ 2023-01-13T03:13:45.1825290Z โ”‚ 0.0, 2023-01-13T03:13:45.1853290Z โ”‚ 0.99892979860 2023-01-13T03:13:45.1883610Z โ”‚ (showing 2.05kB/2.47MB) 2023-01-13T03:13:45.1904560Z โ”” 2023-01-13T03:13:45.1910710Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:45.1928640Z 3ms 309ยตs (cache) (cache) 3.6s 10ms 533ยตs 3.6s 2023-01-13T03:13:45.1932850Z 2023-01-13T03:13:45.1937230Z โœ“ Successful POST request 2023-01-13T03:13:45.1949010Z 2023-01-13T03:13:45.1970080Z โ†’ Model Zoo - Unregister model 2023-01-13T03:13:45.1980720Z DELETE http://localhost:8081/models/fcn_resnet_101_scripted 2023-01-13T03:13:45.1989260Z 200 OK โ˜… 76ms time โ˜… 259Bโ†‘ 331Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:45.2001290Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 65B 2023-01-13T03:13:45.2008820Z โ”‚ { 2023-01-13T03:13:45.2022500Z โ”‚ "status": "Model \"fcn_resnet_101_scripted\" unregis 2023-01-13T03:13:45.2055720Z โ”‚ tered" 2023-01-13T03:13:45.2087360Z โ”‚ } 2023-01-13T03:13:45.2120150Z โ”” 2023-01-13T03:13:45.2153430Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:45.2164760Z 12ms 2ms (cache) (cache) 45ms 27ms 4ms 92ms 2023-01-13T03:13:45.2170460Z 2023-01-13T03:13:45.2195630Z โœ“ Successful DELETE request 2023-01-13T03:13:45.2198030Z 2023-01-13T03:13:45.2199500Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:13:45.2215980Z GET http://localhost:8082/metrics 2023-01-13T03:13:45.2224790Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 7.6kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:45.2227950Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 7.3kB 2023-01-13T03:13:45.2256160Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:13:45.2260860Z โ”‚ erence requests. 2023-01-13T03:13:45.2267640Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:13:45.2288880Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2304890Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101_scripted" 2023-01-13T03:13:45.2313720Z โ”‚ ,model_version="default",} 1.0 2023-01-13T03:13:45.2318890Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2327110Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:13:45.2347530Z โ”‚ default",} 1.0 2023-01-13T03:13:45.2353260Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2361840Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:13:45.2364390Z โ”‚ "default",} 1.0 2023-01-13T03:13:45.2376680Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2394880Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:13:45.2406860Z โ”‚ sion="default",} 1.0 2023-01-13T03:13:45.2414150Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2436920Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:13:45.2475960Z โ”‚ model_version="default",} 1.0 2023-01-13T03:13:45.2477980Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2490080Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:13:45.2515910Z โ”‚ ="default",} 1.0 2023-01-13T03:13:45.2518620Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2520860Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:13:45.2523700Z โ”‚ fault",} 1.0 2023-01-13T03:13:45.2528970Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2529820Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:13:45.2536600Z โ”‚ l_version="default",} 1.0 2023-01-13T03:13:45.2537340Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2538070Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:13:45.2538720Z โ”‚ l_version="default",} 1.0 2023-01-13T03:13:45.2539400Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2540110Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:13:45.2540730Z โ”‚ fault",} 1.0 2023-01-13T03:13:45.2541410Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2542110Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:13:45.2542740Z โ”‚ rsion="default",} 1.0 2023-01-13T03:13:45.2543410Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2544120Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:13:45.2544760Z โ”‚ rsion="default",} 1.0 2023-01-13T03:13:45.2545430Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2546120Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:13:45.2546780Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:13:45.2547470Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2548160Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101",model_ve 2023-01-13T03:13:45.2548780Z โ”‚ rsion="default",} 1.0 2023-01-13T03:13:45.2549450Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:13:45.2550170Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:13:45.2550750Z โ”‚ on="d 2023-01-13T03:13:45.2551330Z โ”‚ (showing 2.05kB/7.3kB) 2023-01-13T03:13:45.2551870Z โ”” 2023-01-13T03:13:45.2552610Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:45.2553400Z 2ms 456ยตs (cache) (cache) 1ms 1ms 65ยตs 6ms 2023-01-13T03:13:45.2553880Z 2023-01-13T03:13:45.2555190Z โœ“ Successful GET request 2023-01-13T03:13:45.2555600Z 2023-01-13T03:13:45.2557930Z Iteration 18/24 2023-01-13T03:13:45.2558350Z 2023-01-13T03:13:45.2558850Z โ†’ Model Zoo - Register Model 2023-01-13T03:13:57.7451430Z POST http://localhost:8081/models?url=deeplabv3_resnet_101_eager.mar&model_name=deeplabv3_resnet_101_eager&initial_workers=1&synchronous=true 2023-01-13T03:13:57.7494520Z 200 OK โ˜… 12.8s time โ˜… 360Bโ†‘ 369Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:13:57.7604020Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 102B 2023-01-13T03:13:57.7680410Z โ”‚ { 2023-01-13T03:13:57.7720660Z โ”‚ "status": "Model \"deeplabv3_resnet_101_eager\" Vers 2023-01-13T03:13:57.7777850Z โ”‚ ion: 1.0 registered with 1 initial workers" 2023-01-13T03:13:57.7785540Z โ”‚ } 2023-01-13T03:13:57.7821700Z โ”” 2023-01-13T03:13:57.7923630Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:13:57.7967390Z 2ms 393ยตs (cache) (cache) 12.7s 1ms 47ยตs 12.8s 2023-01-13T03:13:57.7974510Z 2023-01-13T03:13:57.8015530Z โœ“ Successful POST request 2023-01-13T03:13:57.8030170Z 2023-01-13T03:13:57.8069980Z โ†’ Model Zoo - Inference Model 2023-01-13T03:14:01.9218200Z POST http://localhost:8080/predictions/deeplabv3_resnet_101_eager 2023-01-13T03:14:01.9259550Z 200 OK โ˜… 4.1s time โ˜… 289.23kBโ†‘ 2.47MBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:01.9304960Z โ”Œ โ†‘ file โ˜… 288.94kB 2023-01-13T03:14:01.9309440Z โ”‚ (showing 2.05kB/288.94kB) 2023-01-13T03:14:01.9315070Z โ”” 2023-01-13T03:14:01.9452260Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 2.47MB 2023-01-13T03:14:01.9567860Z โ”‚ [ 2023-01-13T03:14:01.9669670Z โ”‚ [ 2023-01-13T03:14:01.9771650Z โ”‚ [ 2023-01-13T03:14:01.9872070Z โ”‚ 0.0, 2023-01-13T03:14:01.9972550Z โ”‚ 0.9988765120506287 2023-01-13T03:14:02.0065990Z โ”‚ ], 2023-01-13T03:14:02.0188860Z โ”‚ [ 2023-01-13T03:14:02.0290340Z โ”‚ 0.0, 2023-01-13T03:14:02.0364870Z โ”‚ 0.9988765120506287 2023-01-13T03:14:02.0455960Z โ”‚ ], 2023-01-13T03:14:02.0523380Z โ”‚ [ 2023-01-13T03:14:02.0624890Z โ”‚ 0.0, 2023-01-13T03:14:02.0726470Z โ”‚ 0.9988765120506287 2023-01-13T03:14:02.0826980Z โ”‚ ], 2023-01-13T03:14:02.0867220Z โ”‚ [ 2023-01-13T03:14:02.0961980Z โ”‚ 0.0, 2023-01-13T03:14:02.1019360Z โ”‚ 0.9988765120506287 2023-01-13T03:14:02.1050620Z โ”‚ ], 2023-01-13T03:14:02.1139080Z โ”‚ [ 2023-01-13T03:14:02.1215250Z โ”‚ 0.0, 2023-01-13T03:14:02.1306410Z โ”‚ 0.9988669157028198 2023-01-13T03:14:02.1399460Z โ”‚ ], 2023-01-13T03:14:02.1441470Z โ”‚ [ 2023-01-13T03:14:02.1488800Z โ”‚ 0.0, 2023-01-13T03:14:02.1509910Z โ”‚ 0.998843789100647 2023-01-13T03:14:02.1611350Z โ”‚ ], 2023-01-13T03:14:02.1684800Z โ”‚ [ 2023-01-13T03:14:02.1751040Z โ”‚ 0.0, 2023-01-13T03:14:02.1835330Z โ”‚ 0.9988172054290771 2023-01-13T03:14:02.1927920Z โ”‚ ], 2023-01-13T03:14:02.2004060Z โ”‚ [ 2023-01-13T03:14:02.2037290Z โ”‚ 0.0, 2023-01-13T03:14:02.2068830Z โ”‚ 0.9987861514091492 2023-01-13T03:14:02.2112940Z โ”‚ ], 2023-01-13T03:14:02.2186730Z โ”‚ [ 2023-01-13T03:14:02.2225500Z โ”‚ 0.0, 2023-01-13T03:14:02.2281080Z โ”‚ 0.9987504482269287 2023-01-13T03:14:02.2356040Z โ”‚ ], 2023-01-13T03:14:02.2396300Z โ”‚ [ 2023-01-13T03:14:02.2418680Z โ”‚ 0.0, 2023-01-13T03:14:02.2473300Z โ”‚ 0.9987117052078247 2023-01-13T03:14:02.2501240Z โ”‚ ], 2023-01-13T03:14:02.2509290Z โ”‚ [ 2023-01-13T03:14:02.2542240Z โ”‚ 0.0, 2023-01-13T03:14:02.2621890Z โ”‚ 0.9986679553985596 2023-01-13T03:14:02.2648850Z โ”‚ ], 2023-01-13T03:14:02.2673780Z โ”‚ [ 2023-01-13T03:14:02.2700260Z โ”‚ 0.0, 2023-01-13T03:14:02.2722700Z โ”‚ 0.9986202716827393 2023-01-13T03:14:02.2732340Z โ”‚ ], 2023-01-13T03:14:02.2784070Z โ”‚ [ 2023-01-13T03:14:02.2820210Z โ”‚ 0.0, 2023-01-13T03:14:02.2834970Z โ”‚ 0.9985180497169495 2023-01-13T03:14:02.2906350Z โ”‚ ], 2023-01-13T03:14:02.2932710Z โ”‚ [ 2023-01-13T03:14:02.2958110Z โ”‚ 0.0, 2023-01-13T03:14:02.2979000Z โ”‚ 0.9983478784561157 2023-01-13T03:14:02.3004200Z โ”‚ ], 2023-01-13T03:14:02.3023040Z โ”‚ [ 2023-01-13T03:14:02.3052130Z โ”‚ 0.0, 2023-01-13T03:14:02.3081430Z โ”‚ 0.9981531500816345 2023-01-13T03:14:02.3084060Z โ”‚ ], 2023-01-13T03:14:02.3084820Z โ”‚ [ 2023-01-13T03:14:02.3085560Z โ”‚ 0.0, 2023-01-13T03:14:02.3086830Z โ”‚ 0.9979324340820312 2023-01-13T03:14:02.3090430Z โ”‚ ], 2023-01-13T03:14:02.3091880Z โ”‚ [ 2023-01-13T03:14:02.3094130Z โ”‚ 0.0, 2023-01-13T03:14:02.3096410Z โ”‚ 0.9976813793182373 2023-01-13T03:14:02.3099180Z โ”‚ ], 2023-01-13T03:14:02.3103430Z โ”‚ [ 2023-01-13T03:14:02.3106410Z โ”‚ 0.0, 2023-01-13T03:14:02.3108800Z โ”‚ 0.9973964691162109 2023-01-13T03:14:02.3110840Z โ”‚ ], 2023-01-13T03:14:02.3113960Z โ”‚ [ 2023-01-13T03:14:02.3115430Z โ”‚ 0.0, 2023-01-13T03:14:02.3118080Z โ”‚ 0.9970728158950806 2023-01-13T03:14:02.3120340Z โ”‚ ], 2023-01-13T03:14:02.3121620Z โ”‚ [ 2023-01-13T03:14:02.3123950Z โ”‚ 0.0, 2023-01-13T03:14:02.3126340Z โ”‚ 0.9967058300971985 2023-01-13T03:14:02.3127970Z โ”‚ ], 2023-01-13T03:14:02.3131870Z โ”‚ [ 2023-01-13T03:14:02.3134810Z โ”‚ 0.0, 2023-01-13T03:14:02.3136980Z โ”‚ 0.9964045286178589 2023-01-13T03:14:02.3138950Z โ”‚ ], 2023-01-13T03:14:02.3140820Z โ”‚ [ 2023-01-13T03:14:02.3144420Z โ”‚ 0.0, 2023-01-13T03:14:02.3145860Z โ”‚ 0.9961955547332764 2023-01-13T03:14:02.3147900Z โ”‚ ], 2023-01-13T03:14:02.3149280Z โ”‚ [ 2023-01-13T03:14:02.3151310Z โ”‚ 0.0, 2023-01-13T03:14:02.3152450Z โ”‚ 0.9959736466407776 2023-01-13T03:14:02.3153220Z โ”‚ ], 2023-01-13T03:14:02.3153950Z โ”‚ [ 2023-01-13T03:14:02.3154680Z โ”‚ 0.0, 2023-01-13T03:14:02.3156350Z โ”‚ 0.9957382678985596 2023-01-13T03:14:02.3157080Z โ”‚ ], 2023-01-13T03:14:02.3157790Z โ”‚ [ 2023-01-13T03:14:02.3158510Z โ”‚ 0.0, 2023-01-13T03:14:02.3159250Z โ”‚ 0.9954884648323059 2023-01-13T03:14:02.3160040Z โ”‚ ], 2023-01-13T03:14:02.3161860Z โ”‚ [ 2023-01-13T03:14:02.3162480Z โ”‚ 0.0, 2023-01-13T03:14:02.3163260Z โ”‚ 0.9952237010002136 2023-01-13T03:14:02.3163990Z โ”‚ ], 2023-01-13T03:14:02.3164700Z โ”‚ [ 2023-01-13T03:14:02.3165410Z โ”‚ 0.0, 2023-01-13T03:14:02.3166160Z โ”‚ 0.9949429631233215 2023-01-13T03:14:02.3166880Z โ”‚ ], 2023-01-13T03:14:02.3167590Z โ”‚ [ 2023-01-13T03:14:02.3169700Z โ”‚ 0.0, 2023-01-13T03:14:02.3170520Z โ”‚ 0.9946452379226685 2023-01-13T03:14:02.3171280Z โ”‚ ], 2023-01-13T03:14:02.3172030Z โ”‚ [ 2023-01-13T03:14:02.3172790Z โ”‚ 0.0, 2023-01-13T03:14:02.3173910Z โ”‚ 0.9945149421691895 2023-01-13T03:14:02.3174710Z โ”‚ ], 2023-01-13T03:14:02.3175470Z โ”‚ [ 2023-01-13T03:14:02.3176220Z โ”‚ 0.0, 2023-01-13T03:14:02.3177580Z โ”‚ 0.9945646524429321 2023-01-13T03:14:02.3178370Z โ”‚ ], 2023-01-13T03:14:02.3179110Z โ”‚ [ 2023-01-13T03:14:02.3179880Z โ”‚ 0.0, 2023-01-13T03:14:02.3180680Z โ”‚ 0.9946145415306091 2023-01-13T03:14:02.3181940Z โ”‚ ], 2023-01-13T03:14:02.3182930Z โ”‚ [ 2023-01-13T03:14:02.3184170Z โ”‚ 0.0, 2023-01-13T03:14:02.3184990Z โ”‚ 0.9946632385253906 2023-01-13T03:14:02.3185740Z โ”‚ ], 2023-01-13T03:14:02.3186490Z โ”‚ [ 2023-01-13T03:14:02.3187340Z โ”‚ 0.0, 2023-01-13T03:14:02.3187630Z โ”‚ 0.9947116374969482 2023-01-13T03:14:02.3187880Z โ”‚ ], 2023-01-13T03:14:02.3188100Z โ”‚ [ 2023-01-13T03:14:02.3188320Z โ”‚ 0.0, 2023-01-13T03:14:02.3188590Z โ”‚ 0.9947587847709656 2023-01-13T03:14:02.3188830Z โ”‚ ], 2023-01-13T03:14:02.3189050Z โ”‚ [ 2023-01-13T03:14:02.3190550Z โ”‚ 0.0, 2023-01-13T03:14:02.3190950Z โ”‚ 0.9948055148124695 2023-01-13T03:14:02.3191180Z โ”‚ ], 2023-01-13T03:14:02.3191420Z โ”‚ [ 2023-01-13T03:14:02.3191650Z โ”‚ 0.0, 2023-01-13T03:14:02.3191900Z โ”‚ 0.9948518872261047 2023-01-13T03:14:02.3192140Z โ”‚ ], 2023-01-13T03:14:02.3192690Z โ”‚ [ 2023-01-13T03:14:02.3193090Z โ”‚ 0.0, 2023-01-13T03:14:02.3193370Z โ”‚ 0.9948965907096863 2023-01-13T03:14:02.3193620Z โ”‚ ], 2023-01-13T03:14:02.3193850Z โ”‚ [ 2023-01-13T03:14:02.3194070Z โ”‚ 0.0, 2023-01-13T03:14:02.3194340Z โ”‚ 0.9949400424957275 2023-01-13T03:14:02.3194570Z โ”‚ ], 2023-01-13T03:14:02.3194790Z โ”‚ [ 2023-01-13T03:14:02.3195500Z โ”‚ 0.0, 2023-01-13T03:14:02.3195770Z โ”‚ 0.9949839115142822 2023-01-13T03:14:02.3196000Z โ”‚ ], 2023-01-13T03:14:02.3196230Z โ”‚ [ 2023-01-13T03:14:02.3196460Z โ”‚ 0.0, 2023-01-13T03:14:02.3196710Z โ”‚ 0.9950267672538757 2023-01-13T03:14:02.3196950Z โ”‚ ], 2023-01-13T03:14:02.3197180Z โ”‚ [ 2023-01-13T03:14:02.3197410Z โ”‚ 0.0, 2023-01-13T03:14:02.3197670Z โ”‚ 0.9950693845748901 2023-01-13T03:14:02.3197970Z โ”‚ ], 2023-01-13T03:14:02.3198190Z โ”‚ [ 2023-01-13T03:14:02.3198410Z โ”‚ 0.0, 2023-01-13T03:14:02.3198660Z โ”‚ 0.995111525 2023-01-13T03:14:02.3198940Z โ”‚ (showing 2.05kB/2.47MB) 2023-01-13T03:14:02.3199160Z โ”” 2023-01-13T03:14:02.3199590Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:02.3200080Z 8ms 709ยตs (cache) (cache) 4.1s 6ms 1ms 4.1s 2023-01-13T03:14:02.3200250Z 2023-01-13T03:14:02.3200430Z โœ“ Successful POST request 2023-01-13T03:14:02.3200580Z 2023-01-13T03:14:02.3200770Z โ†’ Model Zoo - Unregister model 2023-01-13T03:14:02.3201080Z DELETE http://localhost:8081/models/deeplabv3_resnet_101_eager 2023-01-13T03:14:02.3201540Z 200 OK โ˜… 42ms time โ˜… 262Bโ†‘ 334Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:02.3202040Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 68B 2023-01-13T03:14:02.3202340Z โ”‚ { 2023-01-13T03:14:02.3202680Z โ”‚ "status": "Model \"deeplabv3_resnet_101_eager\" unre 2023-01-13T03:14:02.3202960Z โ”‚ gistered" 2023-01-13T03:14:02.3203190Z โ”‚ } 2023-01-13T03:14:02.3203390Z โ”” 2023-01-13T03:14:02.3203800Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:02.3204340Z 3ms 428ยตs (cache) (cache) 38ms 2ms 88ยตs 44ms 2023-01-13T03:14:02.3204520Z 2023-01-13T03:14:02.3204710Z โœ“ Successful DELETE request 2023-01-13T03:14:02.3204850Z 2023-01-13T03:14:02.3205020Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:14:02.3205280Z GET http://localhost:8082/metrics 2023-01-13T03:14:02.3205690Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 8.04kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:02.3206080Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 7.75kB 2023-01-13T03:14:02.3206470Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:14:02.3206790Z โ”‚ erence requests. 2023-01-13T03:14:02.3207120Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:14:02.3207510Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3207890Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101_scripted" 2023-01-13T03:14:02.3208290Z โ”‚ ,model_version="default",} 1.0 2023-01-13T03:14:02.3209080Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3209590Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:14:02.3210170Z โ”‚ default",} 1.0 2023-01-13T03:14:02.3210570Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3210970Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:14:02.3211280Z โ”‚ "default",} 1.0 2023-01-13T03:14:02.3211630Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3212450Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:14:02.3213500Z โ”‚ sion="default",} 1.0 2023-01-13T03:14:02.3214920Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3215330Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:14:02.3215660Z โ”‚ model_version="default",} 1.0 2023-01-13T03:14:02.3216020Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3216410Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:14:02.3216700Z โ”‚ ="default",} 1.0 2023-01-13T03:14:02.3217050Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3217430Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:14:02.3218150Z โ”‚ fault",} 1.0 2023-01-13T03:14:02.3218480Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3218870Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:14:02.3219200Z โ”‚ l_version="default",} 1.0 2023-01-13T03:14:02.3219560Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3219960Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:14:02.3220280Z โ”‚ l_version="default",} 1.0 2023-01-13T03:14:02.3220630Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3221010Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:14:02.3221310Z โ”‚ fault",} 1.0 2023-01-13T03:14:02.3221630Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3222020Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:14:02.3222330Z โ”‚ rsion="default",} 1.0 2023-01-13T03:14:02.3222680Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3223070Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:14:02.3223370Z โ”‚ rsion="default",} 1.0 2023-01-13T03:14:02.3224610Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3225260Z โ”‚ 966-f7a8f1df27fc",model_name="deeplabv3_resnet_101_eag 2023-01-13T03:14:02.3225640Z โ”‚ er",model_version="default",} 1.0 2023-01-13T03:14:02.3226170Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3226570Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier_scrip 2023-01-13T03:14:02.3226940Z โ”‚ ted",model_version="default",} 1.0 2023-01-13T03:14:02.3227320Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:02.3227690Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101",m 2023-01-13T03:14:02.3228000Z โ”‚ (showing 2.05kB/7.75kB) 2023-01-13T03:14:02.3228240Z โ”” 2023-01-13T03:14:02.3228660Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:02.3229150Z 2ms 292ยตs (cache) (cache) 2ms 1ms 48ยตs 6ms 2023-01-13T03:14:02.3229330Z 2023-01-13T03:14:02.3229500Z โœ“ Successful GET request 2023-01-13T03:14:02.3229640Z 2023-01-13T03:14:02.3229720Z Iteration 19/24 2023-01-13T03:14:02.3229850Z 2023-01-13T03:14:02.3230040Z โ†’ Model Zoo - Register Model 2023-01-13T03:14:18.9821840Z POST http://localhost:8081/models?url=https://torchserve.s3.amazonaws.com/mar_files/deeplabv3_resnet_101_scripted.mar&model_name=deeplabv3_resnet_101_scripted&initial_workers=1&synchronous=true 2023-01-13T03:14:18.9880600Z 200 OK โ˜… 16.7s time โ˜… 412Bโ†‘ 372Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:18.9928040Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 105B 2023-01-13T03:14:18.9991770Z โ”‚ { 2023-01-13T03:14:19.0047820Z โ”‚ "status": "Model \"deeplabv3_resnet_101_scripted\" V 2023-01-13T03:14:19.0087660Z โ”‚ ersion: 1.0 registered with 1 initial workers" 2023-01-13T03:14:19.0109590Z โ”‚ } 2023-01-13T03:14:19.0136530Z โ”” 2023-01-13T03:14:19.0181110Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:19.0291540Z 2ms 305ยตs (cache) (cache) 16.7s 4ms 99ยตs 16.7s 2023-01-13T03:14:19.0372680Z 2023-01-13T03:14:19.0400740Z โœ“ Successful POST request 2023-01-13T03:14:19.0408650Z 2023-01-13T03:14:19.0438700Z โ†’ Model Zoo - Inference Model 2023-01-13T03:14:23.7091850Z POST http://localhost:8080/predictions/deeplabv3_resnet_101_scripted 2023-01-13T03:14:23.7193590Z 200 OK โ˜… 4.6s time โ˜… 289.24kBโ†‘ 2.47MBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:23.7213740Z โ”Œ โ†‘ file โ˜… 288.94kB 2023-01-13T03:14:23.7255460Z โ”‚ (showing 2.05kB/288.94kB) 2023-01-13T03:14:23.7273770Z โ”” 2023-01-13T03:14:23.7285650Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 2.47MB 2023-01-13T03:14:23.7294600Z โ”‚ [ 2023-01-13T03:14:23.7354010Z โ”‚ [ 2023-01-13T03:14:23.7385370Z โ”‚ [ 2023-01-13T03:14:23.7628740Z โ”‚ 0.0, 2023-01-13T03:14:23.7665490Z โ”‚ 0.9988765120506287 2023-01-13T03:14:23.7673870Z โ”‚ ], 2023-01-13T03:14:23.7703320Z โ”‚ [ 2023-01-13T03:14:23.7737550Z โ”‚ 0.0, 2023-01-13T03:14:23.7774350Z โ”‚ 0.9988765120506287 2023-01-13T03:14:23.7801580Z โ”‚ ], 2023-01-13T03:14:23.7812550Z โ”‚ [ 2023-01-13T03:14:23.7838340Z โ”‚ 0.0, 2023-01-13T03:14:23.7838760Z โ”‚ 0.9988765120506287 2023-01-13T03:14:23.7901740Z โ”‚ ], 2023-01-13T03:14:23.7929290Z โ”‚ [ 2023-01-13T03:14:23.7950840Z โ”‚ 0.0, 2023-01-13T03:14:23.7955490Z โ”‚ 0.9988765120506287 2023-01-13T03:14:23.8016770Z โ”‚ ], 2023-01-13T03:14:23.8071050Z โ”‚ [ 2023-01-13T03:14:23.8121670Z โ”‚ 0.0, 2023-01-13T03:14:23.8190130Z โ”‚ 0.9988669157028198 2023-01-13T03:14:23.8239210Z โ”‚ ], 2023-01-13T03:14:23.8255680Z โ”‚ [ 2023-01-13T03:14:23.8265460Z โ”‚ 0.0, 2023-01-13T03:14:23.8287350Z โ”‚ 0.998843789100647 2023-01-13T03:14:23.8302290Z โ”‚ ], 2023-01-13T03:14:23.8344170Z โ”‚ [ 2023-01-13T03:14:23.8373060Z โ”‚ 0.0, 2023-01-13T03:14:23.8407490Z โ”‚ 0.9988172054290771 2023-01-13T03:14:23.8428190Z โ”‚ ], 2023-01-13T03:14:23.8437780Z โ”‚ [ 2023-01-13T03:14:23.8462090Z โ”‚ 0.0, 2023-01-13T03:14:23.8465220Z โ”‚ 0.9987861514091492 2023-01-13T03:14:23.8468630Z โ”‚ ], 2023-01-13T03:14:23.8496290Z โ”‚ [ 2023-01-13T03:14:23.8598120Z โ”‚ 0.0, 2023-01-13T03:14:23.8700110Z โ”‚ 0.9987504482269287 2023-01-13T03:14:23.8754340Z โ”‚ ], 2023-01-13T03:14:23.8780080Z โ”‚ [ 2023-01-13T03:14:23.8796240Z โ”‚ 0.0, 2023-01-13T03:14:23.8823090Z โ”‚ 0.9987117052078247 2023-01-13T03:14:23.8856650Z โ”‚ ], 2023-01-13T03:14:23.8968780Z โ”‚ [ 2023-01-13T03:14:23.8969250Z โ”‚ 0.0, 2023-01-13T03:14:23.8995470Z โ”‚ 0.9986679553985596 2023-01-13T03:14:23.9026860Z โ”‚ ], 2023-01-13T03:14:23.9079430Z โ”‚ [ 2023-01-13T03:14:23.9101690Z โ”‚ 0.0, 2023-01-13T03:14:23.9131400Z โ”‚ 0.9986202716827393 2023-01-13T03:14:23.9180250Z โ”‚ ], 2023-01-13T03:14:23.9245590Z โ”‚ [ 2023-01-13T03:14:23.9292490Z โ”‚ 0.0, 2023-01-13T03:14:23.9306770Z โ”‚ 0.9985180497169495 2023-01-13T03:14:23.9335050Z โ”‚ ], 2023-01-13T03:14:23.9344120Z โ”‚ [ 2023-01-13T03:14:23.9371280Z โ”‚ 0.0, 2023-01-13T03:14:23.9421300Z โ”‚ 0.9983478784561157 2023-01-13T03:14:23.9460880Z โ”‚ ], 2023-01-13T03:14:23.9538620Z โ”‚ [ 2023-01-13T03:14:23.9569710Z โ”‚ 0.0, 2023-01-13T03:14:23.9598440Z โ”‚ 0.9981531500816345 2023-01-13T03:14:23.9598840Z โ”‚ ], 2023-01-13T03:14:23.9656890Z โ”‚ [ 2023-01-13T03:14:23.9703420Z โ”‚ 0.0, 2023-01-13T03:14:23.9751320Z โ”‚ 0.9979324340820312 2023-01-13T03:14:23.9762710Z โ”‚ ], 2023-01-13T03:14:23.9786910Z โ”‚ [ 2023-01-13T03:14:23.9813000Z โ”‚ 0.0, 2023-01-13T03:14:23.9830320Z โ”‚ 0.9976813793182373 2023-01-13T03:14:23.9851470Z โ”‚ ], 2023-01-13T03:14:23.9860960Z โ”‚ [ 2023-01-13T03:14:23.9884530Z โ”‚ 0.0, 2023-01-13T03:14:23.9894870Z โ”‚ 0.9973964691162109 2023-01-13T03:14:23.9920980Z โ”‚ ], 2023-01-13T03:14:23.9948540Z โ”‚ [ 2023-01-13T03:14:23.9974730Z โ”‚ 0.0, 2023-01-13T03:14:24.0020040Z โ”‚ 0.9970728158950806 2023-01-13T03:14:24.0078430Z โ”‚ ], 2023-01-13T03:14:24.0127830Z โ”‚ [ 2023-01-13T03:14:24.0231300Z โ”‚ 0.0, 2023-01-13T03:14:24.0356710Z โ”‚ 0.9967058300971985 2023-01-13T03:14:24.0458320Z โ”‚ ], 2023-01-13T03:14:24.0562330Z โ”‚ [ 2023-01-13T03:14:24.0665330Z โ”‚ 0.0, 2023-01-13T03:14:24.0773290Z โ”‚ 0.9964045286178589 2023-01-13T03:14:24.0875630Z โ”‚ ], 2023-01-13T03:14:24.0977580Z โ”‚ [ 2023-01-13T03:14:24.1079120Z โ”‚ 0.0, 2023-01-13T03:14:24.1183310Z โ”‚ 0.9961955547332764 2023-01-13T03:14:24.1250120Z โ”‚ ], 2023-01-13T03:14:24.1351480Z โ”‚ [ 2023-01-13T03:14:24.1449260Z โ”‚ 0.0, 2023-01-13T03:14:24.1462090Z โ”‚ 0.9959736466407776 2023-01-13T03:14:24.1463000Z โ”‚ ], 2023-01-13T03:14:24.1466430Z โ”‚ [ 2023-01-13T03:14:24.1467290Z โ”‚ 0.0, 2023-01-13T03:14:24.1468430Z โ”‚ 0.9957382678985596 2023-01-13T03:14:24.1469350Z โ”‚ ], 2023-01-13T03:14:24.1490360Z โ”‚ [ 2023-01-13T03:14:24.1592210Z โ”‚ 0.0, 2023-01-13T03:14:24.1619360Z โ”‚ 0.9954884648323059 2023-01-13T03:14:24.1620480Z โ”‚ ], 2023-01-13T03:14:24.1631280Z โ”‚ [ 2023-01-13T03:14:24.1632140Z โ”‚ 0.0, 2023-01-13T03:14:24.1635910Z โ”‚ 0.9952237010002136 2023-01-13T03:14:24.1636810Z โ”‚ ], 2023-01-13T03:14:24.1639070Z โ”‚ [ 2023-01-13T03:14:24.1641250Z โ”‚ 0.0, 2023-01-13T03:14:24.1642310Z โ”‚ 0.9949429631233215 2023-01-13T03:14:24.1644560Z โ”‚ ], 2023-01-13T03:14:24.1645330Z โ”‚ [ 2023-01-13T03:14:24.1647540Z โ”‚ 0.0, 2023-01-13T03:14:24.1660070Z โ”‚ 0.9946452379226685 2023-01-13T03:14:24.1661240Z โ”‚ ], 2023-01-13T03:14:24.1662070Z โ”‚ [ 2023-01-13T03:14:24.1664520Z โ”‚ 0.0, 2023-01-13T03:14:24.1665390Z โ”‚ 0.9945149421691895 2023-01-13T03:14:24.1667290Z โ”‚ ], 2023-01-13T03:14:24.1668270Z โ”‚ [ 2023-01-13T03:14:24.1669320Z โ”‚ 0.0, 2023-01-13T03:14:24.1670160Z โ”‚ 0.9945646524429321 2023-01-13T03:14:24.1771390Z โ”‚ ], 2023-01-13T03:14:24.1872780Z โ”‚ [ 2023-01-13T03:14:24.1909300Z โ”‚ 0.0, 2023-01-13T03:14:24.1910330Z โ”‚ 0.9946145415306091 2023-01-13T03:14:24.1911370Z โ”‚ ], 2023-01-13T03:14:24.1912240Z โ”‚ [ 2023-01-13T03:14:24.1912950Z โ”‚ 0.0, 2023-01-13T03:14:24.1913260Z โ”‚ 0.9946632385253906 2023-01-13T03:14:24.1913520Z โ”‚ ], 2023-01-13T03:14:24.1913740Z โ”‚ [ 2023-01-13T03:14:24.1913970Z โ”‚ 0.0, 2023-01-13T03:14:24.1914240Z โ”‚ 0.9947116374969482 2023-01-13T03:14:24.1914480Z โ”‚ ], 2023-01-13T03:14:24.1914700Z โ”‚ [ 2023-01-13T03:14:24.1914930Z โ”‚ 0.0, 2023-01-13T03:14:24.1915200Z โ”‚ 0.9947587847709656 2023-01-13T03:14:24.1915430Z โ”‚ ], 2023-01-13T03:14:24.1915660Z โ”‚ [ 2023-01-13T03:14:24.1915920Z โ”‚ 0.0, 2023-01-13T03:14:24.1916170Z โ”‚ 0.9948055148124695 2023-01-13T03:14:24.1916410Z โ”‚ ], 2023-01-13T03:14:24.1916640Z โ”‚ [ 2023-01-13T03:14:24.1916860Z โ”‚ 0.0, 2023-01-13T03:14:24.1917120Z โ”‚ 0.9948518872261047 2023-01-13T03:14:24.1917360Z โ”‚ ], 2023-01-13T03:14:24.1917580Z โ”‚ [ 2023-01-13T03:14:24.1917820Z โ”‚ 0.0, 2023-01-13T03:14:24.1918080Z โ”‚ 0.9948965907096863 2023-01-13T03:14:24.1918310Z โ”‚ ], 2023-01-13T03:14:24.1918540Z โ”‚ [ 2023-01-13T03:14:24.1918770Z โ”‚ 0.0, 2023-01-13T03:14:24.1919020Z โ”‚ 0.9949400424957275 2023-01-13T03:14:24.1919260Z โ”‚ ], 2023-01-13T03:14:24.1919490Z โ”‚ [ 2023-01-13T03:14:24.1919700Z โ”‚ 0.0, 2023-01-13T03:14:24.1919960Z โ”‚ 0.9949839115142822 2023-01-13T03:14:24.1920200Z โ”‚ ], 2023-01-13T03:14:24.1920420Z โ”‚ [ 2023-01-13T03:14:24.1920650Z โ”‚ 0.0, 2023-01-13T03:14:24.1920910Z โ”‚ 0.9950267672538757 2023-01-13T03:14:24.1921140Z โ”‚ ], 2023-01-13T03:14:24.1922040Z โ”‚ [ 2023-01-13T03:14:24.1922270Z โ”‚ 0.0, 2023-01-13T03:14:24.1922520Z โ”‚ 0.9950693845748901 2023-01-13T03:14:24.1922760Z โ”‚ ], 2023-01-13T03:14:24.1922990Z โ”‚ [ 2023-01-13T03:14:24.1923200Z โ”‚ 0.0, 2023-01-13T03:14:24.1923460Z โ”‚ 0.995111525 2023-01-13T03:14:24.1923990Z โ”‚ (showing 2.05kB/2.47MB) 2023-01-13T03:14:24.1924320Z โ”” 2023-01-13T03:14:24.1924750Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:24.1925420Z 8ms 791ยตs (cache) (cache) 4.6s 7ms 1ms 4.6s 2023-01-13T03:14:24.1926220Z 2023-01-13T03:14:24.1927210Z โœ“ Successful POST request 2023-01-13T03:14:24.1927900Z 2023-01-13T03:14:24.1928580Z โ†’ Model Zoo - Unregister model 2023-01-13T03:14:24.1931070Z DELETE http://localhost:8081/models/deeplabv3_resnet_101_scripted 2023-01-13T03:14:24.1933560Z 200 OK โ˜… 125ms time โ˜… 265Bโ†‘ 337Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:24.1936000Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 71B 2023-01-13T03:14:24.1937000Z โ”‚ { 2023-01-13T03:14:24.1937910Z โ”‚ "status": "Model \"deeplabv3_resnet_101_scripted\" u 2023-01-13T03:14:24.1938340Z โ”‚ nregistered" 2023-01-13T03:14:24.1938580Z โ”‚ } 2023-01-13T03:14:24.1938790Z โ”” 2023-01-13T03:14:24.1939220Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:24.1939700Z 8ms 754ยตs (cache) (cache) 114ms 8ms 241ยตs 133ms 2023-01-13T03:14:24.1939870Z 2023-01-13T03:14:24.1940050Z โœ“ Successful DELETE request 2023-01-13T03:14:24.1940190Z 2023-01-13T03:14:24.1940360Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:14:24.1940610Z GET http://localhost:8082/metrics 2023-01-13T03:14:24.1941020Z 200 OK โ˜… 4ms time โ˜… 233Bโ†‘ 8.49kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:24.1941390Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 8.2kB 2023-01-13T03:14:24.1941780Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:14:24.1942110Z โ”‚ erence requests. 2023-01-13T03:14:24.1942440Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:14:24.1942820Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.1943230Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101_scripted" 2023-01-13T03:14:24.1943570Z โ”‚ ,model_version="default",} 1.0 2023-01-13T03:14:24.1944030Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.1945330Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:14:24.1946230Z โ”‚ default",} 1.0 2023-01-13T03:14:24.1947180Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.1949660Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:14:24.1950540Z โ”‚ "default",} 1.0 2023-01-13T03:14:24.1952780Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.1953750Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:14:24.1957500Z โ”‚ sion="default",} 1.0 2023-01-13T03:14:24.1973460Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.1974630Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:14:24.1975560Z โ”‚ model_version="default",} 1.0 2023-01-13T03:14:24.1976910Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.1979740Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:14:24.1980600Z โ”‚ ="default",} 1.0 2023-01-13T03:14:24.1981440Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.1982340Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:14:24.1987050Z โ”‚ fault",} 1.0 2023-01-13T03:14:24.2007530Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.2013990Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:14:24.2041080Z โ”‚ l_version="default",} 1.0 2023-01-13T03:14:24.2068250Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.2095180Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:14:24.2122470Z โ”‚ l_version="default",} 1.0 2023-01-13T03:14:24.2151090Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.2157730Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:14:24.2179070Z โ”‚ fault",} 1.0 2023-01-13T03:14:24.2187790Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.2213130Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:14:24.2236710Z โ”‚ rsion="default",} 1.0 2023-01-13T03:14:24.2239450Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.2265740Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:14:24.2292640Z โ”‚ rsion="default",} 1.0 2023-01-13T03:14:24.2320710Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.2421900Z โ”‚ 966-f7a8f1df27fc",model_name="deeplabv3_resnet_101_eag 2023-01-13T03:14:24.2472970Z โ”‚ er",model_version="default",} 1.0 2023-01-13T03:14:24.2474090Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.2477370Z โ”‚ 966-f7a8f1df27fc",model_name="deeplabv3_resnet_101_scr 2023-01-13T03:14:24.2479530Z โ”‚ ipted",model_version="default",} 1.0 2023-01-13T03:14:24.2505680Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:24.2509740Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classif 2023-01-13T03:14:24.2518770Z โ”‚ (showing 2.05kB/8.2kB) 2023-01-13T03:14:24.2526920Z โ”” 2023-01-13T03:14:24.2533220Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:24.2536090Z 1ms 314ยตs (cache) (cache) 2ms 1ms 46ยตs 5ms 2023-01-13T03:14:24.2544080Z 2023-01-13T03:14:24.2552630Z โœ“ Successful GET request 2023-01-13T03:14:24.2554160Z 2023-01-13T03:14:24.2560180Z Iteration 20/24 2023-01-13T03:14:24.2568720Z 2023-01-13T03:14:24.2577640Z โ†’ Model Zoo - Register Model 2023-01-13T03:14:39.2274790Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&initial_workers=1&synchronous=true 2023-01-13T03:14:39.2372990Z 200 OK โ˜… 15s time โ˜… 333Bโ†‘ 351Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:39.2373990Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 85B 2023-01-13T03:14:39.2475240Z โ”‚ { 2023-01-13T03:14:39.2546490Z โ”‚ "status": "Model \"resnet152\" Version: 1.0 register 2023-01-13T03:14:39.2551030Z โ”‚ ed with 1 initial workers" 2023-01-13T03:14:39.2557640Z โ”‚ } 2023-01-13T03:14:39.2614970Z โ”” 2023-01-13T03:14:39.2631240Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:39.2732960Z 2ms 317ยตs (cache) (cache) 15s 4ms 98ยตs 15s 2023-01-13T03:14:39.2833030Z 2023-01-13T03:14:39.2834300Z โœ“ Successful POST request 2023-01-13T03:14:39.2836580Z 2023-01-13T03:14:39.2837320Z โ†’ Model Zoo - Inference Model 2023-01-13T03:14:40.0416700Z POST http://localhost:8080/predictions/resnet152 2023-01-13T03:14:40.0420800Z 200 OK โ˜… 768ms time โ˜… 111.24kBโ†‘ 410Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:40.0463840Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:14:40.0527300Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:14:40.0563510Z โ”” 2023-01-13T03:14:40.0603410Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 175B 2023-01-13T03:14:40.0605560Z โ”‚ { 2023-01-13T03:14:40.0607270Z โ”‚ "tiger_cat": 0.5798612236976624, 2023-01-13T03:14:40.0613780Z โ”‚ "tabby": 0.3834418058395386, 2023-01-13T03:14:40.0614200Z โ”‚ "Egyptian_cat": 0.03421153500676155, 2023-01-13T03:14:40.0625690Z โ”‚ "lynx": 0.0005819810903631151, 2023-01-13T03:14:40.0626060Z โ”‚ "quilt": 0.00027332082390785217 2023-01-13T03:14:40.0626390Z โ”‚ } 2023-01-13T03:14:40.0627350Z โ”” 2023-01-13T03:14:40.0648790Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:40.0671930Z 9ms 744ยตs (cache) (cache) 765ms 1ms 52ยตs 776ms 2023-01-13T03:14:40.0672240Z 2023-01-13T03:14:40.0673390Z โœ“ Successful POST request 2023-01-13T03:14:40.0674480Z โœ“ Test expected JSON response 2023-01-13T03:14:40.0675770Z 2023-01-13T03:14:40.0680610Z โ†’ Model Zoo - Unregister model 2023-01-13T03:14:40.1061180Z DELETE http://localhost:8081/models/resnet152 2023-01-13T03:14:40.1084440Z 200 OK โ˜… 31ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:40.1095030Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:14:40.1114120Z โ”‚ { 2023-01-13T03:14:40.1114670Z โ”‚ "status": "Model \"resnet152\" unregistered" 2023-01-13T03:14:40.1144570Z โ”‚ } 2023-01-13T03:14:40.1159390Z โ”” 2023-01-13T03:14:40.1172190Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:40.1174630Z 2ms 326ยตs (cache) (cache) 27ms 2ms 52ยตs 32ms 2023-01-13T03:14:40.1178150Z 2023-01-13T03:14:40.1179730Z โœ“ Successful DELETE request 2023-01-13T03:14:40.1235950Z 2023-01-13T03:14:40.1240860Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:14:40.1373230Z GET http://localhost:8082/metrics 2023-01-13T03:14:40.1398900Z 200 OK โ˜… 6ms time โ˜… 233Bโ†‘ 8.89kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:40.1400400Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 8.6kB 2023-01-13T03:14:40.1404290Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:14:40.1409480Z โ”‚ erence requests. 2023-01-13T03:14:40.1412450Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:14:40.1418330Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1420030Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101_scripted" 2023-01-13T03:14:40.1421610Z โ”‚ ,model_version="default",} 1.0 2023-01-13T03:14:40.1423100Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1425630Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:14:40.1429290Z โ”‚ default",} 1.0 2023-01-13T03:14:40.1439440Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1474700Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:14:40.1487700Z โ”‚ "default",} 1.0 2023-01-13T03:14:40.1533360Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1558740Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:14:40.1562850Z โ”‚ sion="default",} 1.0 2023-01-13T03:14:40.1589710Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1618480Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:14:40.1650620Z โ”‚ model_version="default",} 1.0 2023-01-13T03:14:40.1682590Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1694390Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:14:40.1708000Z โ”‚ ="default",} 1.0 2023-01-13T03:14:40.1714040Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1715470Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:14:40.1719830Z โ”‚ fault",} 1.0 2023-01-13T03:14:40.1720730Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1737910Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:14:40.1740590Z โ”‚ l_version="default",} 1.0 2023-01-13T03:14:40.1744540Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1755890Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:14:40.1761120Z โ”‚ l_version="default",} 1.0 2023-01-13T03:14:40.1767420Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1771770Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:14:40.1775250Z โ”‚ fault",} 1.0 2023-01-13T03:14:40.1778840Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1780900Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:14:40.1787800Z โ”‚ rsion="default",} 1.0 2023-01-13T03:14:40.1796510Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1799630Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:14:40.1800990Z โ”‚ rsion="default",} 1.0 2023-01-13T03:14:40.1809490Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1810430Z โ”‚ 966-f7a8f1df27fc",model_name="resnet152",model_version 2023-01-13T03:14:40.1814300Z โ”‚ ="default",} 1.0 2023-01-13T03:14:40.1815580Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1816510Z โ”‚ 966-f7a8f1df27fc",model_name="deeplabv3_resnet_101_eag 2023-01-13T03:14:40.1818030Z โ”‚ er",model_version="default",} 1.0 2023-01-13T03:14:40.1820740Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:14:40.1823750Z โ”‚ 966-f7a8f1df27fc",model_name="deeplabv3_resnet_101_scr 2023-01-13T03:14:40.1827030Z โ”‚ ipted",mode 2023-01-13T03:14:40.1828570Z โ”‚ (showing 2.05kB/8.6kB) 2023-01-13T03:14:40.1829500Z โ”” 2023-01-13T03:14:40.1830300Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:40.1830880Z 2ms 364ยตs (cache) (cache) 3ms 1ms 63ยตs 7ms 2023-01-13T03:14:40.1832740Z 2023-01-13T03:14:40.1835220Z โœ“ Successful GET request 2023-01-13T03:14:40.1835710Z 2023-01-13T03:14:40.1836190Z Iteration 21/24 2023-01-13T03:14:40.1836900Z 2023-01-13T03:14:40.1837640Z โ†’ Model Zoo - Register Model 2023-01-13T03:14:57.9845810Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/resnet-152-batch_scripted.mar&model_name=resnet-152-batch_scripted&initial_workers=1&synchronous=true 2023-01-13T03:14:57.9947760Z 200 OK โ˜… 17.8s time โ˜… 399Bโ†‘ 368Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:14:58.0039470Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 101B 2023-01-13T03:14:58.0142350Z โ”‚ { 2023-01-13T03:14:58.0196420Z โ”‚ "status": "Model \"resnet-152-batch_scripted\" Versi 2023-01-13T03:14:58.0246690Z โ”‚ on: 1.0 registered with 1 initial workers" 2023-01-13T03:14:58.0297450Z โ”‚ } 2023-01-13T03:14:58.0336350Z โ”” 2023-01-13T03:14:58.0376950Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:14:58.0478700Z 1ms 289ยตs (cache) (cache) 17.8s 1ms 40ยตs 17.8s 2023-01-13T03:14:58.0533920Z 2023-01-13T03:14:58.0590060Z โœ“ Successful POST request 2023-01-13T03:14:58.0691290Z 2023-01-13T03:14:58.0756120Z โ†’ Model Zoo - Inference Model 2023-01-13T03:15:00.2098530Z POST http://localhost:8080/predictions/resnet-152-batch_scripted 2023-01-13T03:15:00.2138370Z 200 OK โ˜… 2.1s time โ˜… 111.26kBโ†‘ 410Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:00.2179540Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:15:00.2216140Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:15:00.2251890Z โ”” 2023-01-13T03:15:00.2287820Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 175B 2023-01-13T03:15:00.2294540Z โ”‚ { 2023-01-13T03:15:00.2303370Z โ”‚ "tiger_cat": 0.5798612236976624, 2023-01-13T03:15:00.2308720Z โ”‚ "tabby": 0.3834418058395386, 2023-01-13T03:15:00.2336600Z โ”‚ "Egyptian_cat": 0.03421153500676155, 2023-01-13T03:15:00.2350560Z โ”‚ "lynx": 0.0005819810903631151, 2023-01-13T03:15:00.2435930Z โ”‚ "quilt": 0.00027332082390785217 2023-01-13T03:15:00.2499400Z โ”‚ } 2023-01-13T03:15:00.2531080Z โ”” 2023-01-13T03:15:00.2590890Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:00.2774010Z 2ms 305ยตs (cache) (cache) 2.1s 1ms 38ยตs 2.2s 2023-01-13T03:15:00.2829440Z 2023-01-13T03:15:00.2876350Z โœ“ Successful POST request 2023-01-13T03:15:00.2900000Z โœ“ Test expected JSON response 2023-01-13T03:15:00.3000900Z 2023-01-13T03:15:00.3107180Z โ†’ Model Zoo - Unregister model 2023-01-13T03:15:00.3208390Z DELETE http://localhost:8081/models/resnet-152-batch_scripted 2023-01-13T03:15:00.3266280Z 200 OK โ˜… 47ms time โ˜… 261Bโ†‘ 333Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:00.3284260Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 67B 2023-01-13T03:15:00.3320320Z โ”‚ { 2023-01-13T03:15:00.3332400Z โ”‚ "status": "Model \"resnet-152-batch_scripted\" unreg 2023-01-13T03:15:00.3340230Z โ”‚ istered" 2023-01-13T03:15:00.3391610Z โ”‚ } 2023-01-13T03:15:00.3492920Z โ”” 2023-01-13T03:15:00.3594100Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:00.3643370Z 1ms 276ยตs (cache) (cache) 44ms 1ms 44ยตs 48ms 2023-01-13T03:15:00.3671350Z 2023-01-13T03:15:00.3684280Z โœ“ Successful DELETE request 2023-01-13T03:15:00.3701230Z 2023-01-13T03:15:00.3723570Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:15:00.3727740Z GET http://localhost:8082/metrics 2023-01-13T03:15:00.3732850Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 9.33kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:00.3734820Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 9.04kB 2023-01-13T03:15:00.3748580Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:15:00.3763240Z โ”‚ erence requests. 2023-01-13T03:15:00.3792960Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:15:00.3810560Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.3815430Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101_scripted" 2023-01-13T03:15:00.3821200Z โ”‚ ,model_version="default",} 1.0 2023-01-13T03:15:00.3830190Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.3835520Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:15:00.3846900Z โ”‚ default",} 1.0 2023-01-13T03:15:00.3849850Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.3863620Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:15:00.3876200Z โ”‚ "default",} 1.0 2023-01-13T03:15:00.3879230Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.3890380Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:15:00.3894520Z โ”‚ sion="default",} 1.0 2023-01-13T03:15:00.3903180Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.3909440Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:15:00.3918550Z โ”‚ model_version="default",} 1.0 2023-01-13T03:15:00.3926130Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.3931180Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:15:00.3940480Z โ”‚ ="default",} 1.0 2023-01-13T03:15:00.3944130Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.3946540Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:15:00.3954060Z โ”‚ fault",} 1.0 2023-01-13T03:15:00.3957600Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.3963520Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:15:00.3969240Z โ”‚ l_version="default",} 1.0 2023-01-13T03:15:00.3972850Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.3978740Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:15:00.3987520Z โ”‚ l_version="default",} 1.0 2023-01-13T03:15:00.3999190Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.4009120Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:15:00.4010770Z โ”‚ fault",} 1.0 2023-01-13T03:15:00.4013840Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.4015610Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:15:00.4017290Z โ”‚ rsion="default",} 1.0 2023-01-13T03:15:00.4023430Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.4035640Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:15:00.4049650Z โ”‚ rsion="default",} 1.0 2023-01-13T03:15:00.4054240Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.4060550Z โ”‚ 966-f7a8f1df27fc",model_name="resnet152",model_version 2023-01-13T03:15:00.4062820Z โ”‚ ="default",} 1.0 2023-01-13T03:15:00.4069740Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.4092020Z โ”‚ 966-f7a8f1df27fc",model_name="deeplabv3_resnet_101_eag 2023-01-13T03:15:00.4119650Z โ”‚ er",model_version="default",} 1.0 2023-01-13T03:15:00.4145130Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:00.4171270Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-152-batch_scripte 2023-01-13T03:15:00.4197420Z โ”‚ d",model_ve 2023-01-13T03:15:00.4222390Z โ”‚ (showing 2.05kB/9.04kB) 2023-01-13T03:15:00.4247080Z โ”” 2023-01-13T03:15:00.4253410Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:00.4278090Z 1ms 273ยตs (cache) (cache) 2ms 1ms 50ยตs 6ms 2023-01-13T03:15:00.4287110Z 2023-01-13T03:15:00.4293270Z โœ“ Successful GET request 2023-01-13T03:15:00.4302070Z 2023-01-13T03:15:00.4326050Z Iteration 22/24 2023-01-13T03:15:00.4327780Z 2023-01-13T03:15:00.4329900Z โ†’ Model Zoo - Register Model 2023-01-13T03:15:21.8028120Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/distill_bert_qa_eager.mar&model_name=distill_bert_qa_eager&initial_workers=1&synchronous=true 2023-01-13T03:15:21.8038870Z 200 OK โ˜… 21.4s time โ˜… 391Bโ†‘ 363Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:21.8089800Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 97B 2023-01-13T03:15:21.8099560Z โ”‚ { 2023-01-13T03:15:21.8142700Z โ”‚ "status": "Model \"distill_bert_qa_eager\" Version: 2023-01-13T03:15:21.8151070Z โ”‚ 1.0 registered with 1 initial workers" 2023-01-13T03:15:21.8177530Z โ”‚ } 2023-01-13T03:15:21.8184170Z โ”” 2023-01-13T03:15:21.8185410Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:21.8186390Z 1ms 286ยตs (cache) (cache) 21.4s 2ms 51ยตs 21.4s 2023-01-13T03:15:21.8186930Z 2023-01-13T03:15:21.8187460Z โœ“ Successful POST request 2023-01-13T03:15:21.8218470Z 2023-01-13T03:15:21.8221100Z โ†’ Model Zoo - Inference Model 2023-01-13T03:15:22.6884200Z POST http://localhost:8080/predictions/distill_bert_qa_eager 2023-01-13T03:15:22.6911300Z 200 OK โ˜… 855ms time โ˜… 359Bโ†‘ 247Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:22.6980040Z โ”Œ โ†‘ file โ˜… 79B 2023-01-13T03:15:22.7052150Z โ”‚ 2023-01-13T03:15:22.7069000Z โ”” 2023-01-13T03:15:22.7094250Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 13B 2023-01-13T03:15:22.7096080Z โ”‚ a nice puppet 2023-01-13T03:15:22.7115420Z โ”” 2023-01-13T03:15:22.7117040Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:22.7218640Z 4ms 412ยตs (cache) (cache) 852ms 1ms 52ยตs 859ms 2023-01-13T03:15:22.7255230Z 2023-01-13T03:15:22.7333020Z โœ“ Successful POST request 2023-01-13T03:15:22.7561090Z 2023-01-13T03:15:22.7572020Z โ†’ Model Zoo - Unregister model 2023-01-13T03:15:22.7829040Z DELETE http://localhost:8081/models/distill_bert_qa_eager 2023-01-13T03:15:22.7931440Z 200 OK โ˜… 66ms time โ˜… 257Bโ†‘ 329Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:22.7942500Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 63B 2023-01-13T03:15:22.7952580Z โ”‚ { 2023-01-13T03:15:22.7958220Z โ”‚ "status": "Model \"distill_bert_qa_eager\" unregiste 2023-01-13T03:15:22.7973230Z โ”‚ red" 2023-01-13T03:15:22.7974180Z โ”‚ } 2023-01-13T03:15:22.7975290Z โ”” 2023-01-13T03:15:22.7976450Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:22.7979700Z 1ms 319ยตs (cache) (cache) 63ms 1ms 55ยตs 67ms 2023-01-13T03:15:22.7982270Z 2023-01-13T03:15:22.7983000Z โœ“ Successful DELETE request 2023-01-13T03:15:22.7999140Z 2023-01-13T03:15:22.8000890Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:15:22.8202930Z GET http://localhost:8082/metrics 2023-01-13T03:15:22.8209010Z 200 OK โ˜… 4ms time โ˜… 233Bโ†‘ 9.76kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:22.8265110Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 9.47kB 2023-01-13T03:15:22.8336350Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:15:22.8437970Z โ”‚ erence requests. 2023-01-13T03:15:22.8466000Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:15:22.8471220Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8473290Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101_scripted" 2023-01-13T03:15:22.8476120Z โ”‚ ,model_version="default",} 1.0 2023-01-13T03:15:22.8481090Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8481950Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:15:22.8482330Z โ”‚ default",} 1.0 2023-01-13T03:15:22.8483280Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8484190Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:15:22.8484940Z โ”‚ "default",} 1.0 2023-01-13T03:15:22.8485730Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8494500Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:15:22.8495370Z โ”‚ sion="default",} 1.0 2023-01-13T03:15:22.8497870Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8500140Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:15:22.8501140Z โ”‚ model_version="default",} 1.0 2023-01-13T03:15:22.8503290Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8505510Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:15:22.8506340Z โ”‚ ="default",} 1.0 2023-01-13T03:15:22.8508510Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8512910Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:15:22.8514650Z โ”‚ fault",} 1.0 2023-01-13T03:15:22.8515540Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8516430Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:15:22.8517690Z โ”‚ l_version="default",} 1.0 2023-01-13T03:15:22.8518570Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8519450Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:15:22.8519860Z โ”‚ l_version="default",} 1.0 2023-01-13T03:15:22.8524000Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8525080Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:15:22.8525850Z โ”‚ fault",} 1.0 2023-01-13T03:15:22.8526680Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8527570Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:15:22.8574730Z โ”‚ rsion="default",} 1.0 2023-01-13T03:15:22.8577700Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8583170Z โ”‚ 966-f7a8f1df27fc",model_name="distill_bert_qa_eager",m 2023-01-13T03:15:22.8586000Z โ”‚ odel_version="default",} 1.0 2023-01-13T03:15:22.8587800Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8626450Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:15:22.8628050Z โ”‚ rsion="default",} 1.0 2023-01-13T03:15:22.8629620Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8632800Z โ”‚ 966-f7a8f1df27fc",model_name="resnet152",model_version 2023-01-13T03:15:22.8633640Z โ”‚ ="default",} 1.0 2023-01-13T03:15:22.8634770Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:22.8700840Z โ”‚ 966-f7a8f1df27fc",model_name="deeplabv3_resnet_101_eag 2023-01-13T03:15:22.8714150Z โ”‚ er",model_versio 2023-01-13T03:15:22.8762730Z โ”‚ (showing 2.05kB/9.47kB) 2023-01-13T03:15:22.8763960Z โ”” 2023-01-13T03:15:22.8765010Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:22.8767450Z 1ms 333ยตs (cache) (cache) 1ms 1ms 58ยตs 5ms 2023-01-13T03:15:22.8780810Z 2023-01-13T03:15:22.8781750Z โœ“ Successful GET request 2023-01-13T03:15:22.8782370Z 2023-01-13T03:15:22.8782810Z Iteration 23/24 2023-01-13T03:15:22.8783330Z 2023-01-13T03:15:22.8783900Z โ†’ Model Zoo - Register Model 2023-01-13T03:15:58.6714850Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/bert_token_classification_no_torchscript.mar&model_name=bert_token_classification_no_torchscript&initial_workers=1&synchronous=true 2023-01-13T03:15:58.6716750Z 200 OK โ˜… 35.8s time โ˜… 429Bโ†‘ 383Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:58.6717750Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 116B 2023-01-13T03:15:58.6718610Z โ”‚ { 2023-01-13T03:15:58.6719400Z โ”‚ "status": "Model \"bert_token_classification_no_torc 2023-01-13T03:15:58.6720320Z โ”‚ hscript\" Version: 1.0 registered with 1 initial worke 2023-01-13T03:15:58.6721220Z โ”‚ rs" 2023-01-13T03:15:58.6721850Z โ”‚ } 2023-01-13T03:15:58.6742990Z โ”” 2023-01-13T03:15:58.6744370Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:58.6745330Z 1ms 325ยตs (cache) (cache) 35.8s 2ms 59ยตs 35.8s 2023-01-13T03:15:58.6745540Z 2023-01-13T03:15:58.6852510Z โœ“ Successful POST request 2023-01-13T03:15:58.6962970Z 2023-01-13T03:15:58.6964140Z โ†’ Model Zoo - Inference Model 2023-01-13T03:15:59.5083660Z POST http://localhost:8080/predictions/bert_token_classification_no_torchscript 2023-01-13T03:15:59.5096870Z 200 OK โ˜… 802ms time โ˜… 375Bโ†‘ 5.45kBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:59.5109750Z โ”Œ โ†‘ file โ˜… 76B 2023-01-13T03:15:59.5110740Z โ”‚ 2023-01-13T03:15:59.5111690Z โ”” 2023-01-13T03:15:59.5112680Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 5.22kB 2023-01-13T03:15:59.5113620Z โ”‚ [ 2023-01-13T03:15:59.5114690Z โ”‚ [ 2023-01-13T03:15:59.5115590Z โ”‚ "[CLS]", 2023-01-13T03:15:59.5119440Z โ”‚ "B-LOC" 2023-01-13T03:15:59.5119810Z โ”‚ ], 2023-01-13T03:15:59.5120150Z โ”‚ [ 2023-01-13T03:15:59.5120410Z โ”‚ "bloomberg", 2023-01-13T03:15:59.5120670Z โ”‚ "O" 2023-01-13T03:15:59.5121430Z โ”‚ ], 2023-01-13T03:15:59.5121750Z โ”‚ [ 2023-01-13T03:15:59.5121980Z โ”‚ "has", 2023-01-13T03:15:59.5122230Z โ”‚ "I-ORG" 2023-01-13T03:15:59.5122460Z โ”‚ ], 2023-01-13T03:15:59.5122730Z โ”‚ [ 2023-01-13T03:15:59.5122990Z โ”‚ "decided", 2023-01-13T03:15:59.5123230Z โ”‚ "B-PER" 2023-01-13T03:15:59.5123470Z โ”‚ ], 2023-01-13T03:15:59.5123700Z โ”‚ [ 2023-01-13T03:15:59.5123920Z โ”‚ "to", 2023-01-13T03:15:59.5124160Z โ”‚ "O" 2023-01-13T03:15:59.5124390Z โ”‚ ], 2023-01-13T03:15:59.5124600Z โ”‚ [ 2023-01-13T03:15:59.5124840Z โ”‚ "publish", 2023-01-13T03:15:59.5125090Z โ”‚ "I-PER" 2023-01-13T03:15:59.5125310Z โ”‚ ], 2023-01-13T03:15:59.5125530Z โ”‚ [ 2023-01-13T03:15:59.5126330Z โ”‚ "a", 2023-01-13T03:15:59.5126570Z โ”‚ "I-MISC" 2023-01-13T03:15:59.5126810Z โ”‚ ], 2023-01-13T03:15:59.5127100Z โ”‚ [ 2023-01-13T03:15:59.5127320Z โ”‚ "new", 2023-01-13T03:15:59.5127570Z โ”‚ "B-PER" 2023-01-13T03:15:59.5127810Z โ”‚ ], 2023-01-13T03:15:59.5128040Z โ”‚ [ 2023-01-13T03:15:59.5128280Z โ”‚ "report", 2023-01-13T03:15:59.5128610Z โ”‚ "O" 2023-01-13T03:15:59.5128840Z โ”‚ ], 2023-01-13T03:15:59.5129070Z โ”‚ [ 2023-01-13T03:15:59.5129290Z โ”‚ "on", 2023-01-13T03:15:59.5129530Z โ”‚ "O" 2023-01-13T03:15:59.5129860Z โ”‚ ], 2023-01-13T03:15:59.5130110Z โ”‚ [ 2023-01-13T03:15:59.5130350Z โ”‚ "global", 2023-01-13T03:15:59.5130600Z โ”‚ "B-PER" 2023-01-13T03:15:59.5131530Z โ”‚ ], 2023-01-13T03:15:59.5131960Z โ”‚ [ 2023-01-13T03:15:59.5132220Z โ”‚ "economic", 2023-01-13T03:15:59.5132460Z โ”‚ "O" 2023-01-13T03:15:59.5132690Z โ”‚ ], 2023-01-13T03:15:59.5132920Z โ”‚ [ 2023-01-13T03:15:59.5133160Z โ”‚ "situation", 2023-01-13T03:15:59.5133440Z โ”‚ "B-LOC" 2023-01-13T03:15:59.5133680Z โ”‚ ], 2023-01-13T03:15:59.5133890Z โ”‚ [ 2023-01-13T03:15:59.5134130Z โ”‚ ".", 2023-01-13T03:15:59.5134370Z โ”‚ "B-PER" 2023-01-13T03:15:59.5134590Z โ”‚ ], 2023-01-13T03:15:59.5134820Z โ”‚ [ 2023-01-13T03:15:59.5135540Z โ”‚ "[SEP]", 2023-01-13T03:15:59.5135790Z โ”‚ "B-PER" 2023-01-13T03:15:59.5136020Z โ”‚ ], 2023-01-13T03:15:59.5136240Z โ”‚ [ 2023-01-13T03:15:59.5136490Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5136720Z โ”‚ "I-ORG" 2023-01-13T03:15:59.5136950Z โ”‚ ], 2023-01-13T03:15:59.5137180Z โ”‚ [ 2023-01-13T03:15:59.5137400Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5137640Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5137880Z โ”‚ ], 2023-01-13T03:15:59.5138090Z โ”‚ [ 2023-01-13T03:15:59.5138320Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5138560Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5138780Z โ”‚ ], 2023-01-13T03:15:59.5139010Z โ”‚ [ 2023-01-13T03:15:59.5139250Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5139490Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5139720Z โ”‚ ], 2023-01-13T03:15:59.5139940Z โ”‚ [ 2023-01-13T03:15:59.5140160Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5140400Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5140630Z โ”‚ ], 2023-01-13T03:15:59.5140840Z โ”‚ [ 2023-01-13T03:15:59.5141080Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5141330Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5141550Z โ”‚ ], 2023-01-13T03:15:59.5141780Z โ”‚ [ 2023-01-13T03:15:59.5142010Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5142240Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5142550Z โ”‚ ], 2023-01-13T03:15:59.5142810Z โ”‚ [ 2023-01-13T03:15:59.5143030Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5143280Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5143500Z โ”‚ ], 2023-01-13T03:15:59.5143720Z โ”‚ [ 2023-01-13T03:15:59.5143950Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5144190Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5144410Z โ”‚ ], 2023-01-13T03:15:59.5144640Z โ”‚ [ 2023-01-13T03:15:59.5144870Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5145100Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5145340Z โ”‚ ], 2023-01-13T03:15:59.5145570Z โ”‚ [ 2023-01-13T03:15:59.5145790Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5146030Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5146260Z โ”‚ ], 2023-01-13T03:15:59.5146470Z โ”‚ [ 2023-01-13T03:15:59.5146710Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5147380Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5147750Z โ”‚ ], 2023-01-13T03:15:59.5147980Z โ”‚ [ 2023-01-13T03:15:59.5148210Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5148450Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5148680Z โ”‚ ], 2023-01-13T03:15:59.5148910Z โ”‚ [ 2023-01-13T03:15:59.5149130Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5149370Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5149600Z โ”‚ ], 2023-01-13T03:15:59.5149820Z โ”‚ [ 2023-01-13T03:15:59.5150050Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5150300Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5150520Z โ”‚ ], 2023-01-13T03:15:59.5150750Z โ”‚ [ 2023-01-13T03:15:59.5150980Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5151220Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5151840Z โ”‚ ], 2023-01-13T03:15:59.5152070Z โ”‚ [ 2023-01-13T03:15:59.5152290Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5152530Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5152760Z โ”‚ ], 2023-01-13T03:15:59.5152980Z โ”‚ [ 2023-01-13T03:15:59.5153210Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5153450Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5153680Z โ”‚ ], 2023-01-13T03:15:59.5153920Z โ”‚ [ 2023-01-13T03:15:59.5154150Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5154380Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5154620Z โ”‚ ], 2023-01-13T03:15:59.5154840Z โ”‚ [ 2023-01-13T03:15:59.5155060Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5155310Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5155530Z โ”‚ ], 2023-01-13T03:15:59.5155750Z โ”‚ [ 2023-01-13T03:15:59.5155980Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5156220Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5156450Z โ”‚ ], 2023-01-13T03:15:59.5156670Z โ”‚ [ 2023-01-13T03:15:59.5156900Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5157140Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5157370Z โ”‚ ], 2023-01-13T03:15:59.5157600Z โ”‚ [ 2023-01-13T03:15:59.5157840Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5158070Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5158300Z โ”‚ ], 2023-01-13T03:15:59.5158530Z โ”‚ [ 2023-01-13T03:15:59.5158750Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5158990Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5159230Z โ”‚ ], 2023-01-13T03:15:59.5159450Z โ”‚ [ 2023-01-13T03:15:59.5159680Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5159920Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5160140Z โ”‚ ], 2023-01-13T03:15:59.5160360Z โ”‚ [ 2023-01-13T03:15:59.5160590Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5160830Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5161060Z โ”‚ ], 2023-01-13T03:15:59.5161280Z โ”‚ [ 2023-01-13T03:15:59.5161500Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5161740Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5161970Z โ”‚ ], 2023-01-13T03:15:59.5162190Z โ”‚ [ 2023-01-13T03:15:59.5162420Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5162650Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5162870Z โ”‚ ], 2023-01-13T03:15:59.5163090Z โ”‚ [ 2023-01-13T03:15:59.5163340Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5163570Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5163800Z โ”‚ ], 2023-01-13T03:15:59.5164030Z โ”‚ [ 2023-01-13T03:15:59.5164250Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5164490Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5164830Z โ”‚ ], 2023-01-13T03:15:59.5165050Z โ”‚ [ 2023-01-13T03:15:59.5165290Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5165540Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5165760Z โ”‚ ], 2023-01-13T03:15:59.5165980Z โ”‚ [ 2023-01-13T03:15:59.5166210Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5166440Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5166680Z โ”‚ ], 2023-01-13T03:15:59.5166900Z โ”‚ [ 2023-01-13T03:15:59.5167120Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5167370Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5167590Z โ”‚ ], 2023-01-13T03:15:59.5167830Z โ”‚ [ 2023-01-13T03:15:59.5178800Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5179110Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5179350Z โ”‚ ], 2023-01-13T03:15:59.5179560Z โ”‚ [ 2023-01-13T03:15:59.5179820Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5180060Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5180290Z โ”‚ ], 2023-01-13T03:15:59.5180510Z โ”‚ [ 2023-01-13T03:15:59.5180740Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5180970Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5181200Z โ”‚ ], 2023-01-13T03:15:59.5181430Z โ”‚ [ 2023-01-13T03:15:59.5182110Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5182460Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5182690Z โ”‚ ], 2023-01-13T03:15:59.5182900Z โ”‚ [ 2023-01-13T03:15:59.5183130Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5183380Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5183590Z โ”‚ ], 2023-01-13T03:15:59.5183820Z โ”‚ [ 2023-01-13T03:15:59.5184060Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5184290Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5184520Z โ”‚ ], 2023-01-13T03:15:59.5184740Z โ”‚ [ 2023-01-13T03:15:59.5184970Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5185210Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5185440Z โ”‚ ], 2023-01-13T03:15:59.5185650Z โ”‚ [ 2023-01-13T03:15:59.5185880Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5186510Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5186730Z โ”‚ ], 2023-01-13T03:15:59.5186950Z โ”‚ [ 2023-01-13T03:15:59.5187180Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5187410Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5187650Z โ”‚ ], 2023-01-13T03:15:59.5187870Z โ”‚ [ 2023-01-13T03:15:59.5188110Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5188360Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5188580Z โ”‚ ], 2023-01-13T03:15:59.5188790Z โ”‚ [ 2023-01-13T03:15:59.5189030Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5189270Z โ”‚ "B-MISC" 2023-01-13T03:15:59.5189500Z โ”‚ ], 2023-01-13T03:15:59.5189710Z โ”‚ [ 2023-01-13T03:15:59.5189940Z โ”‚ "[PAD]", 2023-01-13T03:15:59.5190250Z โ”‚ (showing 2.05kB/5.22kB) 2023-01-13T03:15:59.5190480Z โ”” 2023-01-13T03:15:59.5190910Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:59.5191390Z 2ms 307ยตs (cache) (cache) 799ms 1ms 54ยตs 804ms 2023-01-13T03:15:59.5191580Z 2023-01-13T03:15:59.5211210Z โœ“ Successful POST request 2023-01-13T03:15:59.5220240Z โœ“ Test expected JSON response 2023-01-13T03:15:59.5305050Z 2023-01-13T03:15:59.5305630Z โ†’ Model Zoo - Unregister model 2023-01-13T03:15:59.5822520Z DELETE http://localhost:8081/models/bert_token_classification_no_torchscript 2023-01-13T03:15:59.5823930Z 200 OK โ˜… 44ms time โ˜… 276Bโ†‘ 348Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:59.5824840Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 82B 2023-01-13T03:15:59.5825520Z โ”‚ { 2023-01-13T03:15:59.5826270Z โ”‚ "status": "Model \"bert_token_classification_no_torc 2023-01-13T03:15:59.5827020Z โ”‚ hscript\" unregistered" 2023-01-13T03:15:59.5827660Z โ”‚ } 2023-01-13T03:15:59.5846690Z โ”” 2023-01-13T03:15:59.5847680Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:59.5848640Z 1ms 274ยตs (cache) (cache) 41ms 2ms 296ยตs 45ms 2023-01-13T03:15:59.5849240Z 2023-01-13T03:15:59.5933270Z โœ“ Successful DELETE request 2023-01-13T03:15:59.6026070Z 2023-01-13T03:15:59.6027100Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:15:59.6144880Z GET http://localhost:8082/metrics 2023-01-13T03:15:59.6145860Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 10.25kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:15:59.6147070Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 9.95kB 2023-01-13T03:15:59.6147650Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:15:59.6147980Z โ”‚ erence requests. 2023-01-13T03:15:59.6148320Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:15:59.6148700Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6149200Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101_scripted" 2023-01-13T03:15:59.6149610Z โ”‚ ,model_version="default",} 1.0 2023-01-13T03:15:59.6149980Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6150360Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet",model_version=" 2023-01-13T03:15:59.6150690Z โ”‚ default",} 1.0 2023-01-13T03:15:59.6151040Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6151420Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:15:59.6151710Z โ”‚ "default",} 1.0 2023-01-13T03:15:59.6152580Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6153060Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:15:59.6153630Z โ”‚ sion="default",} 1.0 2023-01-13T03:15:59.6154320Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6154790Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:15:59.6155230Z โ”‚ model_version="default",} 1.0 2023-01-13T03:15:59.6155760Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6156150Z โ”‚ 966-f7a8f1df27fc",model_name="bert_token_classificatio 2023-01-13T03:15:59.6156510Z โ”‚ n_no_torchscript",model_version="default",} 1.0 2023-01-13T03:15:59.6158110Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6158510Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18",model_version 2023-01-13T03:15:59.6158810Z โ”‚ ="default",} 1.0 2023-01-13T03:15:59.6159160Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6159550Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:15:59.6159850Z โ”‚ fault",} 1.0 2023-01-13T03:15:59.6160190Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6160570Z โ”‚ 966-f7a8f1df27fc",model_name="my_text_classifier",mode 2023-01-13T03:15:59.6160900Z โ”‚ l_version="default",} 1.0 2023-01-13T03:15:59.6161250Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6161910Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:15:59.6162770Z โ”‚ l_version="default",} 1.0 2023-01-13T03:15:59.6163450Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6163950Z โ”‚ 966-f7a8f1df27fc",model_name="mnist",model_version="de 2023-01-13T03:15:59.6164270Z โ”‚ fault",} 1.0 2023-01-13T03:15:59.6164610Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6164980Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16_scripted",model_ve 2023-01-13T03:15:59.6165470Z โ”‚ rsion="default",} 1.0 2023-01-13T03:15:59.6166010Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6166470Z โ”‚ 966-f7a8f1df27fc",model_name="distill_bert_qa_eager",m 2023-01-13T03:15:59.6166810Z โ”‚ odel_version="default",} 1.0 2023-01-13T03:15:59.6167170Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6167550Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:15:59.6167860Z โ”‚ rsion="default",} 1.0 2023-01-13T03:15:59.6168210Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:15:59.6168570Z โ”‚ 966-f7a8f1df27fc",model_name="resnet152 2023-01-13T03:15:59.6168870Z โ”‚ (showing 2.05kB/9.95kB) 2023-01-13T03:15:59.6184110Z โ”” 2023-01-13T03:15:59.6185520Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:15:59.6186060Z 1ms 349ยตs (cache) (cache) 2ms 1ms 54ยตs 5ms 2023-01-13T03:15:59.6186240Z 2023-01-13T03:15:59.6288810Z โœ“ Successful GET request 2023-01-13T03:15:59.6397540Z 2023-01-13T03:15:59.6398650Z Iteration 24/24 2023-01-13T03:15:59.6416190Z 2023-01-13T03:15:59.6417230Z โ†’ Model Zoo - Register Model 2023-01-13T03:16:25.7934910Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/bert_seqc_without_torchscript.mar&model_name=bert_seqc_without_torchscript&initial_workers=1&synchronous=true 2023-01-13T03:16:25.7936370Z 200 OK โ˜… 26.1s time โ˜… 407Bโ†‘ 372Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:16:25.7942210Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 105B 2023-01-13T03:16:25.7942890Z โ”‚ { 2023-01-13T03:16:25.7943680Z โ”‚ "status": "Model \"bert_seqc_without_torchscript\" V 2023-01-13T03:16:25.7944510Z โ”‚ ersion: 1.0 registered with 1 initial workers" 2023-01-13T03:16:25.7944860Z โ”‚ } 2023-01-13T03:16:25.7956570Z โ”” 2023-01-13T03:16:25.7958650Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:16:25.7960610Z 2ms 824ยตs (cache) (cache) 26.1s 1ms 41ยตs 26.1s 2023-01-13T03:16:25.7960930Z 2023-01-13T03:16:25.8016980Z โœ“ Successful POST request 2023-01-13T03:16:25.8058640Z 2023-01-13T03:16:25.8059500Z โ†’ Model Zoo - Inference Model 2023-01-13T03:16:26.5296190Z POST http://localhost:8080/predictions/bert_seqc_without_torchscript 2023-01-13T03:16:26.5330640Z 200 OK โ˜… 715ms time โ˜… 364Bโ†‘ 246Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:16:26.5390610Z โ”Œ โ†‘ file โ˜… 76B 2023-01-13T03:16:26.5452720Z โ”‚ 2023-01-13T03:16:26.5469270Z โ”” 2023-01-13T03:16:26.5476370Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 12B 2023-01-13T03:16:26.5516630Z โ”‚ Not Accepted 2023-01-13T03:16:26.5542830Z โ”” 2023-01-13T03:16:26.5560600Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:16:26.5633310Z 4ms 269ยตs (cache) (cache) 712ms 1ms 41ยตs 718ms 2023-01-13T03:16:26.5633630Z 2023-01-13T03:16:26.5713520Z โœ“ Successful POST request 2023-01-13T03:16:26.5761130Z โœ“ Test expected TEXT response 2023-01-13T03:16:26.5790510Z 2023-01-13T03:16:26.5891830Z โ†’ Model Zoo - Unregister model 2023-01-13T03:16:26.6211500Z DELETE http://localhost:8081/models/bert_seqc_without_torchscript 2023-01-13T03:16:26.6279120Z 200 OK โ˜… 62ms time โ˜… 265Bโ†‘ 337Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:16:26.6300410Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 71B 2023-01-13T03:16:26.6313940Z โ”‚ { 2023-01-13T03:16:26.6327870Z โ”‚ "status": "Model \"bert_seqc_without_torchscript\" u 2023-01-13T03:16:26.6384570Z โ”‚ nregistered" 2023-01-13T03:16:26.6386030Z โ”‚ } 2023-01-13T03:16:26.6387220Z โ”” 2023-01-13T03:16:26.6388160Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:16:26.6453190Z 1ms 263ยตs (cache) (cache) 58ms 2ms 40ยตs 62ms 2023-01-13T03:16:26.6491190Z 2023-01-13T03:16:26.6605450Z โœ“ Successful DELETE request 2023-01-13T03:16:26.6635740Z 2023-01-13T03:16:26.6697070Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:16:26.6760780Z GET http://localhost:8082/metrics 2023-01-13T03:16:26.6817870Z 200 OK โ˜… 5ms time โ˜… 233Bโ†‘ 10.7kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:16:26.6877710Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 10.41kB 2023-01-13T03:16:26.6907720Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:16:26.6962360Z โ”‚ erence requests. 2023-01-13T03:16:26.6982730Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:16:26.6992770Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7007920Z โ”‚ 966-f7a8f1df27fc",model_name="fastrcnn",model_version= 2023-01-13T03:16:26.7011300Z โ”‚ "default",} 1.0 2023-01-13T03:16:26.7040000Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7050220Z โ”‚ 966-f7a8f1df27fc",model_name="bert_seqc_without_torchs 2023-01-13T03:16:26.7051660Z โ”‚ cript",model_version="default",} 1.0 2023-01-13T03:16:26.7053660Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7055780Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1",model_ver 2023-01-13T03:16:26.7071630Z โ”‚ sion="default",} 1.0 2023-01-13T03:16:26.7074240Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7089820Z โ”‚ 966-f7a8f1df27fc",model_name="squeezenet1_1_scripted", 2023-01-13T03:16:26.7093920Z โ”‚ model_version="default",} 1.0 2023-01-13T03:16:26.7097910Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7122170Z โ”‚ 966-f7a8f1df27fc",model_name="bert_token_classificatio 2023-01-13T03:16:26.7148310Z โ”‚ n_no_torchscript",model_version="default",} 1.0 2023-01-13T03:16:26.7153370Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7159390Z โ”‚ 966-f7a8f1df27fc",model_name="vgg16",model_version="de 2023-01-13T03:16:26.7164980Z โ”‚ fault",} 1.0 2023-01-13T03:16:26.7166130Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7167280Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-18_scripted",mode 2023-01-13T03:16:26.7167710Z โ”‚ l_version="default",} 1.0 2023-01-13T03:16:26.7168870Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7169310Z โ”‚ 966-f7a8f1df27fc",model_name="mnist_scripted",model_ve 2023-01-13T03:16:26.7169640Z โ”‚ rsion="default",} 1.0 2023-01-13T03:16:26.7170000Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7170390Z โ”‚ 966-f7a8f1df27fc",model_name="deeplabv3_resnet_101_eag 2023-01-13T03:16:26.7170750Z โ”‚ er",model_version="default",} 1.0 2023-01-13T03:16:26.7171130Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7172130Z โ”‚ 966-f7a8f1df27fc",model_name="resnet-152-batch_scripte 2023-01-13T03:16:26.7172470Z โ”‚ d",model_version="default",} 1.0 2023-01-13T03:16:26.7172830Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7173230Z โ”‚ 966-f7a8f1df27fc",model_name="deeplabv3_resnet_101_scr 2023-01-13T03:16:26.7173580Z โ”‚ ipted",model_version="default",} 1.0 2023-01-13T03:16:26.7173960Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7174340Z โ”‚ 966-f7a8f1df27fc",model_name="fcn_resnet_101",model_ve 2023-01-13T03:16:26.7174640Z โ”‚ rsion="default",} 1.0 2023-01-13T03:16:26.7175000Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7175380Z โ”‚ 966-f7a8f1df27fc",model_name="densenet161",model_versi 2023-01-13T03:16:26.7175690Z โ”‚ on="default",} 1.0 2023-01-13T03:16:26.7176030Z โ”‚ ts_inference_requests_total{uuid="15fe81f8-6953-4e7f-8 2023-01-13T03:16:26.7176410Z โ”‚ 966-f7a8f1df27fc",model_name="alexnet_scripted",model_ 2023-01-13T03:16:26.7176740Z โ”‚ version="default",} 1.0 2023-01-13T03:16:26.7177070Z โ”‚ ts_inference_requests_total{uuid="15fe81 2023-01-13T03:16:26.7177390Z โ”‚ (showing 2.05kB/10.41kB) 2023-01-13T03:16:26.7177730Z โ”” 2023-01-13T03:16:26.7178180Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:16:26.7178670Z 1ms 273ยตs (cache) (cache) 2ms 2ms 51ยตs 6ms 2023-01-13T03:16:26.7178840Z 2023-01-13T03:16:26.7179020Z โœ“ Successful GET request 2023-01-13T03:16:26.7179160Z 2023-01-13T03:16:26.7179440Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:16:26.7179810Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:16:26.7180220Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7180580Z โ”‚ iterations โ”‚ 24 โ”‚ 0 โ”‚ 2023-01-13T03:16:26.7181020Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7181370Z โ”‚ requests โ”‚ 96 โ”‚ 0 โ”‚ 2023-01-13T03:16:26.7181770Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7182440Z โ”‚ test-scripts โ”‚ 96 โ”‚ 0 โ”‚ 2023-01-13T03:16:26.7182940Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7183340Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:16:26.7183750Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7184110Z โ”‚ assertions โ”‚ 113 โ”‚ 0 โ”‚ 2023-01-13T03:16:26.7184520Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7184890Z โ”‚ total run duration: 7m 4.3s โ”‚ 2023-01-13T03:16:26.7185290Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7186020Z โ”‚ total data received: 10.04MB (approx) โ”‚ 2023-01-13T03:16:26.7186450Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7186840Z โ”‚ average response time: 4.3s [min: 4ms, max: 35.8s, s.d.: 7.9s] โ”‚ 2023-01-13T03:16:26.7188470Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7189260Z โ”‚ average DNS lookup time: 1ms [min: 627ยตs, max: 2ms, s.d.: 671ยตs] โ”‚ 2023-01-13T03:16:26.7189710Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:16:26.7190100Z โ”‚ average first byte time: 4.3s [min: 1ms, max: 35.8s, s.d.: 7.9s] โ”‚ 2023-01-13T03:16:26.7190520Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:16:26.7898430Z TorchServe has stopped. 2023-01-13T03:16:48.2037410Z newman: could not find "htmlextra" reporter 2023-01-13T03:16:48.2043590Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:16:48.2044010Z please install reporter using npm 2023-01-13T03:16:48.2044160Z 2023-01-13T03:16:48.4674290Z newman 2023-01-13T03:16:48.4774320Z 2023-01-13T03:16:48.4876080Z inference 2023-01-13T03:16:48.4976960Z 2023-01-13T03:16:48.5078050Z โ†’ Model Zoo - Register Model 2023-01-13T03:17:00.3170360Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/densenet161_scripted.mar&model_name=densenet161_scripted&initial_workers=1&synchronous=true 2023-01-13T03:17:00.3172140Z 200 OK โ˜… 11.7s time โ˜… 389Bโ†‘ 362Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:00.3177940Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 96B 2023-01-13T03:17:00.3184130Z โ”‚ { 2023-01-13T03:17:00.3186580Z โ”‚ "status": "Model \"densenet161_scripted\" Version: 1 2023-01-13T03:17:00.3187440Z โ”‚ .0 registered with 1 initial workers" 2023-01-13T03:17:00.3188250Z โ”‚ } 2023-01-13T03:17:00.3322680Z โ”” 2023-01-13T03:17:00.3329940Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:00.3341740Z 52ms 7ms 2ms 399ยตs 11.7s 11ms 644ยตs 11.8s 2023-01-13T03:17:00.3342850Z 2023-01-13T03:17:00.3675990Z โœ“ Successful POST request 2023-01-13T03:17:00.3833400Z 2023-01-13T03:17:00.3837620Z โ†’ Model Zoo - Inference Model 2023-01-13T03:17:02.1043400Z POST http://localhost:8080/predictions/densenet161_scripted 2023-01-13T03:17:02.1140150Z 200 OK โ˜… 1700ms time โ˜… 111.25kBโ†‘ 417Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:02.1165920Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:17:02.1167770Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:17:02.1190100Z โ”” 2023-01-13T03:17:02.1194500Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 182B 2023-01-13T03:17:02.1237620Z โ”‚ { 2023-01-13T03:17:02.1239310Z โ”‚ "tabby": 0.4666196405887604, 2023-01-13T03:17:02.1276330Z โ”‚ "tiger_cat": 0.46448981761932373, 2023-01-13T03:17:02.1310850Z โ”‚ "Egyptian_cat": 0.06614061444997787, 2023-01-13T03:17:02.1313270Z โ”‚ "lynx": 0.0012924396432936192, 2023-01-13T03:17:02.1315080Z โ”‚ "plastic_bag": 0.00022909772815182805 2023-01-13T03:17:02.1362950Z โ”‚ } 2023-01-13T03:17:02.1389660Z โ”” 2023-01-13T03:17:02.1396340Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:02.1396940Z 9ms 2ms 838ยตs 307ยตs 1693ms 3ms 75ยตs 1708ms 2023-01-13T03:17:02.1403710Z 2023-01-13T03:17:02.1406000Z โœ“ Successful POST request 2023-01-13T03:17:02.1413480Z โœ“ Test expected JSON response 2023-01-13T03:17:02.1520030Z 2023-01-13T03:17:02.1618920Z โ†’ Model Zoo - Unregister model 2023-01-13T03:17:02.1950870Z DELETE http://localhost:8081/models/densenet161_scripted 2023-01-13T03:17:02.1958730Z 200 OK โ˜… 50ms time โ˜… 256Bโ†‘ 328Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:02.1991850Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 62B 2023-01-13T03:17:02.2033220Z โ”‚ { 2023-01-13T03:17:02.2065030Z โ”‚ "status": "Model \"densenet161_scripted\" unregister 2023-01-13T03:17:02.2069080Z โ”‚ ed" 2023-01-13T03:17:02.2094210Z โ”‚ } 2023-01-13T03:17:02.2112470Z โ”” 2023-01-13T03:17:02.2128890Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:02.2159340Z 1ms 666ยตs (cache) (cache) 46ms 2ms 108ยตs 51ms 2023-01-13T03:17:02.2170330Z 2023-01-13T03:17:02.2171240Z โœ“ Successful DELETE request 2023-01-13T03:17:02.2171930Z 2023-01-13T03:17:02.2173890Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:17:02.2472710Z GET http://localhost:8082/metrics 2023-01-13T03:17:02.2476200Z 200 OK โ˜… 24ms time โ˜… 233Bโ†‘ 1.09kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:02.2477660Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 802B 2023-01-13T03:17:02.2480690Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:17:02.2483670Z โ”‚ ference duration in microseconds 2023-01-13T03:17:02.2485320Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:17:02.2486130Z โ”‚ ts_inference_latency_microseconds{uuid="7c715888-c8bd- 2023-01-13T03:17:02.2486930Z โ”‚ 4f15-b233-bf38a523454b",model_name="densenet161_script 2023-01-13T03:17:02.2488480Z โ”‚ ed",model_version="default",} 1660445.669 2023-01-13T03:17:02.2489560Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:17:02.2492550Z โ”‚ duration in microseconds 2023-01-13T03:17:02.2493530Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:17:02.2494060Z โ”‚ ts_queue_latency_microseconds{uuid="7c715888-c8bd-4f15 2023-01-13T03:17:02.2494490Z โ”‚ -b233-bf38a523454b",model_name="densenet161_scripted", 2023-01-13T03:17:02.2494860Z โ”‚ model_version="default",} 180.239 2023-01-13T03:17:02.2495490Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:17:02.2496290Z โ”‚ erence requests. 2023-01-13T03:17:02.2497090Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:17:02.2499850Z โ”‚ ts_inference_requests_total{uuid="7c715888-c8bd-4f15-b 2023-01-13T03:17:02.2501290Z โ”‚ 233-bf38a523454b",model_name="densenet161_scripted",mo 2023-01-13T03:17:02.2502980Z โ”‚ del_version="default",} 1.0 2023-01-13T03:17:02.2503860Z โ”” 2023-01-13T03:17:02.2505330Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:02.2507160Z 1ms 780ยตs 241ยตs 227ยตs 19ms 2ms 89ยตs 25ms 2023-01-13T03:17:02.2509740Z 2023-01-13T03:17:02.2593030Z โœ“ Successful GET request 2023-01-13T03:17:02.2718670Z 2023-01-13T03:17:02.2720040Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:17:02.2728360Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:17:02.2729080Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2729830Z โ”‚ iterations โ”‚ 1 โ”‚ 0 โ”‚ 2023-01-13T03:17:02.2730340Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2739260Z โ”‚ requests โ”‚ 4 โ”‚ 0 โ”‚ 2023-01-13T03:17:02.2740610Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2745270Z โ”‚ test-scripts โ”‚ 4 โ”‚ 0 โ”‚ 2023-01-13T03:17:02.2746190Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2747060Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:17:02.2747960Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2748790Z โ”‚ assertions โ”‚ 5 โ”‚ 0 โ”‚ 2023-01-13T03:17:02.2749640Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2750480Z โ”‚ total run duration: 13.8s โ”‚ 2023-01-13T03:17:02.2751350Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2752500Z โ”‚ total data received: 1.14kB (approx) โ”‚ 2023-01-13T03:17:02.2753470Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2758070Z โ”‚ average response time: 3.3s [min: 24ms, max: 11.7s, s.d.: 4.8s] โ”‚ 2023-01-13T03:17:02.2762150Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2762760Z โ”‚ average DNS lookup time: 1ms [min: 241ยตs, max: 2ms, s.d.: 752ยตs] โ”‚ 2023-01-13T03:17:02.2764600Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:02.2765520Z โ”‚ average first byte time: 3.3s [min: 19ms, max: 11.7s, s.d.: 4.8s] โ”‚ 2023-01-13T03:17:02.2766410Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:17:02.3648350Z TorchServe has stopped. 2023-01-13T03:17:23.3769480Z newman: could not find "htmlextra" reporter 2023-01-13T03:17:23.3777680Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:17:23.3780970Z please install reporter using npm 2023-01-13T03:17:23.3781370Z 2023-01-13T03:17:23.6423120Z newman 2023-01-13T03:17:23.6523960Z 2023-01-13T03:17:23.6621910Z https_test_collection 2023-01-13T03:17:23.6683500Z 2023-01-13T03:17:23.6704750Z โ†’ HTTPS Inference API Description 2023-01-13T03:17:23.9596810Z OPTIONS https://localhost:8443 2023-01-13T03:17:23.9615740Z 200 OK โ˜… 245ms time โ˜… 230Bโ†‘ 23.67kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:23.9618240Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 23.41kB 2023-01-13T03:17:23.9618860Z โ”‚ { 2023-01-13T03:17:23.9620890Z โ”‚ "openapi": "3.0.1", 2023-01-13T03:17:23.9621480Z โ”‚ "info": { 2023-01-13T03:17:23.9623460Z โ”‚ "title": "TorchServe APIs", 2023-01-13T03:17:23.9624250Z โ”‚ "description": "TorchServe is a flexible and easy 2023-01-13T03:17:23.9626320Z โ”‚ to use tool for serving deep learning models", 2023-01-13T03:17:23.9627010Z โ”‚ "version": "0.7.0" 2023-01-13T03:17:23.9628890Z โ”‚ }, 2023-01-13T03:17:23.9629480Z โ”‚ "paths": { 2023-01-13T03:17:23.9630010Z โ”‚ "/": { 2023-01-13T03:17:23.9631900Z โ”‚ "options": { 2023-01-13T03:17:23.9632570Z โ”‚ "description": "Get openapi description.", 2023-01-13T03:17:23.9634510Z โ”‚ "operationId": "apiDescription", 2023-01-13T03:17:23.9635190Z โ”‚ "parameters": [], 2023-01-13T03:17:23.9637070Z โ”‚ "responses": { 2023-01-13T03:17:23.9637660Z โ”‚ "200": { 2023-01-13T03:17:23.9638300Z โ”‚ "description": "A openapi 3.0.1 descriptor 2023-01-13T03:17:23.9640370Z โ”‚ ", 2023-01-13T03:17:23.9640970Z โ”‚ "content": { 2023-01-13T03:17:23.9661280Z โ”‚ "application/json": { 2023-01-13T03:17:23.9685520Z โ”‚ "schema": { 2023-01-13T03:17:23.9687870Z โ”‚ "type": "object", 2023-01-13T03:17:23.9706220Z โ”‚ "required": [ 2023-01-13T03:17:23.9707300Z โ”‚ "openapi", 2023-01-13T03:17:23.9708460Z โ”‚ "info", 2023-01-13T03:17:23.9724120Z โ”‚ "paths" 2023-01-13T03:17:23.9724990Z โ”‚ ], 2023-01-13T03:17:23.9754260Z โ”‚ "properties": { 2023-01-13T03:17:23.9755160Z โ”‚ "openapi": { 2023-01-13T03:17:23.9790980Z โ”‚ "type": "string" 2023-01-13T03:17:23.9814370Z โ”‚ }, 2023-01-13T03:17:23.9815220Z โ”‚ "info": { 2023-01-13T03:17:23.9816050Z โ”‚ "type": "object" 2023-01-13T03:17:23.9816860Z โ”‚ }, 2023-01-13T03:17:23.9817670Z โ”‚ "paths": { 2023-01-13T03:17:23.9818500Z โ”‚ "type": "object" 2023-01-13T03:17:23.9819530Z โ”‚ } 2023-01-13T03:17:23.9826580Z โ”‚ } 2023-01-13T03:17:23.9828970Z โ”‚ } 2023-01-13T03:17:23.9829740Z โ”‚ } 2023-01-13T03:17:23.9831920Z โ”‚ } 2023-01-13T03:17:23.9832690Z โ”‚ }, 2023-01-13T03:17:23.9878450Z โ”‚ "500": { 2023-01-13T03:17:23.9880560Z โ”‚ "description": "Internal Server Error", 2023-01-13T03:17:23.9881460Z โ”‚ "content": { 2023-01-13T03:17:23.9895730Z โ”‚ "application/json": { 2023-01-13T03:17:23.9953180Z โ”‚ "schema": { 2023-01-13T03:17:23.9955620Z โ”‚ "type": "object", 2023-01-13T03:17:23.9957850Z โ”‚ "required": [ 2023-01-13T03:17:23.9958680Z โ”‚ "code", 2023-01-13T03:17:23.9960810Z โ”‚ "type", 2023-01-13T03:17:23.9961630Z โ”‚ "message" 2023-01-13T03:17:23.9989880Z โ”‚ ], 2023-01-13T03:17:23.9990760Z โ”‚ "properties": { 2023-01-13T03:17:23.9991580Z โ”‚ "code": { 2023-01-13T03:17:23.9992420Z โ”‚ "type": "integer", 2023-01-13T03:17:23.9993280Z โ”‚ "description": "Error code." 2023-01-13T03:17:23.9994090Z โ”‚ }, 2023-01-13T03:17:23.9995800Z โ”‚ "type": { 2023-01-13T03:17:24.0000350Z โ”‚ "type": "string", 2023-01-13T03:17:24.0001250Z โ”‚ "description": "Error type." 2023-01-13T03:17:24.0002080Z โ”‚ }, 2023-01-13T03:17:24.0017170Z โ”‚ "message": { 2023-01-13T03:17:24.0018070Z โ”‚ "type": "string", 2023-01-13T03:17:24.0020450Z โ”‚ "description": "Error message." 2023-01-13T03:17:24.0022720Z โ”‚ } 2023-01-13T03:17:24.0023540Z โ”‚ } 2023-01-13T03:17:24.0025820Z โ”‚ } 2023-01-13T03:17:24.0026600Z โ”‚ } 2023-01-13T03:17:24.0029240Z โ”‚ } 2023-01-13T03:17:24.0030010Z โ”‚ } 2023-01-13T03:17:24.0032270Z โ”‚ } 2023-01-13T03:17:24.0033070Z โ”‚ } 2023-01-13T03:17:24.0033820Z โ”‚ }, 2023-01-13T03:17:24.0034590Z โ”‚ "/ping": { 2023-01-13T03:17:24.0035320Z โ”‚ 2023-01-13T03:17:24.0036730Z โ”‚ (showing 2.05kB/23.41kB) 2023-01-13T03:17:24.0037660Z โ”” 2023-01-13T03:17:24.0038650Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:17:24.0039680Z 50ms 9ms 1ms 819ยตs 176ms 45ms 9ms 605ยตs 296ms 2023-01-13T03:17:24.0041810Z 2023-01-13T03:17:24.0203710Z โœ“ Status code is 200 2023-01-13T03:17:24.0351080Z 2023-01-13T03:17:24.0352020Z โ†’ HTTPS Management API Description 2023-01-13T03:17:24.1119220Z OPTIONS https://localhost:8444 2023-01-13T03:17:24.1220880Z 200 OK โ˜… 68ms time โ˜… 230Bโ†‘ 58.87kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:24.1322720Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 58.6kB 2023-01-13T03:17:24.1424380Z โ”‚ { 2023-01-13T03:17:24.1524980Z โ”‚ "openapi": "3.0.1", 2023-01-13T03:17:24.1539190Z โ”‚ "info": { 2023-01-13T03:17:24.1640220Z โ”‚ "title": "TorchServe APIs", 2023-01-13T03:17:24.1741840Z โ”‚ "description": "TorchServe is a flexible and easy 2023-01-13T03:17:24.1848010Z โ”‚ to use tool for serving deep learning models", 2023-01-13T03:17:24.1974770Z โ”‚ "version": "0.7.0" 2023-01-13T03:17:24.2076160Z โ”‚ }, 2023-01-13T03:17:24.2153170Z โ”‚ "paths": { 2023-01-13T03:17:24.2212940Z โ”‚ "/": { 2023-01-13T03:17:24.2273960Z โ”‚ "options": { 2023-01-13T03:17:24.2359880Z โ”‚ "description": "Get openapi description.", 2023-01-13T03:17:24.2394790Z โ”‚ "operationId": "apiDescription", 2023-01-13T03:17:24.2396130Z โ”‚ "parameters": [], 2023-01-13T03:17:24.2444460Z โ”‚ "responses": { 2023-01-13T03:17:24.2489600Z โ”‚ "200": { 2023-01-13T03:17:24.2497470Z โ”‚ "description": "A openapi 3.0.1 descriptor 2023-01-13T03:17:24.2540420Z โ”‚ ", 2023-01-13T03:17:24.2641780Z โ”‚ "content": { 2023-01-13T03:17:24.2736290Z โ”‚ "application/json": { 2023-01-13T03:17:24.2746690Z โ”‚ "schema": { 2023-01-13T03:17:24.2779710Z โ”‚ "type": "object", 2023-01-13T03:17:24.2814070Z โ”‚ "required": [ 2023-01-13T03:17:24.2915350Z โ”‚ "openapi", 2023-01-13T03:17:24.2930320Z โ”‚ "info", 2023-01-13T03:17:24.2972940Z โ”‚ "paths" 2023-01-13T03:17:24.3004630Z โ”‚ ], 2023-01-13T03:17:24.3106310Z โ”‚ "properties": { 2023-01-13T03:17:24.3122910Z โ”‚ "openapi": { 2023-01-13T03:17:24.3131490Z โ”‚ "type": "string" 2023-01-13T03:17:24.3146090Z โ”‚ }, 2023-01-13T03:17:24.3193680Z โ”‚ "info": { 2023-01-13T03:17:24.3250200Z โ”‚ "type": "object" 2023-01-13T03:17:24.3313630Z โ”‚ }, 2023-01-13T03:17:24.3361680Z โ”‚ "paths": { 2023-01-13T03:17:24.3390800Z โ”‚ "type": "object" 2023-01-13T03:17:24.3393670Z โ”‚ } 2023-01-13T03:17:24.3438020Z โ”‚ } 2023-01-13T03:17:24.3517710Z โ”‚ } 2023-01-13T03:17:24.3529520Z โ”‚ } 2023-01-13T03:17:24.3533640Z โ”‚ } 2023-01-13T03:17:24.3546690Z โ”‚ }, 2023-01-13T03:17:24.3549370Z โ”‚ "500": { 2023-01-13T03:17:24.3557470Z โ”‚ "description": "Internal Server Error", 2023-01-13T03:17:24.3568290Z โ”‚ "content": { 2023-01-13T03:17:24.3570250Z โ”‚ "application/json": { 2023-01-13T03:17:24.3571610Z โ”‚ "schema": { 2023-01-13T03:17:24.3578400Z โ”‚ "type": "object", 2023-01-13T03:17:24.3679740Z โ”‚ "required": [ 2023-01-13T03:17:24.3779100Z โ”‚ "code", 2023-01-13T03:17:24.3830640Z โ”‚ "type", 2023-01-13T03:17:24.3930740Z โ”‚ "message" 2023-01-13T03:17:24.3932880Z โ”‚ ], 2023-01-13T03:17:24.3940290Z โ”‚ "properties": { 2023-01-13T03:17:24.3945300Z โ”‚ "code": { 2023-01-13T03:17:24.3952480Z โ”‚ "type": "integer", 2023-01-13T03:17:24.3957520Z โ”‚ "description": "Error code." 2023-01-13T03:17:24.3970850Z โ”‚ }, 2023-01-13T03:17:24.3975780Z โ”‚ "type": { 2023-01-13T03:17:24.3983000Z โ”‚ "type": "string", 2023-01-13T03:17:24.3985040Z โ”‚ "description": "Error type." 2023-01-13T03:17:24.4012960Z โ”‚ }, 2023-01-13T03:17:24.4038620Z โ”‚ "message": { 2023-01-13T03:17:24.4041320Z โ”‚ "type": "string", 2023-01-13T03:17:24.4056750Z โ”‚ "description": "Error message." 2023-01-13T03:17:24.4059080Z โ”‚ } 2023-01-13T03:17:24.4065860Z โ”‚ } 2023-01-13T03:17:24.4098880Z โ”‚ } 2023-01-13T03:17:24.4121250Z โ”‚ } 2023-01-13T03:17:24.4126940Z โ”‚ } 2023-01-13T03:17:24.4149450Z โ”‚ } 2023-01-13T03:17:24.4171990Z โ”‚ } 2023-01-13T03:17:24.4173870Z โ”‚ } 2023-01-13T03:17:24.4242340Z โ”‚ }, 2023-01-13T03:17:24.4260230Z โ”‚ "/models": { 2023-01-13T03:17:24.4270420Z โ”‚ 2023-01-13T03:17:24.4276200Z โ”‚ (showing 2.05kB/58.6kB) 2023-01-13T03:17:24.4361530Z โ”” 2023-01-13T03:17:24.4362900Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:17:24.4406890Z 1ms 1ms 250ยตs 419ยตs 29ms 33ms 2ms 99ยตs 69ms 2023-01-13T03:17:24.4412620Z 2023-01-13T03:17:24.4425010Z โœ“ Status code is 200 2023-01-13T03:17:24.4442830Z 2023-01-13T03:17:24.4456810Z โ†’ HTTPS Metrics API Description 2023-01-13T03:17:24.4494220Z OPTIONS https://localhost:8445 2023-01-13T03:17:24.4595620Z 200 OK โ˜… 41ms time โ˜… 230Bโ†‘ 2.82kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:24.4697250Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 2.55kB 2023-01-13T03:17:24.4763850Z โ”‚ { 2023-01-13T03:17:24.4826320Z โ”‚ "openapi": "3.0.1", 2023-01-13T03:17:24.4927550Z โ”‚ "info": { 2023-01-13T03:17:24.5028950Z โ”‚ "title": "TorchServe APIs", 2023-01-13T03:17:24.5085530Z โ”‚ "description": "TorchServe is a flexible and easy 2023-01-13T03:17:24.5168780Z โ”‚ to use tool for serving deep learning models", 2023-01-13T03:17:24.5235570Z โ”‚ "version": "0.7.0" 2023-01-13T03:17:24.5310200Z โ”‚ }, 2023-01-13T03:17:24.5411660Z โ”‚ "paths": { 2023-01-13T03:17:24.5498480Z โ”‚ "/metrics": { 2023-01-13T03:17:24.5548860Z โ”‚ "get": { 2023-01-13T03:17:24.5602330Z โ”‚ "description": "Get TorchServe application met 2023-01-13T03:17:24.5669360Z โ”‚ rics in prometheus format.", 2023-01-13T03:17:24.5747570Z โ”‚ "operationId": "metrics", 2023-01-13T03:17:24.5834510Z โ”‚ "parameters": [ 2023-01-13T03:17:24.5843150Z โ”‚ { 2023-01-13T03:17:24.5901590Z โ”‚ "in": "query", 2023-01-13T03:17:24.5960190Z โ”‚ "name": "name[]", 2023-01-13T03:17:24.6047850Z โ”‚ "description": "Names of metrics to filter 2023-01-13T03:17:24.6149500Z โ”‚ ", 2023-01-13T03:17:24.6251100Z โ”‚ "required": false, 2023-01-13T03:17:24.6352630Z โ”‚ "schema": { 2023-01-13T03:17:24.6454270Z โ”‚ "type": "string" 2023-01-13T03:17:24.6555710Z โ”‚ } 2023-01-13T03:17:24.6657170Z โ”‚ } 2023-01-13T03:17:24.6751250Z โ”‚ ], 2023-01-13T03:17:24.6812850Z โ”‚ "responses": { 2023-01-13T03:17:24.6852620Z โ”‚ "200": { 2023-01-13T03:17:24.6942220Z โ”‚ "description": "TorchServe application met 2023-01-13T03:17:24.6963990Z โ”‚ rics", 2023-01-13T03:17:24.6996700Z โ”‚ "content": { 2023-01-13T03:17:24.7042650Z โ”‚ "text/plain; version=0.0.4; charset=utf- 2023-01-13T03:17:24.7098070Z โ”‚ 8": { 2023-01-13T03:17:24.7143650Z โ”‚ "schema": { 2023-01-13T03:17:24.7201760Z โ”‚ "type": "object", 2023-01-13T03:17:24.7207000Z โ”‚ "required": [ 2023-01-13T03:17:24.7233280Z โ”‚ "# HELP", 2023-01-13T03:17:24.7245150Z โ”‚ "# TYPE", 2023-01-13T03:17:24.7287070Z โ”‚ "metric" 2023-01-13T03:17:24.7311780Z โ”‚ ], 2023-01-13T03:17:24.7313340Z โ”‚ "properties": { 2023-01-13T03:17:24.7326050Z โ”‚ "# HELP": { 2023-01-13T03:17:24.7337760Z โ”‚ "type": "string", 2023-01-13T03:17:24.7351320Z โ”‚ "description": "Help text for To 2023-01-13T03:17:24.7453130Z โ”‚ rchServe metric." 2023-01-13T03:17:24.7538030Z โ”‚ }, 2023-01-13T03:17:24.7575620Z โ”‚ "# TYPE": { 2023-01-13T03:17:24.7665710Z โ”‚ "type": "string", 2023-01-13T03:17:24.7700880Z โ”‚ "description": "Type of TorchSer 2023-01-13T03:17:24.7707730Z โ”‚ ve metric." 2023-01-13T03:17:24.7759580Z โ”‚ }, 2023-01-13T03:17:24.7791760Z โ”‚ "metric": { 2023-01-13T03:17:24.7867270Z โ”‚ "type": "string", 2023-01-13T03:17:24.7888310Z โ”‚ "description": "TorchServe appli 2023-01-13T03:17:24.7921830Z โ”‚ cation metric." 2023-01-13T03:17:24.7963100Z โ”‚ } 2023-01-13T03:17:24.7977640Z โ”‚ } 2023-01-13T03:17:24.7981370Z โ”‚ } 2023-01-13T03:17:24.8004600Z โ”‚ } 2023-01-13T03:17:24.8034900Z โ”‚ } 2023-01-13T03:17:24.8062750Z โ”‚ }, 2023-01-13T03:17:24.8070820Z โ”‚ "500": { 2023-01-13T03:17:24.8081120Z โ”‚ "description": "Internal Server Error", 2023-01-13T03:17:24.8097420Z โ”‚ "content": { 2023-01-13T03:17:24.8113630Z โ”‚ "application/json": { 2023-01-13T03:17:24.8140820Z โ”‚ "schema": { 2023-01-13T03:17:24.8227530Z โ”‚ "type": "object", 2023-01-13T03:17:24.8228090Z โ”‚ "required": [ 2023-01-13T03:17:24.8228930Z โ”‚ "code", 2023-01-13T03:17:24.8229210Z โ”‚ "type", 2023-01-13T03:17:24.8229490Z โ”‚ "message" 2023-01-13T03:17:24.8229750Z โ”‚ ], 2023-01-13T03:17:24.8230050Z โ”‚ "properties": { 2023-01-13T03:17:24.8230690Z โ”‚ "code": { 2023-01-13T03:17:24.8231030Z โ”‚ 2023-01-13T03:17:24.8231310Z โ”‚ (showing 2.05kB/2.55kB) 2023-01-13T03:17:24.8231540Z โ”” 2023-01-13T03:17:24.8232000Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:17:24.8232510Z 1ms 1ms 219ยตs 415ยตs 31ms 4ms 2ms 95ยตs 42ms 2023-01-13T03:17:24.8232680Z 2023-01-13T03:17:24.8232850Z โœ“ Status code is 200 2023-01-13T03:17:24.8232980Z 2023-01-13T03:17:24.8233170Z โ†’ HTTPS Register Model - SqueezeNet 2023-01-13T03:17:26.9808220Z POST https://localhost:8444/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&initial_workers=1&synchronous=true 2023-01-13T03:17:26.9820340Z 200 OK โ˜… 2.7s time โ˜… 334Bโ†‘ 355Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:26.9822060Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 89B 2023-01-13T03:17:26.9824740Z โ”‚ { 2023-01-13T03:17:26.9825620Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:17:26.9889760Z โ”‚ stered with 1 initial workers" 2023-01-13T03:17:26.9890820Z โ”‚ } 2023-01-13T03:17:26.9891590Z โ”” 2023-01-13T03:17:26.9892590Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:17:26.9893840Z 2ms 559ยตs (cache) (cache) (cache) 2.7s 2ms 122ยตs 2.7s 2023-01-13T03:17:26.9894480Z 2023-01-13T03:17:26.9902310Z โœ“ Successful POST request 2023-01-13T03:17:26.9983440Z 2023-01-13T03:17:26.9984380Z โ†’ HTTPS Get SqueezeNet Model Description 2023-01-13T03:17:27.0162580Z GET https://localhost:8444/models/squeezenet1_1 2023-01-13T03:17:27.0163970Z 200 OK โ˜… 10ms time โ˜… 246Bโ†‘ 753Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:27.0164880Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 486B 2023-01-13T03:17:27.0166240Z โ”‚ [ 2023-01-13T03:17:27.0166950Z โ”‚ { 2023-01-13T03:17:27.0167690Z โ”‚ "modelName": "squeezenet1_1", 2023-01-13T03:17:27.0168430Z โ”‚ "modelVersion": "1.0", 2023-01-13T03:17:27.0169190Z โ”‚ "modelUrl": "squeezenet1_1.mar", 2023-01-13T03:17:27.0169910Z โ”‚ "runtime": "python", 2023-01-13T03:17:27.0170620Z โ”‚ "minWorkers": 1, 2023-01-13T03:17:27.0171320Z โ”‚ "maxWorkers": 1, 2023-01-13T03:17:27.0172010Z โ”‚ "batchSize": 1, 2023-01-13T03:17:27.0172710Z โ”‚ "maxBatchDelay": 100, 2023-01-13T03:17:27.0173440Z โ”‚ "loadedAtStartup": false, 2023-01-13T03:17:27.0174230Z โ”‚ "workers": [ 2023-01-13T03:17:27.0174480Z โ”‚ { 2023-01-13T03:17:27.0174760Z โ”‚ "id": "9000", 2023-01-13T03:17:27.0175090Z โ”‚ "startTime": "2023-01-13T03:17:24.647Z", 2023-01-13T03:17:27.0176210Z โ”‚ "status": "READY", 2023-01-13T03:17:27.0176520Z โ”‚ "memoryUsage": 0, 2023-01-13T03:17:27.0176810Z โ”‚ "pid": 50430, 2023-01-13T03:17:27.0177080Z โ”‚ "gpu": false, 2023-01-13T03:17:27.0177760Z โ”‚ "gpuUsage": "N/A" 2023-01-13T03:17:27.0178120Z โ”‚ } 2023-01-13T03:17:27.0178350Z โ”‚ ] 2023-01-13T03:17:27.0178570Z โ”‚ } 2023-01-13T03:17:27.0179130Z โ”‚ ] 2023-01-13T03:17:27.0194120Z โ”” 2023-01-13T03:17:27.0195330Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:17:27.0196360Z 1ms 432ยตs (cache) (cache) (cache) 7ms 1ms 68ยตs 11ms 2023-01-13T03:17:27.0197060Z 2023-01-13T03:17:27.0276410Z โœ“ Successful GET request 2023-01-13T03:17:27.0387870Z 2023-01-13T03:17:27.0388790Z โ†’ HTTPS Scale up Workers - Synchronous 2023-01-13T03:17:27.0536160Z PUT https://localhost:8444/models/squeezenet1_1?min_worker=1&max_worker=1&synchronous=true 2023-01-13T03:17:27.0604740Z 200 OK โ˜… 6ms time โ˜… 308Bโ†‘ 329Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:27.0605180Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 63B 2023-01-13T03:17:27.0605460Z โ”‚ { 2023-01-13T03:17:27.0605830Z โ”‚ "status": "Workers scaled to 1 for model: squeezenet 2023-01-13T03:17:27.0606110Z โ”‚ 1_1" 2023-01-13T03:17:27.0606330Z โ”‚ } 2023-01-13T03:17:27.0606530Z โ”” 2023-01-13T03:17:27.0606970Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:17:27.0607500Z 1ms 428ยตs (cache) (cache) (cache) 3ms 1ms 61ยตs 7ms 2023-01-13T03:17:27.0607680Z 2023-01-13T03:17:27.0708880Z โœ“ Successful PUT request 2023-01-13T03:17:27.0809810Z 2023-01-13T03:17:27.0911240Z โ†’ HTTPS Scale up Workers - Asynchronous 2023-01-13T03:17:27.1012520Z PUT https://localhost:8444/models/squeezenet1_1?min_worker=1&max_worker=1&synchronous=false 2023-01-13T03:17:27.1114280Z 202 Accepted โ˜… 6ms time โ˜… 309Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:27.1215710Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:17:27.1317190Z โ”‚ { 2023-01-13T03:17:27.1418860Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:17:27.1520360Z โ”‚ } 2023-01-13T03:17:27.1621700Z โ”” 2023-01-13T03:17:27.1723490Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:17:27.1814760Z 2ms 388ยตs (cache) (cache) (cache) 3ms 1ms 52ยตs 7ms 2023-01-13T03:17:27.1916630Z 2023-01-13T03:17:27.1970610Z โœ“ Successful PUT request 2023-01-13T03:17:27.2034880Z 2023-01-13T03:17:27.2062700Z โ†’ HTTPS - Inference - SqueezeNet 2023-01-13T03:17:27.2197800Z POST https://localhost:8443/predictions/squeezenet1_1 2023-01-13T03:17:27.2224540Z 200 OK โ˜… 92ms time โ˜… 111.25kBโ†‘ 408Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:27.2311150Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:17:27.2338440Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:17:27.2371510Z โ”” 2023-01-13T03:17:27.2389370Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 173B 2023-01-13T03:17:27.2416570Z โ”‚ { 2023-01-13T03:17:27.2419420Z โ”‚ "tabby": 0.27850812673568726, 2023-01-13T03:17:27.2446350Z โ”‚ "lynx": 0.252991259098053, 2023-01-13T03:17:27.2456500Z โ”‚ "tiger_cat": 0.24496448040008545, 2023-01-13T03:17:27.2472050Z โ”‚ "Egyptian_cat": 0.21722444891929626, 2023-01-13T03:17:27.2474590Z โ”‚ "cougar": 0.0022175461053848267 2023-01-13T03:17:27.2475370Z โ”‚ } 2023-01-13T03:17:27.2486300Z โ”” 2023-01-13T03:17:27.2587930Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:17:27.2588720Z 7ms 1ms (cache) (cache) (cache) 89ms 1ms 52ยตs 99ms 2023-01-13T03:17:27.2689540Z 2023-01-13T03:17:27.2790790Z โœ“ Status code is 200 2023-01-13T03:17:27.2883180Z 2023-01-13T03:17:27.2893340Z โ†’ HTTPS UnRegister Model SqueezeNet 2023-01-13T03:17:27.2894490Z DELETE https://localhost:8444/models/squeezenet1_1 2023-01-13T03:17:27.2995970Z 200 OK โ˜… 35ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:27.3098190Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:17:27.3200200Z โ”‚ { 2023-01-13T03:17:27.3290600Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:17:27.3345080Z โ”‚ } 2023-01-13T03:17:27.3402070Z โ”” 2023-01-13T03:17:27.3426790Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:17:27.3462340Z 1ms 353ยตs (cache) (cache) (cache) 32ms 1ms 38ยตs 35ms 2023-01-13T03:17:27.3528150Z 2023-01-13T03:17:27.3575140Z โœ“ Successful DELETE request 2023-01-13T03:17:27.3604830Z 2023-01-13T03:17:27.3620480Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:17:27.3654510Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:17:27.3700160Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.3728840Z โ”‚ iterations โ”‚ 1 โ”‚ 0 โ”‚ 2023-01-13T03:17:27.3729970Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.3756350Z โ”‚ requests โ”‚ 9 โ”‚ 0 โ”‚ 2023-01-13T03:17:27.3780780Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.3792160Z โ”‚ test-scripts โ”‚ 9 โ”‚ 0 โ”‚ 2023-01-13T03:17:27.3814640Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.3816270Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:17:27.3843670Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.3851500Z โ”‚ assertions โ”‚ 9 โ”‚ 0 โ”‚ 2023-01-13T03:17:27.3905040Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.3957100Z โ”‚ total run duration: 3.6s โ”‚ 2023-01-13T03:17:27.3974800Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.4003700Z โ”‚ total data received: 85.47kB (approx) โ”‚ 2023-01-13T03:17:27.4057480Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.4066600Z โ”‚ average response time: 359ms [min: 6ms, max: 2.7s, s.d.: 843ms] โ”‚ 2023-01-13T03:17:27.4082580Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.4105670Z โ”‚ average DNS lookup time: 753ยตs [min: 219ยตs, max: 1ms, s.d.: 733ยตs] โ”‚ 2023-01-13T03:17:27.4168300Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:17:27.4272840Z โ”‚ average first byte time: 328ms [min: 3ms, max: 2.7s, s.d.: 850ms] โ”‚ 2023-01-13T03:17:27.4335010Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:17:27.4344980Z TorchServe has stopped. 2023-01-13T03:17:48.6589330Z newman: could not find "htmlextra" reporter 2023-01-13T03:17:48.6595670Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:17:48.6596550Z please install reporter using npm 2023-01-13T03:17:48.6597020Z 2023-01-13T03:17:48.9418590Z newman 2023-01-13T03:17:48.9453570Z 2023-01-13T03:17:48.9459260Z management_api_collection 2023-01-13T03:17:48.9514150Z 2023-01-13T03:17:48.9541280Z Iteration 1/82 2023-01-13T03:17:48.9544010Z 2023-01-13T03:17:48.9549360Z โ†’ management request 2023-01-13T03:17:50.0100220Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:17:50.0201090Z 200 OK โ˜… 981ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:50.0302880Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:17:50.0403850Z โ”‚ { 2023-01-13T03:17:50.0505230Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:17:50.0606370Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:17:50.0707730Z โ”‚ o add workers for the model." 2023-01-13T03:17:50.0808860Z โ”‚ } 2023-01-13T03:17:50.0909500Z โ”” 2023-01-13T03:17:50.1011300Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:50.1111920Z 56ms 7ms 2ms 591ยตs 959ms 10ms 711ยตs 1038ms 2023-01-13T03:17:50.1212640Z 2023-01-13T03:17:50.1242630Z โœ“ Successful request 2023-01-13T03:17:50.1344140Z 2023-01-13T03:17:50.1445060Z Iteration 2/82 2023-01-13T03:17:50.1491860Z 2023-01-13T03:17:50.1493450Z โ†’ management request 2023-01-13T03:17:50.5228670Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist 2023-01-13T03:17:50.5258600Z 200 OK โ˜… 438ms time โ˜… 283Bโ†‘ 401Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:50.5300960Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 134B 2023-01-13T03:17:50.5366200Z โ”‚ { 2023-01-13T03:17:50.5411240Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:17:50.5418730Z โ”‚ ith 0 initial workers. Use scale workers API to add wo 2023-01-13T03:17:50.5446270Z โ”‚ rkers for the model." 2023-01-13T03:17:50.5448970Z โ”‚ } 2023-01-13T03:17:50.5475630Z โ”” 2023-01-13T03:17:50.5503050Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:50.5530460Z 2ms 969ยตs (cache) (cache) 433ms 2ms 102ยตs 439ms 2023-01-13T03:17:50.5569560Z 2023-01-13T03:17:50.5634720Z โœ“ Successful request 2023-01-13T03:17:50.5662090Z 2023-01-13T03:17:50.5711270Z Iteration 3/82 2023-01-13T03:17:50.5762480Z 2023-01-13T03:17:50.5799030Z โ†’ management request 2023-01-13T03:17:54.8945530Z POST http://localhost:8081/models?url=densenet161.mar&model_name=densenet161 2023-01-13T03:17:54.9002400Z 200 OK โ˜… 4.3s time โ˜… 295Bโ†‘ 407Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:54.9055290Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 140B 2023-01-13T03:17:54.9082460Z โ”‚ { 2023-01-13T03:17:54.9087220Z โ”‚ "status": "Model \"densenet161\" Version: 1.0 regist 2023-01-13T03:17:54.9108660Z โ”‚ ered with 0 initial workers. Use scale workers API to 2023-01-13T03:17:54.9132510Z โ”‚ add workers for the model." 2023-01-13T03:17:54.9140360Z โ”‚ } 2023-01-13T03:17:54.9148720Z โ”” 2023-01-13T03:17:54.9150480Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:54.9158880Z 1ms 367ยตs (cache) (cache) 4.3s 2ms 193ยตs 4.3s 2023-01-13T03:17:54.9180520Z 2023-01-13T03:17:54.9202850Z โœ“ Successful request 2023-01-13T03:17:54.9261870Z 2023-01-13T03:17:54.9282000Z Iteration 4/82 2023-01-13T03:17:54.9306100Z 2023-01-13T03:17:54.9320030Z โ†’ management request 2023-01-13T03:17:54.9356460Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/densenet161.mar&model_name=densenet161 2023-01-13T03:17:54.9420860Z 500 Internal Server Error โ˜… 7ms time โ˜… 336Bโ†‘ 394Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:54.9522670Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 113B 2023-01-13T03:17:54.9622920Z โ”‚ { 2023-01-13T03:17:54.9723140Z โ”‚ "code": 500, 2023-01-13T03:17:54.9846210Z โ”‚ "type": "InternalServerException", 2023-01-13T03:17:54.9894120Z โ”‚ "message": "Model file already exists densenet161.ma 2023-01-13T03:17:54.9931020Z โ”‚ r" 2023-01-13T03:17:54.9979160Z โ”‚ } 2023-01-13T03:17:54.9997220Z โ”” 2023-01-13T03:17:55.0006510Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:55.0025330Z 1ms 349ยตs (cache) (cache) 3ms 2ms 72ยตs 7ms 2023-01-13T03:17:55.0076780Z 2023-01-13T03:17:55.0144710Z โœ“ Successful request 2023-01-13T03:17:55.0152000Z 2023-01-13T03:17:55.0152810Z Iteration 5/82 2023-01-13T03:17:55.0224860Z 2023-01-13T03:17:55.0276920Z โ†’ management request 2023-01-13T03:17:55.0309000Z DELETE http://localhost:8081/models/densenet161 2023-01-13T03:17:55.0319270Z 200 OK โ˜… 22ms time โ˜… 247Bโ†‘ 319Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:55.0319780Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 53B 2023-01-13T03:17:55.0336210Z โ”‚ { 2023-01-13T03:17:55.0362450Z โ”‚ "status": "Model \"densenet161\" unregistered" 2023-01-13T03:17:55.0399020Z โ”‚ } 2023-01-13T03:17:55.0403080Z โ”” 2023-01-13T03:17:55.0445620Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:55.0497750Z 1ms 819ยตs 275ยตs 228ยตs 18ms 1ms 86ยตs 22ms 2023-01-13T03:17:55.0554610Z 2023-01-13T03:17:55.0600870Z โœ“ Successful request 2023-01-13T03:17:55.0608800Z 2023-01-13T03:17:55.0692050Z Iteration 6/82 2023-01-13T03:17:55.0703920Z 2023-01-13T03:17:55.0721230Z โ†’ management request 2023-01-13T03:17:55.0732290Z POST http://localhost:8081/models 2023-01-13T03:17:55.0752420Z 400 Bad Request โ˜… 5ms time โ˜… 252Bโ†‘ 364Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:55.0782100Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 94B 2023-01-13T03:17:55.0785220Z โ”‚ { 2023-01-13T03:17:55.0786440Z โ”‚ "code": 400, 2023-01-13T03:17:55.0787450Z โ”‚ "type": "BadRequestException", 2023-01-13T03:17:55.0788500Z โ”‚ "message": "Parameter url is required." 2023-01-13T03:17:55.0811570Z โ”‚ } 2023-01-13T03:17:55.0823340Z โ”” 2023-01-13T03:17:55.0836900Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:55.0891090Z 1ms 301ยตs (cache) (cache) 2ms 1ms 56ยตs 6ms 2023-01-13T03:17:55.0916850Z 2023-01-13T03:17:55.0940400Z โœ“ Successful request 2023-01-13T03:17:55.0943620Z 2023-01-13T03:17:55.0944160Z Iteration 7/82 2023-01-13T03:17:55.0969420Z 2023-01-13T03:17:55.1021330Z โ†’ management request 2023-01-13T03:17:55.1043960Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:17:55.1045430Z 200 OK โ˜… 17ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:55.1046880Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:17:55.1072550Z โ”‚ { 2023-01-13T03:17:55.1120460Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:17:55.1126870Z โ”‚ } 2023-01-13T03:17:55.1153180Z โ”” 2023-01-13T03:17:55.1163630Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:55.1191640Z 1ms 835ยตs 262ยตs 289ยตs 13ms 1ms 59ยตs 17ms 2023-01-13T03:17:55.1240870Z 2023-01-13T03:17:55.1254870Z โœ“ Successful request 2023-01-13T03:17:55.1276200Z 2023-01-13T03:17:55.1302910Z Iteration 8/82 2023-01-13T03:17:55.1342210Z 2023-01-13T03:17:55.1373610Z โ†’ management request 2023-01-13T03:17:55.3118580Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&handler=invalidHandler 2023-01-13T03:17:55.3120470Z 200 OK โ˜… 227ms time โ˜… 306Bโ†‘ 401Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:55.3121390Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 134B 2023-01-13T03:17:55.3122060Z โ”‚ { 2023-01-13T03:17:55.3122850Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:17:55.3125190Z โ”‚ ith 0 initial workers. Use scale workers API to add wo 2023-01-13T03:17:55.3125950Z โ”‚ rkers for the model." 2023-01-13T03:17:55.3126600Z โ”‚ } 2023-01-13T03:17:55.3150990Z โ”” 2023-01-13T03:17:55.3151840Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:55.3152750Z 1ms 388ยตs (cache) (cache) 224ms 1ms 55ยตs 228ms 2023-01-13T03:17:55.3178580Z 2023-01-13T03:17:55.3285490Z โœ“ Successful request 2023-01-13T03:17:55.3293190Z 2023-01-13T03:17:55.3293430Z Iteration 9/82 2023-01-13T03:17:55.3310210Z 2023-01-13T03:17:55.3311020Z โ†’ management request 2023-01-13T03:17:55.3440940Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:17:55.3469910Z 200 OK โ˜… 6ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:55.3470780Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:17:55.3471100Z โ”‚ { 2023-01-13T03:17:55.3471430Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:17:55.3471710Z โ”‚ } 2023-01-13T03:17:55.3471910Z โ”” 2023-01-13T03:17:55.3472350Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:55.3473790Z 1ms 288ยตs (cache) (cache) 3ms 1ms 41ยตs 7ms 2023-01-13T03:17:55.3473980Z 2023-01-13T03:17:55.3538840Z โœ“ Successful request 2023-01-13T03:17:55.3590400Z 2023-01-13T03:17:55.3591170Z Iteration 10/82 2023-01-13T03:17:55.3607790Z 2023-01-13T03:17:55.3609120Z โ†’ management request 2023-01-13T03:17:55.6101450Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&handler=invalidHandler 2023-01-13T03:17:55.6106190Z 200 OK โ˜… 242ms time โ˜… 306Bโ†‘ 401Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:55.6107090Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 134B 2023-01-13T03:17:55.6107810Z โ”‚ { 2023-01-13T03:17:55.6108620Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:17:55.6109450Z โ”‚ ith 0 initial workers. Use scale workers API to add wo 2023-01-13T03:17:55.6110210Z โ”‚ rkers for the model." 2023-01-13T03:17:55.6110860Z โ”‚ } 2023-01-13T03:17:55.6125410Z โ”” 2023-01-13T03:17:55.6126300Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:55.6127300Z 1ms 239ยตs (cache) (cache) 239ms 1ms 43ยตs 242ms 2023-01-13T03:17:55.6127890Z 2023-01-13T03:17:55.6227570Z โœ“ Successful request 2023-01-13T03:17:55.6285440Z 2023-01-13T03:17:55.6286100Z Iteration 11/82 2023-01-13T03:17:55.6302810Z 2023-01-13T03:17:55.6303870Z โ†’ management request 2023-01-13T03:17:57.4831750Z PUT http://localhost:8081/models/mnist?min_worker=1&synchronous=true 2023-01-13T03:17:57.4849240Z 500 Internal Server Error โ˜… 1846ms time โ˜… 287Bโ†‘ 406Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:57.4951760Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 125B 2023-01-13T03:17:57.5051290Z โ”‚ { 2023-01-13T03:17:57.5130120Z โ”‚ "code": 500, 2023-01-13T03:17:57.5149200Z โ”‚ "type": "InternalServerException", 2023-01-13T03:17:57.5158640Z โ”‚ "message": "Failed to start workers for model mnist 2023-01-13T03:17:57.5174710Z โ”‚ version: null" 2023-01-13T03:17:57.5183990Z โ”‚ } 2023-01-13T03:17:57.5228530Z โ”” 2023-01-13T03:17:57.5236010Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:57.5284570Z 1ms 357ยตs (cache) (cache) 1840ms 4ms 102ยตs 1847ms 2023-01-13T03:17:57.5293070Z 2023-01-13T03:17:57.5371550Z โœ“ Successful request 2023-01-13T03:17:57.5473270Z 2023-01-13T03:17:57.5481700Z Iteration 12/82 2023-01-13T03:17:57.5488450Z 2023-01-13T03:17:57.5530360Z โ†’ management request 2023-01-13T03:17:57.5543600Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:17:57.5545450Z 200 OK โ˜… 18ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:57.5546240Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:17:57.5546850Z โ”‚ { 2023-01-13T03:17:57.5547570Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:17:57.5554980Z โ”‚ } 2023-01-13T03:17:57.5555530Z โ”” 2023-01-13T03:17:57.5556310Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:57.5557140Z 1ms 1ms 375ยตs 226ยตs 14ms 1ms 60ยตs 19ms 2023-01-13T03:17:57.5557750Z 2023-01-13T03:17:57.5558220Z โœ“ Successful request 2023-01-13T03:17:57.5558740Z 2023-01-13T03:17:57.5559080Z Iteration 13/82 2023-01-13T03:17:57.5569610Z 2023-01-13T03:17:57.5574060Z โ†’ management request 2023-01-13T03:17:57.5746860Z GET http://localhost:8081/models/squeezenet1_1/all 2023-01-13T03:17:57.5847660Z 200 OK โ˜… 9ms time โ˜… 250Bโ†‘ 538Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:57.5905130Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 271B 2023-01-13T03:17:57.5913050Z โ”‚ [ 2023-01-13T03:17:57.5916890Z โ”‚ { 2023-01-13T03:17:57.5917900Z โ”‚ "modelName": "squeezenet1_1", 2023-01-13T03:17:57.5926740Z โ”‚ "modelVersion": "1.0", 2023-01-13T03:17:57.5927790Z โ”‚ "modelUrl": "squeezenet1_1.mar", 2023-01-13T03:17:57.5928700Z โ”‚ "runtime": "python", 2023-01-13T03:17:57.5938070Z โ”‚ "minWorkers": 0, 2023-01-13T03:17:57.5938860Z โ”‚ "maxWorkers": 0, 2023-01-13T03:17:57.5939580Z โ”‚ "batchSize": 1, 2023-01-13T03:17:57.5940310Z โ”‚ "maxBatchDelay": 100, 2023-01-13T03:17:57.5941080Z โ”‚ "loadedAtStartup": false, 2023-01-13T03:17:57.5944160Z โ”‚ "workers": [] 2023-01-13T03:17:57.5946220Z โ”‚ } 2023-01-13T03:17:57.5950560Z โ”‚ ] 2023-01-13T03:17:57.5951230Z โ”” 2023-01-13T03:17:57.5952100Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:57.5956320Z 1ms 293ยตs (cache) (cache) 6ms 2ms 50ยตs 10ms 2023-01-13T03:17:57.5956910Z 2023-01-13T03:17:57.5957810Z โœ“ Successful request 2023-01-13T03:17:57.5958630Z 2023-01-13T03:17:57.5959050Z Iteration 14/82 2023-01-13T03:17:57.5959490Z 2023-01-13T03:17:57.5960080Z โ†’ management request 2023-01-13T03:17:57.6097190Z GET http://localhost:8081/models/squeezenet1_1/1.0 2023-01-13T03:17:57.6136720Z 200 OK โ˜… 8ms time โ˜… 250Bโ†‘ 538Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:57.6141570Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 271B 2023-01-13T03:17:57.6142540Z โ”‚ [ 2023-01-13T03:17:57.6148100Z โ”‚ { 2023-01-13T03:17:57.6249710Z โ”‚ "modelName": "squeezenet1_1", 2023-01-13T03:17:57.6351340Z โ”‚ "modelVersion": "1.0", 2023-01-13T03:17:57.6374620Z โ”‚ "modelUrl": "squeezenet1_1.mar", 2023-01-13T03:17:57.6390360Z โ”‚ "runtime": "python", 2023-01-13T03:17:57.6391160Z โ”‚ "minWorkers": 0, 2023-01-13T03:17:57.6391870Z โ”‚ "maxWorkers": 0, 2023-01-13T03:17:57.6392550Z โ”‚ "batchSize": 1, 2023-01-13T03:17:57.6393260Z โ”‚ "maxBatchDelay": 100, 2023-01-13T03:17:57.6394680Z โ”‚ "loadedAtStartup": false, 2023-01-13T03:17:57.6395480Z โ”‚ "workers": [] 2023-01-13T03:17:57.6396120Z โ”‚ } 2023-01-13T03:17:57.6406220Z โ”‚ ] 2023-01-13T03:17:57.6406550Z โ”” 2023-01-13T03:17:57.6409090Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:57.6410610Z 2ms 300ยตs (cache) (cache) 4ms 2ms 59ยตs 9ms 2023-01-13T03:17:57.6412730Z 2023-01-13T03:17:57.6413530Z โœ“ Successful request 2023-01-13T03:17:57.6414100Z 2023-01-13T03:17:57.6414510Z Iteration 15/82 2023-01-13T03:17:57.6415260Z 2023-01-13T03:17:57.6415840Z โ†’ management request 2023-01-13T03:17:57.6586340Z GET http://localhost:8081/models/squeezenet1_1 2023-01-13T03:17:57.6682400Z 200 OK โ˜… 6ms time โ˜… 246Bโ†‘ 538Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:57.6738300Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 271B 2023-01-13T03:17:57.6744510Z โ”‚ [ 2023-01-13T03:17:57.6746800Z โ”‚ { 2023-01-13T03:17:57.6747610Z โ”‚ "modelName": "squeezenet1_1", 2023-01-13T03:17:57.6748370Z โ”‚ "modelVersion": "1.0", 2023-01-13T03:17:57.6749120Z โ”‚ "modelUrl": "squeezenet1_1.mar", 2023-01-13T03:17:57.6749850Z โ”‚ "runtime": "python", 2023-01-13T03:17:57.6750820Z โ”‚ "minWorkers": 0, 2023-01-13T03:17:57.6763640Z โ”‚ "maxWorkers": 0, 2023-01-13T03:17:57.6764420Z โ”‚ "batchSize": 1, 2023-01-13T03:17:57.6765150Z โ”‚ "maxBatchDelay": 100, 2023-01-13T03:17:57.6765880Z โ”‚ "loadedAtStartup": false, 2023-01-13T03:17:57.6767120Z โ”‚ "workers": [] 2023-01-13T03:17:57.6767780Z โ”‚ } 2023-01-13T03:17:57.6782900Z โ”‚ ] 2023-01-13T03:17:57.6787410Z โ”” 2023-01-13T03:17:57.6788360Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:57.6789640Z 1ms 389ยตs (cache) (cache) 2ms 2ms 370ยตs 7ms 2023-01-13T03:17:57.6790560Z 2023-01-13T03:17:57.6791240Z โœ“ Successful request 2023-01-13T03:17:57.6791730Z 2023-01-13T03:17:57.6792640Z Iteration 16/82 2023-01-13T03:17:57.6793040Z 2023-01-13T03:17:57.6793550Z โ†’ management request 2023-01-13T03:17:57.6979640Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:17:57.7042310Z 200 OK โ˜… 7ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:57.7059050Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:17:57.7098910Z โ”‚ { 2023-01-13T03:17:57.7106850Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:17:57.7147180Z โ”‚ } 2023-01-13T03:17:57.7154970Z โ”” 2023-01-13T03:17:57.7192160Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:57.7199420Z 1ms 483ยตs (cache) (cache) 4ms 1ms 39ยตs 7ms 2023-01-13T03:17:57.7212380Z 2023-01-13T03:17:57.7213250Z โœ“ Successful request 2023-01-13T03:17:57.7228710Z 2023-01-13T03:17:57.7233240Z Iteration 17/82 2023-01-13T03:17:57.7256450Z 2023-01-13T03:17:57.7258810Z โ†’ management request 2023-01-13T03:17:57.7638150Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&runtime=python4 2023-01-13T03:17:57.7641520Z 400 Bad Request โ˜… 8ms time โ˜… 315Bโ†‘ 373Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:57.7650890Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 102B 2023-01-13T03:17:57.7751340Z โ”‚ { 2023-01-13T03:17:57.7757490Z โ”‚ "code": 400, 2023-01-13T03:17:57.7765560Z โ”‚ "type": "BadRequestException", 2023-01-13T03:17:57.7868420Z โ”‚ "message": "Invalid RuntimeType value: python4" 2023-01-13T03:17:57.7939750Z โ”‚ } 2023-01-13T03:17:57.7947000Z โ”” 2023-01-13T03:17:57.7988790Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:57.7996670Z 17ms 1ms (cache) (cache) 2ms 3ms 127ยตs 24ms 2023-01-13T03:17:57.8044330Z 2023-01-13T03:17:57.8053880Z โœ“ Successful request 2023-01-13T03:17:57.8926110Z 2023-01-13T03:17:57.9026660Z Iteration 18/82 2023-01-13T03:17:57.9127800Z 2023-01-13T03:17:57.9229440Z โ†’ management request 2023-01-13T03:17:57.9329510Z GET http://localhost:8081/models?limit=&next_page_token= 2023-01-13T03:17:57.9431160Z 200 OK โ˜… 19ms time โ˜… 256Bโ†‘ 285Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:57.9532260Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 19B 2023-01-13T03:17:57.9631850Z โ”‚ { 2023-01-13T03:17:57.9733370Z โ”‚ "models": [] 2023-01-13T03:17:57.9833610Z โ”‚ } 2023-01-13T03:17:57.9935100Z โ”” 2023-01-13T03:17:58.0036050Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.0136280Z 2ms 1ms 248ยตs 2ms 11ms 1ms 43ยตs 20ms 2023-01-13T03:17:58.0236810Z 2023-01-13T03:17:58.0338250Z โœ“ Successful request 2023-01-13T03:17:58.0438130Z 2023-01-13T03:17:58.0530470Z Iteration 19/82 2023-01-13T03:17:58.0609160Z 2023-01-13T03:17:58.0679300Z โ†’ management request 2023-01-13T03:17:58.2440060Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:17:58.2462680Z 200 OK โ˜… 270ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.2470190Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:17:58.2473550Z โ”‚ { 2023-01-13T03:17:58.2474390Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:17:58.2475140Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:17:58.2481000Z โ”‚ o add workers for the model." 2023-01-13T03:17:58.2483540Z โ”‚ } 2023-01-13T03:17:58.2484290Z โ”” 2023-01-13T03:17:58.2485130Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.2518630Z 2ms 464ยตs (cache) (cache) 267ms 1ms 52ยตs 271ms 2023-01-13T03:17:58.2526370Z 2023-01-13T03:17:58.2566400Z โœ“ Successful request 2023-01-13T03:17:58.2628670Z 2023-01-13T03:17:58.2629050Z Iteration 20/82 2023-01-13T03:17:58.2629250Z 2023-01-13T03:17:58.2632740Z โ†’ management request 2023-01-13T03:17:58.2919140Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1 2023-01-13T03:17:58.2950060Z 202 Accepted โ˜… 21ms time โ˜… 278Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.3023110Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:17:58.3096800Z โ”‚ { 2023-01-13T03:17:58.3106600Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:17:58.3149430Z โ”‚ } 2023-01-13T03:17:58.3156810Z โ”” 2023-01-13T03:17:58.3160750Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.3196740Z 1ms 397ยตs (cache) (cache) 18ms 1ms 48ยตs 22ms 2023-01-13T03:17:58.3282120Z 2023-01-13T03:17:58.3383180Z โœ“ Successful request 2023-01-13T03:17:58.3475420Z 2023-01-13T03:17:58.3515030Z Iteration 21/82 2023-01-13T03:17:58.3615820Z 2023-01-13T03:17:58.3717070Z โ†’ management request 2023-01-13T03:17:58.3818510Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1&synchronous=true 2023-01-13T03:17:58.3921020Z 200 OK โ˜… 5ms time โ˜… 295Bโ†‘ 329Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.4022550Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 63B 2023-01-13T03:17:58.4123890Z โ”‚ { 2023-01-13T03:17:58.4225840Z โ”‚ "status": "Workers scaled to 1 for model: squeezenet 2023-01-13T03:17:58.4327220Z โ”‚ 1_1" 2023-01-13T03:17:58.4428780Z โ”‚ } 2023-01-13T03:17:58.4530120Z โ”” 2023-01-13T03:17:58.4599750Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.4701400Z 2ms 285ยตs (cache) (cache) 3ms 1ms 40ยตs 7ms 2023-01-13T03:17:58.4803470Z 2023-01-13T03:17:58.4885710Z โœ“ Successful request 2023-01-13T03:17:58.4951720Z 2023-01-13T03:17:58.5027280Z Iteration 22/82 2023-01-13T03:17:58.5092480Z 2023-01-13T03:17:58.5149430Z โ†’ management request 2023-01-13T03:17:58.5212200Z PUT http://localhost:8081/models/squeezenet1_1/1.0?min_worker=1&synchronous=true 2023-01-13T03:17:58.5227050Z 200 OK โ˜… 7ms time โ˜… 299Bโ†‘ 343Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.5263960Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 77B 2023-01-13T03:17:58.5283180Z โ”‚ { 2023-01-13T03:17:58.5331010Z โ”‚ "status": "Workers scaled to 1 for model: squeezenet 2023-01-13T03:17:58.5359520Z โ”‚ 1_1, version: 1.0" 2023-01-13T03:17:58.5412810Z โ”‚ } 2023-01-13T03:17:58.5479240Z โ”” 2023-01-13T03:17:58.5548700Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.5610190Z 3ms 311ยตs (cache) (cache) 3ms 3ms 41ยตs 9ms 2023-01-13T03:17:58.5660180Z 2023-01-13T03:17:58.5724490Z โœ“ Successful request 2023-01-13T03:17:58.5798100Z 2023-01-13T03:17:58.5876240Z Iteration 23/82 2023-01-13T03:17:58.5919770Z 2023-01-13T03:17:58.6020870Z โ†’ management request 2023-01-13T03:17:58.6121390Z PUT http://localhost:8081/models/squeezenet1_1/0.0?min_worker=1&synchronous=true 2023-01-13T03:17:58.6223180Z 404 Not Found โ˜… 15ms time โ˜… 299Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.6323550Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 136B 2023-01-13T03:17:58.6362200Z โ”‚ { 2023-01-13T03:17:58.6397970Z โ”‚ "code": 404, 2023-01-13T03:17:58.6409710Z โ”‚ "type": "ModelVersionNotFoundException", 2023-01-13T03:17:58.6511670Z โ”‚ "message": "Model version: 0.0 does not exist for mo 2023-01-13T03:17:58.6594760Z โ”‚ del: squeezenet1_1" 2023-01-13T03:17:58.6696850Z โ”‚ } 2023-01-13T03:17:58.6762430Z โ”” 2023-01-13T03:17:58.6863900Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.6965690Z 2ms 2ms (cache) (cache) 10ms 1ms 41ยตs 16ms 2023-01-13T03:17:58.7014310Z 2023-01-13T03:17:58.7079000Z โœ“ Successful request 2023-01-13T03:17:58.7132650Z 2023-01-13T03:17:58.7233740Z Iteration 24/82 2023-01-13T03:17:58.7290680Z 2023-01-13T03:17:58.7299460Z โ†’ management request 2023-01-13T03:17:58.7355710Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1&number_gpu=1 2023-01-13T03:17:58.7440370Z 202 Accepted โ˜… 7ms time โ˜… 291Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.7446720Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:17:58.7488950Z โ”‚ { 2023-01-13T03:17:58.7554560Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:17:58.7656050Z โ”‚ } 2023-01-13T03:17:58.7692400Z โ”” 2023-01-13T03:17:58.7746680Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.7778640Z 1ms 735ยตs 212ยตs 220ยตs 3ms 1ms 38ยตs 7ms 2023-01-13T03:17:58.7809700Z 2023-01-13T03:17:58.7876350Z โœ“ Successful request 2023-01-13T03:17:58.7893130Z 2023-01-13T03:17:58.7915920Z Iteration 25/82 2023-01-13T03:17:58.7940150Z 2023-01-13T03:17:58.7985030Z โ†’ management request 2023-01-13T03:17:58.8039800Z PUT http://localhost:8081/models/squeezenet1_1/1.0/set-default 2023-01-13T03:17:58.8140960Z 200 OK โ˜… 5ms time โ˜… 281Bโ†‘ 359Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.8153310Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 93B 2023-01-13T03:17:58.8217540Z โ”‚ { 2023-01-13T03:17:58.8244090Z โ”‚ "status": "Default vesion succsesfully updated for m 2023-01-13T03:17:58.8255750Z โ”‚ odel \"squeezenet1_1\" to \"1.0\"" 2023-01-13T03:17:58.8268790Z โ”‚ } 2023-01-13T03:17:58.8276490Z โ”” 2023-01-13T03:17:58.8297730Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.8392360Z 1ms 316ยตs (cache) (cache) 2ms 1ms 42ยตs 6ms 2023-01-13T03:17:58.8418120Z 2023-01-13T03:17:58.8446630Z โœ“ Successful request 2023-01-13T03:17:58.8497750Z 2023-01-13T03:17:58.8531880Z Iteration 26/82 2023-01-13T03:17:58.8571860Z 2023-01-13T03:17:58.8607960Z โ†’ management request 2023-01-13T03:17:58.8635570Z PUT http://localhost:8081/models/squeezenet1_1/0.0/set-default 2023-01-13T03:17:58.8705150Z 404 Not Found โ˜… 5ms time โ˜… 281Bโ†‘ 403Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.8767420Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 134B 2023-01-13T03:17:58.8797320Z โ”‚ { 2023-01-13T03:17:58.8829320Z โ”‚ "code": 404, 2023-01-13T03:17:58.8844470Z โ”‚ "type": "ModelVersionNotFoundException", 2023-01-13T03:17:58.8850930Z โ”‚ "message": "Model version 0.0 does not exist for mod 2023-01-13T03:17:58.8900660Z โ”‚ el squeezenet1_1" 2023-01-13T03:17:58.8918380Z โ”‚ } 2023-01-13T03:17:58.8995830Z โ”” 2023-01-13T03:17:58.9097910Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.9147160Z 4ms 383ยตs (cache) (cache) 2ms 1ms 609ยตs 10ms 2023-01-13T03:17:58.9213440Z 2023-01-13T03:17:58.9241300Z โœ“ Successful request 2023-01-13T03:17:58.9304650Z 2023-01-13T03:17:58.9371010Z Iteration 27/82 2023-01-13T03:17:58.9471970Z 2023-01-13T03:17:58.9496730Z โ†’ management request 2023-01-13T03:17:58.9527060Z PUT http://localhost:8081/models/squeezenet0_1/1.0/set-default 2023-01-13T03:17:58.9553710Z 404 Not Found โ˜… 12ms time โ˜… 281Bโ†‘ 370Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.9616850Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 101B 2023-01-13T03:17:58.9636880Z โ”‚ { 2023-01-13T03:17:58.9657420Z โ”‚ "code": 404, 2023-01-13T03:17:58.9658770Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:17:58.9685270Z โ”‚ "message": "Model not found: squeezenet0_1" 2023-01-13T03:17:58.9689110Z โ”‚ } 2023-01-13T03:17:58.9715400Z โ”” 2023-01-13T03:17:58.9734350Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.9750320Z 2ms 851ยตs 3ms 1ms 5ms 1ms 35ยตs 13ms 2023-01-13T03:17:58.9799640Z 2023-01-13T03:17:58.9825980Z โœ“ Successful request 2023-01-13T03:17:58.9831640Z 2023-01-13T03:17:58.9842940Z Iteration 28/82 2023-01-13T03:17:58.9866170Z 2023-01-13T03:17:58.9869570Z โ†’ management request 2023-01-13T03:17:58.9880920Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:17:58.9921380Z 200 OK โ˜… 36ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:58.9941550Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:17:58.9961760Z โ”‚ { 2023-01-13T03:17:58.9975650Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:17:58.9977020Z โ”‚ } 2023-01-13T03:17:58.9979450Z โ”” 2023-01-13T03:17:58.9981300Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:58.9982450Z 6ms 922ยตs 221ยตs 293ยตs 31ms 1ms 36ยตs 41ms 2023-01-13T03:17:58.9983320Z 2023-01-13T03:17:58.9985320Z โœ“ Successful request 2023-01-13T03:17:58.9986240Z 2023-01-13T03:17:58.9988120Z Iteration 29/82 2023-01-13T03:17:59.0006080Z 2023-01-13T03:17:59.0010530Z โ†’ management request 2023-01-13T03:17:59.1377240Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&handler=serve/ts/torch_handler/image_classifier.py:handle 2023-01-13T03:17:59.1378940Z 200 OK โ˜… 236ms time โ˜… 357Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:59.1379940Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:17:59.1380800Z โ”‚ { 2023-01-13T03:17:59.1381610Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:17:59.1382360Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:17:59.1385940Z โ”‚ o add workers for the model." 2023-01-13T03:17:59.1409590Z โ”‚ } 2023-01-13T03:17:59.1410330Z โ”” 2023-01-13T03:17:59.1411240Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:59.1412240Z 8ms 361ยตs (cache) (cache) 233ms 1ms 38ยตs 244ms 2023-01-13T03:17:59.1412830Z 2023-01-13T03:17:59.1448980Z โœ“ Successful request 2023-01-13T03:17:59.1497940Z 2023-01-13T03:17:59.1498370Z Iteration 30/82 2023-01-13T03:17:59.1515050Z 2023-01-13T03:17:59.1515720Z โ†’ management request 2023-01-13T03:17:59.1658460Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:17:59.1664500Z 200 OK โ˜… 6ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:17:59.1665330Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:17:59.1666030Z โ”‚ { 2023-01-13T03:17:59.1666780Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:17:59.1667470Z โ”‚ } 2023-01-13T03:17:59.1694760Z โ”” 2023-01-13T03:17:59.1701170Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:17:59.1702390Z 1ms 296ยตs (cache) (cache) 3ms 1ms 37ยตs 7ms 2023-01-13T03:17:59.1703130Z 2023-01-13T03:17:59.1783510Z โœ“ Successful request 2023-01-13T03:17:59.1801270Z 2023-01-13T03:17:59.1802010Z Iteration 31/82 2023-01-13T03:17:59.1819680Z 2023-01-13T03:17:59.1820570Z โ†’ management request 2023-01-13T03:18:02.4236490Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&batch_size=3&initial_workers=3&response_timeout=0 2023-01-13T03:18:02.4338350Z 500 Internal Server Error โ˜… 3.2s time โ˜… 349Bโ†‘ 413Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:02.4438700Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 132B 2023-01-13T03:18:02.4540270Z โ”‚ { 2023-01-13T03:18:02.4641550Z โ”‚ "code": 500, 2023-01-13T03:18:02.4742880Z โ”‚ "type": "InternalServerException", 2023-01-13T03:18:02.4774480Z โ”‚ "message": "Failed to start workers for model squeez 2023-01-13T03:18:02.4790220Z โ”‚ enet1_1 version: 1.0" 2023-01-13T03:18:02.4800730Z โ”‚ } 2023-01-13T03:18:02.4844980Z โ”” 2023-01-13T03:18:02.4850940Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:02.4853380Z 1ms 286ยตs (cache) (cache) 3.2s 1ms 42ยตs 3.2s 2023-01-13T03:18:02.4877180Z 2023-01-13T03:18:02.4889410Z โœ“ Successful request 2023-01-13T03:18:02.4933720Z 2023-01-13T03:18:02.4936260Z Iteration 32/82 2023-01-13T03:18:02.4959290Z 2023-01-13T03:18:02.5033950Z โ†’ management request 2023-01-13T03:18:02.6809340Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&response_timeout=0 2023-01-13T03:18:02.6810590Z 200 OK โ˜… 241ms time โ˜… 318Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:02.6811400Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:18:02.6812050Z โ”‚ { 2023-01-13T03:18:02.6812830Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:18:02.6813610Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:18:02.6814330Z โ”‚ o add workers for the model." 2023-01-13T03:18:02.6814940Z โ”‚ } 2023-01-13T03:18:02.6830580Z โ”” 2023-01-13T03:18:02.6900580Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:02.6901610Z 1ms 724ยตs 210ยตs 223ยตs 237ms 2ms 38ยตs 242ms 2023-01-13T03:18:02.6902100Z 2023-01-13T03:18:02.6902670Z โœ“ Successful request 2023-01-13T03:18:02.6950160Z 2023-01-13T03:18:02.6956400Z Iteration 33/82 2023-01-13T03:18:02.6966110Z 2023-01-13T03:18:02.6966780Z โ†’ management request 2023-01-13T03:18:02.7108030Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:18:02.7142510Z 200 OK โ˜… 6ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:02.7146490Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:18:02.7147530Z โ”‚ { 2023-01-13T03:18:02.7148780Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:18:02.7161260Z โ”‚ } 2023-01-13T03:18:02.7161980Z โ”” 2023-01-13T03:18:02.7162820Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:02.7165500Z 1ms 309ยตs (cache) (cache) 3ms 1ms 59ยตs 6ms 2023-01-13T03:18:02.7166010Z 2023-01-13T03:18:02.7207450Z โœ“ Successful request 2023-01-13T03:18:02.7258980Z 2023-01-13T03:18:02.7281790Z Iteration 34/82 2023-01-13T03:18:02.7282410Z 2023-01-13T03:18:02.7283010Z โ†’ management request 2023-01-13T03:18:10.7499280Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=2 2023-01-13T03:18:10.7500590Z 200 OK โ˜… 8s time โ˜… 311Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:10.7501500Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 138B 2023-01-13T03:18:10.7502200Z โ”‚ { 2023-01-13T03:18:10.7503000Z โ”‚ "status": "Model \"resnet152\" Version: 1.0 register 2023-01-13T03:18:10.7503820Z โ”‚ ed with 0 initial workers. Use scale workers API to ad 2023-01-13T03:18:10.7504460Z โ”‚ d workers for the model." 2023-01-13T03:18:10.7504730Z โ”‚ } 2023-01-13T03:18:10.7520740Z โ”” 2023-01-13T03:18:10.7524630Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:10.7531640Z 1ms 340ยตs (cache) (cache) 8s 1ms 35ยตs 8s 2023-01-13T03:18:10.7534970Z 2023-01-13T03:18:10.7582750Z โœ“ Successful request 2023-01-13T03:18:10.7627070Z 2023-01-13T03:18:10.7627450Z Iteration 35/82 2023-01-13T03:18:10.7644140Z 2023-01-13T03:18:10.7644910Z โ†’ management request 2023-01-13T03:18:10.7868340Z DELETE http://localhost:8081/models/resnet152 2023-01-13T03:18:10.7869060Z 200 OK โ˜… 14ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:10.7869510Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:18:10.7869840Z โ”‚ { 2023-01-13T03:18:10.7870170Z โ”‚ "status": "Model \"resnet152\" unregistered" 2023-01-13T03:18:10.7870440Z โ”‚ } 2023-01-13T03:18:10.7894210Z โ”” 2023-01-13T03:18:10.7895200Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:10.7895730Z 1ms 375ยตs (cache) (cache) 11ms 1ms 39ยตs 15ms 2023-01-13T03:18:10.7895910Z 2023-01-13T03:18:10.7991020Z โœ“ Successful request 2023-01-13T03:18:10.8036870Z 2023-01-13T03:18:10.8037100Z Iteration 36/82 2023-01-13T03:18:10.8053050Z 2023-01-13T03:18:10.8053630Z โ†’ management request 2023-01-13T03:18:23.6940660Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=dd&initial_workers=1 2023-01-13T03:18:23.6965310Z 200 OK โ˜… 12.8s time โ˜… 330Bโ†‘ 351Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:23.6966080Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 85B 2023-01-13T03:18:23.6966700Z โ”‚ { 2023-01-13T03:18:23.6967330Z โ”‚ "status": "Model \"resnet152\" Version: 1.0 register 2023-01-13T03:18:23.6967970Z โ”‚ ed with 1 initial workers" 2023-01-13T03:18:23.6968510Z โ”‚ } 2023-01-13T03:18:23.6968990Z โ”” 2023-01-13T03:18:23.6970210Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:23.6971150Z 1ms 312ยตs (cache) (cache) 12.8s 1ms 43ยตs 12.8s 2023-01-13T03:18:23.6971570Z 2023-01-13T03:18:23.7073030Z โœ“ Successful request 2023-01-13T03:18:23.7103030Z 2023-01-13T03:18:23.7103820Z Iteration 37/82 2023-01-13T03:18:23.7117910Z 2023-01-13T03:18:23.7119120Z โ†’ management request 2023-01-13T03:18:23.8425740Z DELETE http://localhost:8081/models/resnet152 2023-01-13T03:18:23.8527580Z 200 OK โ˜… 122ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:23.8627810Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:18:23.8729250Z โ”‚ { 2023-01-13T03:18:23.8827920Z โ”‚ "status": "Model \"resnet152\" unregistered" 2023-01-13T03:18:23.8928020Z โ”‚ } 2023-01-13T03:18:23.8959570Z โ”” 2023-01-13T03:18:23.8964780Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:23.8977560Z 1ms 264ยตs (cache) (cache) 119ms 1ms 45ยตs 123ms 2023-01-13T03:18:23.9044870Z 2023-01-13T03:18:23.9052440Z โœ“ Successful request 2023-01-13T03:18:23.9082050Z 2023-01-13T03:18:23.9134870Z Iteration 38/82 2023-01-13T03:18:23.9235340Z 2023-01-13T03:18:23.9275970Z โ†’ management request 2023-01-13T03:18:38.2015470Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=2&initial_workers=1&max_batch_delay=junk 2023-01-13T03:18:38.2117300Z 200 OK โ˜… 14.3s time โ˜… 350Bโ†‘ 351Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:38.2209500Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 85B 2023-01-13T03:18:38.2311360Z โ”‚ { 2023-01-13T03:18:38.2384480Z โ”‚ "status": "Model \"resnet152\" Version: 1.0 register 2023-01-13T03:18:38.2463180Z โ”‚ ed with 1 initial workers" 2023-01-13T03:18:38.2512950Z โ”‚ } 2023-01-13T03:18:38.2644470Z โ”” 2023-01-13T03:18:38.2746190Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:38.2848510Z 1ms 258ยตs (cache) (cache) 14.3s 3ms 88ยตs 14.3s 2023-01-13T03:18:38.2900960Z 2023-01-13T03:18:38.2927080Z โœ“ Successful request 2023-01-13T03:18:38.2947640Z 2023-01-13T03:18:38.2948370Z Iteration 39/82 2023-01-13T03:18:38.2955580Z 2023-01-13T03:18:38.2980070Z โ†’ management request 2023-01-13T03:18:38.3023550Z DELETE http://localhost:8081/models/resnet152 2023-01-13T03:18:38.3062770Z 200 OK โ˜… 45ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:38.3066430Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:18:38.3077190Z โ”‚ { 2023-01-13T03:18:38.3112850Z โ”‚ "status": "Model \"resnet152\" unregistered" 2023-01-13T03:18:38.3161200Z โ”‚ } 2023-01-13T03:18:38.3180500Z โ”” 2023-01-13T03:18:38.3193860Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:38.3195020Z 2ms 536ยตs (cache) (cache) 41ms 1ms 43ยตs 46ms 2023-01-13T03:18:38.3207670Z 2023-01-13T03:18:38.3222260Z โœ“ Successful request 2023-01-13T03:18:38.3275380Z 2023-01-13T03:18:38.3290830Z Iteration 40/82 2023-01-13T03:18:38.3306060Z 2023-01-13T03:18:38.3313370Z โ†’ management request 2023-01-13T03:18:38.5120590Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&initial_workers=-1 2023-01-13T03:18:38.5122010Z 200 OK โ˜… 211ms time โ˜… 318Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:38.5123070Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:18:38.5123990Z โ”‚ { 2023-01-13T03:18:38.5124730Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:18:38.5125490Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:18:38.5126250Z โ”‚ o add workers for the model." 2023-01-13T03:18:38.5126880Z โ”‚ } 2023-01-13T03:18:38.5149890Z โ”” 2023-01-13T03:18:38.5151000Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:38.5152440Z 1ms 301ยตs (cache) (cache) 207ms 2ms 40ยตs 211ms 2023-01-13T03:18:38.5153050Z 2023-01-13T03:18:38.5227860Z โœ“ Successful request 2023-01-13T03:18:38.5266940Z 2023-01-13T03:18:38.5267350Z Iteration 41/82 2023-01-13T03:18:38.5287060Z 2023-01-13T03:18:38.5289120Z โ†’ management request 2023-01-13T03:18:38.5412680Z DELETE http://localhost:8081/models/squeezenet1_1 2023-01-13T03:18:38.5418070Z 200 OK โ˜… 6ms time โ˜… 249Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:38.5454740Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:18:38.5465970Z โ”‚ { 2023-01-13T03:18:38.5475620Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:18:38.5478350Z โ”‚ } 2023-01-13T03:18:38.5480690Z โ”” 2023-01-13T03:18:38.5482240Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:38.5483830Z 1ms 228ยตs (cache) (cache) 3ms 1ms 39ยตs 6ms 2023-01-13T03:18:38.5486640Z 2023-01-13T03:18:38.5538440Z โœ“ Successful request 2023-01-13T03:18:38.5582650Z 2023-01-13T03:18:38.5583200Z Iteration 42/82 2023-01-13T03:18:38.5596980Z 2023-01-13T03:18:38.5597630Z โ†’ management request 2023-01-13T03:18:40.2405330Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=true 2023-01-13T03:18:40.2439720Z 200 OK โ˜… 1674ms time โ˜… 308Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:40.2471560Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 138B 2023-01-13T03:18:40.2516710Z โ”‚ { 2023-01-13T03:18:40.2530420Z โ”‚ "status": "Model \"resnet-18\" Version: 1.0 register 2023-01-13T03:18:40.2579330Z โ”‚ ed with 0 initial workers. Use scale workers API to ad 2023-01-13T03:18:40.2611390Z โ”‚ d workers for the model." 2023-01-13T03:18:40.2652070Z โ”‚ } 2023-01-13T03:18:40.2660020Z โ”” 2023-01-13T03:18:40.2693030Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:40.2716290Z 1ms 245ยตs (cache) (cache) 1671ms 1ms 37ยตs 1674ms 2023-01-13T03:18:40.2734440Z 2023-01-13T03:18:40.2735460Z โœ“ Successful request 2023-01-13T03:18:40.2736480Z 2023-01-13T03:18:40.2742050Z Iteration 43/82 2023-01-13T03:18:40.2762700Z 2023-01-13T03:18:40.2788060Z โ†’ management request 2023-01-13T03:18:40.2798060Z DELETE http://localhost:8081/models/resnet-18 2023-01-13T03:18:40.2799370Z 200 OK โ˜… 7ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:40.2868190Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:18:40.2868730Z โ”‚ { 2023-01-13T03:18:40.2895950Z โ”‚ "status": "Model \"resnet-18\" unregistered" 2023-01-13T03:18:40.2896680Z โ”‚ } 2023-01-13T03:18:40.2926980Z โ”” 2023-01-13T03:18:40.2928770Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:40.2929420Z 1ms 223ยตs (cache) (cache) 5ms 1ms 39ยตs 8ms 2023-01-13T03:18:40.2965320Z 2023-01-13T03:18:40.3015680Z โœ“ Successful request 2023-01-13T03:18:40.3017600Z 2023-01-13T03:18:40.3022830Z Iteration 44/82 2023-01-13T03:18:40.3024090Z 2023-01-13T03:18:40.3026840Z โ†’ management request 2023-01-13T03:18:42.0903910Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=-1 2023-01-13T03:18:42.0921910Z 200 OK โ˜… 1794ms time โ˜… 306Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:42.0924870Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 138B 2023-01-13T03:18:42.0925660Z โ”‚ { 2023-01-13T03:18:42.0926540Z โ”‚ "status": "Model \"resnet-18\" Version: 1.0 register 2023-01-13T03:18:42.0927710Z โ”‚ ed with 0 initial workers. Use scale workers API to ad 2023-01-13T03:18:42.0928060Z โ”‚ d workers for the model." 2023-01-13T03:18:42.0928300Z โ”‚ } 2023-01-13T03:18:42.0928500Z โ”” 2023-01-13T03:18:42.0928930Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:42.0929710Z 1ms 242ยตs (cache) (cache) 1791ms 1ms 47ยตs 1795ms 2023-01-13T03:18:42.0929940Z 2023-01-13T03:18:42.0995890Z โœ“ Successful request 2023-01-13T03:18:42.1037010Z 2023-01-13T03:18:42.1046140Z Iteration 45/82 2023-01-13T03:18:42.1048970Z 2023-01-13T03:18:42.1049630Z โ†’ management request 2023-01-13T03:18:42.1180850Z DELETE http://localhost:8081/models/resnet-18 2023-01-13T03:18:42.1184040Z 200 OK โ˜… 7ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:42.1185090Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:18:42.1185960Z โ”‚ { 2023-01-13T03:18:42.1186850Z โ”‚ "status": "Model \"resnet-18\" unregistered" 2023-01-13T03:18:42.1187730Z โ”‚ } 2023-01-13T03:18:42.1199490Z โ”” 2023-01-13T03:18:42.1200530Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:42.1201610Z 1ms 220ยตs (cache) (cache) 4ms 1ms 34ยตs 7ms 2023-01-13T03:18:42.1202310Z 2023-01-13T03:18:42.1271260Z โœ“ Successful request 2023-01-13T03:18:42.1320660Z 2023-01-13T03:18:42.1321470Z Iteration 46/82 2023-01-13T03:18:42.1335580Z 2023-01-13T03:18:42.1339480Z โ†’ management request 2023-01-13T03:18:43.8846500Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=false 2023-01-13T03:18:43.8847120Z 200 OK โ˜… 1744ms time โ˜… 309Bโ†‘ 405Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:43.8847540Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 138B 2023-01-13T03:18:43.8847810Z โ”‚ { 2023-01-13T03:18:43.8848160Z โ”‚ "status": "Model \"resnet-18\" Version: 1.0 register 2023-01-13T03:18:43.8848600Z โ”‚ ed with 0 initial workers. Use scale workers API to ad 2023-01-13T03:18:43.8848920Z โ”‚ d workers for the model." 2023-01-13T03:18:43.8849190Z โ”‚ } 2023-01-13T03:18:43.8876600Z โ”” 2023-01-13T03:18:43.8877180Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:43.8877680Z 1ms 248ยตs (cache) (cache) 1741ms 1ms 61ยตs 1745ms 2023-01-13T03:18:43.8877850Z 2023-01-13T03:18:43.8937870Z โœ“ Successful request 2023-01-13T03:18:43.8985500Z 2023-01-13T03:18:43.8985830Z Iteration 47/82 2023-01-13T03:18:43.9002690Z 2023-01-13T03:18:43.9003180Z โ†’ management request 2023-01-13T03:18:43.9130690Z GET http://localhost:8081/models?limit=1 2023-01-13T03:18:43.9131790Z 200 OK โ˜… 4ms time โ˜… 240Bโ†‘ 391Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:43.9132260Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 124B 2023-01-13T03:18:43.9132540Z โ”‚ { 2023-01-13T03:18:43.9133020Z โ”‚ "nextPageToken": "1", 2023-01-13T03:18:43.9133340Z โ”‚ "models": [ 2023-01-13T03:18:43.9133570Z โ”‚ { 2023-01-13T03:18:43.9133860Z โ”‚ "modelName": "resnet-18", 2023-01-13T03:18:43.9134190Z โ”‚ "modelUrl": "resnet-18.mar" 2023-01-13T03:18:43.9134440Z โ”‚ } 2023-01-13T03:18:43.9134670Z โ”‚ ] 2023-01-13T03:18:43.9135560Z โ”‚ } 2023-01-13T03:18:43.9151330Z โ”” 2023-01-13T03:18:43.9151870Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:43.9152370Z 1ms 339ยตs (cache) (cache) 2ms 1ms 41ยตs 5ms 2023-01-13T03:18:43.9152540Z 2023-01-13T03:18:43.9221900Z โœ“ Successful request 2023-01-13T03:18:43.9265630Z 2023-01-13T03:18:43.9265970Z Iteration 48/82 2023-01-13T03:18:43.9281770Z 2023-01-13T03:18:43.9282170Z โ†’ management request 2023-01-13T03:18:43.9392930Z GET http://localhost:8081/models?limit=-1 2023-01-13T03:18:43.9393490Z 200 OK โ˜… 4ms time โ˜… 241Bโ†‘ 367Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:43.9394610Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 100B 2023-01-13T03:18:43.9394890Z โ”‚ { 2023-01-13T03:18:43.9395130Z โ”‚ "models": [ 2023-01-13T03:18:43.9395360Z โ”‚ { 2023-01-13T03:18:43.9395650Z โ”‚ "modelName": "resnet-18", 2023-01-13T03:18:43.9395990Z โ”‚ "modelUrl": "resnet-18.mar" 2023-01-13T03:18:43.9396260Z โ”‚ } 2023-01-13T03:18:43.9396480Z โ”‚ ] 2023-01-13T03:18:43.9396690Z โ”‚ } 2023-01-13T03:18:43.9414290Z โ”” 2023-01-13T03:18:43.9414830Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:43.9415330Z 1ms 211ยตs (cache) (cache) 1ms 1ms 35ยตs 4ms 2023-01-13T03:18:43.9415510Z 2023-01-13T03:18:43.9484810Z โœ“ Successful request 2023-01-13T03:18:43.9535020Z 2023-01-13T03:18:43.9535660Z Iteration 49/82 2023-01-13T03:18:43.9553270Z 2023-01-13T03:18:43.9553720Z โ†’ management request 2023-01-13T03:18:43.9651320Z GET http://localhost:8081/models?limit=1&next_page_token=1 2023-01-13T03:18:43.9652110Z 200 OK โ˜… 4ms time โ˜… 258Bโ†‘ 285Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:43.9652550Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 19B 2023-01-13T03:18:43.9652840Z โ”‚ { 2023-01-13T03:18:43.9653080Z โ”‚ "models": [] 2023-01-13T03:18:43.9653320Z โ”‚ } 2023-01-13T03:18:43.9677330Z โ”” 2023-01-13T03:18:43.9677970Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:43.9678470Z 1ms 262ยตs (cache) (cache) 1ms 1ms 35ยตs 5ms 2023-01-13T03:18:43.9678640Z 2023-01-13T03:18:43.9740410Z โœ“ Successful request 2023-01-13T03:18:43.9781050Z 2023-01-13T03:18:43.9781520Z Iteration 50/82 2023-01-13T03:18:43.9797180Z 2023-01-13T03:18:43.9798020Z โ†’ management request 2023-01-13T03:18:43.9909620Z GET http://localhost:8081/models?limit=1&next_page_token=-1 2023-01-13T03:18:43.9910180Z 200 OK โ˜… 4ms time โ˜… 259Bโ†‘ 391Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:43.9910670Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 124B 2023-01-13T03:18:43.9910940Z โ”‚ { 2023-01-13T03:18:43.9911230Z โ”‚ "nextPageToken": "1", 2023-01-13T03:18:43.9911500Z โ”‚ "models": [ 2023-01-13T03:18:43.9911720Z โ”‚ { 2023-01-13T03:18:43.9912030Z โ”‚ "modelName": "resnet-18", 2023-01-13T03:18:43.9912360Z โ”‚ "modelUrl": "resnet-18.mar" 2023-01-13T03:18:43.9912610Z โ”‚ } 2023-01-13T03:18:43.9912840Z โ”‚ ] 2023-01-13T03:18:43.9913050Z โ”‚ } 2023-01-13T03:18:43.9929140Z โ”” 2023-01-13T03:18:43.9929700Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:43.9930190Z 1ms 208ยตs (cache) (cache) 1ms 1ms 36ยตs 4ms 2023-01-13T03:18:43.9930360Z 2023-01-13T03:18:44.0015290Z โœ“ Successful request 2023-01-13T03:18:44.0082120Z 2023-01-13T03:18:44.0082430Z Iteration 51/82 2023-01-13T03:18:44.0098560Z 2023-01-13T03:18:44.0099200Z โ†’ management request 2023-01-13T03:18:44.0226390Z PUT http://localhost:8081/models/resnet-18?number_gpu=10 2023-01-13T03:18:44.0227710Z 202 Accepted โ˜… 4ms time โ˜… 275Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:44.0229990Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:44.0235610Z โ”‚ { 2023-01-13T03:18:44.0253030Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:44.0253830Z โ”‚ } 2023-01-13T03:18:44.0357050Z โ”” 2023-01-13T03:18:44.0371590Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:44.0372600Z 1ms 220ยตs (cache) (cache) 2ms 1ms 39ยตs 5ms 2023-01-13T03:18:44.0373140Z 2023-01-13T03:18:44.0373780Z โœ“ Successful request 2023-01-13T03:18:44.0388620Z 2023-01-13T03:18:44.0389150Z Iteration 52/82 2023-01-13T03:18:44.0405660Z 2023-01-13T03:18:44.0406350Z โ†’ management request 2023-01-13T03:18:44.0518960Z PUT http://localhost:8081/models/resnet-18?number_gpu=-1 2023-01-13T03:18:44.0636470Z 202 Accepted โ˜… 4ms time โ˜… 275Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:44.0738750Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:44.0839360Z โ”‚ { 2023-01-13T03:18:44.0948180Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:44.1048980Z โ”‚ } 2023-01-13T03:18:44.1150770Z โ”” 2023-01-13T03:18:44.1252510Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:44.1354340Z 1ms 210ยตs (cache) (cache) 1ms 1ms 87ยตs 4ms 2023-01-13T03:18:44.1468770Z 2023-01-13T03:18:44.1570470Z โœ“ Successful request 2023-01-13T03:18:44.1671730Z 2023-01-13T03:18:44.1772660Z Iteration 53/82 2023-01-13T03:18:44.1873470Z 2023-01-13T03:18:44.1974770Z โ†’ management request 2023-01-13T03:18:44.2075400Z PUT http://localhost:8081/models/resnet-18?min_worker=1&max_worker=1&synchronous=true 2023-01-13T03:18:44.2175690Z 200 OK โ˜… 4ms time โ˜… 304Bโ†‘ 325Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:44.2277410Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 59B 2023-01-13T03:18:44.2377610Z โ”‚ { 2023-01-13T03:18:44.2478840Z โ”‚ "status": "Workers scaled to 1 for model: resnet-18" 2023-01-13T03:18:44.2578840Z โ”‚ } 2023-01-13T03:18:44.2679100Z โ”” 2023-01-13T03:18:44.2780700Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:44.2881650Z 1ms 253ยตs (cache) (cache) 2ms 1ms 38ยตs 5ms 2023-01-13T03:18:44.2981690Z 2023-01-13T03:18:44.3082510Z โœ“ Successful request 2023-01-13T03:18:44.3183200Z 2023-01-13T03:18:44.3284290Z Iteration 54/82 2023-01-13T03:18:44.3384430Z 2023-01-13T03:18:44.3485520Z โ†’ management request 2023-01-13T03:18:44.3586110Z PUT http://localhost:8081/models/resnet-18?min_worker=1&max_worker=1&synchronous=false 2023-01-13T03:18:44.3687430Z 202 Accepted โ˜… 4ms time โ˜… 305Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:44.3798000Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:44.3902060Z โ”‚ { 2023-01-13T03:18:44.4004800Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:44.4105380Z โ”‚ } 2023-01-13T03:18:44.4206100Z โ”” 2023-01-13T03:18:44.4307390Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:44.4406970Z 2ms 255ยตs (cache) (cache) 1ms 1ms 38ยตs 6ms 2023-01-13T03:18:44.4507730Z 2023-01-13T03:18:44.4609030Z โœ“ Successful request 2023-01-13T03:18:44.4708800Z 2023-01-13T03:18:44.4809540Z Iteration 55/82 2023-01-13T03:18:44.4909840Z 2023-01-13T03:18:44.5010850Z โ†’ management request 2023-01-13T03:18:44.5111400Z PUT http://localhost:8081/models/resnet-18?timeout=-1 2023-01-13T03:18:44.5211630Z 202 Accepted โ˜… 4ms time โ˜… 272Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:44.5312210Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:44.5412500Z โ”‚ { 2023-01-13T03:18:44.5513740Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:44.5614450Z โ”‚ } 2023-01-13T03:18:44.5714930Z โ”” 2023-01-13T03:18:44.5816690Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:44.5917450Z 1ms 312ยตs (cache) (cache) 2ms 1ms 40ยตs 5ms 2023-01-13T03:18:44.6016550Z 2023-01-13T03:18:44.6117590Z โœ“ Successful request 2023-01-13T03:18:44.6217600Z 2023-01-13T03:18:44.6318840Z Iteration 56/82 2023-01-13T03:18:44.6418980Z 2023-01-13T03:18:44.6520410Z โ†’ management request 2023-01-13T03:18:44.6622010Z PUT http://localhost:8081/models/resnet-18?timeout=0 2023-01-13T03:18:44.6723680Z 202 Accepted โ˜… 5ms time โ˜… 271Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:44.6825300Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:44.6926700Z โ”‚ { 2023-01-13T03:18:44.7028250Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:44.7130640Z โ”‚ } 2023-01-13T03:18:44.7232890Z โ”” 2023-01-13T03:18:44.7354500Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:44.7452800Z 1ms 241ยตs (cache) (cache) 2ms 1ms 42ยตs 5ms 2023-01-13T03:18:44.7543170Z 2023-01-13T03:18:44.7583450Z โœ“ Successful request 2023-01-13T03:18:44.7684810Z 2023-01-13T03:18:44.7785890Z Iteration 57/82 2023-01-13T03:18:44.7887040Z 2023-01-13T03:18:44.7988290Z โ†’ management request 2023-01-13T03:18:44.8089930Z POST http://localhost:8081/models?url=&model_name=resnet-18 2023-01-13T03:18:44.8090590Z 404 Not Found โ˜… 4ms time โ˜… 278Bโ†‘ 348Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:44.8196690Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 80B 2023-01-13T03:18:44.8298340Z โ”‚ { 2023-01-13T03:18:44.8399940Z โ”‚ "code": 404, 2023-01-13T03:18:44.8501760Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:18:44.8603570Z โ”‚ "message": "empty url" 2023-01-13T03:18:44.8704940Z โ”‚ } 2023-01-13T03:18:44.8806710Z โ”” 2023-01-13T03:18:44.8863520Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:44.8919370Z 1ms 280ยตs (cache) (cache) 1ms 1ms 39ยตs 5ms 2023-01-13T03:18:44.9014010Z 2023-01-13T03:18:44.9115160Z โœ“ Successful request 2023-01-13T03:18:44.9216070Z 2023-01-13T03:18:44.9257530Z Iteration 58/82 2023-01-13T03:18:44.9341260Z 2023-01-13T03:18:44.9419430Z โ†’ management request 2023-01-13T03:18:45.4081350Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/invalid-resnet-18.mar&model_name=invalid-resnet18 2023-01-13T03:18:45.4183460Z 400 Bad Request โ˜… 1193ms time โ˜… 347Bโ†‘ 439Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:45.4283810Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 168B 2023-01-13T03:18:45.4385260Z โ”‚ { 2023-01-13T03:18:45.4486540Z โ”‚ "code": 400, 2023-01-13T03:18:45.4588300Z โ”‚ "type": "DownloadArchiveException", 2023-01-13T03:18:45.4685150Z โ”‚ "message": "Failed to download archive from: https:/ 2023-01-13T03:18:45.4790390Z โ”‚ /torchserve.pytorch.org/mar_files/invalid-resnet-18.ma 2023-01-13T03:18:45.4891020Z โ”‚ r" 2023-01-13T03:18:45.4992580Z โ”‚ } 2023-01-13T03:18:45.5093690Z โ”” 2023-01-13T03:18:45.5195380Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:45.5296590Z 3ms 952ยตs 307ยตs 1ms 1187ms 1ms 52ยตs 1196ms 2023-01-13T03:18:45.5397720Z 2023-01-13T03:18:45.5499880Z โœ“ Successful request 2023-01-13T03:18:45.5599360Z 2023-01-13T03:18:45.5629250Z Iteration 59/82 2023-01-13T03:18:45.5669570Z 2023-01-13T03:18:45.5762750Z โ†’ management request 2023-01-13T03:18:45.5812260Z GET http://localhost:8081/models/invalid_squeezenet1_1 2023-01-13T03:18:45.5857510Z 404 Not Found โ˜… 5ms time โ˜… 254Bโ†‘ 378Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:45.5959190Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 109B 2023-01-13T03:18:45.6059500Z โ”‚ { 2023-01-13T03:18:45.6159730Z โ”‚ "code": 404, 2023-01-13T03:18:45.6260710Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:18:45.6361260Z โ”‚ "message": "Model not found: invalid_squeezenet1_1" 2023-01-13T03:18:45.6461840Z โ”‚ } 2023-01-13T03:18:45.6535230Z โ”” 2023-01-13T03:18:45.6637070Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:45.6738060Z 1ms 611ยตs 205ยตs 192ยตs 2ms 1ms 38ยตs 5ms 2023-01-13T03:18:45.6837720Z 2023-01-13T03:18:45.6938960Z โœ“ Successful request 2023-01-13T03:18:45.7039100Z 2023-01-13T03:18:45.7140350Z Iteration 60/82 2023-01-13T03:18:45.7240800Z 2023-01-13T03:18:45.7350300Z โ†’ management request 2023-01-13T03:18:45.7450690Z GET http://localhost:8081/models/squeezenet1_1/0.0 2023-01-13T03:18:45.7552400Z 404 Not Found โ˜… 5ms time โ˜… 250Bโ†‘ 370Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:45.7653470Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 101B 2023-01-13T03:18:45.7755560Z โ”‚ { 2023-01-13T03:18:45.7855880Z โ”‚ "code": 404, 2023-01-13T03:18:45.7956800Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:18:45.8057820Z โ”‚ "message": "Model not found: squeezenet1_1" 2023-01-13T03:18:45.8158740Z โ”‚ } 2023-01-13T03:18:45.8259270Z โ”” 2023-01-13T03:18:45.8360310Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:45.8460680Z 1ms 633ยตs 209ยตs 192ยตs 2ms 1ms 43ยตs 5ms 2023-01-13T03:18:45.8560360Z 2023-01-13T03:18:45.8662330Z โœ“ Successful request 2023-01-13T03:18:45.8774970Z 2023-01-13T03:18:45.8875920Z Iteration 61/82 2023-01-13T03:18:45.8976760Z 2023-01-13T03:18:45.9077960Z โ†’ management request 2023-01-13T03:18:45.9179730Z GET http://localhost:8081/models?next_page_token=12 2023-01-13T03:18:45.9281350Z 200 OK โ˜… 5ms time โ˜… 251Bโ†‘ 285Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:45.9750370Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 19B 2023-01-13T03:18:45.9853510Z โ”‚ { 2023-01-13T03:18:45.9960080Z โ”‚ "models": [] 2023-01-13T03:18:46.0059930Z โ”‚ } 2023-01-13T03:18:46.0161430Z โ”” 2023-01-13T03:18:46.0264730Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:46.0366830Z 1ms 733ยตs 220ยตs 212ยตs 1ms 1ms 38ยตs 5ms 2023-01-13T03:18:46.0489190Z 2023-01-13T03:18:46.0662600Z โœ“ Successful request 2023-01-13T03:18:46.1100930Z 2023-01-13T03:18:46.1231970Z Iteration 62/82 2023-01-13T03:18:46.1511390Z 2023-01-13T03:18:46.1814040Z โ†’ management request 2023-01-13T03:18:46.1916570Z PUT http://localhost:8081/models/resnet-18?min_worker=1&synchronous=Nan 2023-01-13T03:18:46.2018710Z 202 Accepted โ˜… 4ms time โ˜… 290Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:46.2127190Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:46.2228830Z โ”‚ { 2023-01-13T03:18:46.2614640Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:46.2715960Z โ”‚ } 2023-01-13T03:18:46.2874820Z โ”” 2023-01-13T03:18:46.3056860Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:46.3163490Z 1ms 256ยตs (cache) (cache) 1ms 1ms 37ยตs 4ms 2023-01-13T03:18:46.3264790Z 2023-01-13T03:18:46.3367050Z โœ“ Successful request 2023-01-13T03:18:46.3466220Z 2023-01-13T03:18:46.3598470Z Iteration 63/82 2023-01-13T03:18:46.3718540Z 2023-01-13T03:18:46.3819910Z โ†’ management request 2023-01-13T03:18:46.3921640Z PUT http://localhost:8081/models/resnet-18?min_worker=nan&synchronous=nan 2023-01-13T03:18:46.4022050Z 202 Accepted โ˜… 14ms time โ˜… 292Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:46.4123060Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:46.4224570Z โ”‚ { 2023-01-13T03:18:46.4325640Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:46.4427720Z โ”‚ } 2023-01-13T03:18:46.4529300Z โ”” 2023-01-13T03:18:46.4631190Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:46.4732090Z 6ms 296ยตs (cache) (cache) 11ms 1ms 43ยตs 19ms 2023-01-13T03:18:46.4831330Z 2023-01-13T03:18:46.4932740Z โœ“ Successful request 2023-01-13T03:18:46.5044020Z 2023-01-13T03:18:46.5146860Z Iteration 64/82 2023-01-13T03:18:46.5247600Z 2023-01-13T03:18:46.5348780Z โ†’ management request 2023-01-13T03:18:46.5450290Z PUT http://localhost:8081/models/resnet-18 2023-01-13T03:18:46.5551960Z 202 Accepted โ˜… 6ms time โ˜… 261Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:46.5653510Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:46.5754860Z โ”‚ { 2023-01-13T03:18:46.5856310Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:46.5957670Z โ”‚ } 2023-01-13T03:18:46.6058940Z โ”” 2023-01-13T03:18:46.6160940Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:46.6262900Z 1ms 404ยตs (cache) (cache) 3ms 1ms 38ยตs 6ms 2023-01-13T03:18:46.6370130Z 2023-01-13T03:18:46.6471330Z โœ“ Successful request 2023-01-13T03:18:46.6572230Z 2023-01-13T03:18:46.6673180Z Iteration 65/82 2023-01-13T03:18:46.6774090Z 2023-01-13T03:18:46.6875310Z โ†’ management request 2023-01-13T03:18:46.6976630Z PUT http://localhost:8081/models/resnet181?min_worker=1 2023-01-13T03:18:46.7078310Z 404 Not Found โ˜… 5ms time โ˜… 274Bโ†‘ 365Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:46.7179890Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 97B 2023-01-13T03:18:46.7281320Z โ”‚ { 2023-01-13T03:18:46.7494800Z โ”‚ "code": 404, 2023-01-13T03:18:46.7597060Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:18:46.7698680Z โ”‚ "message": "Model not found: resnet181" 2023-01-13T03:18:46.7800030Z โ”‚ } 2023-01-13T03:18:46.7902220Z โ”” 2023-01-13T03:18:46.8004990Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:46.8108910Z 1ms 280ยตs (cache) (cache) 2ms 1ms 49ยตs 6ms 2023-01-13T03:18:46.8210780Z 2023-01-13T03:18:46.8317020Z โœ“ Successful request 2023-01-13T03:18:46.8419220Z 2023-01-13T03:18:46.8520470Z Iteration 66/82 2023-01-13T03:18:46.8621640Z 2023-01-13T03:18:46.8725860Z โ†’ management request 2023-01-13T03:18:46.8828190Z PUT http://localhost:8081/models/resnet-18?min_worker=2&max_worker=1 2023-01-13T03:18:46.8930450Z 400 Bad Request โ˜… 7ms time โ˜… 287Bโ†‘ 381Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:46.9040720Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 110B 2023-01-13T03:18:46.9142220Z โ”‚ { 2023-01-13T03:18:46.9242800Z โ”‚ "code": 400, 2023-01-13T03:18:46.9345280Z โ”‚ "type": "BadRequestException", 2023-01-13T03:18:46.9447050Z โ”‚ "message": "max_worker cannot be less than min_worke 2023-01-13T03:18:46.9548060Z โ”‚ r." 2023-01-13T03:18:46.9649250Z โ”‚ } 2023-01-13T03:18:46.9649950Z โ”” 2023-01-13T03:18:46.9751550Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:46.9854880Z 3ms 651ยตs 219ยตs 768ยตs 3ms 1ms 39ยตs 10ms 2023-01-13T03:18:46.9955750Z 2023-01-13T03:18:47.0055060Z โœ“ Successful request 2023-01-13T03:18:47.0155920Z 2023-01-13T03:18:47.0256890Z Iteration 67/82 2023-01-13T03:18:47.0358160Z 2023-01-13T03:18:47.0459400Z โ†’ management request 2023-01-13T03:18:47.0561500Z PUT http://localhost:8081/models/resnet-18?min_worker=1 2023-01-13T03:18:47.0662300Z 202 Accepted โ˜… 6ms time โ˜… 274Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:47.0763130Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:47.0865110Z โ”‚ { 2023-01-13T03:18:47.0964010Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:47.1065400Z โ”‚ } 2023-01-13T03:18:47.1167050Z โ”” 2023-01-13T03:18:47.1267620Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:47.1363410Z 11ms 790ยตs 212ยตs 1ms 2ms 1ms 44ยตs 17ms 2023-01-13T03:18:47.1464330Z 2023-01-13T03:18:47.1565540Z โœ“ Successful request 2023-01-13T03:18:47.1666460Z 2023-01-13T03:18:47.1767400Z Iteration 68/82 2023-01-13T03:18:47.1868260Z 2023-01-13T03:18:47.1969700Z โ†’ management request 2023-01-13T03:18:47.2070020Z PUT http://localhost:8081/models/resnet-18?min_worker=0 2023-01-13T03:18:47.2171550Z 202 Accepted โ˜… 31ms time โ˜… 274Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:47.2272000Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:18:47.2359680Z โ”‚ { 2023-01-13T03:18:47.2448300Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:18:47.2542290Z โ”‚ } 2023-01-13T03:18:47.2644070Z โ”” 2023-01-13T03:18:47.2745920Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:47.2847840Z 1ms 241ยตs (cache) (cache) 27ms 2ms 41ยตs 31ms 2023-01-13T03:18:47.2947560Z 2023-01-13T03:18:47.3049100Z โœ“ Successful request 2023-01-13T03:18:47.3051060Z 2023-01-13T03:18:47.3051690Z Iteration 69/82 2023-01-13T03:18:47.3052320Z 2023-01-13T03:18:47.3052980Z โ†’ management request 2023-01-13T03:18:47.3053970Z PUT http://localhost:8081/models/resnet-18?min_worker=-1 2023-01-13T03:18:47.3055030Z 500 Internal Server Error โ˜… 7ms time โ˜… 275Bโ†‘ 390Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:47.3056030Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 109B 2023-01-13T03:18:47.3056880Z โ”‚ { 2023-01-13T03:18:47.3057670Z โ”‚ "code": 500, 2023-01-13T03:18:47.3159740Z โ”‚ "type": "IndexOutOfBoundsException", 2023-01-13T03:18:47.3261680Z โ”‚ "message": "Index -1 out of bounds for length 0" 2023-01-13T03:18:47.3363050Z โ”‚ } 2023-01-13T03:18:47.3464300Z โ”” 2023-01-13T03:18:47.3565880Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:47.3667520Z 3ms 623ยตs (cache) (cache) 3ms 2ms 41ยตs 10ms 2023-01-13T03:18:47.3768380Z 2023-01-13T03:18:47.3869620Z โœ“ Successful request 2023-01-13T03:18:47.3970490Z 2023-01-13T03:18:47.4071360Z Iteration 70/82 2023-01-13T03:18:47.4172260Z 2023-01-13T03:18:47.4263220Z โ†’ management request 2023-01-13T03:18:47.4364920Z PUT http://localhost:8081/models/resnet-18?max_worker=-1 2023-01-13T03:18:47.4466540Z 400 Bad Request โ˜… 17ms time โ˜… 275Bโ†‘ 381Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:47.4568150Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 110B 2023-01-13T03:18:47.4669510Z โ”‚ { 2023-01-13T03:18:47.4770920Z โ”‚ "code": 400, 2023-01-13T03:18:47.4872380Z โ”‚ "type": "BadRequestException", 2023-01-13T03:18:47.4973810Z โ”‚ "message": "max_worker cannot be less than min_worke 2023-01-13T03:18:47.5075430Z โ”‚ r." 2023-01-13T03:18:47.5175740Z โ”‚ } 2023-01-13T03:18:47.5277190Z โ”” 2023-01-13T03:18:47.5378020Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:47.5479730Z 1ms 664ยตs 207ยตs 314ยตs 6ms 8ms 58ยตs 18ms 2023-01-13T03:18:47.5579710Z 2023-01-13T03:18:47.5680950Z โœ“ Successful request 2023-01-13T03:18:47.5781230Z 2023-01-13T03:18:47.5879840Z Iteration 71/82 2023-01-13T03:18:47.5976580Z 2023-01-13T03:18:47.6049340Z โ†’ management request 2023-01-13T03:18:47.6151110Z PUT http://localhost:8081/models/invalid_squeezenet1_1/1.0/set-default 2023-01-13T03:18:47.6240720Z 404 Not Found โ˜… 5ms time โ˜… 289Bโ†‘ 378Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:47.6342410Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 109B 2023-01-13T03:18:47.6424450Z โ”‚ { 2023-01-13T03:18:47.6525770Z โ”‚ "code": 404, 2023-01-13T03:18:47.6626660Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:18:47.6728350Z โ”‚ "message": "Model not found: invalid_squeezenet1_1" 2023-01-13T03:18:47.6830400Z โ”‚ } 2023-01-13T03:18:47.6933920Z โ”” 2023-01-13T03:18:47.7036510Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:47.7138370Z 1ms 659ยตs 218ยตs 221ยตs 1ms 1ms 173ยตs 5ms 2023-01-13T03:18:47.7239430Z 2023-01-13T03:18:47.7341250Z โœ“ Successful request 2023-01-13T03:18:47.7442210Z 2023-01-13T03:18:47.7543070Z Iteration 72/82 2023-01-13T03:18:47.7643800Z 2023-01-13T03:18:47.7747610Z โ†’ management request 2023-01-13T03:18:47.7849190Z DELETE http://localhost:8081/models/resnet-18 2023-01-13T03:18:47.7955470Z 200 OK โ˜… 10ms time โ˜… 245Bโ†‘ 317Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:47.8064810Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 51B 2023-01-13T03:18:47.8172680Z โ”‚ { 2023-01-13T03:18:47.8274770Z โ”‚ "status": "Model \"resnet-18\" unregistered" 2023-01-13T03:18:47.8379930Z โ”‚ } 2023-01-13T03:18:47.8528300Z โ”” 2023-01-13T03:18:47.8631110Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:47.8733570Z 2ms 821ยตs 417ยตs 387ยตs 5ms 1ms 85ยตs 11ms 2023-01-13T03:18:47.8840310Z 2023-01-13T03:18:47.8950190Z โœ“ Successful request 2023-01-13T03:18:47.9053740Z 2023-01-13T03:18:47.9155760Z Iteration 73/82 2023-01-13T03:18:47.9256870Z 2023-01-13T03:18:47.9359640Z โ†’ management request 2023-01-13T03:18:47.9461550Z DELETE http://localhost:8081/models/squeezenet1_1/0.0 2023-01-13T03:18:47.9563350Z 404 Not Found โ˜… 7ms time โ˜… 253Bโ†‘ 370Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:47.9665480Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 101B 2023-01-13T03:18:47.9770480Z โ”‚ { 2023-01-13T03:18:47.9874420Z โ”‚ "code": 404, 2023-01-13T03:18:47.9977940Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:18:48.0087330Z โ”‚ "message": "Model not found: squeezenet1_1" 2023-01-13T03:18:48.0192970Z โ”‚ } 2023-01-13T03:18:48.0299780Z โ”” 2023-01-13T03:18:48.0411390Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.0517190Z 1ms 261ยตs (cache) (cache) 4ms 1ms 76ยตs 8ms 2023-01-13T03:18:48.0619380Z 2023-01-13T03:18:48.0721660Z โœ“ Successful request 2023-01-13T03:18:48.0842970Z 2023-01-13T03:18:48.0944240Z Iteration 74/82 2023-01-13T03:18:48.0944520Z 2023-01-13T03:18:48.1045760Z โ†’ management request 2023-01-13T03:18:48.1148870Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:18:48.1250680Z 200 OK โ˜… 542ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:48.1357280Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:18:48.1458660Z โ”‚ { 2023-01-13T03:18:48.1560230Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:18:48.1661850Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:18:48.1762330Z โ”‚ o add workers for the model." 2023-01-13T03:18:48.1863560Z โ”‚ } 2023-01-13T03:18:48.1964020Z โ”” 2023-01-13T03:18:48.2065430Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.2166430Z 1ms 1ms 219ยตs 728ยตs 538ms 1ms 39ยตs 543ms 2023-01-13T03:18:48.2266650Z 2023-01-13T03:18:48.2367970Z โœ“ Successful request 2023-01-13T03:18:48.2468850Z 2023-01-13T03:18:48.2569960Z Iteration 75/82 2023-01-13T03:18:48.2671060Z 2023-01-13T03:18:48.2772480Z โ†’ management request 2023-01-13T03:18:48.2873220Z DELETE http://localhost:8081/models/squeezenet1_1/?synchronous=true 2023-01-13T03:18:48.2974920Z 200 OK โ˜… 23ms time โ˜… 267Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:48.3076060Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:18:48.3164700Z โ”‚ { 2023-01-13T03:18:48.3253960Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:18:48.3334220Z โ”‚ } 2023-01-13T03:18:48.3435470Z โ”” 2023-01-13T03:18:48.3537040Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.3638670Z 1ms 261ยตs (cache) (cache) 20ms 1ms 40ยตs 23ms 2023-01-13T03:18:48.3731230Z 2023-01-13T03:18:48.3833550Z โœ“ Successful request 2023-01-13T03:18:48.3920270Z 2023-01-13T03:18:48.4021290Z Iteration 76/82 2023-01-13T03:18:48.4122090Z 2023-01-13T03:18:48.4223300Z โ†’ management request 2023-01-13T03:18:48.4343750Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:18:48.4438570Z 200 OK โ˜… 604ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:48.4496790Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:18:48.4538760Z โ”‚ { 2023-01-13T03:18:48.4577010Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:18:48.4582050Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:18:48.4582530Z โ”‚ o add workers for the model." 2023-01-13T03:18:48.4592200Z โ”‚ } 2023-01-13T03:18:48.4596830Z โ”” 2023-01-13T03:18:48.4598660Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.4603250Z 1ms 280ยตs (cache) (cache) 602ms 1ms 41ยตs 605ms 2023-01-13T03:18:48.4615260Z 2023-01-13T03:18:48.4617040Z โœ“ Successful request 2023-01-13T03:18:48.4618800Z 2023-01-13T03:18:48.4628320Z Iteration 77/82 2023-01-13T03:18:48.4628990Z 2023-01-13T03:18:48.4632840Z โ†’ management request 2023-01-13T03:18:48.4636730Z DELETE http://localhost:8081/models/squeezenet1_1/?synchronous=nan 2023-01-13T03:18:48.4649770Z 200 OK โ˜… 6ms time โ˜… 266Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:48.4651690Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:18:48.4654180Z โ”‚ { 2023-01-13T03:18:48.4657040Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:18:48.4661370Z โ”‚ } 2023-01-13T03:18:48.4671020Z โ”” 2023-01-13T03:18:48.4683400Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.4685170Z 1ms 241ยตs (cache) (cache) 3ms 1ms 109ยตs 6ms 2023-01-13T03:18:48.4687170Z 2023-01-13T03:18:48.4691050Z โœ“ Successful request 2023-01-13T03:18:48.4703470Z 2023-01-13T03:18:48.4704970Z Iteration 78/82 2023-01-13T03:18:48.4706920Z 2023-01-13T03:18:48.4709620Z โ†’ management request 2023-01-13T03:18:48.4721650Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:18:48.4723950Z 200 OK โ˜… 584ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:48.4726320Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:18:48.4730310Z โ”‚ { 2023-01-13T03:18:48.4735820Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:18:48.4759080Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:18:48.4769440Z โ”‚ o add workers for the model." 2023-01-13T03:18:48.4770350Z โ”‚ } 2023-01-13T03:18:48.4771140Z โ”” 2023-01-13T03:18:48.4772170Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.4773580Z 1ms 241ยตs (cache) (cache) 581ms 1ms 36ยตs 584ms 2023-01-13T03:18:48.4774350Z 2023-01-13T03:18:48.4775040Z โœ“ Successful request 2023-01-13T03:18:48.4775730Z 2023-01-13T03:18:48.4776270Z Iteration 79/82 2023-01-13T03:18:48.4776880Z 2023-01-13T03:18:48.4777530Z โ†’ management request 2023-01-13T03:18:48.4778370Z DELETE http://localhost:8081/models/squeezenet1_1/?timeout=true 2023-01-13T03:18:48.4779400Z 200 OK โ˜… 6ms time โ˜… 263Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:48.4780380Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:18:48.4781480Z โ”‚ { 2023-01-13T03:18:48.4782300Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:18:48.4783520Z โ”‚ } 2023-01-13T03:18:48.4784210Z โ”” 2023-01-13T03:18:48.4785110Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.4788750Z 1ms 237ยตs (cache) (cache) 3ms 1ms 44ยตs 6ms 2023-01-13T03:18:48.4789370Z 2023-01-13T03:18:48.4789940Z โœ“ Successful request 2023-01-13T03:18:48.4790520Z 2023-01-13T03:18:48.4790980Z Iteration 80/82 2023-01-13T03:18:48.4791510Z 2023-01-13T03:18:48.4792070Z โ†’ management request 2023-01-13T03:18:48.7159150Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-01-13T03:18:48.7170790Z 200 OK โ˜… 313ms time โ˜… 299Bโ†‘ 409Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:48.7171630Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 142B 2023-01-13T03:18:48.7172320Z โ”‚ { 2023-01-13T03:18:48.7173050Z โ”‚ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-01-13T03:18:48.7173900Z โ”‚ stered with 0 initial workers. Use scale workers API t 2023-01-13T03:18:48.7174640Z โ”‚ o add workers for the model." 2023-01-13T03:18:48.7175300Z โ”‚ } 2023-01-13T03:18:48.7176250Z โ”” 2023-01-13T03:18:48.7177100Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.7177970Z 1ms 262ยตs (cache) (cache) 311ms 1ms 55ยตs 313ms 2023-01-13T03:18:48.7178490Z 2023-01-13T03:18:48.7231670Z โœ“ Successful request 2023-01-13T03:18:48.7269270Z 2023-01-13T03:18:48.7269540Z Iteration 81/82 2023-01-13T03:18:48.7284640Z 2023-01-13T03:18:48.7285310Z โ†’ management request 2023-01-13T03:18:48.7429340Z DELETE http://localhost:8081/models/squeezenet1_1/?timeout=true&synchronous=-1 2023-01-13T03:18:48.7447960Z 200 OK โ˜… 8ms time โ˜… 278Bโ†‘ 321Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:48.7448650Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:18:48.7449190Z โ”‚ { 2023-01-13T03:18:48.7449800Z โ”‚ "status": "Model \"squeezenet1_1\" unregistered" 2023-01-13T03:18:48.7450320Z โ”‚ } 2023-01-13T03:18:48.7450750Z โ”” 2023-01-13T03:18:48.7451390Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.7452130Z 1ms 235ยตs (cache) (cache) 3ms 3ms 33ยตs 8ms 2023-01-13T03:18:48.7452510Z 2023-01-13T03:18:48.7503130Z โœ“ Successful request 2023-01-13T03:18:48.7553780Z 2023-01-13T03:18:48.7554380Z Iteration 82/82 2023-01-13T03:18:48.7571370Z 2023-01-13T03:18:48.7572040Z โ†’ management request 2023-01-13T03:18:48.7672600Z DELETE http://localhost:8081/models/invalid_squeezenet1_1 2023-01-13T03:18:48.7674690Z 404 Not Found โ˜… 4ms time โ˜… 257Bโ†‘ 378Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:18:48.7675430Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 109B 2023-01-13T03:18:48.7676000Z โ”‚ { 2023-01-13T03:18:48.7676520Z โ”‚ "code": 404, 2023-01-13T03:18:48.7677130Z โ”‚ "type": "ModelNotFoundException", 2023-01-13T03:18:48.7677850Z โ”‚ "message": "Model not found: invalid_squeezenet1_1" 2023-01-13T03:18:48.7678400Z โ”‚ } 2023-01-13T03:18:48.7691420Z โ”” 2023-01-13T03:18:48.7692290Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:18:48.7693830Z 1ms 238ยตs (cache) (cache) 1ms 1ms 35ยตs 4ms 2023-01-13T03:18:48.7694700Z 2023-01-13T03:18:48.7752720Z โœ“ Successful request 2023-01-13T03:18:48.7840350Z 2023-01-13T03:18:48.7843320Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:18:48.7850070Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:18:48.7864100Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.7865480Z โ”‚ iterations โ”‚ 82 โ”‚ 0 โ”‚ 2023-01-13T03:18:48.7870180Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.7891980Z โ”‚ requests โ”‚ 82 โ”‚ 0 โ”‚ 2023-01-13T03:18:48.7896990Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.7921510Z โ”‚ test-scripts โ”‚ 82 โ”‚ 0 โ”‚ 2023-01-13T03:18:48.7922370Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.7925440Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:18:48.7926830Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.7934730Z โ”‚ assertions โ”‚ 82 โ”‚ 0 โ”‚ 2023-01-13T03:18:48.7952900Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.7971930Z โ”‚ total run duration: 59.8s โ”‚ 2023-01-13T03:18:48.8005900Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.8006830Z โ”‚ total data received: 7.75kB (approx) โ”‚ 2023-01-13T03:18:48.8007560Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.8008260Z โ”‚ average response time: 690ms [min: 4ms, max: 14.3s, s.d.: 2.3s] โ”‚ 2023-01-13T03:18:48.8009020Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.8010080Z โ”‚ average DNS lookup time: 1ms [min: 205ยตs, max: 3ms, s.d.: 1ms] โ”‚ 2023-01-13T03:18:48.8010870Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:18:48.8011570Z โ”‚ average first byte time: 687ms [min: 1ms, max: 14.3s, s.d.: 2.3s] โ”‚ 2023-01-13T03:18:48.8012280Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:18:48.8805870Z TorchServe has stopped. 2023-01-13T03:19:10.0468740Z newman: could not find "htmlextra" reporter 2023-01-13T03:19:10.0474680Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:19:10.0475980Z please install reporter using npm 2023-01-13T03:19:10.0476540Z 2023-01-13T03:19:10.3190510Z newman 2023-01-13T03:19:10.3293990Z 2023-01-13T03:19:10.3395070Z kf_api_test_collection 2023-01-13T03:19:10.3495430Z 2023-01-13T03:19:10.3596700Z โ†’ Model Zoo - Register Model 2023-01-13T03:19:17.3310180Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-01-13T03:19:17.3311040Z 200 OK โ˜… 6.9s time โ˜… 318Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:17.3315690Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:19:17.3317240Z โ”‚ { 2023-01-13T03:19:17.3317620Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:19:17.3317960Z โ”‚ ith 1 initial workers" 2023-01-13T03:19:17.3318200Z โ”‚ } 2023-01-13T03:19:17.3417610Z โ”” 2023-01-13T03:19:17.3419530Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:19:17.3422550Z 56ms 8ms 2ms 458ยตs 6.9s 10ms 689ยตs 6.9s 2023-01-13T03:19:17.3422770Z 2023-01-13T03:19:17.3730850Z โœ“ Successful POST request 2023-01-13T03:19:17.3883170Z 2023-01-13T03:19:17.3884190Z โ†’ Model Zoo - Inference Model 2023-01-13T03:19:17.5845350Z POST http://localhost:8080/v1/models/mnist:predict 2023-01-13T03:19:17.5846130Z 200 OK โ˜… 149ms time โ˜… 680Bโ†‘ 266Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:17.5846460Z โ”Œ โ†‘ file โ˜… 409B 2023-01-13T03:19:17.5846810Z โ”‚ 2023-01-13T03:19:17.5847320Z โ”” 2023-01-13T03:19:17.5848410Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 32B 2023-01-13T03:19:17.5848790Z โ”‚ { 2023-01-13T03:19:17.5849060Z โ”‚ "predictions": [ 2023-01-13T03:19:17.5849380Z โ”‚ 2 2023-01-13T03:19:17.5850000Z โ”‚ ] 2023-01-13T03:19:17.5850760Z โ”‚ } 2023-01-13T03:19:17.5894090Z โ”” 2023-01-13T03:19:17.5894660Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:19:17.5895160Z 36ms 1ms 762ยตs 287ยตs 143ms 2ms 77ยตs 185ms 2023-01-13T03:19:17.5895360Z 2023-01-13T03:19:17.6066610Z โœ“ Successful POST request 2023-01-13T03:19:17.6068720Z โœ“ Test expected JSON response 2023-01-13T03:19:17.6205210Z 2023-01-13T03:19:17.6206100Z โ†’ Model Zoo - Explanations Model 2023-01-13T03:19:17.7490000Z POST http://localhost:8080/v1/models/mnist:explain 2023-01-13T03:19:17.7490750Z 200 OK โ˜… 118ms time โ˜… 680Bโ†‘ 25.4kBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:17.7491080Z โ”Œ โ†‘ file โ˜… 409B 2023-01-13T03:19:17.7491310Z โ”‚ 2023-01-13T03:19:17.7491530Z โ”” 2023-01-13T03:19:17.7492910Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 25.16kB 2023-01-13T03:19:17.7493290Z โ”‚ { 2023-01-13T03:19:17.7493570Z โ”‚ "explanations": [ 2023-01-13T03:19:17.7493860Z โ”‚ [ 2023-01-13T03:19:17.7494100Z โ”‚ [ 2023-01-13T03:19:17.7494340Z โ”‚ [ 2023-01-13T03:19:17.7494610Z โ”‚ 0.004570948897904518, 2023-01-13T03:19:17.7494940Z โ”‚ 0.006216969889570567, 2023-01-13T03:19:17.7495840Z โ”‚ 0.008197565416790054, 2023-01-13T03:19:17.7496140Z โ”‚ 0.00956357460960162, 2023-01-13T03:19:17.7496430Z โ”‚ 0.008999275288000682, 2023-01-13T03:19:17.7496700Z โ”‚ 0.009673474987299204, 2023-01-13T03:19:17.7496980Z โ”‚ 0.00759990526415611, 2023-01-13T03:19:17.7497940Z โ”‚ 0.006361380878730576, 2023-01-13T03:19:17.7498310Z โ”‚ 0.005768828899722464, 2023-01-13T03:19:17.7498600Z โ”‚ 0.004394465640364998, 2023-01-13T03:19:17.7498870Z โ”‚ 0.004948217991151021, 2023-01-13T03:19:17.7499140Z โ”‚ 0.005273460563398554, 2023-01-13T03:19:17.7499420Z โ”‚ 0.00552379926645563, 2023-01-13T03:19:17.7499710Z โ”‚ 0.007789356689948116, 2023-01-13T03:19:17.7499970Z โ”‚ 0.008759363781687306, 2023-01-13T03:19:17.7500250Z โ”‚ 0.004304805492455091, 2023-01-13T03:19:17.7500530Z โ”‚ 0.010970578510053957, 2023-01-13T03:19:17.7500790Z โ”‚ 0.003248439400258881, 2023-01-13T03:19:17.7501460Z โ”‚ 0.005998033077575954, 2023-01-13T03:19:17.7501740Z โ”‚ 0.003754366178236297, 2023-01-13T03:19:17.7502020Z โ”‚ 0.0027652909543984913, 2023-01-13T03:19:17.7502300Z โ”‚ 0.004314086108302201, 2023-01-13T03:19:17.7502600Z โ”‚ 0.0014008575309793832, 2023-01-13T03:19:17.7502890Z โ”‚ 0.004841846807879152, 2023-01-13T03:19:17.7503660Z โ”‚ 0.0006374842152188424, 2023-01-13T03:19:17.7503980Z โ”‚ 0.0018558540351896193, 2023-01-13T03:19:17.7504280Z โ”‚ -0.0008280457003662673, 2023-01-13T03:19:17.7504530Z โ”‚ -0.0 2023-01-13T03:19:17.7504770Z โ”‚ ], 2023-01-13T03:19:17.7505010Z โ”‚ [ 2023-01-13T03:19:17.7505270Z โ”‚ 0.0016625157327411805, 2023-01-13T03:19:17.7505570Z โ”‚ 0.004443791786549075, 2023-01-13T03:19:17.7505850Z โ”‚ 0.012387840467473451, 2023-01-13T03:19:17.7506440Z โ”‚ 0.009450843895706938, 2023-01-13T03:19:17.7506830Z โ”‚ 0.01614381960979215, 2023-01-13T03:19:17.7508060Z โ”‚ 0.0077975023121792325, 2023-01-13T03:19:17.7508400Z โ”‚ 0.013942240330074955, 2023-01-13T03:19:17.7508690Z โ”‚ 0.007557430502259043, 2023-01-13T03:19:17.7508980Z โ”‚ 0.005479091252857082, 2023-01-13T03:19:17.7509270Z โ”‚ 0.009751320682034742, 2023-01-13T03:19:17.7509550Z โ”‚ 0.004764407344038749, 2023-01-13T03:19:17.7509830Z โ”‚ 0.007292147982231926, 2023-01-13T03:19:17.7510110Z โ”‚ 0.011798000543243184, 2023-01-13T03:19:17.7510380Z โ”‚ 0.006462684960091364, 2023-01-13T03:19:17.7510660Z โ”‚ 0.0033832136159066134, 2023-01-13T03:19:17.7510940Z โ”‚ 0.00922505881538608, 2023-01-13T03:19:17.7511220Z โ”‚ 0.001675069900192248, 2023-01-13T03:19:17.7511510Z โ”‚ 0.0073623054528825765, 2023-01-13T03:19:17.7511790Z โ”‚ 0.005270058467529804, 2023-01-13T03:19:17.7512060Z โ”‚ 0.005453598290693001, 2023-01-13T03:19:17.7512360Z โ”‚ 0.004342726383428029, 2023-01-13T03:19:17.7512650Z โ”‚ 0.005856133456208024, 2023-01-13T03:19:17.7512930Z โ”‚ 0.012168384559923013, 2023-01-13T03:19:17.7513200Z โ”‚ 0.009902719265755299, 2023-01-13T03:19:17.7522230Z โ”‚ 0.009813113128718033, 2023-01-13T03:19:17.7522580Z โ”‚ 0.003442758277537053, 2023-01-13T03:19:17.7522860Z โ”‚ 0.002292428270929502, 2023-01-13T03:19:17.7523130Z โ”‚ -0.0 2023-01-13T03:19:17.7523370Z โ”‚ ], 2023-01-13T03:19:17.7523610Z โ”‚ [ 2023-01-13T03:19:17.7523880Z โ”‚ 0.011528256064393238, 2023-01-13T03:19:17.7524160Z โ”‚ 0.009146989658220684, 2023-01-13T03:19:17.7524440Z โ”‚ 0.022265419533677198, 2023-01-13T03:19:17.7524710Z โ”‚ 0.017558217932072313, 2023-01-13T03:19:17.7524990Z โ”‚ 0.02477055440142161, 2023-01-13T03:19:17.7525280Z โ”‚ 0.02141269536059282, 2023-01-13T03:19:17.7525510Z โ”‚ 2023-01-13T03:19:17.7525810Z โ”‚ (showing 2.05kB/25.16kB) 2023-01-13T03:19:17.7526070Z โ”” 2023-01-13T03:19:17.7526490Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:19:17.7526990Z 2ms 651ยตs (cache) (cache) 114ms 2ms 145ยตs 120ms 2023-01-13T03:19:17.7528220Z 2023-01-13T03:19:17.7866410Z โœ“ Successful POST request 2023-01-13T03:19:17.7907300Z โœ“ Test expected JSON response 2023-01-13T03:19:17.8043190Z 2023-01-13T03:19:17.8044000Z โ†’ Model Zoo - Unregister model 2023-01-13T03:19:17.8345970Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:19:17.8346890Z 200 OK โ˜… 22ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:17.8347440Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:19:17.8347720Z โ”‚ { 2023-01-13T03:19:17.8348270Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:19:17.8348550Z โ”‚ } 2023-01-13T03:19:17.8372820Z โ”” 2023-01-13T03:19:17.8373330Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:19:17.8374530Z 1ms 419ยตs (cache) (cache) 19ms 1ms 62ยตs 23ms 2023-01-13T03:19:17.8374710Z 2023-01-13T03:19:17.8490630Z โœ“ Successful DELETE request 2023-01-13T03:19:17.8602450Z 2023-01-13T03:19:17.8603090Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:19:17.8934660Z GET http://localhost:8082/metrics 2023-01-13T03:19:17.8935760Z 200 OK โ˜… 27ms time โ˜… 233Bโ†‘ 1.06kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:17.8936550Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 767B 2023-01-13T03:19:17.8937310Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:19:17.8937960Z โ”‚ ference duration in microseconds 2023-01-13T03:19:17.8938600Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:19:17.8939420Z โ”‚ ts_inference_latency_microseconds{uuid="5deb806f-46d2- 2023-01-13T03:19:17.8940080Z โ”‚ 4fc5-9552-d9454cf2a532",model_name="mnist",model_versi 2023-01-13T03:19:17.8940710Z โ”‚ on="default",} 148619.636 2023-01-13T03:19:17.8941340Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:19:17.8946760Z โ”‚ erence requests. 2023-01-13T03:19:17.8947690Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:19:17.8948380Z โ”‚ ts_inference_requests_total{uuid="5deb806f-46d2-4fc5-9 2023-01-13T03:19:17.8949060Z โ”‚ 552-d9454cf2a532",model_name="mnist",model_version="de 2023-01-13T03:19:17.8967500Z โ”‚ fault",} 2.0 2023-01-13T03:19:17.8968390Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:19:17.8969020Z โ”‚ duration in microseconds 2023-01-13T03:19:17.8969640Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:19:17.8970330Z โ”‚ ts_queue_latency_microseconds{uuid="5deb806f-46d2-4fc5 2023-01-13T03:19:17.8970990Z โ”‚ -9552-d9454cf2a532",model_name="mnist",model_version=" 2023-01-13T03:19:17.8971590Z โ”‚ default",} 249.47199999999998 2023-01-13T03:19:17.8972310Z โ”” 2023-01-13T03:19:17.8973070Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:19:17.8973820Z 1ms 877ยตs 246ยตs 218ยตs 23ms 1ms 83ยตs 27ms 2023-01-13T03:19:17.8974190Z 2023-01-13T03:19:17.9152550Z โœ“ Successful GET request 2023-01-13T03:19:17.9281280Z 2023-01-13T03:19:17.9282300Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:19:17.9283050Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:19:17.9283760Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9284440Z โ”‚ iterations โ”‚ 1 โ”‚ 0 โ”‚ 2023-01-13T03:19:17.9285140Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9285790Z โ”‚ requests โ”‚ 5 โ”‚ 0 โ”‚ 2023-01-13T03:19:17.9286460Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9288420Z โ”‚ test-scripts โ”‚ 5 โ”‚ 0 โ”‚ 2023-01-13T03:19:17.9289130Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9290140Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:19:17.9291090Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9291920Z โ”‚ assertions โ”‚ 7 โ”‚ 0 โ”‚ 2023-01-13T03:19:17.9292640Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9293300Z โ”‚ total run duration: 7.6s โ”‚ 2023-01-13T03:19:17.9293970Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9294650Z โ”‚ total data received: 26.09kB (approx) โ”‚ 2023-01-13T03:19:17.9305690Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9306680Z โ”‚ average response time: 1448ms [min: 22ms, max: 6.9s, s.d.: 2.7s] โ”‚ 2023-01-13T03:19:17.9307230Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9307980Z โ”‚ average DNS lookup time: 1ms [min: 246ยตs, max: 2ms, s.d.: 751ยตs] โ”‚ 2023-01-13T03:19:17.9308510Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:17.9308980Z โ”‚ average first byte time: 1440ms [min: 19ms, max: 6.9s, s.d.: 2.7s] โ”‚ 2023-01-13T03:19:17.9309700Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:19:18.0731740Z TorchServe has stopped. 2023-01-13T03:19:39.6467750Z newman: could not find "htmlextra" reporter 2023-01-13T03:19:39.6483140Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:19:39.6497680Z please install reporter using npm 2023-01-13T03:19:39.6499970Z 2023-01-13T03:19:40.1851820Z newman 2023-01-13T03:19:40.1952720Z 2023-01-13T03:19:40.2053780Z kf_https_test_collection 2023-01-13T03:19:40.2082360Z 2023-01-13T03:19:40.2089660Z โ†’ HTTPS Inference API Description 2023-01-13T03:19:40.5578480Z OPTIONS https://localhost:8443 2023-01-13T03:19:40.5581270Z 200 OK โ˜… 280ms time โ˜… 230Bโ†‘ 23.67kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:40.5585030Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 23.41kB 2023-01-13T03:19:40.5586520Z โ”‚ { 2023-01-13T03:19:40.5587320Z โ”‚ "openapi": "3.0.1", 2023-01-13T03:19:40.5589470Z โ”‚ "info": { 2023-01-13T03:19:40.5590540Z โ”‚ "title": "TorchServe APIs", 2023-01-13T03:19:40.5591370Z โ”‚ "description": "TorchServe is a flexible and easy 2023-01-13T03:19:40.5592170Z โ”‚ to use tool for serving deep learning models", 2023-01-13T03:19:40.5592880Z โ”‚ "version": "0.7.0" 2023-01-13T03:19:40.5593550Z โ”‚ }, 2023-01-13T03:19:40.5594670Z โ”‚ "paths": { 2023-01-13T03:19:40.5625310Z โ”‚ "/": { 2023-01-13T03:19:40.5626100Z โ”‚ "options": { 2023-01-13T03:19:40.5626900Z โ”‚ "description": "Get openapi description.", 2023-01-13T03:19:40.5657790Z โ”‚ "operationId": "apiDescription", 2023-01-13T03:19:40.5708390Z โ”‚ "parameters": [], 2023-01-13T03:19:40.5712140Z โ”‚ "responses": { 2023-01-13T03:19:40.5712870Z โ”‚ "200": { 2023-01-13T03:19:40.5713660Z โ”‚ "description": "A openapi 3.0.1 descriptor 2023-01-13T03:19:40.5714330Z โ”‚ ", 2023-01-13T03:19:40.5714990Z โ”‚ "content": { 2023-01-13T03:19:40.5715710Z โ”‚ "application/json": { 2023-01-13T03:19:40.5716390Z โ”‚ "schema": { 2023-01-13T03:19:40.5717110Z โ”‚ "type": "object", 2023-01-13T03:19:40.5719240Z โ”‚ "required": [ 2023-01-13T03:19:40.5719950Z โ”‚ "openapi", 2023-01-13T03:19:40.5720620Z โ”‚ "info", 2023-01-13T03:19:40.5721300Z โ”‚ "paths" 2023-01-13T03:19:40.5721960Z โ”‚ ], 2023-01-13T03:19:40.5722650Z โ”‚ "properties": { 2023-01-13T03:19:40.5723370Z โ”‚ "openapi": { 2023-01-13T03:19:40.5724080Z โ”‚ "type": "string" 2023-01-13T03:19:40.5726250Z โ”‚ }, 2023-01-13T03:19:40.5726930Z โ”‚ "info": { 2023-01-13T03:19:40.5727650Z โ”‚ "type": "object" 2023-01-13T03:19:40.5728340Z โ”‚ }, 2023-01-13T03:19:40.5729030Z โ”‚ "paths": { 2023-01-13T03:19:40.5729730Z โ”‚ "type": "object" 2023-01-13T03:19:40.5730730Z โ”‚ } 2023-01-13T03:19:40.5731440Z โ”‚ } 2023-01-13T03:19:40.5732090Z โ”‚ } 2023-01-13T03:19:40.5732710Z โ”‚ } 2023-01-13T03:19:40.5734960Z โ”‚ } 2023-01-13T03:19:40.5735610Z โ”‚ }, 2023-01-13T03:19:40.5736230Z โ”‚ "500": { 2023-01-13T03:19:40.5736970Z โ”‚ "description": "Internal Server Error", 2023-01-13T03:19:40.5737670Z โ”‚ "content": { 2023-01-13T03:19:40.5738390Z โ”‚ "application/json": { 2023-01-13T03:19:40.5739260Z โ”‚ "schema": { 2023-01-13T03:19:40.5739960Z โ”‚ "type": "object", 2023-01-13T03:19:40.5740660Z โ”‚ "required": [ 2023-01-13T03:19:40.5741310Z โ”‚ "code", 2023-01-13T03:19:40.5742000Z โ”‚ "type", 2023-01-13T03:19:40.5744130Z โ”‚ "message" 2023-01-13T03:19:40.5744790Z โ”‚ ], 2023-01-13T03:19:40.5745470Z โ”‚ "properties": { 2023-01-13T03:19:40.5746140Z โ”‚ "code": { 2023-01-13T03:19:40.5746840Z โ”‚ "type": "integer", 2023-01-13T03:19:40.5747570Z โ”‚ "description": "Error code." 2023-01-13T03:19:40.5748230Z โ”‚ }, 2023-01-13T03:19:40.5748890Z โ”‚ "type": { 2023-01-13T03:19:40.5750990Z โ”‚ "type": "string", 2023-01-13T03:19:40.5751720Z โ”‚ "description": "Error type." 2023-01-13T03:19:40.5752430Z โ”‚ }, 2023-01-13T03:19:40.5753090Z โ”‚ "message": { 2023-01-13T03:19:40.5753790Z โ”‚ "type": "string", 2023-01-13T03:19:40.5754510Z โ”‚ "description": "Error message." 2023-01-13T03:19:40.5755820Z โ”‚ } 2023-01-13T03:19:40.5758150Z โ”‚ } 2023-01-13T03:19:40.5758800Z โ”‚ } 2023-01-13T03:19:40.5759420Z โ”‚ } 2023-01-13T03:19:40.5760020Z โ”‚ } 2023-01-13T03:19:40.5760640Z โ”‚ } 2023-01-13T03:19:40.5761250Z โ”‚ } 2023-01-13T03:19:40.5761860Z โ”‚ } 2023-01-13T03:19:40.5762450Z โ”‚ }, 2023-01-13T03:19:40.5763070Z โ”‚ "/ping": { 2023-01-13T03:19:40.5763680Z โ”‚ 2023-01-13T03:19:40.5781310Z โ”‚ (showing 2.05kB/23.41kB) 2023-01-13T03:19:40.5782160Z โ”” 2023-01-13T03:19:40.5783270Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:40.5830100Z 73ms 18ms 2ms 4ms 195ms 48ms 10ms 712ยตs 353ms 2023-01-13T03:19:40.5830800Z 2023-01-13T03:19:40.6234390Z โœ“ Status code is 200 2023-01-13T03:19:40.6357760Z 2023-01-13T03:19:40.6359300Z โ†’ HTTPS Management API Description 2023-01-13T03:19:40.7118640Z OPTIONS https://localhost:8444 2023-01-13T03:19:40.7219440Z 200 OK โ˜… 67ms time โ˜… 230Bโ†‘ 58.87kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:40.7320650Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 58.6kB 2023-01-13T03:19:40.7421690Z โ”‚ { 2023-01-13T03:19:40.7543270Z โ”‚ "openapi": "3.0.1", 2023-01-13T03:19:40.7590760Z โ”‚ "info": { 2023-01-13T03:19:40.7593280Z โ”‚ "title": "TorchServe APIs", 2023-01-13T03:19:40.7594090Z โ”‚ "description": "TorchServe is a flexible and easy 2023-01-13T03:19:40.7594860Z โ”‚ to use tool for serving deep learning models", 2023-01-13T03:19:40.7595560Z โ”‚ "version": "0.7.0" 2023-01-13T03:19:40.7596210Z โ”‚ }, 2023-01-13T03:19:40.7596840Z โ”‚ "paths": { 2023-01-13T03:19:40.7598790Z โ”‚ "/": { 2023-01-13T03:19:40.7599450Z โ”‚ "options": { 2023-01-13T03:19:40.7600190Z โ”‚ "description": "Get openapi description.", 2023-01-13T03:19:40.7600960Z โ”‚ "operationId": "apiDescription", 2023-01-13T03:19:40.7601650Z โ”‚ "parameters": [], 2023-01-13T03:19:40.7602330Z โ”‚ "responses": { 2023-01-13T03:19:40.7602970Z โ”‚ "200": { 2023-01-13T03:19:40.7603690Z โ”‚ "description": "A openapi 3.0.1 descriptor 2023-01-13T03:19:40.7604330Z โ”‚ ", 2023-01-13T03:19:40.7608060Z โ”‚ "content": { 2023-01-13T03:19:40.7609210Z โ”‚ "application/json": { 2023-01-13T03:19:40.7609900Z โ”‚ "schema": { 2023-01-13T03:19:40.7610580Z โ”‚ "type": "object", 2023-01-13T03:19:40.7611390Z โ”‚ "required": [ 2023-01-13T03:19:40.7613590Z โ”‚ "openapi", 2023-01-13T03:19:40.7614270Z โ”‚ "info", 2023-01-13T03:19:40.7614930Z โ”‚ "paths" 2023-01-13T03:19:40.7615580Z โ”‚ ], 2023-01-13T03:19:40.7616240Z โ”‚ "properties": { 2023-01-13T03:19:40.7616910Z โ”‚ "openapi": { 2023-01-13T03:19:40.7617620Z โ”‚ "type": "string" 2023-01-13T03:19:40.7618280Z โ”‚ }, 2023-01-13T03:19:40.7618940Z โ”‚ "info": { 2023-01-13T03:19:40.7628740Z โ”‚ "type": "object" 2023-01-13T03:19:40.7629440Z โ”‚ }, 2023-01-13T03:19:40.7630110Z โ”‚ "paths": { 2023-01-13T03:19:40.7630780Z โ”‚ "type": "object" 2023-01-13T03:19:40.7631440Z โ”‚ } 2023-01-13T03:19:40.7632080Z โ”‚ } 2023-01-13T03:19:40.7632700Z โ”‚ } 2023-01-13T03:19:40.7634730Z โ”‚ } 2023-01-13T03:19:40.7635470Z โ”‚ } 2023-01-13T03:19:40.7636070Z โ”‚ }, 2023-01-13T03:19:40.7636660Z โ”‚ "500": { 2023-01-13T03:19:40.7637350Z โ”‚ "description": "Internal Server Error", 2023-01-13T03:19:40.7638020Z โ”‚ "content": { 2023-01-13T03:19:40.7638680Z โ”‚ "application/json": { 2023-01-13T03:19:40.7641180Z โ”‚ "schema": { 2023-01-13T03:19:40.7647270Z โ”‚ "type": "object", 2023-01-13T03:19:40.7649430Z โ”‚ "required": [ 2023-01-13T03:19:40.7650090Z โ”‚ "code", 2023-01-13T03:19:40.7650710Z โ”‚ "type", 2023-01-13T03:19:40.7651340Z โ”‚ "message" 2023-01-13T03:19:40.7651950Z โ”‚ ], 2023-01-13T03:19:40.7652580Z โ”‚ "properties": { 2023-01-13T03:19:40.7653230Z โ”‚ "code": { 2023-01-13T03:19:40.7653880Z โ”‚ "type": "integer", 2023-01-13T03:19:40.7654580Z โ”‚ "description": "Error code." 2023-01-13T03:19:40.7657140Z โ”‚ }, 2023-01-13T03:19:40.7657780Z โ”‚ "type": { 2023-01-13T03:19:40.7658440Z โ”‚ "type": "string", 2023-01-13T03:19:40.7659160Z โ”‚ "description": "Error type." 2023-01-13T03:19:40.7674640Z โ”‚ }, 2023-01-13T03:19:40.7675350Z โ”‚ "message": { 2023-01-13T03:19:40.7676030Z โ”‚ "type": "string", 2023-01-13T03:19:40.7676730Z โ”‚ "description": "Error message." 2023-01-13T03:19:40.7677390Z โ”‚ } 2023-01-13T03:19:40.7679590Z โ”‚ } 2023-01-13T03:19:40.7680180Z โ”‚ } 2023-01-13T03:19:40.7680730Z โ”‚ } 2023-01-13T03:19:40.7681280Z โ”‚ } 2023-01-13T03:19:40.7681820Z โ”‚ } 2023-01-13T03:19:40.7682350Z โ”‚ } 2023-01-13T03:19:40.7682900Z โ”‚ } 2023-01-13T03:19:40.7683440Z โ”‚ }, 2023-01-13T03:19:40.7684000Z โ”‚ "/models": { 2023-01-13T03:19:40.7684550Z โ”‚ 2023-01-13T03:19:40.7702330Z โ”‚ (showing 2.05kB/58.6kB) 2023-01-13T03:19:40.7702990Z โ”” 2023-01-13T03:19:40.7703800Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:40.7704700Z 2ms 1ms 267ยตs 421ยตs 39ms 22ms 2ms 95ยตs 68ms 2023-01-13T03:19:40.7705180Z 2023-01-13T03:19:40.7705760Z โœ“ Status code is 200 2023-01-13T03:19:40.7706190Z 2023-01-13T03:19:40.7708270Z โ†’ HTTPS Metrics API Description 2023-01-13T03:19:40.8274210Z OPTIONS https://localhost:8445 2023-01-13T03:19:40.8376040Z 200 OK โ˜… 51ms time โ˜… 230Bโ†‘ 2.82kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:40.8477790Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 2.55kB 2023-01-13T03:19:40.8579190Z โ”‚ { 2023-01-13T03:19:40.8680730Z โ”‚ "openapi": "3.0.1", 2023-01-13T03:19:40.8782150Z โ”‚ "info": { 2023-01-13T03:19:40.8867740Z โ”‚ "title": "TorchServe APIs", 2023-01-13T03:19:40.8945670Z โ”‚ "description": "TorchServe is a flexible and easy 2023-01-13T03:19:40.8947970Z โ”‚ to use tool for serving deep learning models", 2023-01-13T03:19:40.8948630Z โ”‚ "version": "0.7.0" 2023-01-13T03:19:40.8949160Z โ”‚ }, 2023-01-13T03:19:40.8949700Z โ”‚ "paths": { 2023-01-13T03:19:40.8950290Z โ”‚ "/metrics": { 2023-01-13T03:19:40.8950820Z โ”‚ "get": { 2023-01-13T03:19:40.8951450Z โ”‚ "description": "Get TorchServe application met 2023-01-13T03:19:40.8952090Z โ”‚ rics in prometheus format.", 2023-01-13T03:19:40.9053480Z โ”‚ "operationId": "metrics", 2023-01-13T03:19:40.9152140Z โ”‚ "parameters": [ 2023-01-13T03:19:40.9234400Z โ”‚ { 2023-01-13T03:19:40.9335880Z โ”‚ "in": "query", 2023-01-13T03:19:40.9437450Z โ”‚ "name": "name[]", 2023-01-13T03:19:40.9539360Z โ”‚ "description": "Names of metrics to filter 2023-01-13T03:19:40.9640770Z โ”‚ ", 2023-01-13T03:19:40.9742940Z โ”‚ "required": false, 2023-01-13T03:19:40.9899990Z โ”‚ "schema": { 2023-01-13T03:19:41.0001660Z โ”‚ "type": "string" 2023-01-13T03:19:41.0094780Z โ”‚ } 2023-01-13T03:19:41.0196130Z โ”‚ } 2023-01-13T03:19:41.0296170Z โ”‚ ], 2023-01-13T03:19:41.0369250Z โ”‚ "responses": { 2023-01-13T03:19:41.0455240Z โ”‚ "200": { 2023-01-13T03:19:41.0556950Z โ”‚ "description": "TorchServe application met 2023-01-13T03:19:41.0658600Z โ”‚ rics", 2023-01-13T03:19:41.0760080Z โ”‚ "content": { 2023-01-13T03:19:41.0861650Z โ”‚ "text/plain; version=0.0.4; charset=utf- 2023-01-13T03:19:41.0963070Z โ”‚ 8": { 2023-01-13T03:19:41.1064590Z โ”‚ "schema": { 2023-01-13T03:19:41.1167520Z โ”‚ "type": "object", 2023-01-13T03:19:41.1269230Z โ”‚ "required": [ 2023-01-13T03:19:41.1336420Z โ”‚ "# HELP", 2023-01-13T03:19:41.1437980Z โ”‚ "# TYPE", 2023-01-13T03:19:41.1538910Z โ”‚ "metric" 2023-01-13T03:19:41.1639780Z โ”‚ ], 2023-01-13T03:19:41.1741240Z โ”‚ "properties": { 2023-01-13T03:19:41.1841680Z โ”‚ "# HELP": { 2023-01-13T03:19:41.1943040Z โ”‚ "type": "string", 2023-01-13T03:19:41.2043490Z โ”‚ "description": "Help text for To 2023-01-13T03:19:41.2144870Z โ”‚ rchServe metric." 2023-01-13T03:19:41.2245340Z โ”‚ }, 2023-01-13T03:19:41.2318410Z โ”‚ "# TYPE": { 2023-01-13T03:19:41.2420090Z โ”‚ "type": "string", 2023-01-13T03:19:41.2491080Z โ”‚ "description": "Type of TorchSer 2023-01-13T03:19:41.2554890Z โ”‚ ve metric." 2023-01-13T03:19:41.2608170Z โ”‚ }, 2023-01-13T03:19:41.2650670Z โ”‚ "metric": { 2023-01-13T03:19:41.2752290Z โ”‚ "type": "string", 2023-01-13T03:19:41.2769790Z โ”‚ "description": "TorchServe appli 2023-01-13T03:19:41.2814970Z โ”‚ cation metric." 2023-01-13T03:19:41.2856660Z โ”‚ } 2023-01-13T03:19:41.2898600Z โ”‚ } 2023-01-13T03:19:41.2987590Z โ”‚ } 2023-01-13T03:19:41.3029490Z โ”‚ } 2023-01-13T03:19:41.3131100Z โ”‚ } 2023-01-13T03:19:41.3346340Z โ”‚ }, 2023-01-13T03:19:41.3447750Z โ”‚ "500": { 2023-01-13T03:19:41.3549080Z โ”‚ "description": "Internal Server Error", 2023-01-13T03:19:41.3650440Z โ”‚ "content": { 2023-01-13T03:19:41.3751880Z โ”‚ "application/json": { 2023-01-13T03:19:41.3784790Z โ”‚ "schema": { 2023-01-13T03:19:41.3824930Z โ”‚ "type": "object", 2023-01-13T03:19:41.3853450Z โ”‚ "required": [ 2023-01-13T03:19:41.3857810Z โ”‚ "code", 2023-01-13T03:19:41.3905200Z โ”‚ "type", 2023-01-13T03:19:41.3982350Z โ”‚ "message" 2023-01-13T03:19:41.4083870Z โ”‚ ], 2023-01-13T03:19:41.4116200Z โ”‚ "properties": { 2023-01-13T03:19:41.4155260Z โ”‚ "code": { 2023-01-13T03:19:41.4256570Z โ”‚ 2023-01-13T03:19:41.4305170Z โ”‚ (showing 2.05kB/2.55kB) 2023-01-13T03:19:41.4406450Z โ”” 2023-01-13T03:19:41.4508860Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:41.4610580Z 2ms 1ms 225ยตs 392ยตs 41ms 4ms 2ms 94ยตs 52ms 2023-01-13T03:19:41.4711450Z 2023-01-13T03:19:41.4812640Z โœ“ Status code is 200 2023-01-13T03:19:41.4913480Z 2023-01-13T03:19:41.5014850Z โ†’ HTTPS Register Model - Mnist 2023-01-13T03:19:44.1283420Z POST https://localhost:8444/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-01-13T03:19:44.1285040Z 200 OK โ˜… 3.2s time โ˜… 318Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:44.1286870Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:19:44.1290050Z โ”‚ { 2023-01-13T03:19:44.1290860Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:19:44.1292270Z โ”‚ ith 1 initial workers" 2023-01-13T03:19:44.1292900Z โ”‚ } 2023-01-13T03:19:44.1320220Z โ”” 2023-01-13T03:19:44.1321630Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:44.1322670Z 2ms 600ยตs (cache) (cache) (cache) 3.2s 2ms 163ยตs 3.2s 2023-01-13T03:19:44.1323370Z 2023-01-13T03:19:44.1409360Z โœ“ Successful POST request 2023-01-13T03:19:44.1494560Z 2023-01-13T03:19:44.1495520Z โ†’ HTTPS Get Mnist Model Description 2023-01-13T03:19:44.1667420Z GET https://localhost:8444/models/mnist 2023-01-13T03:19:44.1668120Z 200 OK โ˜… 9ms time โ˜… 238Bโ†‘ 737Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:44.1668540Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 470B 2023-01-13T03:19:44.1669170Z โ”‚ [ 2023-01-13T03:19:44.1669410Z โ”‚ { 2023-01-13T03:19:44.1669690Z โ”‚ "modelName": "mnist", 2023-01-13T03:19:44.1669990Z โ”‚ "modelVersion": "1.0", 2023-01-13T03:19:44.1670320Z โ”‚ "modelUrl": "mnist.mar", 2023-01-13T03:19:44.1670620Z โ”‚ "runtime": "python", 2023-01-13T03:19:44.1670920Z โ”‚ "minWorkers": 1, 2023-01-13T03:19:44.1671200Z โ”‚ "maxWorkers": 1, 2023-01-13T03:19:44.1671470Z โ”‚ "batchSize": 1, 2023-01-13T03:19:44.1671770Z โ”‚ "maxBatchDelay": 100, 2023-01-13T03:19:44.1672080Z โ”‚ "loadedAtStartup": false, 2023-01-13T03:19:44.1672350Z โ”‚ "workers": [ 2023-01-13T03:19:44.1672590Z โ”‚ { 2023-01-13T03:19:44.1672850Z โ”‚ "id": "9000", 2023-01-13T03:19:44.1673170Z โ”‚ "startTime": "2023-01-13T03:19:41.394Z", 2023-01-13T03:19:44.1673480Z โ”‚ "status": "READY", 2023-01-13T03:19:44.1673770Z โ”‚ "memoryUsage": 0, 2023-01-13T03:19:44.1674040Z โ”‚ "pid": 56213, 2023-01-13T03:19:44.1674300Z โ”‚ "gpu": false, 2023-01-13T03:19:44.1674600Z โ”‚ "gpuUsage": "N/A" 2023-01-13T03:19:44.1674840Z โ”‚ } 2023-01-13T03:19:44.1675070Z โ”‚ ] 2023-01-13T03:19:44.1675290Z โ”‚ } 2023-01-13T03:19:44.1675500Z โ”‚ ] 2023-01-13T03:19:44.1697880Z โ”” 2023-01-13T03:19:44.1698470Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:44.1699040Z 1ms 439ยตs (cache) (cache) (cache) 6ms 1ms 67ยตs 10ms 2023-01-13T03:19:44.1699210Z 2023-01-13T03:19:44.1784290Z โœ“ Successful GET request 2023-01-13T03:19:44.1873270Z 2023-01-13T03:19:44.1874030Z โ†’ HTTPS Scale up Workers - Synchronous for Mnist 2023-01-13T03:19:50.8686350Z PUT https://localhost:8444/models/mnist?min_worker=5&max_worker=5&synchronous=true 2023-01-13T03:19:50.8693940Z 200 OK โ˜… 6.6s time โ˜… 300Bโ†‘ 321Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:50.8707380Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:19:50.8710010Z โ”‚ { 2023-01-13T03:19:50.8710850Z โ”‚ "status": "Workers scaled to 5 for model: mnist" 2023-01-13T03:19:50.8711580Z โ”‚ } 2023-01-13T03:19:50.8712330Z โ”” 2023-01-13T03:19:50.8713250Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:50.8714790Z 1ms 406ยตs (cache) (cache) (cache) 6.6s 2ms 138ยตs 6.6s 2023-01-13T03:19:50.8715430Z 2023-01-13T03:19:50.8795350Z โœ“ Successful PUT request 2023-01-13T03:19:50.8883160Z 2023-01-13T03:19:50.8886740Z โ†’ HTTPS Scale up Workers - Asynchronous for Mnist 2023-01-13T03:19:50.9052280Z PUT https://localhost:8444/models/mnist?min_worker=6&max_worker=6&synchronous=false 2023-01-13T03:19:50.9123300Z 202 Accepted โ˜… 7ms time โ˜… 301Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:50.9130810Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:19:50.9231670Z โ”‚ { 2023-01-13T03:19:50.9333140Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:19:50.9433460Z โ”‚ } 2023-01-13T03:19:50.9534760Z โ”” 2023-01-13T03:19:50.9643500Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:50.9737880Z 1ms 427ยตs (cache) (cache) (cache) 4ms 2ms 69ยตs 8ms 2023-01-13T03:19:50.9838810Z 2023-01-13T03:19:50.9886860Z โœ“ Successful PUT request 2023-01-13T03:19:50.9955110Z 2023-01-13T03:19:51.0032170Z โ†’ HTTPS - Inference - Mnist_KF 2023-01-13T03:19:51.0133470Z POST https://localhost:8443/v1/models/mnist:predict 2023-01-13T03:19:51.0235140Z 200 OK โ˜… 33ms time โ˜… 680Bโ†‘ 266Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:51.0334510Z โ”Œ โ†‘ file โ˜… 409B 2023-01-13T03:19:51.0436270Z โ”‚ 2023-01-13T03:19:51.0483670Z โ”” 2023-01-13T03:19:51.0526680Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 32B 2023-01-13T03:19:51.0538520Z โ”‚ { 2023-01-13T03:19:51.0640290Z โ”‚ "predictions": [ 2023-01-13T03:19:51.0640830Z โ”‚ 2 2023-01-13T03:19:51.0667880Z โ”‚ ] 2023-01-13T03:19:51.0706880Z โ”‚ } 2023-01-13T03:19:51.0715750Z โ”” 2023-01-13T03:19:51.0771180Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:51.0781940Z 8ms 1ms (cache) (cache) (cache) 28ms 1ms 59ยตs 41ms 2023-01-13T03:19:51.0882680Z 2023-01-13T03:19:51.1045740Z โœ“ Status code is 200 2023-01-13T03:19:51.1146750Z 2023-01-13T03:19:51.1248200Z โ†’ HTTPS - Explanations - Mnist_KF 2023-01-13T03:19:51.2491560Z POST https://localhost:8443/v1/models/mnist:explain 2023-01-13T03:19:51.2593290Z 200 OK โ˜… 150ms time โ˜… 680Bโ†‘ 25.4kBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:51.2638430Z โ”Œ โ†‘ file โ˜… 409B 2023-01-13T03:19:51.2739560Z โ”‚ 2023-01-13T03:19:51.2834650Z โ”” 2023-01-13T03:19:51.2849160Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 25.16kB 2023-01-13T03:19:51.2873360Z โ”‚ { 2023-01-13T03:19:51.2885820Z โ”‚ "explanations": [ 2023-01-13T03:19:51.2937950Z โ”‚ [ 2023-01-13T03:19:51.2954610Z โ”‚ [ 2023-01-13T03:19:51.2996030Z โ”‚ [ 2023-01-13T03:19:51.3074900Z โ”‚ 0.004570948897904518, 2023-01-13T03:19:51.3098070Z โ”‚ 0.006216969889570567, 2023-01-13T03:19:51.3112070Z โ”‚ 0.008197565416790054, 2023-01-13T03:19:51.3119880Z โ”‚ 0.00956357460960162, 2023-01-13T03:19:51.3211140Z โ”‚ 0.008999275288000682, 2023-01-13T03:19:51.3213620Z โ”‚ 0.009673474987299204, 2023-01-13T03:19:51.3217320Z โ”‚ 0.00759990526415611, 2023-01-13T03:19:51.3219420Z โ”‚ 0.006361380878730576, 2023-01-13T03:19:51.3221510Z โ”‚ 0.005768828899722464, 2023-01-13T03:19:51.3223330Z โ”‚ 0.004394465640364998, 2023-01-13T03:19:51.3239530Z โ”‚ 0.004948217991151021, 2023-01-13T03:19:51.3241720Z โ”‚ 0.005273460563398554, 2023-01-13T03:19:51.3245090Z โ”‚ 0.00552379926645563, 2023-01-13T03:19:51.3247070Z โ”‚ 0.007789356689948116, 2023-01-13T03:19:51.3249460Z โ”‚ 0.008759363781687306, 2023-01-13T03:19:51.3252790Z โ”‚ 0.004304805492455091, 2023-01-13T03:19:51.3256870Z โ”‚ 0.010970578510053957, 2023-01-13T03:19:51.3260260Z โ”‚ 0.003248439400258881, 2023-01-13T03:19:51.3262730Z โ”‚ 0.005998033077575954, 2023-01-13T03:19:51.3265170Z โ”‚ 0.003754366178236297, 2023-01-13T03:19:51.3267410Z โ”‚ 0.0027652909543984913, 2023-01-13T03:19:51.3268550Z โ”‚ 0.004314086108302201, 2023-01-13T03:19:51.3350980Z โ”‚ 0.0014008575309793832, 2023-01-13T03:19:51.3427770Z โ”‚ 0.004841846807879152, 2023-01-13T03:19:51.3467340Z โ”‚ 0.0006374842152188424, 2023-01-13T03:19:51.3469920Z โ”‚ 0.0018558540351896193, 2023-01-13T03:19:51.3473250Z โ”‚ -0.0008280457003662673, 2023-01-13T03:19:51.3475140Z โ”‚ -0.0 2023-01-13T03:19:51.3477020Z โ”‚ ], 2023-01-13T03:19:51.3478660Z โ”‚ [ 2023-01-13T03:19:51.3560090Z โ”‚ 0.0016625157327411805, 2023-01-13T03:19:51.3601010Z โ”‚ 0.004443791786549075, 2023-01-13T03:19:51.3610800Z โ”‚ 0.012387840467473451, 2023-01-13T03:19:51.3674580Z โ”‚ 0.009450843895706938, 2023-01-13T03:19:51.3716790Z โ”‚ 0.01614381960979215, 2023-01-13T03:19:51.3717260Z โ”‚ 0.0077975023121792325, 2023-01-13T03:19:51.3722070Z โ”‚ 0.013942240330074955, 2023-01-13T03:19:51.3723810Z โ”‚ 0.007557430502259043, 2023-01-13T03:19:51.3807560Z โ”‚ 0.005479091252857082, 2023-01-13T03:19:51.3818220Z โ”‚ 0.009751320682034742, 2023-01-13T03:19:51.3866500Z โ”‚ 0.004764407344038749, 2023-01-13T03:19:51.3875750Z โ”‚ 0.007292147982231926, 2023-01-13T03:19:51.3919800Z โ”‚ 0.011798000543243184, 2023-01-13T03:19:51.3921320Z โ”‚ 0.006462684960091364, 2023-01-13T03:19:51.3926510Z โ”‚ 0.0033832136159066134, 2023-01-13T03:19:51.3928150Z โ”‚ 0.00922505881538608, 2023-01-13T03:19:51.3928570Z โ”‚ 0.001675069900192248, 2023-01-13T03:19:51.3930350Z โ”‚ 0.0073623054528825765, 2023-01-13T03:19:51.3938920Z โ”‚ 0.005270058467529804, 2023-01-13T03:19:51.4040860Z โ”‚ 0.005453598290693001, 2023-01-13T03:19:51.4121100Z โ”‚ 0.004342726383428029, 2023-01-13T03:19:51.4169360Z โ”‚ 0.005856133456208024, 2023-01-13T03:19:51.4180920Z โ”‚ 0.012168384559923013, 2023-01-13T03:19:51.4282410Z โ”‚ 0.009902719265755299, 2023-01-13T03:19:51.4282890Z โ”‚ 0.009813113128718033, 2023-01-13T03:19:51.4307190Z โ”‚ 0.003442758277537053, 2023-01-13T03:19:51.4316890Z โ”‚ 0.002292428270929502, 2023-01-13T03:19:51.4363510Z โ”‚ -0.0 2023-01-13T03:19:51.4372220Z โ”‚ ], 2023-01-13T03:19:51.4392430Z โ”‚ [ 2023-01-13T03:19:51.4394070Z โ”‚ 0.011528256064393238, 2023-01-13T03:19:51.4395550Z โ”‚ 0.009146989658220684, 2023-01-13T03:19:51.4397090Z โ”‚ 0.022265419533677198, 2023-01-13T03:19:51.4416880Z โ”‚ 0.017558217932072313, 2023-01-13T03:19:51.4427310Z โ”‚ 0.02477055440142161, 2023-01-13T03:19:51.4468480Z โ”‚ 0.02141269536059282, 2023-01-13T03:19:51.4476450Z โ”‚ 2023-01-13T03:19:51.4577810Z โ”‚ (showing 2.05kB/25.16kB) 2023-01-13T03:19:51.4680180Z โ”” 2023-01-13T03:19:51.4781830Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:51.4883390Z 14ms 6ms (cache) (cache) (cache) 140ms 1ms 51ยตs 163ms 2023-01-13T03:19:51.4984330Z 2023-01-13T03:19:51.5085420Z โœ“ Status code is 200 2023-01-13T03:19:51.5186250Z 2023-01-13T03:19:51.5287680Z โ†’ HTTPS UnRegister Model Mnist 2023-01-13T03:19:51.5389450Z DELETE https://localhost:8444/models/mnist 2023-01-13T03:19:51.5491460Z 200 OK โ˜… 178ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:19:51.5593030Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:19:51.5772380Z โ”‚ { 2023-01-13T03:19:51.5874170Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:19:51.5979220Z โ”‚ } 2023-01-13T03:19:51.6080890Z โ”” 2023-01-13T03:19:51.6127780Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:19:51.6233270Z 3ms 721ยตs (cache) (cache) (cache) 136ms 40ms 61ยตs 181ms 2023-01-13T03:19:51.6476310Z 2023-01-13T03:19:51.6580820Z โœ“ Successful DELETE request 2023-01-13T03:19:51.6732930Z 2023-01-13T03:19:51.6811710Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:19:51.6912120Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:19:51.6961850Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7007800Z โ”‚ iterations โ”‚ 1 โ”‚ 0 โ”‚ 2023-01-13T03:19:51.7081160Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7093960Z โ”‚ requests โ”‚ 10 โ”‚ 0 โ”‚ 2023-01-13T03:19:51.7145450Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7193970Z โ”‚ test-scripts โ”‚ 10 โ”‚ 0 โ”‚ 2023-01-13T03:19:51.7199730Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7203570Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:19:51.7228190Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7297690Z โ”‚ assertions โ”‚ 10 โ”‚ 0 โ”‚ 2023-01-13T03:19:51.7326600Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7328660Z โ”‚ total run duration: 11.3s โ”‚ 2023-01-13T03:19:51.7347360Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7359300Z โ”‚ total data received: 110.45kB (approx) โ”‚ 2023-01-13T03:19:51.7363510Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7364500Z โ”‚ average response time: 1070ms [min: 7ms, max: 6.6s, s.d.: 2s] โ”‚ 2023-01-13T03:19:51.7365020Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7366850Z โ”‚ average DNS lookup time: 841ยตs [min: 225ยตs, max: 2ms, s.d.: 841ยตs] โ”‚ 2023-01-13T03:19:51.7369760Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:19:51.7370810Z โ”‚ average first byte time: 1031ms [min: 4ms, max: 6.6s, s.d.: 2.1s] โ”‚ 2023-01-13T03:19:51.7371330Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:19:51.7372140Z TorchServe has stopped. 2023-01-13T03:20:12.8321060Z newman: could not find "htmlextra" reporter 2023-01-13T03:20:12.8327310Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:20:12.8328110Z please install reporter using npm 2023-01-13T03:20:12.8328580Z 2023-01-13T03:20:13.1038400Z newman 2023-01-13T03:20:13.1138680Z 2023-01-13T03:20:13.1240770Z kfv2_api_test_collection 2023-01-13T03:20:13.1331450Z 2023-01-13T03:20:13.1431630Z โ†’ Model Zoo - Register Model 2023-01-13T03:20:17.1911780Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-01-13T03:20:17.1912740Z 200 OK โ˜… 4s time โ˜… 318Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:17.1917180Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:20:17.1918800Z โ”‚ { 2023-01-13T03:20:17.1919460Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:20:17.1920070Z โ”‚ ith 1 initial workers" 2023-01-13T03:20:17.1920580Z โ”‚ } 2023-01-13T03:20:17.2016890Z โ”” 2023-01-13T03:20:17.2017880Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:20:17.2018700Z 55ms 7ms 2ms 641ยตs 3.9s 11ms 579ยตs 4s 2023-01-13T03:20:17.2019120Z 2023-01-13T03:20:17.2306210Z โœ“ Successful POST request 2023-01-13T03:20:17.2451990Z 2023-01-13T03:20:17.2452770Z โ†’ Model Zoo - Inference Model 2023-01-13T03:20:17.3134600Z POST http://localhost:8080/v2/models/mnist/infer 2023-01-13T03:20:17.3135550Z 200 OK โ˜… 49ms time โ˜… 7kBโ†‘ 473Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:17.3137000Z โ”Œ โ†‘ file โ˜… 6.73kB 2023-01-13T03:20:17.3138810Z โ”‚ (showing 2.05kB/6.73kB) 2023-01-13T03:20:17.3139300Z โ”” 2023-01-13T03:20:17.3140760Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 238B 2023-01-13T03:20:17.3141180Z โ”‚ { 2023-01-13T03:20:17.3141630Z โ”‚ "id": "d3b15cad-50a2-4eaf-80ce-8b0a428bd298", 2023-01-13T03:20:17.3141980Z โ”‚ "model_name": "mnist", 2023-01-13T03:20:17.3142270Z โ”‚ "model_version": "1.0", 2023-01-13T03:20:17.3142710Z โ”‚ "outputs": [ 2023-01-13T03:20:17.3143080Z โ”‚ { 2023-01-13T03:20:17.3143360Z โ”‚ "name": "predict", 2023-01-13T03:20:17.3143630Z โ”‚ "shape": [], 2023-01-13T03:20:17.3143930Z โ”‚ "datatype": "INT64", 2023-01-13T03:20:17.3144180Z โ”‚ "data": [ 2023-01-13T03:20:17.3144420Z โ”‚ 1 2023-01-13T03:20:17.3144670Z โ”‚ ] 2023-01-13T03:20:17.3144890Z โ”‚ } 2023-01-13T03:20:17.3145120Z โ”‚ ] 2023-01-13T03:20:17.3145330Z โ”‚ } 2023-01-13T03:20:17.3184850Z โ”” 2023-01-13T03:20:17.3186020Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:20:17.3186530Z 8ms 1ms 695ยตs 267ยตs 44ms 2ms 82ยตs 57ms 2023-01-13T03:20:17.3186700Z 2023-01-13T03:20:17.3313640Z โœ“ Successful POST request 2023-01-13T03:20:17.3329410Z โœ“ Test expected JSON response 2023-01-13T03:20:17.3434350Z 2023-01-13T03:20:17.3435140Z โ†’ Model Zoo - Explanations Model 2023-01-13T03:20:17.4393570Z POST http://localhost:8080/v2/models/mnist/explain 2023-01-13T03:20:17.4495870Z 200 OK โ˜… 79ms time โ˜… 7kBโ†‘ 14.06kBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:17.4597290Z โ”Œ โ†‘ file โ˜… 6.73kB 2023-01-13T03:20:17.4698540Z โ”‚ (showing 2.05kB/6.73kB) 2023-01-13T03:20:17.4800370Z โ”” 2023-01-13T03:20:17.4901520Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 13.82kB 2023-01-13T03:20:17.5004060Z โ”‚ { 2023-01-13T03:20:17.5085550Z โ”‚ "id": "d3b15cad-50a2-4eaf-80ce-8b0a428bd298", 2023-01-13T03:20:17.5163620Z โ”‚ "model_name": "mnist", 2023-01-13T03:20:17.5230420Z โ”‚ "model_version": "1.0", 2023-01-13T03:20:17.5305450Z โ”‚ "outputs": [ 2023-01-13T03:20:17.5380640Z โ”‚ { 2023-01-13T03:20:17.5482210Z โ”‚ "name": "explain", 2023-01-13T03:20:17.5482680Z โ”‚ "shape": [ 2023-01-13T03:20:17.5593240Z โ”‚ 1, 2023-01-13T03:20:17.5694940Z โ”‚ 28, 2023-01-13T03:20:17.5796410Z โ”‚ 28 2023-01-13T03:20:17.5897880Z โ”‚ ], 2023-01-13T03:20:17.5931250Z โ”‚ "datatype": "FP64", 2023-01-13T03:20:17.5962040Z โ”‚ "data": [ 2023-01-13T03:20:17.5969330Z โ”‚ -0.0, 2023-01-13T03:20:17.5973140Z โ”‚ -0.0, 2023-01-13T03:20:17.6006070Z โ”‚ -0.0, 2023-01-13T03:20:17.6008430Z โ”‚ -0.0, 2023-01-13T03:20:17.6037490Z โ”‚ -0.0, 2023-01-13T03:20:17.6064300Z โ”‚ -0.0, 2023-01-13T03:20:17.6082230Z โ”‚ -0.0, 2023-01-13T03:20:17.6090570Z โ”‚ -0.0, 2023-01-13T03:20:17.6095720Z โ”‚ -0.0, 2023-01-13T03:20:17.6096470Z โ”‚ -0.0, 2023-01-13T03:20:17.6097270Z โ”‚ -0.0, 2023-01-13T03:20:17.6097990Z โ”‚ -0.0, 2023-01-13T03:20:17.6098660Z โ”‚ -0.0, 2023-01-13T03:20:17.6099380Z โ”‚ -0.0, 2023-01-13T03:20:17.6101070Z โ”‚ -0.0, 2023-01-13T03:20:17.6108180Z โ”‚ -0.0, 2023-01-13T03:20:17.6119760Z โ”‚ 0.0, 2023-01-13T03:20:17.6124910Z โ”‚ -0.0, 2023-01-13T03:20:17.6126010Z โ”‚ -0.0, 2023-01-13T03:20:17.6126940Z โ”‚ 0.0, 2023-01-13T03:20:17.6127650Z โ”‚ -0.0, 2023-01-13T03:20:17.6128380Z โ”‚ 0.0, 2023-01-13T03:20:17.6129080Z โ”‚ -0.0, 2023-01-13T03:20:17.6129740Z โ”‚ -0.0, 2023-01-13T03:20:17.6130060Z โ”‚ -0.0, 2023-01-13T03:20:17.6130300Z โ”‚ -0.0, 2023-01-13T03:20:17.6130550Z โ”‚ -0.0, 2023-01-13T03:20:17.6130790Z โ”‚ 0.0, 2023-01-13T03:20:17.6131040Z โ”‚ -0.0, 2023-01-13T03:20:17.6131710Z โ”‚ -0.0, 2023-01-13T03:20:17.6132020Z โ”‚ -0.0, 2023-01-13T03:20:17.6132270Z โ”‚ -0.0, 2023-01-13T03:20:17.6132510Z โ”‚ -0.0, 2023-01-13T03:20:17.6132830Z โ”‚ -0.0, 2023-01-13T03:20:17.6133150Z โ”‚ -0.0, 2023-01-13T03:20:17.6133380Z โ”‚ 0.0, 2023-01-13T03:20:17.6133630Z โ”‚ -0.0, 2023-01-13T03:20:17.6133870Z โ”‚ 0.0, 2023-01-13T03:20:17.6134150Z โ”‚ -0.0, 2023-01-13T03:20:17.6134490Z โ”‚ -0.0, 2023-01-13T03:20:17.6134950Z โ”‚ -0.0, 2023-01-13T03:20:17.6135230Z โ”‚ 0.0, 2023-01-13T03:20:17.6135460Z โ”‚ 0.0, 2023-01-13T03:20:17.6135720Z โ”‚ 0.0, 2023-01-13T03:20:17.6135940Z โ”‚ 0.0, 2023-01-13T03:20:17.6137420Z โ”‚ 0.0, 2023-01-13T03:20:17.6138210Z โ”‚ 0.0, 2023-01-13T03:20:17.6138480Z โ”‚ 0.0, 2023-01-13T03:20:17.6138720Z โ”‚ 0.0, 2023-01-13T03:20:17.6138950Z โ”‚ 0.0, 2023-01-13T03:20:17.6139190Z โ”‚ -0.0, 2023-01-13T03:20:17.6139440Z โ”‚ -0.0, 2023-01-13T03:20:17.6140020Z โ”‚ 0.0, 2023-01-13T03:20:17.6140910Z โ”‚ 0.0, 2023-01-13T03:20:17.6141240Z โ”‚ -0.0, 2023-01-13T03:20:17.6141620Z โ”‚ 0.0, 2023-01-13T03:20:17.6141890Z โ”‚ -0.0, 2023-01-13T03:20:17.6142140Z โ”‚ -0.0, 2023-01-13T03:20:17.6142380Z โ”‚ -0.0, 2023-01-13T03:20:17.6142610Z โ”‚ -0.0, 2023-01-13T03:20:17.6143180Z โ”‚ -0.0, 2023-01-13T03:20:17.6143740Z โ”‚ 0.0, 2023-01-13T03:20:17.6144180Z โ”‚ 0.0, 2023-01-13T03:20:17.6144440Z โ”‚ 0.0, 2023-01-13T03:20:17.6144670Z โ”‚ 0.0, 2023-01-13T03:20:17.6145080Z โ”‚ 0.0, 2023-01-13T03:20:17.6145340Z โ”‚ 0.0, 2023-01-13T03:20:17.6145570Z โ”‚ 0.0, 2023-01-13T03:20:17.6145960Z โ”‚ 0.0, 2023-01-13T03:20:17.6146220Z โ”‚ 0.0, 2023-01-13T03:20:17.6146450Z โ”‚ -0.0, 2023-01-13T03:20:17.6146690Z โ”‚ -0.0, 2023-01-13T03:20:17.6147830Z โ”‚ -0.0, 2023-01-13T03:20:17.6148370Z โ”‚ 0.0, 2023-01-13T03:20:17.6148620Z โ”‚ -0.0, 2023-01-13T03:20:17.6148850Z โ”‚ 0.0, 2023-01-13T03:20:17.6149080Z โ”‚ 0.0, 2023-01-13T03:20:17.6149510Z โ”‚ 0.0, 2023-01-13T03:20:17.6149750Z โ”‚ -0.0, 2023-01-13T03:20:17.6149990Z โ”‚ -0.0, 2023-01-13T03:20:17.6150230Z โ”‚ -0.0, 2023-01-13T03:20:17.6150460Z โ”‚ 0.0, 2023-01-13T03:20:17.6150690Z โ”‚ -0.0, 2023-01-13T03:20:17.6150930Z โ”‚ 0.0, 2023-01-13T03:20:17.6151440Z โ”‚ -0.0, 2023-01-13T03:20:17.6152340Z โ”‚ -0.0, 2023-01-13T03:20:17.6152670Z โ”‚ -0.0, 2023-01-13T03:20:17.6153360Z โ”‚ -0.0, 2023-01-13T03:20:17.6153600Z โ”‚ 0.0, 2023-01-13T03:20:17.6153840Z โ”‚ 0.0, 2023-01-13T03:20:17.6154070Z โ”‚ 0.0, 2023-01-13T03:20:17.6154450Z โ”‚ 0.0, 2023-01-13T03:20:17.6154700Z โ”‚ 0.0, 2023-01-13T03:20:17.6155170Z โ”‚ 0.0, 2023-01-13T03:20:17.6155420Z โ”‚ 0.0, 2023-01-13T03:20:17.6155660Z โ”‚ -0.0, 2023-01-13T03:20:17.6155890Z โ”‚ -0.0, 2023-01-13T03:20:17.6156460Z โ”‚ 0.0, 2023-01-13T03:20:17.6156700Z โ”‚ 0.0, 2023-01-13T03:20:17.6156920Z โ”‚ -0.0, 2023-01-13T03:20:17.6157150Z โ”‚ -0.0, 2023-01-13T03:20:17.6157390Z โ”‚ -0.0, 2023-01-13T03:20:17.6157610Z โ”‚ -0.0, 2023-01-13T03:20:17.6157850Z โ”‚ -0.0, 2023-01-13T03:20:17.6158080Z โ”‚ 0.0, 2023-01-13T03:20:17.6158300Z โ”‚ 0.0, 2023-01-13T03:20:17.6158750Z โ”‚ -0.0, 2023-01-13T03:20:17.6159030Z โ”‚ -0.0, 2023-01-13T03:20:17.6159270Z โ”‚ -0.0, 2023-01-13T03:20:17.6159990Z โ”‚ 0.0, 2023-01-13T03:20:17.6160450Z โ”‚ 0.0, 2023-01-13T03:20:17.6160700Z โ”‚ 0.0, 2023-01-13T03:20:17.6160930Z โ”‚ -0.0, 2023-01-13T03:20:17.6161180Z โ”‚ -0.0, 2023-01-13T03:20:17.6161430Z โ”‚ -0.0, 2023-01-13T03:20:17.6161660Z โ”‚ -0.0, 2023-01-13T03:20:17.6161910Z โ”‚ 0.0, 2023-01-13T03:20:17.6162150Z โ”‚ 0.0, 2023-01-13T03:20:17.6162380Z โ”‚ 0.0, 2023-01-13T03:20:17.6162610Z โ”‚ 0.0, 2023-01-13T03:20:17.6162850Z โ”‚ 0.0, 2023-01-13T03:20:17.6163070Z โ”‚ 0.0, 2023-01-13T03:20:17.6163300Z โ”‚ -0.0, 2023-01-13T03:20:17.6163830Z โ”‚ -0.004054753035685658, 2023-01-13T03:20:17.6164120Z โ”‚ -0.00022612878154812334, 2023-01-13T03:20:17.6164420Z โ”‚ -0.00012734145263588084, 2023-01-13T03:20:17.6164710Z โ”‚ 0.005648369412447205, 2023-01-13T03:20:17.6164950Z โ”‚ 2023-01-13T03:20:17.6165210Z โ”‚ (showing 2.05kB/13.82kB) 2023-01-13T03:20:17.6165450Z โ”” 2023-01-13T03:20:17.6165890Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:20:17.6166370Z 2ms 676ยตs (cache) (cache) 75ms 2ms 112ยตs 81ms 2023-01-13T03:20:17.6166540Z 2023-01-13T03:20:17.6166730Z โœ“ Successful POST request 2023-01-13T03:20:17.6167270Z โœ“ Test expected JSON response 2023-01-13T03:20:17.6167420Z 2023-01-13T03:20:17.6167610Z โ†’ Model Zoo - Unregister model 2023-01-13T03:20:17.6167890Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:20:17.6168320Z 200 OK โ˜… 36ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:17.6168710Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:20:17.6168980Z โ”‚ { 2023-01-13T03:20:17.6169460Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:20:17.6169770Z โ”‚ } 2023-01-13T03:20:17.6169960Z โ”” 2023-01-13T03:20:17.6170370Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:20:17.6170870Z 1ms 407ยตs (cache) (cache) 33ms 1ms 64ยตs 37ms 2023-01-13T03:20:17.6171040Z 2023-01-13T03:20:17.6171220Z โœ“ Successful DELETE request 2023-01-13T03:20:17.6171360Z 2023-01-13T03:20:17.6171530Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:20:17.6395280Z GET http://localhost:8082/metrics 2023-01-13T03:20:17.6396050Z 200 OK โ˜… 19ms time โ˜… 233Bโ†‘ 1.05kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:17.6396450Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 755B 2023-01-13T03:20:17.6397280Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:20:17.6397690Z โ”‚ ference duration in microseconds 2023-01-13T03:20:17.6398190Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:20:17.6398620Z โ”‚ ts_inference_latency_microseconds{uuid="fd490127-5c14- 2023-01-13T03:20:17.6399010Z โ”‚ 4c73-a633-5d70e94ebb4e",model_name="mnist",model_versi 2023-01-13T03:20:17.6399350Z โ”‚ on="default",} 85586.016 2023-01-13T03:20:17.6400120Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:20:17.6400430Z โ”‚ erence requests. 2023-01-13T03:20:17.6400770Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:20:17.6401290Z โ”‚ ts_inference_requests_total{uuid="fd490127-5c14-4c73-a 2023-01-13T03:20:17.6401690Z โ”‚ 633-5d70e94ebb4e",model_name="mnist",model_version="de 2023-01-13T03:20:17.6411550Z โ”‚ fault",} 2.0 2023-01-13T03:20:17.6412100Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:20:17.6412470Z โ”‚ duration in microseconds 2023-01-13T03:20:17.6412800Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:20:17.6413190Z โ”‚ ts_queue_latency_microseconds{uuid="fd490127-5c14-4c73 2023-01-13T03:20:17.6413580Z โ”‚ -a633-5d70e94ebb4e",model_name="mnist",model_version=" 2023-01-13T03:20:17.6413870Z โ”‚ default",} 286.644 2023-01-13T03:20:17.6423190Z โ”” 2023-01-13T03:20:17.6423650Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:20:17.6424140Z 1ms 831ยตs 236ยตs 218ยตs 15ms 1ms 78ยตs 19ms 2023-01-13T03:20:17.6424290Z 2023-01-13T03:20:17.6531520Z โœ“ Successful GET request 2023-01-13T03:20:17.6703870Z 2023-01-13T03:20:17.6705740Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:20:17.6706700Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:20:17.6707540Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6708450Z โ”‚ iterations โ”‚ 1 โ”‚ 0 โ”‚ 2023-01-13T03:20:17.6709290Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6710040Z โ”‚ requests โ”‚ 5 โ”‚ 0 โ”‚ 2023-01-13T03:20:17.6710860Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6711780Z โ”‚ test-scripts โ”‚ 5 โ”‚ 0 โ”‚ 2023-01-13T03:20:17.6712620Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6713370Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:20:17.6714570Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6715720Z โ”‚ assertions โ”‚ 7 โ”‚ 0 โ”‚ 2023-01-13T03:20:17.6716950Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6728960Z โ”‚ total run duration: 4.5s โ”‚ 2023-01-13T03:20:17.6729870Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6730700Z โ”‚ total data received: 14.95kB (approx) โ”‚ 2023-01-13T03:20:17.6731550Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6733110Z โ”‚ average response time: 837ms [min: 19ms, max: 4s, s.d.: 1583ms] โ”‚ 2023-01-13T03:20:17.6734440Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6735260Z โ”‚ average DNS lookup time: 1ms [min: 236ยตs, max: 2ms, s.d.: 804ยตs] โ”‚ 2023-01-13T03:20:17.6736130Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:17.6736920Z โ”‚ average first byte time: 829ms [min: 15ms, max: 3.9s, s.d.: 1575ms] โ”‚ 2023-01-13T03:20:17.6737760Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:20:17.7603910Z TorchServe has stopped. 2023-01-13T03:20:27.7903800Z Current date and time : 2023-01-13 03:02:39 2023-01-13T03:20:27.7929700Z ------------------------------------------------------------------------------------------ 2023-01-13T03:20:27.7969230Z Environment headers 2023-01-13T03:20:27.7984990Z ------------------------------------------------------------------------------------------ 2023-01-13T03:20:27.8080830Z Torchserve branch: feature/upgrade_pytorch1.13.1 2023-01-13T03:20:27.8088760Z 2023-01-13T03:20:27.8122950Z torchserve==0.7.0 2023-01-13T03:20:27.8131040Z torch-model-archiver==0.7.0 2023-01-13T03:20:27.8230980Z 2023-01-13T03:20:27.8248010Z Python version: 3.8 (64-bit runtime) 2023-01-13T03:20:27.8256880Z Python executable: /Users/runner/hostedtoolcache/Python/3.8.15/x64/bin/python 2023-01-13T03:20:27.8259630Z 2023-01-13T03:20:27.8260110Z Versions of relevant python libraries: 2023-01-13T03:20:27.8260870Z captum==0.6.0 2023-01-13T03:20:27.8261400Z future==0.18.2 2023-01-13T03:20:27.8262060Z numpy==1.24.1 2023-01-13T03:20:27.8262620Z nvgpu==0.9.0 2023-01-13T03:20:27.8263140Z psutil==5.9.4 2023-01-13T03:20:27.8263660Z pygit2==1.11.1 2023-01-13T03:20:27.8264180Z pylint==2.6.0 2023-01-13T03:20:27.8264710Z pytest==7.2.0 2023-01-13T03:20:27.8265410Z pytest-cov==4.0.0 2023-01-13T03:20:27.8267700Z pytest-mock==3.10.0 2023-01-13T03:20:27.8268290Z requests==2.28.2 2023-01-13T03:20:27.8268950Z requests-toolbelt==0.10.1 2023-01-13T03:20:27.8269530Z torch==1.13.1 2023-01-13T03:20:27.8270080Z torchaudio==0.13.1 2023-01-13T03:20:27.8270610Z torchtext==0.14.1 2023-01-13T03:20:27.8271140Z torchvision==0.14.1 2023-01-13T03:20:27.8271680Z transformers==4.25.1 2023-01-13T03:20:27.8272210Z wheel==0.38.4 2023-01-13T03:20:27.8272710Z torch==1.13.1 2023-01-13T03:20:27.8276180Z torchtext==0.14.1 2023-01-13T03:20:27.8277520Z torchvision==0.14.1 2023-01-13T03:20:27.8278180Z torchaudio==0.13.1 2023-01-13T03:20:27.8278620Z 2023-01-13T03:20:27.8279000Z Java Version: 2023-01-13T03:20:27.8279440Z 2023-01-13T03:20:27.8279710Z 2023-01-13T03:20:27.8280100Z OS: Mac OSX 12.6.2 (x86_64) 2023-01-13T03:20:27.8280640Z GCC version: N/A 2023-01-13T03:20:27.8281390Z Clang version: 14.0.0 (clang-1400.0.29.102) 2023-01-13T03:20:27.8281670Z CMake version: version 3.25.1 2023-01-13T03:20:27.8283610Z 2023-01-13T03:20:27.8284210Z Versions of npm installed packages: 2023-01-13T03:20:27.8284990Z markdown-link-check@3.10.3 2023-01-13T03:20:27.8287500Z UNMET PEER DEPENDENCY newman@5.3.2 2023-01-13T03:20:27.8288870Z newman-reporter-html@1.0.5 2023-01-13T03:20:27.8289450Z 2023-01-13T03:20:27.8290250Z ## In directory /Users/runner/work/serve/serve | Executing command pip install --force-reinstall . 2023-01-13T03:20:27.8296040Z ## In directory /Users/runner/work/serve/serve | Executing command pip install --force-reinstall model-archiver/. 2023-01-13T03:20:27.8306900Z ## In directory /Users/runner/work/serve/serve | Executing command pip install --force-reinstall workflow-archiver/. 2023-01-13T03:20:27.8309640Z ## Starting generate_mars, mar_config:/Users/runner/work/serve/serve/ts_scripts/../ts_scripts/mar_config.json, model_store_dir:/Users/runner/work/serve/serve/ts_scripts/../model_store_gen 2023-01-13T03:20:27.8310340Z 2023-01-13T03:20:27.8311810Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name fastrcnn --version 1.0 --model-file examples/object_detector/fast-rcnn/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fasterrcnn_resnet50_fpn_coco-258fb6c6.pth --handler object_detector --extra-files examples/object_detector/index_to_name.json --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8313000Z 2023-01-13T03:20:27.8314330Z ## fastrcnn.mar is generated. 2023-01-13T03:20:27.8314890Z 2023-01-13T03:20:27.8317560Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name alexnet --version 1.0 --model-file examples/image_classifier/alexnet/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet-owt-7be5be79.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8320430Z 2023-01-13T03:20:27.8320920Z ## alexnet.mar is generated. 2023-01-13T03:20:27.8321380Z 2023-01-13T03:20:27.8324390Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name densenet161 --version 1.0 --model-file examples/image_classifier/densenet_161/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161-8d451a50.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8325490Z 2023-01-13T03:20:27.8325950Z ## densenet161.mar is generated. 2023-01-13T03:20:27.8326460Z 2023-01-13T03:20:27.8327750Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name mnist --version 1.0 --model-file examples/image_classifier/mnist/mnist.py --serialized-file examples/image_classifier/mnist/mnist_cnn.pt --handler examples/image_classifier/mnist/mnist_handler.py --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8328320Z 2023-01-13T03:20:27.8328410Z ## mnist.mar is generated. 2023-01-13T03:20:27.8328550Z 2023-01-13T03:20:27.8330010Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name resnet-152-batch --version 1.0 --model-file examples/image_classifier/resnet_152_batch/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet152-394f9c45.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8330700Z 2023-01-13T03:20:27.8330950Z ## resnet-152-batch.mar is generated. 2023-01-13T03:20:27.8331100Z 2023-01-13T03:20:27.8332120Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name resnet-18 --version 1.0 --model-file examples/image_classifier/resnet_18/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet18-f37072fd.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8338040Z 2023-01-13T03:20:27.8338820Z ## resnet-18.mar is generated. 2023-01-13T03:20:27.8341280Z 2023-01-13T03:20:27.8342910Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name squeezenet1_1 --version 1.0 --model-file examples/image_classifier/squeezenet/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1-b8a52dc0.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8344280Z 2023-01-13T03:20:27.8344820Z ## squeezenet1_1.mar is generated. 2023-01-13T03:20:27.8345410Z 2023-01-13T03:20:27.8346910Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name vgg16 --version 1.0 --model-file examples/image_classifier/vgg_16/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16-397923af.pth --handler examples/image_classifier/vgg_16/vgg_handler.py --extra-files examples/image_classifier/index_to_name.json --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8348040Z 2023-01-13T03:20:27.8350120Z ## vgg16.mar is generated. 2023-01-13T03:20:27.8350710Z 2023-01-13T03:20:27.8352480Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name deeplabv3_resnet_101_eager --version 1.0 --model-file examples/image_segmenter/deeplabv3/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet101_coco-586e9e4e.pth --handler image_segmenter --extra-files examples/image_segmenter/deeplabv3/deeplabv3.py,examples/image_segmenter/deeplabv3/intermediate_layer_getter.py,examples/image_segmenter/deeplabv3/fcn.py --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8354560Z 2023-01-13T03:20:27.8355140Z ## deeplabv3_resnet_101_eager.mar is generated. 2023-01-13T03:20:27.8356790Z 2023-01-13T03:20:27.8358480Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name fcn_resnet_101 --version 1.0 --model-file examples/image_segmenter/fcn/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet101_coco-7ecb50ca.pth --handler image_segmenter --extra-files examples/image_segmenter/fcn/fcn.py,examples/image_segmenter/fcn/intermediate_layer_getter.py --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8359630Z 2023-01-13T03:20:27.8360110Z ## fcn_resnet_101.mar is generated. 2023-01-13T03:20:27.8360670Z 2023-01-13T03:20:27.8363950Z ## In directory: /Users/runner/work/serve/serve | Executing command: torch-model-archiver --model-name maskrcnn --version 1.0 --model-file examples/object_detector/maskrcnn/model.py --serialized-file /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn_resnet50_fpn_coco-bf2d0c1e.pth --handler object_detector --extra-files examples/object_detector/index_to_name.json --export-path /Users/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-01-13T03:20:27.8365430Z 2023-01-13T03:20:27.8366030Z ## maskrcnn.mar is generated. 2023-01-13T03:20:27.8366580Z 2023-01-13T03:20:27.8367160Z ## Starting gen_mar: model_store 2023-01-13T03:20:27.8367710Z 2023-01-13T03:20:27.8368260Z ## Create symlink for mar files 2023-01-13T03:20:27.8368850Z 2023-01-13T03:20:27.8369490Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T03:20:27.8443170Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T03:20:27.8444620Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T03:20:27.8461100Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T03:20:27.8466010Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T03:20:27.8466990Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T03:20:27.8467920Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T03:20:27.8470700Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T03:20:27.8477170Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T03:20:27.8478180Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T03:20:27.8479140Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T03:20:27.8479940Z ## Starting TorchServe 2023-01-13T03:20:27.8480650Z ## Console logs redirected to file: ts_console.log 2023-01-13T03:20:27.8537730Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs >> ts_console.log 2023-01-13T03:20:27.8538750Z ## Successfully started TorchServe 2023-01-13T03:20:27.8541720Z ## Stopping TorchServe 2023-01-13T03:20:27.8542710Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T03:20:27.8543540Z ## Successfully stopped TorchServe 2023-01-13T03:20:27.8544370Z ## Starting gen_mar: model_store 2023-01-13T03:20:27.8544960Z 2023-01-13T03:20:27.8545500Z ## Create symlink for mar files 2023-01-13T03:20:27.8546080Z 2023-01-13T03:20:27.8546720Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T03:20:27.8547640Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T03:20:27.8550540Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T03:20:27.8552420Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T03:20:27.8554800Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T03:20:27.8555730Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T03:20:27.8557070Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T03:20:27.8558480Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T03:20:27.8561590Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T03:20:27.8562530Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T03:20:27.8563500Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T03:20:27.8564330Z ## Starting TorchServe 2023-01-13T03:20:27.8565010Z ## Console logs redirected to file: ts_console.log 2023-01-13T03:20:27.8565950Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs >> ts_console.log 2023-01-13T03:20:27.8567260Z ## Successfully started TorchServe 2023-01-13T03:20:27.8573810Z ## Stopping TorchServe 2023-01-13T03:20:27.8575040Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T03:20:27.8575900Z ## Successfully stopped TorchServe 2023-01-13T03:20:27.8576610Z ## Starting gen_mar: model_store 2023-01-13T03:20:27.8577140Z 2023-01-13T03:20:27.8577580Z ## Create symlink for mar files 2023-01-13T03:20:27.8578080Z 2023-01-13T03:20:27.8580300Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T03:20:27.8581160Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T03:20:27.8582240Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T03:20:27.8583320Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T03:20:27.8584180Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T03:20:27.8585020Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T03:20:27.8585870Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T03:20:27.8586750Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T03:20:27.8589230Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T03:20:27.8590740Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T03:20:27.8591630Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T03:20:27.8593120Z ## Starting TorchServe 2023-01-13T03:20:27.8593800Z ## Console logs redirected to file: ts_console.log 2023-01-13T03:20:27.8595380Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties >> ts_console.log 2023-01-13T03:20:27.8596250Z ## Successfully started TorchServe 2023-01-13T03:20:27.8597940Z ## Stopping TorchServe 2023-01-13T03:20:27.8604190Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T03:20:27.8667880Z ## Successfully stopped TorchServe 2023-01-13T03:20:27.8710740Z ## Starting gen_mar: model_store 2023-01-13T03:20:27.8719040Z 2023-01-13T03:20:27.8759010Z ## Create symlink for mar files 2023-01-13T03:20:27.8767150Z 2023-01-13T03:20:27.8807170Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T03:20:27.8816150Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T03:20:27.8862300Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T03:20:27.8914970Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T03:20:27.8986760Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T03:20:27.9032030Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T03:20:27.9040920Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T03:20:27.9142270Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T03:20:27.9161950Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T03:20:27.9208050Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T03:20:27.9210840Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T03:20:27.9211540Z ## Starting TorchServe 2023-01-13T03:20:27.9212160Z ## Console logs redirected to file: ts_console.log 2023-01-13T03:20:27.9213330Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=resources/config.properties >> ts_console.log 2023-01-13T03:20:27.9275890Z ## Successfully started TorchServe 2023-01-13T03:20:27.9291490Z ## Stopping TorchServe 2023-01-13T03:20:27.9293500Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T03:20:27.9295090Z ## Successfully stopped TorchServe 2023-01-13T03:20:27.9296530Z ## Starting gen_mar: model_store 2023-01-13T03:20:27.9297750Z 2023-01-13T03:20:27.9298960Z ## Create symlink for mar files 2023-01-13T03:20:27.9301850Z 2023-01-13T03:20:27.9303220Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T03:20:27.9304880Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T03:20:27.9313720Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T03:20:27.9316880Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T03:20:27.9318680Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T03:20:27.9320320Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T03:20:27.9321590Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T03:20:27.9361230Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T03:20:27.9374140Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T03:20:38.8215070Z newman: could not find "htmlextra" reporter 2023-01-13T03:20:38.8220870Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:20:38.8224180Z please install reporter using npm 2023-01-13T03:20:38.8224840Z 2023-01-13T03:20:39.1163080Z newman 2023-01-13T03:20:39.1171450Z 2023-01-13T03:20:39.1176550Z kfv2_https_test_collection 2023-01-13T03:20:39.1215580Z 2023-01-13T03:20:39.1316570Z โ†’ HTTPS Inference API Description 2023-01-13T03:20:39.6703160Z OPTIONS https://localhost:8443 2023-01-13T03:20:39.6765660Z 200 OK โ˜… 437ms time โ˜… 230Bโ†‘ 23.67kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:39.6866050Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 23.41kB 2023-01-13T03:20:39.6908950Z โ”‚ { 2023-01-13T03:20:39.7010350Z โ”‚ "openapi": "3.0.1", 2023-01-13T03:20:39.7110780Z โ”‚ "info": { 2023-01-13T03:20:39.7211460Z โ”‚ "title": "TorchServe APIs", 2023-01-13T03:20:39.7311940Z โ”‚ "description": "TorchServe is a flexible and easy 2023-01-13T03:20:39.7413010Z โ”‚ to use tool for serving deep learning models", 2023-01-13T03:20:39.7513500Z โ”‚ "version": "0.7.0" 2023-01-13T03:20:39.7614730Z โ”‚ }, 2023-01-13T03:20:39.7715150Z โ”‚ "paths": { 2023-01-13T03:20:39.7815490Z โ”‚ "/": { 2023-01-13T03:20:39.7824570Z โ”‚ "options": { 2023-01-13T03:20:39.7926170Z โ”‚ "description": "Get openapi description.", 2023-01-13T03:20:39.7972780Z โ”‚ "operationId": "apiDescription", 2023-01-13T03:20:39.8074210Z โ”‚ "parameters": [], 2023-01-13T03:20:39.8154600Z โ”‚ "responses": { 2023-01-13T03:20:39.8256070Z โ”‚ "200": { 2023-01-13T03:20:39.8272420Z โ”‚ "description": "A openapi 3.0.1 descriptor 2023-01-13T03:20:39.8373630Z โ”‚ ", 2023-01-13T03:20:39.8475340Z โ”‚ "content": { 2023-01-13T03:20:39.8600660Z โ”‚ "application/json": { 2023-01-13T03:20:39.8683480Z โ”‚ "schema": { 2023-01-13T03:20:39.8785380Z โ”‚ "type": "object", 2023-01-13T03:20:39.8839360Z โ”‚ "required": [ 2023-01-13T03:20:39.8940660Z โ”‚ "openapi", 2023-01-13T03:20:39.9042040Z โ”‚ "info", 2023-01-13T03:20:39.9147540Z โ”‚ "paths" 2023-01-13T03:20:39.9245190Z โ”‚ ], 2023-01-13T03:20:39.9346670Z โ”‚ "properties": { 2023-01-13T03:20:39.9448110Z โ”‚ "openapi": { 2023-01-13T03:20:39.9549710Z โ”‚ "type": "string" 2023-01-13T03:20:39.9651190Z โ”‚ }, 2023-01-13T03:20:39.9751660Z โ”‚ "info": { 2023-01-13T03:20:39.9846450Z โ”‚ "type": "object" 2023-01-13T03:20:39.9851670Z โ”‚ }, 2023-01-13T03:20:39.9910110Z โ”‚ "paths": { 2023-01-13T03:20:40.0078250Z โ”‚ "type": "object" 2023-01-13T03:20:40.0106900Z โ”‚ } 2023-01-13T03:20:40.0125180Z โ”‚ } 2023-01-13T03:20:40.0226480Z โ”‚ } 2023-01-13T03:20:40.0326840Z โ”‚ } 2023-01-13T03:20:40.0428700Z โ”‚ } 2023-01-13T03:20:40.0514660Z โ”‚ }, 2023-01-13T03:20:40.0616190Z โ”‚ "500": { 2023-01-13T03:20:40.0616780Z โ”‚ "description": "Internal Server Error", 2023-01-13T03:20:40.0718090Z โ”‚ "content": { 2023-01-13T03:20:40.0819440Z โ”‚ "application/json": { 2023-01-13T03:20:40.0920840Z โ”‚ "schema": { 2023-01-13T03:20:40.1022280Z โ”‚ "type": "object", 2023-01-13T03:20:40.1123640Z โ”‚ "required": [ 2023-01-13T03:20:40.1224120Z โ”‚ "code", 2023-01-13T03:20:40.1305090Z โ”‚ "type", 2023-01-13T03:20:40.1406470Z โ”‚ "message" 2023-01-13T03:20:40.1480000Z โ”‚ ], 2023-01-13T03:20:40.1547400Z โ”‚ "properties": { 2023-01-13T03:20:40.1648720Z โ”‚ "code": { 2023-01-13T03:20:40.1750120Z โ”‚ "type": "integer", 2023-01-13T03:20:40.1851590Z โ”‚ "description": "Error code." 2023-01-13T03:20:40.1952930Z โ”‚ }, 2023-01-13T03:20:40.2054270Z โ”‚ "type": { 2023-01-13T03:20:40.2102250Z โ”‚ "type": "string", 2023-01-13T03:20:40.2144370Z โ”‚ "description": "Error type." 2023-01-13T03:20:40.2155770Z โ”‚ }, 2023-01-13T03:20:40.2208030Z โ”‚ "message": { 2023-01-13T03:20:40.2228120Z โ”‚ "type": "string", 2023-01-13T03:20:40.2242290Z โ”‚ "description": "Error message." 2023-01-13T03:20:40.2286390Z โ”‚ } 2023-01-13T03:20:40.2295650Z โ”‚ } 2023-01-13T03:20:40.2321280Z โ”‚ } 2023-01-13T03:20:40.2327800Z โ”‚ } 2023-01-13T03:20:40.2379730Z โ”‚ } 2023-01-13T03:20:40.2384390Z โ”‚ } 2023-01-13T03:20:40.2390140Z โ”‚ } 2023-01-13T03:20:40.2423510Z โ”‚ } 2023-01-13T03:20:40.2464800Z โ”‚ }, 2023-01-13T03:20:40.2499350Z โ”‚ "/ping": { 2023-01-13T03:20:40.2507290Z โ”‚ 2023-01-13T03:20:40.2515670Z โ”‚ (showing 2.05kB/23.41kB) 2023-01-13T03:20:40.2543170Z โ”” 2023-01-13T03:20:40.2581350Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:40.2638350Z 82ms 19ms 1ms 2ms 345ms 55ms 12ms 636ยตs 519ms 2023-01-13T03:20:40.2646090Z 2023-01-13T03:20:40.2688590Z โœ“ Status code is 200 2023-01-13T03:20:40.2724150Z 2023-01-13T03:20:40.2799500Z โ†’ HTTPS Management API Description 2023-01-13T03:20:40.2841040Z OPTIONS https://localhost:8444 2023-01-13T03:20:40.2849370Z 200 OK โ˜… 78ms time โ˜… 230Bโ†‘ 58.87kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:40.2878610Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 58.6kB 2023-01-13T03:20:40.2896610Z โ”‚ { 2023-01-13T03:20:40.2905920Z โ”‚ "openapi": "3.0.1", 2023-01-13T03:20:40.2945270Z โ”‚ "info": { 2023-01-13T03:20:40.2953130Z โ”‚ "title": "TorchServe APIs", 2023-01-13T03:20:40.2972190Z โ”‚ "description": "TorchServe is a flexible and easy 2023-01-13T03:20:40.3000430Z โ”‚ to use tool for serving deep learning models", 2023-01-13T03:20:40.3005260Z โ”‚ "version": "0.7.0" 2023-01-13T03:20:40.3008840Z โ”‚ }, 2023-01-13T03:20:40.3061280Z โ”‚ "paths": { 2023-01-13T03:20:40.3077420Z โ”‚ "/": { 2023-01-13T03:20:40.3079700Z โ”‚ "options": { 2023-01-13T03:20:40.3120760Z โ”‚ "description": "Get openapi description.", 2023-01-13T03:20:40.3124060Z โ”‚ "operationId": "apiDescription", 2023-01-13T03:20:40.3128260Z โ”‚ "parameters": [], 2023-01-13T03:20:40.3168540Z โ”‚ "responses": { 2023-01-13T03:20:40.3200090Z โ”‚ "200": { 2023-01-13T03:20:40.3301480Z โ”‚ "description": "A openapi 3.0.1 descriptor 2023-01-13T03:20:40.3402840Z โ”‚ ", 2023-01-13T03:20:40.3504320Z โ”‚ "content": { 2023-01-13T03:20:40.3605770Z โ”‚ "application/json": { 2023-01-13T03:20:40.3707220Z โ”‚ "schema": { 2023-01-13T03:20:40.3808690Z โ”‚ "type": "object", 2023-01-13T03:20:40.3910200Z โ”‚ "required": [ 2023-01-13T03:20:40.4073810Z โ”‚ "openapi", 2023-01-13T03:20:40.4134340Z โ”‚ "info", 2023-01-13T03:20:40.4235800Z โ”‚ "paths" 2023-01-13T03:20:40.4253280Z โ”‚ ], 2023-01-13T03:20:40.4354630Z โ”‚ "properties": { 2023-01-13T03:20:40.4456110Z โ”‚ "openapi": { 2023-01-13T03:20:40.4557820Z โ”‚ "type": "string" 2023-01-13T03:20:40.4659220Z โ”‚ }, 2023-01-13T03:20:40.4665860Z โ”‚ "info": { 2023-01-13T03:20:40.4767170Z โ”‚ "type": "object" 2023-01-13T03:20:40.4867430Z โ”‚ }, 2023-01-13T03:20:40.4968860Z โ”‚ "paths": { 2023-01-13T03:20:40.5069140Z โ”‚ "type": "object" 2023-01-13T03:20:40.5170490Z โ”‚ } 2023-01-13T03:20:40.5270850Z โ”‚ } 2023-01-13T03:20:40.5372150Z โ”‚ } 2023-01-13T03:20:40.5458240Z โ”‚ } 2023-01-13T03:20:40.5525130Z โ”‚ } 2023-01-13T03:20:40.5587790Z โ”‚ }, 2023-01-13T03:20:40.5653380Z โ”‚ "500": { 2023-01-13T03:20:40.5754660Z โ”‚ "description": "Internal Server Error", 2023-01-13T03:20:40.5855990Z โ”‚ "content": { 2023-01-13T03:20:40.5937160Z โ”‚ "application/json": { 2023-01-13T03:20:40.6038740Z โ”‚ "schema": { 2023-01-13T03:20:40.6139290Z โ”‚ "type": "object", 2023-01-13T03:20:40.6240610Z โ”‚ "required": [ 2023-01-13T03:20:40.6292990Z โ”‚ "code", 2023-01-13T03:20:40.6332770Z โ”‚ "type", 2023-01-13T03:20:40.6434540Z โ”‚ "message" 2023-01-13T03:20:40.6536030Z โ”‚ ], 2023-01-13T03:20:40.6637630Z โ”‚ "properties": { 2023-01-13T03:20:40.6727710Z โ”‚ "code": { 2023-01-13T03:20:40.6809430Z โ”‚ "type": "integer", 2023-01-13T03:20:40.6905370Z โ”‚ "description": "Error code." 2023-01-13T03:20:40.7006860Z โ”‚ }, 2023-01-13T03:20:40.7108650Z โ”‚ "type": { 2023-01-13T03:20:40.7210750Z โ”‚ "type": "string", 2023-01-13T03:20:40.7277410Z โ”‚ "description": "Error type." 2023-01-13T03:20:40.7378950Z โ”‚ }, 2023-01-13T03:20:40.7379450Z โ”‚ "message": { 2023-01-13T03:20:40.7469580Z โ”‚ "type": "string", 2023-01-13T03:20:40.7571020Z โ”‚ "description": "Error message." 2023-01-13T03:20:40.7596390Z โ”‚ } 2023-01-13T03:20:40.7659550Z โ”‚ } 2023-01-13T03:20:40.7681620Z โ”‚ } 2023-01-13T03:20:40.7721460Z โ”‚ } 2023-01-13T03:20:40.7765830Z โ”‚ } 2023-01-13T03:20:40.7845870Z โ”‚ } 2023-01-13T03:20:40.7936690Z โ”‚ } 2023-01-13T03:20:40.7988570Z โ”‚ } 2023-01-13T03:20:40.8037020Z โ”‚ }, 2023-01-13T03:20:40.8052550Z โ”‚ "/models": { 2023-01-13T03:20:40.8146850Z โ”‚ 2023-01-13T03:20:40.8248180Z โ”‚ (showing 2.05kB/58.6kB) 2023-01-13T03:20:40.8349360Z โ”” 2023-01-13T03:20:40.8450990Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:40.8497690Z 2ms 1ms 278ยตs 417ยตs 50ms 20ms 3ms 94ยตs 79ms 2023-01-13T03:20:40.8533070Z 2023-01-13T03:20:40.8599220Z โœ“ Status code is 200 2023-01-13T03:20:40.8633990Z 2023-01-13T03:20:40.8642360Z โ†’ HTTPS Metrics API Description 2023-01-13T03:20:40.8681710Z OPTIONS https://localhost:8445 2023-01-13T03:20:40.8690430Z 200 OK โ˜… 74ms time โ˜… 230Bโ†‘ 2.82kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:40.8756140Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 2.55kB 2023-01-13T03:20:40.8777100Z โ”‚ { 2023-01-13T03:20:40.8795420Z โ”‚ "openapi": "3.0.1", 2023-01-13T03:20:40.8799400Z โ”‚ "info": { 2023-01-13T03:20:40.8802430Z โ”‚ "title": "TorchServe APIs", 2023-01-13T03:20:40.8805500Z โ”‚ "description": "TorchServe is a flexible and easy 2023-01-13T03:20:40.8837680Z โ”‚ to use tool for serving deep learning models", 2023-01-13T03:20:40.8838130Z โ”‚ "version": "0.7.0" 2023-01-13T03:20:40.8844350Z โ”‚ }, 2023-01-13T03:20:40.8871730Z โ”‚ "paths": { 2023-01-13T03:20:40.8917890Z โ”‚ "/metrics": { 2023-01-13T03:20:40.8951360Z โ”‚ "get": { 2023-01-13T03:20:40.8963110Z โ”‚ "description": "Get TorchServe application met 2023-01-13T03:20:40.8965290Z โ”‚ rics in prometheus format.", 2023-01-13T03:20:40.8994290Z โ”‚ "operationId": "metrics", 2023-01-13T03:20:40.9023200Z โ”‚ "parameters": [ 2023-01-13T03:20:40.9046010Z โ”‚ { 2023-01-13T03:20:40.9048940Z โ”‚ "in": "query", 2023-01-13T03:20:40.9050050Z โ”‚ "name": "name[]", 2023-01-13T03:20:40.9051430Z โ”‚ "description": "Names of metrics to filter 2023-01-13T03:20:40.9053600Z โ”‚ ", 2023-01-13T03:20:40.9055170Z โ”‚ "required": false, 2023-01-13T03:20:40.9057030Z โ”‚ "schema": { 2023-01-13T03:20:40.9076430Z โ”‚ "type": "string" 2023-01-13T03:20:40.9101360Z โ”‚ } 2023-01-13T03:20:40.9127860Z โ”‚ } 2023-01-13T03:20:40.9134750Z โ”‚ ], 2023-01-13T03:20:40.9137800Z โ”‚ "responses": { 2023-01-13T03:20:40.9170460Z โ”‚ "200": { 2023-01-13T03:20:40.9174450Z โ”‚ "description": "TorchServe application met 2023-01-13T03:20:40.9183220Z โ”‚ rics", 2023-01-13T03:20:40.9214440Z โ”‚ "content": { 2023-01-13T03:20:40.9222820Z โ”‚ "text/plain; version=0.0.4; charset=utf- 2023-01-13T03:20:40.9226080Z โ”‚ 8": { 2023-01-13T03:20:40.9229830Z โ”‚ "schema": { 2023-01-13T03:20:40.9248720Z โ”‚ "type": "object", 2023-01-13T03:20:40.9255830Z โ”‚ "required": [ 2023-01-13T03:20:40.9286610Z โ”‚ "# HELP", 2023-01-13T03:20:40.9307220Z โ”‚ "# TYPE", 2023-01-13T03:20:40.9333250Z โ”‚ "metric" 2023-01-13T03:20:40.9345990Z โ”‚ ], 2023-01-13T03:20:40.9350400Z โ”‚ "properties": { 2023-01-13T03:20:40.9383610Z โ”‚ "# HELP": { 2023-01-13T03:20:40.9446320Z โ”‚ "type": "string", 2023-01-13T03:20:40.9548320Z โ”‚ "description": "Help text for To 2023-01-13T03:20:40.9655030Z โ”‚ rchServe metric." 2023-01-13T03:20:40.9757760Z โ”‚ }, 2023-01-13T03:20:40.9797850Z โ”‚ "# TYPE": { 2023-01-13T03:20:40.9889830Z โ”‚ "type": "string", 2023-01-13T03:20:40.9991300Z โ”‚ "description": "Type of TorchSer 2023-01-13T03:20:41.0092670Z โ”‚ ve metric." 2023-01-13T03:20:41.0193970Z โ”‚ }, 2023-01-13T03:20:41.0257780Z โ”‚ "metric": { 2023-01-13T03:20:41.0300060Z โ”‚ "type": "string", 2023-01-13T03:20:41.0357650Z โ”‚ "description": "TorchServe appli 2023-01-13T03:20:41.0364990Z โ”‚ cation metric." 2023-01-13T03:20:41.0464810Z โ”‚ } 2023-01-13T03:20:41.0480980Z โ”‚ } 2023-01-13T03:20:41.0517100Z โ”‚ } 2023-01-13T03:20:41.0526780Z โ”‚ } 2023-01-13T03:20:41.0563570Z โ”‚ } 2023-01-13T03:20:41.0570550Z โ”‚ }, 2023-01-13T03:20:41.0608190Z โ”‚ "500": { 2023-01-13T03:20:41.0615540Z โ”‚ "description": "Internal Server Error", 2023-01-13T03:20:41.0651280Z โ”‚ "content": { 2023-01-13T03:20:41.0658330Z โ”‚ "application/json": { 2023-01-13T03:20:41.0693290Z โ”‚ "schema": { 2023-01-13T03:20:41.0700230Z โ”‚ "type": "object", 2023-01-13T03:20:41.0712870Z โ”‚ "required": [ 2023-01-13T03:20:41.0736850Z โ”‚ "code", 2023-01-13T03:20:41.0744670Z โ”‚ "type", 2023-01-13T03:20:41.0778710Z โ”‚ "message" 2023-01-13T03:20:41.0787950Z โ”‚ ], 2023-01-13T03:20:41.0825920Z โ”‚ "properties": { 2023-01-13T03:20:41.0834070Z โ”‚ "code": { 2023-01-13T03:20:41.0866170Z โ”‚ 2023-01-13T03:20:41.0869810Z โ”‚ (showing 2.05kB/2.55kB) 2023-01-13T03:20:41.0876450Z โ”” 2023-01-13T03:20:41.0915480Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:41.0925720Z 2ms 1ms 236ยตs 2ms 63ms 3ms 2ms 90ยตs 76ms 2023-01-13T03:20:41.0961560Z 2023-01-13T03:20:41.0968510Z โœ“ Status code is 200 2023-01-13T03:20:41.1008070Z 2023-01-13T03:20:41.1015080Z โ†’ HTTPS Register Model - Mnist 2023-01-13T03:20:43.5134560Z POST https://localhost:8444/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-01-13T03:20:43.5164360Z 200 OK โ˜… 3.2s time โ˜… 318Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:43.5166060Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:20:43.5166710Z โ”‚ { 2023-01-13T03:20:43.5167450Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:20:43.5168140Z โ”‚ ith 1 initial workers" 2023-01-13T03:20:43.5170350Z โ”‚ } 2023-01-13T03:20:43.5170610Z โ”” 2023-01-13T03:20:43.5171090Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:43.5171620Z 9ms 633ยตs (cache) (cache) (cache) 3.2s 2ms 113ยตs 3.2s 2023-01-13T03:20:43.5171800Z 2023-01-13T03:20:43.5256350Z โœ“ Successful POST request 2023-01-13T03:20:43.5318260Z 2023-01-13T03:20:43.5319000Z โ†’ HTTPS Get Mnist Model Description 2023-01-13T03:20:43.5470320Z GET https://localhost:8444/models/mnist 2023-01-13T03:20:43.5471670Z 200 OK โ˜… 8ms time โ˜… 238Bโ†‘ 737Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:43.5472680Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 470B 2023-01-13T03:20:43.5473450Z โ”‚ [ 2023-01-13T03:20:43.5474080Z โ”‚ { 2023-01-13T03:20:43.5476250Z โ”‚ "modelName": "mnist", 2023-01-13T03:20:43.5477030Z โ”‚ "modelVersion": "1.0", 2023-01-13T03:20:43.5477760Z โ”‚ "modelUrl": "mnist.mar", 2023-01-13T03:20:43.5478460Z โ”‚ "runtime": "python", 2023-01-13T03:20:43.5479140Z โ”‚ "minWorkers": 1, 2023-01-13T03:20:43.5479820Z โ”‚ "maxWorkers": 1, 2023-01-13T03:20:43.5480490Z โ”‚ "batchSize": 1, 2023-01-13T03:20:43.5481180Z โ”‚ "maxBatchDelay": 100, 2023-01-13T03:20:43.5481880Z โ”‚ "loadedAtStartup": false, 2023-01-13T03:20:43.5482570Z โ”‚ "workers": [ 2023-01-13T03:20:43.5484820Z โ”‚ { 2023-01-13T03:20:43.5485520Z โ”‚ "id": "9000", 2023-01-13T03:20:43.5486270Z โ”‚ "startTime": "2023-01-13T03:20:40.934Z", 2023-01-13T03:20:43.5486990Z โ”‚ "status": "READY", 2023-01-13T03:20:43.5487680Z โ”‚ "memoryUsage": 0, 2023-01-13T03:20:43.5488390Z โ”‚ "pid": 58671, 2023-01-13T03:20:43.5489070Z โ”‚ "gpu": false, 2023-01-13T03:20:43.5489750Z โ”‚ "gpuUsage": "N/A" 2023-01-13T03:20:43.5490380Z โ”‚ } 2023-01-13T03:20:43.5492540Z โ”‚ ] 2023-01-13T03:20:43.5493210Z โ”‚ } 2023-01-13T03:20:43.5493840Z โ”‚ ] 2023-01-13T03:20:43.5500660Z โ”” 2023-01-13T03:20:43.5501620Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:43.5502520Z 1ms 411ยตs (cache) (cache) (cache) 5ms 1ms 64ยตs 8ms 2023-01-13T03:20:43.5503070Z 2023-01-13T03:20:43.5564180Z โœ“ Successful GET request 2023-01-13T03:20:43.5646880Z 2023-01-13T03:20:43.5647980Z โ†’ HTTPS Scale up Workers - Synchronous for Mnist 2023-01-13T03:20:50.1705070Z PUT https://localhost:8444/models/mnist?min_worker=5&max_worker=5&synchronous=true 2023-01-13T03:20:50.1721940Z 200 OK โ˜… 6.5s time โ˜… 300Bโ†‘ 321Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:50.1739100Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 55B 2023-01-13T03:20:50.1741950Z โ”‚ { 2023-01-13T03:20:50.1742780Z โ”‚ "status": "Workers scaled to 5 for model: mnist" 2023-01-13T03:20:50.1743490Z โ”‚ } 2023-01-13T03:20:50.1745440Z โ”” 2023-01-13T03:20:50.1747990Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:50.1749090Z 1ms 357ยตs (cache) (cache) (cache) 6.5s 1ms 62ยตs 6.5s 2023-01-13T03:20:50.1752730Z 2023-01-13T03:20:50.1823780Z โœ“ Successful PUT request 2023-01-13T03:20:50.1898360Z 2023-01-13T03:20:50.1900850Z โ†’ HTTPS Scale up Workers - Asynchronous for Mnist 2023-01-13T03:20:50.2085300Z PUT https://localhost:8444/models/mnist?min_worker=6&max_worker=6&synchronous=false 2023-01-13T03:20:50.2176310Z 202 Accepted โ˜… 8ms time โ˜… 301Bโ†‘ 319Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:50.2232470Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:20:50.2272070Z โ”‚ { 2023-01-13T03:20:50.2373540Z โ”‚ "status": "Processing worker updates..." 2023-01-13T03:20:50.2375770Z โ”‚ } 2023-01-13T03:20:50.2476860Z โ”” 2023-01-13T03:20:50.2574460Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:50.2676650Z 1ms 388ยตs (cache) (cache) (cache) 3ms 3ms 54ยตs 9ms 2023-01-13T03:20:50.2777600Z 2023-01-13T03:20:50.2847740Z โœ“ Successful PUT request 2023-01-13T03:20:50.2889580Z 2023-01-13T03:20:50.2974560Z โ†’ HTTPS - Inference - Mnist_KF 2023-01-13T03:20:50.3007340Z POST https://localhost:8443/v2/models/mnist/infer 2023-01-13T03:20:50.3008460Z 200 OK โ˜… 27ms time โ˜… 7kBโ†‘ 473Bโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:50.3009160Z โ”Œ โ†‘ file โ˜… 6.73kB 2023-01-13T03:20:50.3026860Z โ”‚ (showing 2.05kB/6.73kB) 2023-01-13T03:20:50.3054820Z โ”” 2023-01-13T03:20:50.3130030Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 238B 2023-01-13T03:20:50.3186070Z โ”‚ { 2023-01-13T03:20:50.3213990Z โ”‚ "id": "d3b15cad-50a2-4eaf-80ce-8b0a428bd298", 2023-01-13T03:20:50.3260710Z โ”‚ "model_name": "mnist", 2023-01-13T03:20:50.3337420Z โ”‚ "model_version": "1.0", 2023-01-13T03:20:50.3411780Z โ”‚ "outputs": [ 2023-01-13T03:20:50.3443950Z โ”‚ { 2023-01-13T03:20:50.3456010Z โ”‚ "name": "predict", 2023-01-13T03:20:50.3470140Z โ”‚ "shape": [], 2023-01-13T03:20:50.3501990Z โ”‚ "datatype": "INT64", 2023-01-13T03:20:50.3561720Z โ”‚ "data": [ 2023-01-13T03:20:50.3572240Z โ”‚ 1 2023-01-13T03:20:50.3668670Z โ”‚ ] 2023-01-13T03:20:50.3670550Z โ”‚ } 2023-01-13T03:20:50.3673890Z โ”‚ ] 2023-01-13T03:20:50.3675370Z โ”‚ } 2023-01-13T03:20:50.3676890Z โ”” 2023-01-13T03:20:50.3678600Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:50.3680340Z 8ms 829ยตs (cache) (cache) (cache) 24ms 1ms 53ยตs 34ms 2023-01-13T03:20:50.3681780Z 2023-01-13T03:20:50.3683150Z โœ“ Status code is 200 2023-01-13T03:20:50.3685680Z 2023-01-13T03:20:50.3686960Z โ†’ HTTPS - Explanations - Mnist_KF 2023-01-13T03:20:50.3985760Z POST https://localhost:8443/v2/models/mnist/explain 2023-01-13T03:20:50.4023870Z 200 OK โ˜… 80ms time โ˜… 7kBโ†‘ 14.06kBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:50.4124880Z โ”Œ โ†‘ file โ˜… 6.73kB 2023-01-13T03:20:50.4158630Z โ”‚ (showing 2.05kB/6.73kB) 2023-01-13T03:20:50.4159300Z โ”” 2023-01-13T03:20:50.4160060Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 13.82kB 2023-01-13T03:20:50.4160750Z โ”‚ { 2023-01-13T03:20:50.4161610Z โ”‚ "id": "d3b15cad-50a2-4eaf-80ce-8b0a428bd298", 2023-01-13T03:20:50.4162960Z โ”‚ "model_name": "mnist", 2023-01-13T03:20:50.4165180Z โ”‚ "model_version": "1.0", 2023-01-13T03:20:50.4165900Z โ”‚ "outputs": [ 2023-01-13T03:20:50.4166540Z โ”‚ { 2023-01-13T03:20:50.4167210Z โ”‚ "name": "explain", 2023-01-13T03:20:50.4168320Z โ”‚ "shape": [ 2023-01-13T03:20:50.4169070Z โ”‚ 1, 2023-01-13T03:20:50.4172850Z โ”‚ 28, 2023-01-13T03:20:50.4173490Z โ”‚ 28 2023-01-13T03:20:50.4174110Z โ”‚ ], 2023-01-13T03:20:50.4174790Z โ”‚ "datatype": "FP64", 2023-01-13T03:20:50.4175440Z โ”‚ "data": [ 2023-01-13T03:20:50.4176050Z โ”‚ -0.0, 2023-01-13T03:20:50.4176740Z โ”‚ -0.0, 2023-01-13T03:20:50.4177380Z โ”‚ -0.0, 2023-01-13T03:20:50.4177990Z โ”‚ -0.0, 2023-01-13T03:20:50.4178610Z โ”‚ -0.0, 2023-01-13T03:20:50.4180340Z โ”‚ -0.0, 2023-01-13T03:20:50.4181060Z โ”‚ -0.0, 2023-01-13T03:20:50.4181720Z โ”‚ -0.0, 2023-01-13T03:20:50.4182730Z โ”‚ -0.0, 2023-01-13T03:20:50.4183390Z โ”‚ -0.0, 2023-01-13T03:20:50.4184010Z โ”‚ -0.0, 2023-01-13T03:20:50.4195360Z โ”‚ -0.0, 2023-01-13T03:20:50.4196020Z โ”‚ -0.0, 2023-01-13T03:20:50.4196660Z โ”‚ -0.0, 2023-01-13T03:20:50.4197280Z โ”‚ -0.0, 2023-01-13T03:20:50.4197920Z โ”‚ -0.0, 2023-01-13T03:20:50.4198550Z โ”‚ 0.0, 2023-01-13T03:20:50.4199160Z โ”‚ -0.0, 2023-01-13T03:20:50.4199800Z โ”‚ -0.0, 2023-01-13T03:20:50.4200410Z โ”‚ 0.0, 2023-01-13T03:20:50.4202310Z โ”‚ -0.0, 2023-01-13T03:20:50.4202950Z โ”‚ 0.0, 2023-01-13T03:20:50.4203580Z โ”‚ -0.0, 2023-01-13T03:20:50.4204190Z โ”‚ -0.0, 2023-01-13T03:20:50.4204800Z โ”‚ -0.0, 2023-01-13T03:20:50.4205420Z โ”‚ -0.0, 2023-01-13T03:20:50.4206040Z โ”‚ -0.0, 2023-01-13T03:20:50.4206720Z โ”‚ 0.0, 2023-01-13T03:20:50.4207420Z โ”‚ -0.0, 2023-01-13T03:20:50.4308570Z โ”‚ -0.0, 2023-01-13T03:20:50.4331630Z โ”‚ -0.0, 2023-01-13T03:20:50.4339830Z โ”‚ -0.0, 2023-01-13T03:20:50.4341350Z โ”‚ -0.0, 2023-01-13T03:20:50.4342140Z โ”‚ -0.0, 2023-01-13T03:20:50.4343000Z โ”‚ -0.0, 2023-01-13T03:20:50.4343730Z โ”‚ 0.0, 2023-01-13T03:20:50.4344370Z โ”‚ -0.0, 2023-01-13T03:20:50.4345000Z โ”‚ 0.0, 2023-01-13T03:20:50.4345830Z โ”‚ -0.0, 2023-01-13T03:20:50.4346460Z โ”‚ -0.0, 2023-01-13T03:20:50.4347280Z โ”‚ -0.0, 2023-01-13T03:20:50.4348100Z โ”‚ 0.0, 2023-01-13T03:20:50.4348910Z โ”‚ 0.0, 2023-01-13T03:20:50.4349540Z โ”‚ 0.0, 2023-01-13T03:20:50.4350180Z โ”‚ 0.0, 2023-01-13T03:20:50.4350820Z โ”‚ 0.0, 2023-01-13T03:20:50.4428230Z โ”‚ 0.0, 2023-01-13T03:20:50.4430340Z โ”‚ 0.0, 2023-01-13T03:20:50.4431880Z โ”‚ 0.0, 2023-01-13T03:20:50.4433340Z โ”‚ 0.0, 2023-01-13T03:20:50.4447610Z โ”‚ -0.0, 2023-01-13T03:20:50.4449140Z โ”‚ -0.0, 2023-01-13T03:20:50.4450790Z โ”‚ 0.0, 2023-01-13T03:20:50.4452140Z โ”‚ 0.0, 2023-01-13T03:20:50.4453540Z โ”‚ -0.0, 2023-01-13T03:20:50.4455040Z โ”‚ 0.0, 2023-01-13T03:20:50.4457890Z โ”‚ -0.0, 2023-01-13T03:20:50.4459290Z โ”‚ -0.0, 2023-01-13T03:20:50.4460710Z โ”‚ -0.0, 2023-01-13T03:20:50.4462230Z โ”‚ -0.0, 2023-01-13T03:20:50.4463720Z โ”‚ -0.0, 2023-01-13T03:20:50.4465180Z โ”‚ 0.0, 2023-01-13T03:20:50.4566550Z โ”‚ 0.0, 2023-01-13T03:20:50.4570620Z โ”‚ 0.0, 2023-01-13T03:20:50.4572080Z โ”‚ 0.0, 2023-01-13T03:20:50.4574890Z โ”‚ 0.0, 2023-01-13T03:20:50.4576330Z โ”‚ 0.0, 2023-01-13T03:20:50.4577810Z โ”‚ 0.0, 2023-01-13T03:20:50.4579260Z โ”‚ 0.0, 2023-01-13T03:20:50.4580640Z โ”‚ 0.0, 2023-01-13T03:20:50.4582020Z โ”‚ -0.0, 2023-01-13T03:20:50.4583390Z โ”‚ -0.0, 2023-01-13T03:20:50.4584770Z โ”‚ -0.0, 2023-01-13T03:20:50.4587730Z โ”‚ 0.0, 2023-01-13T03:20:50.4589260Z โ”‚ -0.0, 2023-01-13T03:20:50.4590840Z โ”‚ 0.0, 2023-01-13T03:20:50.4592370Z โ”‚ 0.0, 2023-01-13T03:20:50.4593790Z โ”‚ 0.0, 2023-01-13T03:20:50.4673630Z โ”‚ -0.0, 2023-01-13T03:20:50.4676770Z โ”‚ -0.0, 2023-01-13T03:20:50.4678270Z โ”‚ -0.0, 2023-01-13T03:20:50.4680220Z โ”‚ 0.0, 2023-01-13T03:20:50.4681690Z โ”‚ -0.0, 2023-01-13T03:20:50.4683160Z โ”‚ 0.0, 2023-01-13T03:20:50.4684540Z โ”‚ -0.0, 2023-01-13T03:20:50.4685890Z โ”‚ -0.0, 2023-01-13T03:20:50.4688640Z โ”‚ -0.0, 2023-01-13T03:20:50.4690100Z โ”‚ -0.0, 2023-01-13T03:20:50.4691470Z โ”‚ 0.0, 2023-01-13T03:20:50.4692820Z โ”‚ 0.0, 2023-01-13T03:20:50.4694180Z โ”‚ 0.0, 2023-01-13T03:20:50.4695550Z โ”‚ 0.0, 2023-01-13T03:20:50.4696890Z โ”‚ 0.0, 2023-01-13T03:20:50.4698320Z โ”‚ 0.0, 2023-01-13T03:20:50.4701180Z โ”‚ 0.0, 2023-01-13T03:20:50.4702560Z โ”‚ -0.0, 2023-01-13T03:20:50.4709100Z โ”‚ -0.0, 2023-01-13T03:20:50.4810520Z โ”‚ 0.0, 2023-01-13T03:20:50.4852520Z โ”‚ 0.0, 2023-01-13T03:20:50.4854160Z โ”‚ -0.0, 2023-01-13T03:20:50.4878840Z โ”‚ -0.0, 2023-01-13T03:20:50.4880400Z โ”‚ -0.0, 2023-01-13T03:20:50.4884450Z โ”‚ -0.0, 2023-01-13T03:20:50.4885230Z โ”‚ -0.0, 2023-01-13T03:20:50.4885850Z โ”‚ 0.0, 2023-01-13T03:20:50.4886800Z โ”‚ 0.0, 2023-01-13T03:20:50.4887640Z โ”‚ -0.0, 2023-01-13T03:20:50.4888410Z โ”‚ -0.0, 2023-01-13T03:20:50.4889010Z โ”‚ -0.0, 2023-01-13T03:20:50.4889650Z โ”‚ 0.0, 2023-01-13T03:20:50.4890440Z โ”‚ 0.0, 2023-01-13T03:20:50.4891060Z โ”‚ 0.0, 2023-01-13T03:20:50.4891700Z โ”‚ -0.0, 2023-01-13T03:20:50.4895310Z โ”‚ -0.0, 2023-01-13T03:20:50.4895970Z โ”‚ -0.0, 2023-01-13T03:20:50.4896740Z โ”‚ -0.0, 2023-01-13T03:20:50.4897380Z โ”‚ 0.0, 2023-01-13T03:20:50.4898030Z โ”‚ 0.0, 2023-01-13T03:20:50.4898690Z โ”‚ 0.0, 2023-01-13T03:20:50.4899470Z โ”‚ 0.0, 2023-01-13T03:20:50.4900100Z โ”‚ 0.0, 2023-01-13T03:20:50.4900730Z โ”‚ 0.0, 2023-01-13T03:20:50.4901350Z โ”‚ -0.0, 2023-01-13T03:20:50.4902040Z โ”‚ -0.004054753035685658, 2023-01-13T03:20:50.4903990Z โ”‚ -0.00022612878154812334, 2023-01-13T03:20:50.4904730Z โ”‚ -0.00012734145263588084, 2023-01-13T03:20:50.4905440Z โ”‚ 0.005648369412447205, 2023-01-13T03:20:50.4906070Z โ”‚ 2023-01-13T03:20:50.4906810Z โ”‚ (showing 2.05kB/13.82kB) 2023-01-13T03:20:50.4907430Z โ”” 2023-01-13T03:20:50.4908760Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:50.4909720Z 3ms 365ยตs (cache) (cache) (cache) 77ms 1ms 46ยตs 82ms 2023-01-13T03:20:50.4910250Z 2023-01-13T03:20:50.4912170Z โœ“ Status code is 200 2023-01-13T03:20:50.4912690Z 2023-01-13T03:20:50.4913190Z โ†’ HTTPS UnRegister Model Mnist 2023-01-13T03:20:50.5128990Z DELETE https://localhost:8444/models/mnist 2023-01-13T03:20:50.5131640Z 200 OK โ˜… 89ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:20:50.5132540Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:20:50.5133290Z โ”‚ { 2023-01-13T03:20:50.5134020Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:20:50.5134670Z โ”‚ } 2023-01-13T03:20:50.5157210Z โ”” 2023-01-13T03:20:50.5158220Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-01-13T03:20:50.5159220Z 1ms 341ยตs (cache) (cache) (cache) 82ms 5ms 49ยตs 89ms 2023-01-13T03:20:50.5159770Z 2023-01-13T03:20:50.5294740Z โœ“ Successful DELETE request 2023-01-13T03:20:50.5416840Z 2023-01-13T03:20:50.5418240Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:20:50.5418990Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:20:50.5461800Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5476890Z โ”‚ iterations โ”‚ 1 โ”‚ 0 โ”‚ 2023-01-13T03:20:50.5478280Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5479170Z โ”‚ requests โ”‚ 10 โ”‚ 0 โ”‚ 2023-01-13T03:20:50.5480020Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5485140Z โ”‚ test-scripts โ”‚ 10 โ”‚ 0 โ”‚ 2023-01-13T03:20:50.5496920Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5526480Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:20:50.5527420Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5527880Z โ”‚ assertions โ”‚ 10 โ”‚ 0 โ”‚ 2023-01-13T03:20:50.5528390Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5528790Z โ”‚ total run duration: 11.4s โ”‚ 2023-01-13T03:20:50.5529600Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5530430Z โ”‚ total data received: 99.32kB (approx) โ”‚ 2023-01-13T03:20:50.5531280Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5532950Z โ”‚ average response time: 1066ms [min: 8ms, max: 6.5s, s.d.: 2s] โ”‚ 2023-01-13T03:20:50.5533820Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5534310Z โ”‚ average DNS lookup time: 816ยตs [min: 236ยตs, max: 1ms, s.d.: 790ยตs] โ”‚ 2023-01-13T03:20:50.5535150Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:20:50.5535950Z โ”‚ average first byte time: 1013ms [min: 3ms, max: 6.5s, s.d.: 2s] โ”‚ 2023-01-13T03:20:50.5536820Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:20:50.6485050Z TorchServe has stopped. 2023-01-13T03:21:11.6410640Z newman: could not find "htmlextra" reporter 2023-01-13T03:21:11.6417110Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:21:11.6488450Z please install reporter using npm 2023-01-13T03:21:11.6520240Z 2023-01-13T03:21:11.9049900Z newman 2023-01-13T03:21:11.9050700Z 2023-01-13T03:21:11.9051390Z explanation_api_test_collection 2023-01-13T03:21:11.9167120Z 2023-01-13T03:21:11.9268670Z โ†’ Model Zoo - Register Model 2023-01-13T03:21:15.0378730Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-01-13T03:21:15.0414340Z 200 OK โ˜… 3s time โ˜… 318Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:15.0458050Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:21:15.0458810Z โ”‚ { 2023-01-13T03:21:15.0459590Z โ”‚ "status": "Model \"mnist\" Version: 1.0 registered w 2023-01-13T03:21:15.0461220Z โ”‚ ith 1 initial workers" 2023-01-13T03:21:15.0461880Z โ”‚ } 2023-01-13T03:21:15.0486760Z โ”” 2023-01-13T03:21:15.0488040Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:15.0488980Z 53ms 7ms 2ms 458ยตs 3s 10ms 585ยตs 3.1s 2023-01-13T03:21:15.0489520Z 2023-01-13T03:21:15.0771910Z โœ“ Successful POST request 2023-01-13T03:21:15.0916330Z 2023-01-13T03:21:15.0917460Z โ†’ Model Zoo - Explanations Model 2023-01-13T03:21:15.2234650Z POST http://localhost:8080/explanations/mnist 2023-01-13T03:21:15.2335770Z 200 OK โ˜… 113ms time โ˜… 538Bโ†‘ 23.2kBโ†“ size โ˜… 8โ†‘ 6โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:15.2437330Z โ”Œ โ†‘ file โ˜… 272B 2023-01-13T03:21:15.2538790Z โ”‚ 2023-01-13T03:21:15.2639100Z โ”” 2023-01-13T03:21:15.2740650Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 22.96kB 2023-01-13T03:21:15.2751550Z โ”‚ [ 2023-01-13T03:21:15.2770730Z โ”‚ [ 2023-01-13T03:21:15.2795240Z โ”‚ [ 2023-01-13T03:21:15.2798460Z โ”‚ -0.0003991944260010047, 2023-01-13T03:21:15.2799200Z โ”‚ -0.00019002187449287906, 2023-01-13T03:21:15.2799910Z โ”‚ -0.0008597190712390659, 2023-01-13T03:21:15.2806330Z โ”‚ -0.00032936720102199674, 2023-01-13T03:21:15.2807090Z โ”‚ -0.0009114923033171519, 2023-01-13T03:21:15.2811440Z โ”‚ -0.00017816124418623547, 2023-01-13T03:21:15.2814310Z โ”‚ -0.0005801028648177021, 2023-01-13T03:21:15.2930810Z โ”‚ -5.7529239155437246e-05, 2023-01-13T03:21:15.3032770Z โ”‚ -0.00013036387783480554, 2023-01-13T03:21:15.3092050Z โ”‚ -3.622337288874684e-05, 2023-01-13T03:21:15.3095350Z โ”‚ 1.2628205940282632e-05, 2023-01-13T03:21:15.3096920Z โ”‚ -3.1516296784297e-05, 2023-01-13T03:21:15.3098470Z โ”‚ -7.058358724992067e-05, 2023-01-13T03:21:15.3098850Z โ”‚ -6.872767539051156e-05, 2023-01-13T03:21:15.3100450Z โ”‚ -7.877428449394491e-05, 2023-01-13T03:21:15.3160260Z โ”‚ -0.00013302448164365197, 2023-01-13T03:21:15.3261990Z โ”‚ -3.925596760866135e-05, 2023-01-13T03:21:15.3262430Z โ”‚ -0.0002292955565391608, 2023-01-13T03:21:15.3350300Z โ”‚ 1.7131108382827923e-05, 2023-01-13T03:21:15.3451690Z โ”‚ -0.0003846353191170373, 2023-01-13T03:21:15.3530690Z โ”‚ -0.0005095514023480827, 2023-01-13T03:21:15.3533100Z โ”‚ -0.000398801051843612, 2023-01-13T03:21:15.3533850Z โ”‚ -0.0008459618177670134, 2023-01-13T03:21:15.3535230Z โ”‚ -0.0005034789024494699, 2023-01-13T03:21:15.3536330Z โ”‚ -0.000602982590416575, 2023-01-13T03:21:15.3540840Z โ”‚ -0.00017686111234382142, 2023-01-13T03:21:15.3542060Z โ”‚ -0.00015337615274857075, 2023-01-13T03:21:15.3581180Z โ”‚ -0.0 2023-01-13T03:21:15.3589350Z โ”‚ ], 2023-01-13T03:21:15.3690590Z โ”‚ [ 2023-01-13T03:21:15.3791280Z โ”‚ -0.00045936700372476287, 2023-01-13T03:21:15.3892400Z โ”‚ -0.0006972019510941492, 2023-01-13T03:21:15.3992950Z โ”‚ -0.0006564253087082822, 2023-01-13T03:21:15.4043270Z โ”‚ -0.0006832954099635843, 2023-01-13T03:21:15.4144650Z โ”‚ -0.0004380069197580215, 2023-01-13T03:21:15.4179900Z โ”‚ -0.0006188232506248066, 2023-01-13T03:21:15.4387660Z โ”‚ 8.717746431793634e-06, 2023-01-13T03:21:15.4431320Z โ”‚ -0.0003930581918372011, 2023-01-13T03:21:15.4440460Z โ”‚ -0.0001025649797860053, 2023-01-13T03:21:15.4541870Z โ”‚ -0.00018236529082644556, 2023-01-13T03:21:15.4643270Z โ”‚ -0.0005491941178784885, 2023-01-13T03:21:15.4743780Z โ”‚ 4.51985369507874e-05, 2023-01-13T03:21:15.4844960Z โ”‚ -0.0004397755666264522, 2023-01-13T03:21:15.4945640Z โ”‚ -0.0003280011997323363, 2023-01-13T03:21:15.5045960Z โ”‚ -0.0003846251995297467, 2023-01-13T03:21:15.5146930Z โ”‚ -0.0007280317796482974, 2023-01-13T03:21:15.5247350Z โ”‚ -0.0003807700875961582, 2023-01-13T03:21:15.5348870Z โ”‚ -0.0006797484311606648, 2023-01-13T03:21:15.5449240Z โ”‚ -0.0009410587154328029, 2023-01-13T03:21:15.5492780Z โ”‚ -0.0005321376819027118, 2023-01-13T03:21:15.5594160Z โ”‚ -0.0010959785249363366, 2023-01-13T03:21:15.5695780Z โ”‚ -0.0009239368310939245, 2023-01-13T03:21:15.5797180Z โ”‚ -0.0007882725788185756, 2023-01-13T03:21:15.5811770Z โ”‚ -0.0007635522998112582, 2023-01-13T03:21:15.5875010Z โ”‚ -0.0003335173001409385, 2023-01-13T03:21:15.5905760Z โ”‚ 5.10122141099186e-05, 2023-01-13T03:21:15.6042670Z โ”‚ 7.699814064192687e-05, 2023-01-13T03:21:15.6067290Z โ”‚ -0.0 2023-01-13T03:21:15.6080320Z โ”‚ ], 2023-01-13T03:21:15.6135480Z โ”‚ [ 2023-01-13T03:21:15.6237820Z โ”‚ -0.0013165055699506118, 2023-01-13T03:21:15.6238330Z โ”‚ -0.0009519235307056389, 2023-01-13T03:21:15.6339600Z โ”‚ -0.002100062361475806, 2023-01-13T03:21:15.6441200Z โ”‚ -0.0007986432675616436, 2023-01-13T03:21:15.6542570Z โ”‚ -0.0015434151130593236, 2023-01-13T03:21:15.6643870Z โ”‚ -0.0008677094959252854, 2023-01-13T03:21:15.6745270Z โ”‚ -0.0006676294191703121, 2023-01-13T03:21:15.6846670Z โ”‚ -0.0010158371453866067, 2023-01-13T03:21:15.6948170Z โ”‚ -0.0006892677340988555, 2023-01-13T03:21:15.7049640Z โ”‚ -0.0010906412924058864, 2023-01-13T03:21:15.7127990Z โ”‚ -0.0009184818862299863, 2023-01-13T03:21:15.7138130Z โ”‚ -0.0010186683490548587, 2023-01-13T03:21:15.7242130Z โ”‚ -0. 2023-01-13T03:21:15.7343490Z โ”‚ (showing 2.05kB/22.96kB) 2023-01-13T03:21:15.7379060Z โ”” 2023-01-13T03:21:15.7481110Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:15.7527560Z 8ms 1ms 725ยตs 265ยตs 107ms 2ms 97ยตs 121ms 2023-01-13T03:21:15.7530810Z 2023-01-13T03:21:15.7571420Z โœ“ Successful POST request 2023-01-13T03:21:15.7571900Z โœ“ Test expected JSON response 2023-01-13T03:21:15.7573590Z 2023-01-13T03:21:15.7574440Z โ†’ Model Zoo - Unregister model 2023-01-13T03:21:15.7575360Z DELETE http://localhost:8081/models/mnist 2023-01-13T03:21:15.7576560Z 200 OK โ˜… 33ms time โ˜… 241Bโ†‘ 313Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:15.7578790Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 47B 2023-01-13T03:21:15.7579670Z โ”‚ { 2023-01-13T03:21:15.7580620Z โ”‚ "status": "Model \"mnist\" unregistered" 2023-01-13T03:21:15.7581540Z โ”‚ } 2023-01-13T03:21:15.7582350Z โ”” 2023-01-13T03:21:15.7590970Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:15.7592090Z 2ms 724ยตs (cache) (cache) 29ms 2ms 115ยตs 34ms 2023-01-13T03:21:15.7592850Z 2023-01-13T03:21:15.7593570Z โœ“ Successful DELETE request 2023-01-13T03:21:15.7594270Z 2023-01-13T03:21:15.7594970Z โ†’ Model Zoo - Model Metrics 2023-01-13T03:21:15.7595810Z GET http://localhost:8082/metrics 2023-01-13T03:21:15.7598130Z 200 OK โ˜… 20ms time โ˜… 233Bโ†‘ 1.05kBโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:15.7599170Z โ”Œ โ†“ text/plain โ˜… text โ˜… plain โ˜… utf8 โ˜… 755B 2023-01-13T03:21:15.7600200Z โ”‚ # HELP ts_inference_requests_total Total number of inf 2023-01-13T03:21:15.7601140Z โ”‚ erence requests. 2023-01-13T03:21:15.7602060Z โ”‚ # TYPE ts_inference_requests_total counter 2023-01-13T03:21:15.7603250Z โ”‚ ts_inference_requests_total{uuid="1f27c180-f807-4397-b 2023-01-13T03:21:15.7604720Z โ”‚ 104-4fb5e3f95cba",model_name="mnist",model_version="de 2023-01-13T03:21:15.7607320Z โ”‚ fault",} 1.0 2023-01-13T03:21:15.7610220Z โ”‚ # HELP ts_inference_latency_microseconds Cumulative in 2023-01-13T03:21:15.7611570Z โ”‚ ference duration in microseconds 2023-01-13T03:21:15.7612520Z โ”‚ # TYPE ts_inference_latency_microseconds counter 2023-01-13T03:21:15.7613500Z โ”‚ ts_inference_latency_microseconds{uuid="1f27c180-f807- 2023-01-13T03:21:15.7613980Z โ”‚ 4397-b104-4fb5e3f95cba",model_name="mnist",model_versi 2023-01-13T03:21:15.7614310Z โ”‚ on="default",} 78587.817 2023-01-13T03:21:15.7614670Z โ”‚ # HELP ts_queue_latency_microseconds Cumulative queue 2023-01-13T03:21:15.7615460Z โ”‚ duration in microseconds 2023-01-13T03:21:15.7615820Z โ”‚ # TYPE ts_queue_latency_microseconds counter 2023-01-13T03:21:15.7616210Z โ”‚ ts_queue_latency_microseconds{uuid="1f27c180-f807-4397 2023-01-13T03:21:15.7616600Z โ”‚ -b104-4fb5e3f95cba",model_name="mnist",model_version=" 2023-01-13T03:21:15.7616920Z โ”‚ default",} 162.021 2023-01-13T03:21:15.7617150Z โ”” 2023-01-13T03:21:15.7617560Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:15.7618030Z 1ms 1ms 367ยตs 215ยตs 15ms 1ms 88ยตs 21ms 2023-01-13T03:21:15.7618200Z 2023-01-13T03:21:15.7618370Z โœ“ Successful GET request 2023-01-13T03:21:15.7618510Z 2023-01-13T03:21:15.7618790Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:21:15.7619160Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:21:15.7619560Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7619950Z โ”‚ iterations โ”‚ 1 โ”‚ 0 โ”‚ 2023-01-13T03:21:15.7620360Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7620820Z โ”‚ requests โ”‚ 4 โ”‚ 0 โ”‚ 2023-01-13T03:21:15.7623130Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7624230Z โ”‚ test-scripts โ”‚ 4 โ”‚ 0 โ”‚ 2023-01-13T03:21:15.7632000Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7633350Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:21:15.7634360Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7635290Z โ”‚ assertions โ”‚ 5 โ”‚ 0 โ”‚ 2023-01-13T03:21:15.7638360Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7639330Z โ”‚ total run duration: 3.5s โ”‚ 2023-01-13T03:21:15.7641660Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7642670Z โ”‚ total data received: 23.84kB (approx) โ”‚ 2023-01-13T03:21:15.7646280Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7647330Z โ”‚ average response time: 804ms [min: 20ms, max: 3s, s.d.: 1298ms] โ”‚ 2023-01-13T03:21:15.7648680Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7650190Z โ”‚ average DNS lookup time: 1ms [min: 367ยตs, max: 2ms, s.d.: 753ยตs] โ”‚ 2023-01-13T03:21:15.7652360Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:15.7653690Z โ”‚ average first byte time: 796ms [min: 15ms, max: 3s, s.d.: 1291ms] โ”‚ 2023-01-13T03:21:15.7656600Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:21:15.7657090Z TorchServe has stopped. 2023-01-13T03:21:36.7254380Z newman: could not find "htmlextra" reporter 2023-01-13T03:21:36.7264210Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:21:36.7266570Z please install reporter using npm 2023-01-13T03:21:36.7267080Z 2023-01-13T03:21:36.9873680Z newman 2023-01-13T03:21:36.9974170Z 2023-01-13T03:21:37.0075070Z management_api_collection 2023-01-13T03:21:37.0163670Z 2023-01-13T03:21:37.0264320Z Iteration 1/11 2023-01-13T03:21:37.0364580Z 2023-01-13T03:21:37.0477610Z โ†’ workflow management request 2023-01-13T03:21:50.4195070Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/densenet_wf.war 2023-01-13T03:21:50.4243020Z 200 OK โ˜… 13.3s time โ˜… 321Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:50.4272660Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:21:50.4350660Z โ”‚ { 2023-01-13T03:21:50.4381030Z โ”‚ "status": "Workflow densenet has been registered and 2023-01-13T03:21:50.4393300Z โ”‚ scaled successfully." 2023-01-13T03:21:50.4434850Z โ”‚ } 2023-01-13T03:21:50.4466260Z โ”” 2023-01-13T03:21:50.4472500Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:50.4499220Z 52ms 7ms 2ms 427ยตs 13.3s 9ms 661ยตs 13.4s 2023-01-13T03:21:50.4508700Z 2023-01-13T03:21:50.4636610Z โœ“ Successful request 2023-01-13T03:21:50.4744010Z 2023-01-13T03:21:50.4751140Z Iteration 2/11 2023-01-13T03:21:50.4779670Z 2023-01-13T03:21:50.4811790Z โ†’ workflow management request 2023-01-13T03:21:50.5001630Z GET http://localhost:8081/workflows 2023-01-13T03:21:50.5028780Z 200 OK โ˜… 10ms time โ˜… 235Bโ†‘ 423Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:50.5044470Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 156B 2023-01-13T03:21:50.5067310Z โ”‚ { 2023-01-13T03:21:50.5082810Z โ”‚ "workflows": [ 2023-01-13T03:21:50.5084400Z โ”‚ { 2023-01-13T03:21:50.5086040Z โ”‚ "workflowName": "densenet", 2023-01-13T03:21:50.5087720Z โ”‚ "workflowUrl": "https://torchserve.s3.amazonaws. 2023-01-13T03:21:50.5130840Z โ”‚ com/war_files/densenet_wf.war" 2023-01-13T03:21:50.5167160Z โ”‚ } 2023-01-13T03:21:50.5171700Z โ”‚ ] 2023-01-13T03:21:50.5173530Z โ”‚ } 2023-01-13T03:21:50.5192600Z โ”” 2023-01-13T03:21:50.5206550Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:50.5211690Z 2ms 941ยตs (cache) (cache) 6ms 2ms 93ยตs 12ms 2023-01-13T03:21:50.5224520Z 2023-01-13T03:21:50.5230690Z โœ“ Successful request 2023-01-13T03:21:50.5232130Z 2023-01-13T03:21:50.5233000Z Iteration 3/11 2023-01-13T03:21:50.5258980Z 2023-01-13T03:21:50.5299020Z โ†’ workflow management request 2023-01-13T03:21:50.5414820Z GET http://localhost:8081/workflows/densenet 2023-01-13T03:21:50.5416590Z 200 OK โ˜… 6ms time โ˜… 244Bโ†‘ 559Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:50.5418550Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 292B 2023-01-13T03:21:50.5450760Z โ”‚ [ 2023-01-13T03:21:50.5470300Z โ”‚ { 2023-01-13T03:21:50.5489340Z โ”‚ "workflowName": "densenet", 2023-01-13T03:21:50.5491480Z โ”‚ "workflowUrl": "https://torchserve.s3.amazonaws.co 2023-01-13T03:21:50.5491940Z โ”‚ m/war_files/densenet_wf.war", 2023-01-13T03:21:50.5494090Z โ”‚ "minWorkers": 1, 2023-01-13T03:21:50.5523650Z โ”‚ "maxWorkers": 1, 2023-01-13T03:21:50.5553400Z โ”‚ "batchSize": 1, 2023-01-13T03:21:50.5574020Z โ”‚ "maxBatchDelay": 50, 2023-01-13T03:21:50.5579020Z โ”‚ "workflowDag": "{pre_processing=[densenet], densen 2023-01-13T03:21:50.5583600Z โ”‚ et=[post_processing]}" 2023-01-13T03:21:50.5585280Z โ”‚ } 2023-01-13T03:21:50.5604420Z โ”‚ ] 2023-01-13T03:21:50.5638280Z โ”” 2023-01-13T03:21:50.5651360Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:50.5660730Z 2ms 355ยตs (cache) (cache) 3ms 1ms 85ยตs 8ms 2023-01-13T03:21:50.5683080Z 2023-01-13T03:21:50.5686290Z โœ“ Successful request 2023-01-13T03:21:50.5689100Z 2023-01-13T03:21:50.5719530Z Iteration 4/11 2023-01-13T03:21:50.5761480Z 2023-01-13T03:21:50.5800680Z โ†’ workflow management request 2023-01-13T03:21:50.5852880Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/densenet_wf.war 2023-01-13T03:21:50.5917560Z 500 Internal Server Error โ˜… 8ms time โ˜… 321Bโ†‘ 370Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:50.5947120Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 90B 2023-01-13T03:21:50.5978080Z โ”‚ { 2023-01-13T03:21:50.5992040Z โ”‚ "code": 500, 2023-01-13T03:21:50.6037700Z โ”‚ "type": "FileAlreadyExistsException", 2023-01-13T03:21:50.6041720Z โ”‚ "message": "densenet_wf.war" 2023-01-13T03:21:50.6046040Z โ”‚ } 2023-01-13T03:21:50.6050210Z โ”” 2023-01-13T03:21:50.6068970Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:50.6084540Z 4ms 342ยตs (cache) (cache) 4ms 2ms 67ยตs 11ms 2023-01-13T03:21:50.6089550Z 2023-01-13T03:21:50.6098670Z โœ“ Successful request 2023-01-13T03:21:50.6112180Z 2023-01-13T03:21:50.6126640Z Iteration 5/11 2023-01-13T03:21:50.6130190Z 2023-01-13T03:21:50.6131750Z โ†’ workflow management request 2023-01-13T03:21:50.7081500Z DELETE http://localhost:8081/workflows/densenet 2023-01-13T03:21:50.7085330Z 200 OK โ˜… 79ms time โ˜… 247Bโ†‘ 319Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:50.7086710Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 53B 2023-01-13T03:21:50.7120800Z โ”‚ { 2023-01-13T03:21:50.7181290Z โ”‚ "status": "Workflow \"densenet\" unregistered" 2023-01-13T03:21:50.7182490Z โ”‚ } 2023-01-13T03:21:50.7183380Z โ”” 2023-01-13T03:21:50.7218060Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:50.7245590Z 4ms 868ยตs 277ยตs 329ยตs 75ms 1ms 81ยตs 83ms 2023-01-13T03:21:50.7266650Z 2023-01-13T03:21:50.7267760Z โœ“ Successful request 2023-01-13T03:21:50.7293680Z 2023-01-13T03:21:50.7342360Z Iteration 6/11 2023-01-13T03:21:50.7376430Z 2023-01-13T03:21:50.7403670Z โ†’ workflow management request 2023-01-13T03:21:50.8422180Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/does_not_exist.war 2023-01-13T03:21:50.8486410Z 400 Bad Request โ˜… 101ms time โ˜… 324Bโ†‘ 441Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:50.8550220Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 170B 2023-01-13T03:21:50.8604210Z โ”‚ { 2023-01-13T03:21:50.8615080Z โ”‚ "code": 400, 2023-01-13T03:21:50.8621830Z โ”‚ "type": "DownloadArchiveException", 2023-01-13T03:21:50.8630670Z โ”‚ "message": "Failed to download archive from: https:/ 2023-01-13T03:21:50.8732420Z โ”‚ /torchserve.s3.amazonaws.com/war_files/does_not_exist. 2023-01-13T03:21:50.8833190Z โ”‚ war" 2023-01-13T03:21:50.8934430Z โ”‚ } 2023-01-13T03:21:50.9035610Z โ”” 2023-01-13T03:21:50.9087350Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:50.9123280Z 1ms 303ยตs (cache) (cache) 98ms 2ms 56ยตs 102ms 2023-01-13T03:21:50.9126160Z 2023-01-13T03:21:50.9127130Z โœ“ Successful request 2023-01-13T03:21:50.9164520Z 2023-01-13T03:21:50.9170200Z Iteration 7/11 2023-01-13T03:21:50.9228860Z 2023-01-13T03:21:50.9330340Z โ†’ workflow management request 2023-01-13T03:21:50.9350970Z GET http://localhost:8081/workflows/does_not_exist 2023-01-13T03:21:50.9370360Z 404 Not Found โ˜… 15ms time โ˜… 250Bโ†‘ 377Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:50.9397210Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 108B 2023-01-13T03:21:50.9422590Z โ”‚ { 2023-01-13T03:21:50.9444910Z โ”‚ "code": 404, 2023-01-13T03:21:50.9460470Z โ”‚ "type": "WorkflowNotFoundException", 2023-01-13T03:21:50.9461990Z โ”‚ "message": "Workflow not found: does_not_exist" 2023-01-13T03:21:50.9468650Z โ”‚ } 2023-01-13T03:21:50.9475700Z โ”” 2023-01-13T03:21:50.9494060Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:50.9494630Z 1ms 717ยตs 524ยตs 224ยตs 10ms 2ms 59ยตs 16ms 2023-01-13T03:21:50.9507070Z 2023-01-13T03:21:50.9519250Z โœ“ Successful request 2023-01-13T03:21:50.9524000Z 2023-01-13T03:21:50.9527670Z Iteration 8/11 2023-01-13T03:21:50.9528130Z 2023-01-13T03:21:50.9528690Z โ†’ workflow management request 2023-01-13T03:21:50.9529060Z DELETE http://localhost:8081/workflows/does_not_exist 2023-01-13T03:21:50.9530110Z 404 Not Found โ˜… 7ms time โ˜… 253Bโ†‘ 377Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:50.9530780Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 108B 2023-01-13T03:21:50.9531370Z โ”‚ { 2023-01-13T03:21:50.9532510Z โ”‚ "code": 404, 2023-01-13T03:21:50.9533860Z โ”‚ "type": "WorkflowNotFoundException", 2023-01-13T03:21:50.9534940Z โ”‚ "message": "Workflow not found: does_not_exist" 2023-01-13T03:21:50.9535600Z โ”‚ } 2023-01-13T03:21:50.9535830Z โ”” 2023-01-13T03:21:50.9536260Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:50.9536750Z 1ms 769ยตs 240ยตs 286ยตs 3ms 1ms 55ยตs 8ms 2023-01-13T03:21:50.9536930Z 2023-01-13T03:21:50.9537100Z โœ“ Successful request 2023-01-13T03:21:50.9537240Z 2023-01-13T03:21:50.9537320Z Iteration 9/11 2023-01-13T03:21:50.9537550Z 2023-01-13T03:21:50.9537740Z โ†’ workflow management request 2023-01-13T03:21:50.9633910Z POST http://localhost:8081/workflows?url=malformed_url,? 2023-01-13T03:21:50.9662990Z 404 Not Found โ˜… 7ms time โ˜… 275Bโ†‘ 396Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:50.9671770Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 127B 2023-01-13T03:21:50.9672560Z โ”‚ { 2023-01-13T03:21:50.9673200Z โ”‚ "code": 404, 2023-01-13T03:21:50.9673900Z โ”‚ "type": "WorkflowNotFoundException", 2023-01-13T03:21:50.9674620Z โ”‚ "message": "Workflow not found in workflow store: ma 2023-01-13T03:21:50.9675680Z โ”‚ lformed_url,?" 2023-01-13T03:21:50.9677870Z โ”‚ } 2023-01-13T03:21:50.9679800Z โ”” 2023-01-13T03:21:50.9681870Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:50.9683080Z 1ms 816ยตs 235ยตs 497ยตs 3ms 1ms 43ยตs 8ms 2023-01-13T03:21:50.9684970Z 2023-01-13T03:21:50.9728990Z โœ“ Successful request 2023-01-13T03:21:50.9806850Z 2023-01-13T03:21:50.9808160Z Iteration 10/11 2023-01-13T03:21:50.9826190Z 2023-01-13T03:21:50.9828280Z โ†’ workflow management request 2023-01-13T03:21:54.0924420Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/custom_python_dep.war 2023-01-13T03:21:54.1027310Z 500 Internal Server Error โ˜… 3.1s time โ˜… 327Bโ†‘ 531Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:54.1129610Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 250B 2023-01-13T03:21:54.1232910Z โ”‚ { 2023-01-13T03:21:54.1334220Z โ”‚ "code": 500, 2023-01-13T03:21:54.1435700Z โ”‚ "type": "WorkflowException", 2023-01-13T03:21:54.1536680Z โ”‚ "message": "Workflow custom_python_dep has failed to 2023-01-13T03:21:54.1638280Z โ”‚ register. Failures: [Workflow Node custom_python_dep_ 2023-01-13T03:21:54.1738770Z โ”‚ _custom_python_dep failed to register. Details: Model 2023-01-13T03:21:54.1855440Z โ”‚ not found at: custom_python_dep.mar]" 2023-01-13T03:21:54.1956750Z โ”‚ } 2023-01-13T03:21:54.2058940Z โ”” 2023-01-13T03:21:54.2159760Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:54.2261030Z 1ms 691ยตs 189ยตs 229ยตs 3s 1ms 50ยตs 3.1s 2023-01-13T03:21:54.2360680Z 2023-01-13T03:21:54.2461680Z โœ“ Successful request 2023-01-13T03:21:54.2561850Z 2023-01-13T03:21:54.2662880Z Iteration 11/11 2023-01-13T03:21:54.2763070Z 2023-01-13T03:21:54.2864210Z โ†’ workflow management request 2023-01-13T03:21:56.6756760Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/loading-memory-error.war 2023-01-13T03:21:56.6782770Z 500 Internal Server Error โ˜… 2.5s time โ˜… 330Bโ†‘ 543Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:21:56.6847710Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 262B 2023-01-13T03:21:56.6880920Z โ”‚ { 2023-01-13T03:21:56.6906440Z โ”‚ "code": 500, 2023-01-13T03:21:56.6934010Z โ”‚ "type": "WorkflowException", 2023-01-13T03:21:56.6995330Z โ”‚ "message": "Workflow loading-memory-error has failed 2023-01-13T03:21:56.7004360Z โ”‚ to register. Failures: [Workflow Node loading-memory- 2023-01-13T03:21:56.7009900Z โ”‚ error__loading-memory-error failed to register. Detail 2023-01-13T03:21:56.7012590Z โ”‚ s: Model not found at: loading-memory-error.mar]" 2023-01-13T03:21:56.7032350Z โ”‚ } 2023-01-13T03:21:56.7054370Z โ”” 2023-01-13T03:21:56.7090220Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:21:56.7099450Z 1ms 674ยตs 199ยตs 190ยตs 2.5s 1ms 52ยตs 2.5s 2023-01-13T03:21:56.7102570Z 2023-01-13T03:21:56.7110600Z โœ“ Successful request 2023-01-13T03:21:56.7133020Z 2023-01-13T03:21:56.7146360Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:21:56.7182740Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:21:56.7227440Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7247310Z โ”‚ iterations โ”‚ 11 โ”‚ 0 โ”‚ 2023-01-13T03:21:56.7298610Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7340820Z โ”‚ requests โ”‚ 11 โ”‚ 0 โ”‚ 2023-01-13T03:21:56.7375600Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7430910Z โ”‚ test-scripts โ”‚ 11 โ”‚ 0 โ”‚ 2023-01-13T03:21:56.7484980Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7514620Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:21:56.7526980Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7527560Z โ”‚ assertions โ”‚ 11 โ”‚ 0 โ”‚ 2023-01-13T03:21:56.7570200Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7622120Z โ”‚ total run duration: 19.7s โ”‚ 2023-01-13T03:21:56.7626820Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7650620Z โ”‚ total data received: 1.7kB (approx) โ”‚ 2023-01-13T03:21:56.7680140Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7736770Z โ”‚ average response time: 1749ms [min: 6ms, max: 13.3s, s.d.: 3.8s] โ”‚ 2023-01-13T03:21:56.7779810Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7783440Z โ”‚ average DNS lookup time: 1ms [min: 189ยตs, max: 2ms, s.d.: 895ยตs] โ”‚ 2023-01-13T03:21:56.7812880Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:21:56.7865090Z โ”‚ average first byte time: 1744ms [min: 3ms, max: 13.3s, s.d.: 3.8s] โ”‚ 2023-01-13T03:21:56.7878660Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:21:56.8975470Z TorchServe has stopped. 2023-01-13T03:22:17.9180490Z newman: could not find "htmlextra" reporter 2023-01-13T03:22:17.9186350Z ensure that the reporter is installed in the same directory as newman 2023-01-13T03:22:17.9186650Z please install reporter using npm 2023-01-13T03:22:17.9186810Z 2023-01-13T03:22:18.1756990Z newman 2023-01-13T03:22:18.1757190Z 2023-01-13T03:22:18.1757290Z workflow_inference 2023-01-13T03:22:18.1762780Z 2023-01-13T03:22:18.1763360Z Iteration 1/3 2023-01-13T03:22:18.1788980Z 2023-01-13T03:22:18.1789740Z โ†’ Workflow - Register Workflow 2023-01-13T03:22:28.8207420Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/densenet_wf.war 2023-01-13T03:22:28.8208860Z 200 OK โ˜… 10.5s time โ˜… 321Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:22:28.8216470Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:22:28.8218310Z โ”‚ { 2023-01-13T03:22:28.8218940Z โ”‚ "status": "Workflow densenet has been registered and 2023-01-13T03:22:28.8219410Z โ”‚ scaled successfully." 2023-01-13T03:22:28.8219660Z โ”‚ } 2023-01-13T03:22:28.8345200Z โ”” 2023-01-13T03:22:28.8345900Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:22:28.8346430Z 50ms 6ms 2ms 410ยตs 10.5s 11ms 565ยตs 10.6s 2023-01-13T03:22:28.8346590Z 2023-01-13T03:22:28.8649320Z โœ“ Successful POST request 2023-01-13T03:22:28.8784790Z 2023-01-13T03:22:28.8785590Z โ†’ Workflow - Inference 2023-01-13T03:22:29.5107190Z POST http://localhost:8080/wfpredict/densenet 2023-01-13T03:22:29.5107940Z 200 OK โ˜… 614ms time โ˜… 111.24kBโ†‘ 449Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:22:29.5108280Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:22:29.5110970Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:22:29.5111590Z โ”” 2023-01-13T03:22:29.5112580Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 182B 2023-01-13T03:22:29.5112920Z โ”‚ { 2023-01-13T03:22:29.5113200Z โ”‚ "tabby": 0.4666196405887604, 2023-01-13T03:22:29.5113510Z โ”‚ "tiger_cat": 0.46448981761932373, 2023-01-13T03:22:29.5113830Z โ”‚ "Egyptian_cat": 0.06614061444997787, 2023-01-13T03:22:29.5114130Z โ”‚ "lynx": 0.0012924396432936192, 2023-01-13T03:22:29.5114440Z โ”‚ "plastic_bag": 0.00022909772815182805 2023-01-13T03:22:29.5114700Z โ”‚ } 2023-01-13T03:22:29.5156800Z โ”” 2023-01-13T03:22:29.5157640Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:22:29.5158180Z 8ms 1ms 700ยตs 240ยตs 607ms 2ms 80ยตs 621ms 2023-01-13T03:22:29.5158380Z 2023-01-13T03:22:29.5275150Z โœ“ Successful request 2023-01-13T03:22:29.5287630Z โœ“ Test expected JSON response 2023-01-13T03:22:29.5368790Z 2023-01-13T03:22:29.5369710Z โ†’ Workflow - Unregister 2023-01-13T03:22:29.6107990Z DELETE http://localhost:8081/workflows/densenet 2023-01-13T03:22:29.6108970Z 200 OK โ˜… 65ms time โ˜… 247Bโ†‘ 319Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:22:29.6109660Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 53B 2023-01-13T03:22:29.6110000Z โ”‚ { 2023-01-13T03:22:29.6110380Z โ”‚ "status": "Workflow \"densenet\" unregistered" 2023-01-13T03:22:29.6110670Z โ”‚ } 2023-01-13T03:22:29.6143330Z โ”” 2023-01-13T03:22:29.6143880Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:22:29.6144380Z 1ms 608ยตs (cache) (cache) 62ms 1ms 114ยตs 66ms 2023-01-13T03:22:29.6144550Z 2023-01-13T03:22:29.6247260Z โœ“ Successful DELETE request 2023-01-13T03:22:29.6316620Z 2023-01-13T03:22:29.6317240Z Iteration 2/3 2023-01-13T03:22:29.6334750Z 2023-01-13T03:22:29.6335550Z โ†’ Workflow - Register Workflow 2023-01-13T03:22:38.7721010Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/timeout-retry-test.war 2023-01-13T03:22:38.7722500Z 200 OK โ˜… 9.1s time โ˜… 328Bโ†‘ 347Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:22:38.7723220Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 81B 2023-01-13T03:22:38.7723820Z โ”‚ { 2023-01-13T03:22:38.7725770Z โ”‚ "status": "Workflow densenet has been registered and 2023-01-13T03:22:38.7726590Z โ”‚ scaled successfully." 2023-01-13T03:22:38.7728050Z โ”‚ } 2023-01-13T03:22:38.7760510Z โ”” 2023-01-13T03:22:38.7762320Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:22:38.7763610Z 1ms 267ยตs (cache) (cache) 9.1s 2ms 81ยตs 9.1s 2023-01-13T03:22:38.7764630Z 2023-01-13T03:22:38.7872260Z โœ“ Successful POST request 2023-01-13T03:22:38.7978490Z 2023-01-13T03:22:38.7981030Z โ†’ Workflow - Inference 2023-01-13T03:22:50.9883610Z POST http://localhost:8080/wfpredict/densenet 2023-01-13T03:22:50.9892560Z 500 Internal Server Error โ˜… 12.1s time โ˜… 111.24kBโ†‘ 383Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:22:50.9893730Z โ”Œ โ†‘ file โ˜… 110.97kB 2023-01-13T03:22:50.9894420Z โ”‚ (showing 2.05kB/110.97kB) 2023-01-13T03:22:50.9895120Z โ”” 2023-01-13T03:22:50.9896010Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 102B 2023-01-13T03:22:50.9896680Z โ”‚ { 2023-01-13T03:22:50.9897370Z โ”‚ "code": 500, 2023-01-13T03:22:50.9898240Z โ”‚ "type": "InternalServerException", 2023-01-13T03:22:50.9899000Z โ”‚ "message": "Error executing pre_processing" 2023-01-13T03:22:50.9899750Z โ”‚ } 2023-01-13T03:22:50.9919200Z โ”” 2023-01-13T03:22:50.9920140Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:22:50.9921350Z 3ms 424ยตs (cache) (cache) 12.1s 2ms 80ยตs 12.1s 2023-01-13T03:22:50.9922080Z 2023-01-13T03:22:51.0029170Z โœ“ Successful request 2023-01-13T03:22:51.0119900Z 2023-01-13T03:22:51.0120950Z โ†’ Workflow - Unregister 2023-01-13T03:22:51.0776960Z DELETE http://localhost:8081/workflows/densenet 2023-01-13T03:22:51.0788730Z 200 OK โ˜… 55ms time โ˜… 247Bโ†‘ 319Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:22:51.0789770Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 53B 2023-01-13T03:22:51.0791070Z โ”‚ { 2023-01-13T03:22:51.0791810Z โ”‚ "status": "Workflow \"densenet\" unregistered" 2023-01-13T03:22:51.0792520Z โ”‚ } 2023-01-13T03:22:51.0793790Z โ”” 2023-01-13T03:22:51.0794690Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:22:51.0795800Z 2ms 340ยตs (cache) (cache) 51ms 1ms 68ยตs 56ms 2023-01-13T03:22:51.0796360Z 2023-01-13T03:22:51.0892920Z โœ“ Successful DELETE request 2023-01-13T03:22:51.0968700Z 2023-01-13T03:22:51.0969310Z Iteration 3/3 2023-01-13T03:22:51.0988130Z 2023-01-13T03:22:51.0991870Z โ†’ Workflow - Register Workflow 2023-01-13T03:23:00.5371640Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/dog_breed_wf.war 2023-01-13T03:23:00.5376010Z 200 OK โ˜… 9.4s time โ˜… 322Bโ†‘ 351Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:23:00.5376480Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 85B 2023-01-13T03:23:00.5377090Z โ”‚ { 2023-01-13T03:23:00.5377490Z โ”‚ "status": "Workflow dog_breed_wf has been registered 2023-01-13T03:23:00.5378160Z โ”‚ and scaled successfully." 2023-01-13T03:23:00.5378590Z โ”‚ } 2023-01-13T03:23:00.5407030Z โ”” 2023-01-13T03:23:00.5407700Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:23:00.5408220Z 3ms 1ms (cache) (cache) 9.4s 1ms 61ยตs 9.4s 2023-01-13T03:23:00.5408410Z 2023-01-13T03:23:00.5511400Z โœ“ Successful POST request 2023-01-13T03:23:00.5611300Z 2023-01-13T03:23:00.5612030Z โ†’ Workflow - Inference 2023-01-13T03:23:01.3996040Z POST http://localhost:8080/wfpredict/dog_breed_wf 2023-01-13T03:23:01.3997850Z 200 OK โ˜… 827ms time โ˜… 77.75kBโ†‘ 473Bโ†“ size โ˜… 8โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:23:01.3999270Z โ”Œ โ†‘ file โ˜… 77.47kB 2023-01-13T03:23:01.4000890Z โ”‚ (showing 2.05kB/77.47kB) 2023-01-13T03:23:01.4002090Z โ”” 2023-01-13T03:23:01.4002840Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 206B 2023-01-13T03:23:01.4003890Z โ”‚ { 2023-01-13T03:23:01.4004610Z โ”‚ "Cardigan_welsh_corgi": 0.6281962990760803, 2023-01-13T03:23:01.4005320Z โ”‚ "Briard": 0.27462825179100037, 2023-01-13T03:23:01.4006210Z โ”‚ "Icelandic_sheepdog": 0.07453595846891403, 2023-01-13T03:23:01.4008010Z โ”‚ "Tibetan_mastiff": 0.015545734204351902, 2023-01-13T03:23:01.4008740Z โ”‚ "Chow_chow": 0.002062041312456131 2023-01-13T03:23:01.4009380Z โ”‚ } 2023-01-13T03:23:01.4035650Z โ”” 2023-01-13T03:23:01.4036600Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:23:01.4037520Z 4ms 858ยตs 322ยตs 233ยตs 822ms 1ms 78ยตs 830ms 2023-01-13T03:23:01.4038520Z 2023-01-13T03:23:01.4144360Z โœ“ Successful request 2023-01-13T03:23:01.4152380Z โœ“ Test expected JSON response 2023-01-13T03:23:01.4252680Z 2023-01-13T03:23:01.4253670Z โ†’ Workflow - Unregister 2023-01-13T03:23:01.4872060Z DELETE http://localhost:8081/workflows/dog_breed_wf 2023-01-13T03:23:01.4873940Z 200 OK โ˜… 54ms time โ˜… 251Bโ†‘ 323Bโ†“ size โ˜… 7โ†‘ 7โ†“ headers โ˜… 0 cookies 2023-01-13T03:23:01.4874890Z โ”Œ โ†“ application/json โ˜… text โ˜… json โ˜… utf8 โ˜… 57B 2023-01-13T03:23:01.4875240Z โ”‚ { 2023-01-13T03:23:01.4877280Z โ”‚ "status": "Workflow \"dog_breed_wf\" unregistered" 2023-01-13T03:23:01.4878110Z โ”‚ } 2023-01-13T03:23:01.4901720Z โ”” 2023-01-13T03:23:01.4902640Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-01-13T03:23:01.4903580Z 1ms 287ยตs (cache) (cache) 51ms 2ms 54ยตs 55ms 2023-01-13T03:23:01.4904110Z 2023-01-13T03:23:01.4992300Z โœ“ Successful DELETE request 2023-01-13T03:23:01.5107890Z 2023-01-13T03:23:01.5109090Z โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” 2023-01-13T03:23:01.5110560Z โ”‚ โ”‚ executed โ”‚ failed โ”‚ 2023-01-13T03:23:01.5117570Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5118350Z โ”‚ iterations โ”‚ 3 โ”‚ 0 โ”‚ 2023-01-13T03:23:01.5119180Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5119950Z โ”‚ requests โ”‚ 9 โ”‚ 0 โ”‚ 2023-01-13T03:23:01.5120730Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5121510Z โ”‚ test-scripts โ”‚ 9 โ”‚ 0 โ”‚ 2023-01-13T03:23:01.5123060Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5124750Z โ”‚ prerequest-scripts โ”‚ 0 โ”‚ 0 โ”‚ 2023-01-13T03:23:01.5126150Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5127270Z โ”‚ assertions โ”‚ 11 โ”‚ 0 โ”‚ 2023-01-13T03:23:01.5128090Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5128850Z โ”‚ total run duration: 43.3s โ”‚ 2023-01-13T03:23:01.5129360Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5131670Z โ”‚ total data received: 900B (approx) โ”‚ 2023-01-13T03:23:01.5132790Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5133670Z โ”‚ average response time: 4.7s [min: 54ms, max: 12.1s, s.d.: 5s] โ”‚ 2023-01-13T03:23:01.5135070Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5135550Z โ”‚ average DNS lookup time: 1ms [min: 322ยตs, max: 2ms, s.d.: 702ยตs] โ”‚ 2023-01-13T03:23:01.5136440Z โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค 2023-01-13T03:23:01.5137660Z โ”‚ average first byte time: 4.7s [min: 51ms, max: 12.1s, s.d.: 5s] โ”‚ 2023-01-13T03:23:01.5144880Z โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ 2023-01-13T03:23:01.6043620Z TorchServe has stopped. 2023-01-13T03:23:21.8648000Z ============================= test session starts ============================== 2023-01-13T03:23:21.8648910Z platform darwin -- Python 3.8.15, pytest-7.2.0, pluggy-1.0.0 -- /Users/runner/hostedtoolcache/Python/3.8.15/x64/bin/python 2023-01-13T03:23:21.8649250Z cachedir: .pytest_cache 2023-01-13T03:23:21.8649480Z rootdir: /Users/runner/work/serve/serve 2023-01-13T03:23:21.8649820Z plugins: mock-3.10.0, cov-4.0.0 2023-01-13T03:23:23.7354230Z collecting ... collected 82 items 2023-01-13T03:23:23.7354480Z 2023-01-13T03:26:53.6488590Z test_example_dcgan.py::test_model_archive_creation PASSED [ 1%] 2023-01-13T03:26:58.5797050Z test_example_dcgan.py::test_model_register_unregister PASSED [ 2%] 2023-01-13T03:27:02.3428150Z test_example_dcgan.py::test_image_generation_without_any_input_constraints PASSED [ 3%] 2023-01-13T03:27:16.7813380Z test_example_dcgan.py::test_image_generation_with_input_constraints PASSED [ 4%] 2023-01-13T03:27:16.7834150Z test_example_intel_extension_for_pytorch.py::test_single_worker_affinity SKIPPED [ 6%] 2023-01-13T03:27:16.7846980Z test_example_intel_extension_for_pytorch.py::test_multi_worker_affinity SKIPPED [ 7%] 2023-01-13T03:27:16.7860970Z test_example_intel_extension_for_pytorch.py::test_worker_scale_up_affinity SKIPPED [ 8%] 2023-01-13T03:27:16.7872880Z test_example_intel_extension_for_pytorch.py::test_worker_scale_down_affinity SKIPPED [ 9%] 2023-01-13T03:28:03.9389550Z test_example_scriptable_tokenzier.py::test_handler PASSED [ 10%] 2023-01-13T03:29:58.3836020Z test_example_scriptable_tokenzier.py::test_inference_with_untrained_model_and_sample_text PASSED [ 12%] 2023-01-13T03:30:39.5937350Z test_example_scriptable_tokenzier.py::test_inference_with_untrained_model_and_empty_string PASSED [ 13%] 2023-01-13T03:31:57.8248800Z test_example_scriptable_tokenzier.py::test_inference_with_pretrained_model PASSED [ 14%] 2023-01-13T03:38:24.6583030Z test_gRPC_inference_api.py::test_inference_apis PASSED [ 15%] 2023-01-13T03:39:30.1289760Z test_gRPC_management_apis.py::test_management_apis PASSED [ 17%] 2023-01-13T03:40:03.8713850Z test_handler.py::test_mnist_model_register_and_inference_on_valid_model PASSED [ 18%] 2023-01-13T03:40:05.4359390Z test_handler.py::test_mnist_model_register_using_non_existent_handler_with_nonzero_workers PASSED [ 19%] 2023-01-13T03:42:05.7669030Z test_handler.py::test_mnist_model_register_scale_inference_with_non_existent_handler PASSED [ 20%] 2023-01-13T03:42:29.0106350Z test_handler.py::test_mnist_model_register_and_inference_on_valid_model_explain PASSED [ 21%] 2023-01-13T03:42:52.1091340Z test_handler.py::test_kserve_mnist_model_register_and_inference_on_valid_model PASSED [ 23%] 2023-01-13T03:44:52.5535470Z test_handler.py::test_kserve_mnist_model_register_scale_inference_with_non_existent_handler PASSED [ 24%] 2023-01-13T03:45:15.7643840Z test_handler.py::test_kserve_mnist_model_register_and_inference_on_valid_model_explain PASSED [ 25%] 2023-01-13T03:46:03.4221420Z test_handler.py::test_huggingface_bert_batch_inference PASSED [ 26%] 2023-01-13T03:46:03.4238340Z test_handler.py::test_MMF_activity_recognition_model_register_and_inference_on_valid_model SKIPPED [ 28%] 2023-01-13T03:46:13.5778820Z test_handler.py::test_huggingface_bert_model_parallel_inference PASSED [ 29%] 2023-01-13T03:46:47.1362180Z test_metrics.py::test_logs_created PASSED [ 30%] 2023-01-13T03:47:07.5105640Z test_metrics.py::test_logs_startup_cfg_created_snapshot_enabled PASSED [ 31%] 2023-01-13T03:47:27.8828710Z test_metrics.py::test_logs_startup_cfg_created_snapshot_disabled PASSED [ 32%] 2023-01-13T03:47:48.3013530Z test_metrics.py::test_metrics_startup_cfg_created_snapshot_enabled PASSED [ 34%] 2023-01-13T03:48:08.7701890Z test_metrics.py::test_metrics_startup_cfg_created_snapshot_disabled PASSED [ 35%] 2023-01-13T03:48:49.4376590Z test_metrics.py::test_log_location_var_snapshot_disabled PASSED [ 36%] 2023-01-13T03:49:49.2949460Z test_metrics.py::test_log_location_var_snapshot_enabled PASSED [ 37%] 2023-01-13T03:50:19.7982500Z test_metrics.py::test_async_logging PASSED [ 39%] 2023-01-13T03:51:00.5498510Z test_metrics.py::test_async_logging_non_boolean PASSED [ 40%] 2023-01-13T03:51:41.1947170Z test_metrics.py::test_metrics_location_var_snapshot_disabled PASSED [ 41%] 2023-01-13T03:52:25.9854790Z test_metrics.py::test_metrics_location_var_snapshot_enabled PASSED [ 42%] 2023-01-13T03:53:31.0104180Z test_metrics.py::test_log_location_and_metric_location_vars_snapshot_enabled PASSED [ 43%] 2023-01-13T03:54:01.5040890Z test_metrics.py::test_log_location_var_snapshot_disabled_custom_path_read_only PASSED [ 45%] 2023-01-13T03:54:46.3401290Z test_metrics.py::test_metrics_location_var_snapshot_enabled_rdonly_dir PASSED [ 46%] 2023-01-13T03:55:17.3039710Z test_metrics_kf.py::test_logs_created PASSED [ 47%] 2023-01-13T03:55:37.5064630Z test_metrics_kf.py::test_logs_startup_cfg_created_snapshot_enabled PASSED [ 48%] 2023-01-13T03:55:57.8503290Z test_metrics_kf.py::test_logs_startup_cfg_created_snapshot_disabled PASSED [ 50%] 2023-01-13T03:56:18.2578050Z test_metrics_kf.py::test_metrics_startup_cfg_created_snapshot_enabled PASSED [ 51%] 2023-01-13T03:56:38.5701280Z test_metrics_kf.py::test_metrics_startup_cfg_created_snapshot_disabled PASSED [ 52%] 2023-01-13T03:57:19.1593230Z test_metrics_kf.py::test_log_location_var_snapshot_disabled PASSED [ 53%] 2023-01-13T03:58:15.4717850Z test_metrics_kf.py::test_log_location_var_snapshot_enabled PASSED [ 54%] 2023-01-13T03:58:45.9283270Z test_metrics_kf.py::test_async_logging PASSED [ 56%] 2023-01-13T03:59:26.5461450Z test_metrics_kf.py::test_async_logging_non_boolean PASSED [ 57%] 2023-01-13T04:00:07.1782000Z test_metrics_kf.py::test_metrics_location_var_snapshot_disabled PASSED [ 58%] 2023-01-13T04:00:48.2583100Z test_metrics_kf.py::test_metrics_location_var_snapshot_enabled PASSED [ 59%] 2023-01-13T04:01:49.5167500Z test_metrics_kf.py::test_log_location_and_metric_location_vars_snapshot_enabled PASSED [ 60%] 2023-01-13T04:02:20.0839270Z test_metrics_kf.py::test_log_location_var_snapshot_disabled_custom_path_read_only PASSED [ 62%] 2023-01-13T04:03:01.1980920Z test_metrics_kf.py::test_metrics_location_var_snapshot_enabled_rdonly_dir PASSED [ 63%] 2023-01-13T04:03:56.3593650Z test_model_archiver.py::test_multiple_model_versions_registration PASSED [ 64%] 2023-01-13T04:04:21.4958940Z test_model_archiver.py::test_duplicate_model_registration_using_local_url_followed_by_http_url PASSED [ 65%] 2023-01-13T04:04:41.1051720Z test_model_archiver.py::test_duplicate_model_registration_using_http_url_followed_by_local_url PASSED [ 67%] 2023-01-13T04:04:45.2351750Z test_model_archiver.py::test_model_archiver_to_regenerate_model_mar_without_force PASSED [ 68%] 2023-01-13T04:04:53.3666690Z test_model_archiver.py::test_model_archiver_to_regenerate_model_mar_with_force PASSED [ 69%] 2023-01-13T04:04:53.4651100Z test_model_archiver.py::test_model_archiver_without_handler_flag PASSED [ 70%] 2023-01-13T04:04:53.5637660Z test_model_archiver.py::test_model_archiver_without_model_name_flag PASSED [ 71%] 2023-01-13T04:04:57.0657430Z test_model_archiver.py::test_model_archiver_without_model_file_flag PASSED [ 73%] 2023-01-13T04:05:07.3569070Z test_model_archiver.py::test_model_archiver_without_serialized_flag PASSED [ 74%] 2023-01-13T04:05:07.3593190Z test_onnx.py::test_convert_to_onnx SKIPPED (ONNX is not installed) [ 75%] 2023-01-13T04:05:07.3607380Z test_onnx.py::test_model_packaging_and_start SKIPPED (ONNX is not in...) [ 76%] 2023-01-13T04:05:07.3621850Z test_onnx.py::test_model_start SKIPPED (ONNX is not installed) [ 78%] 2023-01-13T04:05:07.3636900Z test_onnx.py::test_inference SKIPPED (ONNX is not installed) [ 79%] 2023-01-13T04:05:07.3654260Z test_onnx.py::test_stop SKIPPED (ONNX is not installed) [ 80%] 2023-01-13T04:06:30.7680390Z test_pytorch_profiler.py::test_profiler_default_and_custom_handler[/Users/runner/work/serve/serve/test/pytest/profiler_utils/resnet_custom.py] PASSED [ 81%] 2023-01-13T04:07:39.1563240Z test_pytorch_profiler.py::test_profiler_default_and_custom_handler[image_classifier] PASSED [ 82%] 2023-01-13T04:08:44.3799550Z test_pytorch_profiler.py::test_profiler_arguments_override[/Users/runner/work/serve/serve/test/pytest/profiler_utils/resnet_profiler_override.py] PASSED [ 84%] 2023-01-13T04:09:50.6731250Z test_pytorch_profiler.py::test_batch_input[/Users/runner/work/serve/serve/test/pytest/profiler_utils/resnet_profiler_override.py] PASSED [ 85%] 2023-01-13T04:10:31.3684820Z test_snapshot.py::test_snapshot_created_on_start_and_stop PASSED [ 86%] 2023-01-13T04:11:16.6331920Z test_snapshot.py::test_snapshot_created_on_management_api_invoke PASSED [ 87%] 2023-01-13T04:11:47.3358760Z test_snapshot.py::test_start_from_snapshot PASSED [ 89%] 2023-01-13T04:12:17.9419430Z test_snapshot.py::test_start_from_latest PASSED [ 90%] 2023-01-13T04:12:38.4658230Z test_snapshot.py::test_start_from_read_only_snapshot PASSED [ 91%] 2023-01-13T04:13:19.0981390Z test_snapshot.py::test_no_config_snapshots_cli_option PASSED [ 92%] 2023-01-13T04:13:39.5253300Z test_snapshot.py::test_start_from_default PASSED [ 93%] 2023-01-13T04:14:10.1452420Z test_snapshot.py::test_start_from_non_existing_snapshot PASSED [ 95%] 2023-01-13T04:14:30.5696900Z test_snapshot.py::test_torchserve_init_with_non_existent_model_store PASSED [ 96%] 2023-01-13T04:15:37.5112230Z test_snapshot.py::test_restart_torchserve_with_last_snapshot_with_model_mar_removed PASSED [ 97%] 2023-01-13T04:17:24.0976200Z test_snapshot.py::test_replace_mar_file_with_dummy PASSED [ 98%] 2023-01-13T04:19:41.0041390Z test_snapshot.py::test_restart_torchserve_with_one_of_model_mar_removed PASSED [100%] 2023-01-13T04:19:41.0041690Z 2023-01-13T04:19:41.0041830Z =============================== warnings summary =============================== 2023-01-13T04:19:41.0042180Z test/pytest/test_example_scriptable_tokenzier.py::test_handler 2023-01-13T04:19:41.0043270Z /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages/torch/jit/_recursive.py:262: UserWarning: 'batch_first' was found in ScriptModule constants, but was not actually set in __init__. Consider removing it. 2023-01-13T04:19:41.0043900Z warnings.warn("'{}' was found in ScriptModule constants, " 2023-01-13T04:19:41.0044160Z 2023-01-13T04:19:41.0044330Z test/pytest/test_example_scriptable_tokenzier.py::test_handler 2023-01-13T04:19:41.0045930Z /Users/runner/hostedtoolcache/Python/3.8.15/x64/lib/python3.8/site-packages/torch/nn/modules/module.py:1194: UserWarning: The PyTorch API of nested tensors is in prototype stage and will change in the near future. (Triggered internally at /Users/runner/work/pytorch/pytorch/pytorch/aten/src/ATen/NestedTensorImpl.cpp:177.) 2023-01-13T04:19:41.0046590Z return forward_call(*input, **kwargs) 2023-01-13T04:19:41.0046740Z 2023-01-13T04:19:41.0046900Z test/pytest/test_example_scriptable_tokenzier.py::test_handler 2023-01-13T04:19:41.0047440Z /Users/runner/work/serve/serve/test/pytest/../../examples/text_classification_with_scriptable_tokenizer/handler.py:97: UserWarning: Implicit dimension choice for softmax has been deprecated. Change the call to include dim=X as an argument. 2023-01-13T04:19:41.0047890Z data = F.softmax(data) 2023-01-13T04:19:41.0048430Z 2023-01-13T04:19:41.0048790Z -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-01-13T04:19:41.0049140Z =========== 72 passed, 10 skipped, 3 warnings in 3379.14s (0:56:19) ============ 2023-01-13T04:19:41.5391470Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T04:19:41.5392040Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T04:19:41.5392460Z ## Starting TorchServe 2023-01-13T04:19:41.5392730Z ## Console logs redirected to file: ts_console.log 2023-01-13T04:19:41.5393750Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties >> ts_console.log 2023-01-13T04:19:41.5394190Z ## Successfully started TorchServe 2023-01-13T04:19:41.5394430Z ## Stopping TorchServe 2023-01-13T04:19:41.5394930Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T04:19:41.5395260Z ## Successfully stopped TorchServe 2023-01-13T04:19:41.5395580Z ## Starting gen_mar: model_store 2023-01-13T04:19:41.5395790Z 2023-01-13T04:19:41.5395910Z ## Create symlink for mar files 2023-01-13T04:19:41.5396130Z 2023-01-13T04:19:41.5396380Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T04:19:41.5396840Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T04:19:41.5397590Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T04:19:41.5398270Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T04:19:41.5398800Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T04:19:41.5399290Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T04:19:41.5399790Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T04:19:41.5400330Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T04:19:41.5400840Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T04:19:41.5401470Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T04:19:41.5402080Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T04:19:41.5402400Z ## Starting TorchServe 2023-01-13T04:19:41.5402640Z ## Console logs redirected to file: ts_console.log 2023-01-13T04:19:41.5403830Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties >> ts_console.log 2023-01-13T04:19:41.5404310Z ## Successfully started TorchServe 2023-01-13T04:19:41.5404530Z ## Stopping TorchServe 2023-01-13T04:19:41.5405060Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T04:19:41.5405450Z ## Successfully stopped TorchServe 2023-01-13T04:19:41.5405680Z ## Starting gen_mar: model_store 2023-01-13T04:19:41.5405820Z 2023-01-13T04:19:41.5405960Z ## Create symlink for mar files 2023-01-13T04:19:41.5406100Z 2023-01-13T04:19:41.5406300Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T04:19:41.5407100Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T04:19:41.5407770Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T04:19:41.5408480Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T04:19:41.5408920Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T04:19:41.5409350Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T04:19:41.5409800Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T04:19:41.5410280Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T04:19:41.5410770Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T04:19:41.5411220Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T04:19:41.5411670Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T04:19:41.5411980Z ## Starting TorchServe 2023-01-13T04:19:41.5412210Z ## Console logs redirected to file: ts_console.log 2023-01-13T04:19:41.5412880Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=resources/config_kf.properties >> ts_console.log 2023-01-13T04:19:41.5413290Z ## Successfully started TorchServe 2023-01-13T04:19:41.5413750Z ## Stopping TorchServe 2023-01-13T04:19:41.5414200Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T04:19:41.5414560Z ## Successfully stopped TorchServe 2023-01-13T04:19:41.5414830Z ## Starting gen_mar: model_store 2023-01-13T04:19:41.5414980Z 2023-01-13T04:19:41.5415080Z ## Create symlink for mar files 2023-01-13T04:19:41.5415210Z 2023-01-13T04:19:41.5415460Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T04:19:41.5415980Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T04:19:41.5416680Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T04:19:41.5417400Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T04:19:41.5417860Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T04:19:41.5418290Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T04:19:41.5418970Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T04:19:41.5419890Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T04:19:41.5420460Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T04:19:41.5420910Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T04:19:41.5421370Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T04:19:41.5422060Z ## Starting TorchServe 2023-01-13T04:19:41.5422300Z ## Console logs redirected to file: ts_console.log 2023-01-13T04:19:41.5423010Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties >> ts_console.log 2023-01-13T04:19:41.5423420Z ## Successfully started TorchServe 2023-01-13T04:19:41.5423640Z ## Stopping TorchServe 2023-01-13T04:19:41.5424080Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T04:19:41.5424390Z ## Successfully stopped TorchServe 2023-01-13T04:19:41.5424620Z ## Starting gen_mar: model_store 2023-01-13T04:19:41.5424750Z 2023-01-13T04:19:41.5424850Z ## Create symlink for mar files 2023-01-13T04:19:41.5424990Z 2023-01-13T04:19:41.5425200Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T04:19:41.5425640Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T04:19:41.5426300Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T04:19:41.5426920Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T04:19:41.5427350Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T04:19:41.5427790Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T04:19:41.5428250Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T04:19:41.5428730Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T04:19:41.5429210Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T04:19:41.5429660Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T04:19:41.5430110Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T04:19:41.5430420Z ## Starting TorchServe 2023-01-13T04:19:41.5430650Z ## Console logs redirected to file: ts_console.log 2023-01-13T04:19:41.5431320Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=resources/config_kfv2.properties >> ts_console.log 2023-01-13T04:19:41.5431750Z ## Successfully started TorchServe 2023-01-13T04:19:41.5431970Z ## Stopping TorchServe 2023-01-13T04:19:41.5432390Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T04:19:41.5432700Z ## Successfully stopped TorchServe 2023-01-13T04:19:41.5433130Z ## Starting gen_mar: model_store 2023-01-13T04:19:41.5433320Z 2023-01-13T04:19:41.5433420Z ## Create symlink for mar files 2023-01-13T04:19:41.5433550Z 2023-01-13T04:19:41.5433760Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T04:19:41.5434200Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T04:19:41.5434850Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T04:19:41.5435550Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T04:19:41.5436280Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T04:19:41.5436720Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T04:19:41.5437170Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T04:19:41.5437650Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T04:19:41.5438130Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T04:19:41.5438580Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T04:19:41.5439020Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T04:19:41.5439340Z ## Starting TorchServe 2023-01-13T04:19:41.5439580Z ## Console logs redirected to file: ts_console.log 2023-01-13T04:19:41.5440180Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs >> ts_console.log 2023-01-13T04:19:41.5440540Z ## Successfully started TorchServe 2023-01-13T04:19:41.5440770Z ## Stopping TorchServe 2023-01-13T04:19:41.5441200Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T04:19:41.5441500Z ## Successfully stopped TorchServe 2023-01-13T04:19:41.5441730Z ## Starting gen_mar: model_store 2023-01-13T04:19:41.5441870Z 2023-01-13T04:19:41.5441960Z ## Create symlink for mar files 2023-01-13T04:19:41.5442100Z 2023-01-13T04:19:41.5442310Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T04:19:41.5442740Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T04:19:41.5443390Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T04:19:41.5444010Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T04:19:41.5444450Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T04:19:41.5444880Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T04:19:41.5445400Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T04:19:41.5445910Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T04:19:41.5446580Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T04:19:41.5447080Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T04:19:41.5447530Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T04:19:41.5447910Z ## Starting TorchServe 2023-01-13T04:19:41.5448150Z ## Console logs redirected to file: ts_console.log 2023-01-13T04:19:41.5448790Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --workflow-store=model_store --ncs >> ts_console.log 2023-01-13T04:19:41.5449450Z ## Successfully started TorchServe 2023-01-13T04:19:41.5449720Z ## Stopping TorchServe 2023-01-13T04:19:41.5450180Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T04:19:41.5450490Z ## Successfully stopped TorchServe 2023-01-13T04:19:41.5450730Z ## Starting gen_mar: model_store 2023-01-13T04:19:41.5450870Z 2023-01-13T04:19:41.5450970Z ## Create symlink for mar files 2023-01-13T04:19:41.5451090Z 2023-01-13T04:19:41.5451350Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-01-13T04:19:41.5451800Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-01-13T04:19:41.5452440Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-01-13T04:19:41.5453060Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-01-13T04:19:41.5453500Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-01-13T04:19:41.5454040Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-01-13T04:19:41.5454500Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-01-13T04:19:41.5454980Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-01-13T04:19:41.5455510Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-01-13T04:19:41.5456070Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-01-13T04:19:41.5456530Z ## Symlink /Users/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-01-13T04:19:41.5456840Z ## Starting TorchServe 2023-01-13T04:19:41.5457070Z ## Console logs redirected to file: ts_console.log 2023-01-13T04:19:41.5457710Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --workflow-store=model_store --ncs >> ts_console.log 2023-01-13T04:19:41.5458120Z ## Successfully started TorchServe 2023-01-13T04:19:41.5458340Z ## Stopping TorchServe 2023-01-13T04:19:41.5458760Z ## In directory: /Users/runner/work/serve/serve/test | Executing command: torchserve --stop 2023-01-13T04:19:41.5459130Z ## Successfully stopped TorchServe 2023-01-13T04:19:41.5459400Z ## Started regression tests 2023-01-13T04:19:41.5459620Z ## Started densenet mar creation 2023-01-13T04:19:41.5461240Z ## In directory: /private/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/workspace/model_store | Executing command: torch-model-archiver --model-name densenet161_v1 --version 1.1 --model-file /Users/runner/work/serve/serve/ts_scripts/../examples/image_classifier/densenet_161/model.py --serialized-file /var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/workspace/model_store/densenet161-8d451a50.pth --extra-files /Users/runner/work/serve/serve/ts_scripts/../examples/image_classifier/index_to_name.json --handler image_classifier --force 2023-01-13T04:19:41.5462110Z ## Started regression pytests 2023-01-13T04:19:41.5462610Z ## In directory: /Users/runner/work/serve/serve/test/pytest | Executing command: python -m pytest -v ./ 2023-01-13T04:19:41.5462930Z Removing file : inference_pb2_grpc.py 2023-01-13T04:19:41.5463170Z Removing file : inference_pb2.py 2023-01-13T04:19:41.5463400Z Removing file : management_pb2.py 2023-01-13T04:19:41.5463650Z Removing file : management_pb2_grpc.py 2023-01-13T04:19:41.5464240Z ## Deleting model_store_gen_dir: /Users/runner/work/serve/serve/ts_scripts/../model_store_gen 2023-01-13T04:19:41.5464510Z 2023-01-13T04:19:42.1370820Z Post job cleanup. 2023-01-13T04:19:42.6494360Z [command]/usr/local/bin/git version 2023-01-13T04:19:42.6891340Z git version 2.39.0 2023-01-13T04:19:42.6977090Z Copying '/Users/runner/.gitconfig' to '/Users/runner/work/_temp/7fe29702-ea2a-4923-bda5-0763eaddc88c/.gitconfig' 2023-01-13T04:19:42.6997590Z Temporarily overriding HOME='/Users/runner/work/_temp/7fe29702-ea2a-4923-bda5-0763eaddc88c' before making global git config changes 2023-01-13T04:19:42.6998360Z Adding repository directory to the temporary git global config as a safe directory 2023-01-13T04:19:42.7007610Z [command]/usr/local/bin/git config --global --add safe.directory /Users/runner/work/serve/serve 2023-01-13T04:19:42.7188740Z [command]/usr/local/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-01-13T04:19:42.8378940Z [command]/usr/local/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2023-01-13T04:19:43.0163720Z [command]/usr/local/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-01-13T04:19:43.0257910Z http.https://github.com/.extraheader 2023-01-13T04:19:43.0282130Z [command]/usr/local/bin/git config --local --unset-all http.https://github.com/.extraheader 2023-01-13T04:19:43.0421680Z [command]/usr/local/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2023-01-13T04:19:43.2018280Z Post job cleanup. 2023-01-13T04:19:43.4539810Z Post job cleanup. 2023-01-13T04:19:43.6667160Z Cleaning up orphan processes 2023-01-13T04:19:43.9289180Z Terminate orphan process: pid (14989) (java)