Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ml_engine.online_prediction.predict_test: test_predict_examples failed #4778

Closed
flaky-bot bot opened this issue Sep 30, 2020 · 5 comments · Fixed by #4791
Closed

ml_engine.online_prediction.predict_test: test_predict_examples failed #4778

flaky-bot bot opened this issue Sep 30, 2020 · 5 comments · Fixed by #4791
Assignees
@alecglassford
Labels
api: ml Issues related to the AI Platform Training & Prediction API API. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. samples Issues that are directly related to samples. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@flaky-bot
Copy link

flaky-bot bot commented Sep 30, 2020

This test failed!

To configure my behavior, see the Build Cop Bot documentation.

If I'm commenting on this issue too often, add the buildcop: quiet label and
I will stop commenting.

commit: 0cf128d
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/ml_engine/online_prediction/predict_test.py", line 69, in test_predict_examples
    PROJECT, MODEL, [BYTESTRING, BYTESTRING], version=EXAMPLES_VERSION)
  File "/workspace/ml_engine/online_prediction/predict.py", line 98, in predict_examples
    raise RuntimeError(response['error'])
RuntimeError: Error loading the model
@flaky-bot flaky-bot bot added buildcop: issue priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Sep 30, 2020
@product-auto-label product-auto-label bot added api: ml Issues related to the AI Platform Training & Prediction API API. samples Issues that are directly related to samples. labels Sep 30, 2020
@flaky-bot
Copy link
Author

flaky-bot bot commented Oct 1, 2020

commit: 107bf7e
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/ml_engine/online_prediction/predict_test.py", line 69, in test_predict_examples
    PROJECT, MODEL, [BYTESTRING, BYTESTRING], version=EXAMPLES_VERSION)
  File "/workspace/ml_engine/online_prediction/predict.py", line 98, in predict_examples
    raise RuntimeError(response['error'])
RuntimeError: Error loading the model

@flaky-bot
Copy link
Author

flaky-bot bot commented Oct 2, 2020

commit: 591787c
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/ml_engine/online_prediction/predict_test.py", line 69, in test_predict_examples
    PROJECT, MODEL, [BYTESTRING, BYTESTRING], version=EXAMPLES_VERSION)
  File "/workspace/ml_engine/online_prediction/predict.py", line 93, in predict_examples
    for example_bytes in example_bytes_list
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/_helpers.py", line 134, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/http.py", line 901, in execute
    headers=self.headers,
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/http.py", line 204, in _retry_request
    raise exception
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/http.py", line 177, in _retry_request
    resp, content = http.request(uri, method, *args, **kwargs)
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/google_auth_httplib2.py", line 201, in request
    uri, method, body=body, headers=request_headers, **kwargs)
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/httplib2/__init__.py", line 1994, in request
    cachekey,
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/httplib2/__init__.py", line 1651, in _request
    conn, request_uri, method, body, headers
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/httplib2/__init__.py", line 1589, in _conn_request
    response = conn.getresponse()
  File "/usr/local/lib/python3.6/http/client.py", line 1354, in getresponse
    response.begin()
  File "/usr/local/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/local/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/local/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
  File "/usr/local/lib/python3.6/ssl.py", line 1012, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/local/lib/python3.6/ssl.py", line 874, in read
    return self._sslobj.read(len, buffer)
  File "/usr/local/lib/python3.6/ssl.py", line 631, in read
    v = self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

@tmatsuo
Copy link
Contributor

tmatsuo commented Oct 2, 2020

@alecglassford
FYI
Also, can you join GoogleCloudPlatform org?

@tmatsuo tmatsuo added the blunderbuss: assign Instruct blunderbuss to assign someone label Oct 2, 2020
@blunderbuss-gcf blunderbuss-gcf bot removed the blunderbuss: assign Instruct blunderbuss to assign someone label Oct 2, 2020
alecglassford pushed a commit that referenced this issue Oct 2, 2020
Remove TFRecord/example code from online prediction sample and test
e36d3e0 
fixes #4778
@alecglassford alecglassford mentioned this issue Oct 2, 2020
Merged
8 tasks
@flaky-bot
Copy link
Author

flaky-bot bot commented Oct 3, 2020

commit: d85e2ca
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/ml_engine/online_prediction/predict_test.py", line 69, in test_predict_examples
    PROJECT, MODEL, [BYTESTRING, BYTESTRING], version=EXAMPLES_VERSION)
  File "/workspace/ml_engine/online_prediction/predict.py", line 98, in predict_examples
    raise RuntimeError(response['error'])
RuntimeError: Error loading the model

@flaky-bot
Copy link
Author

flaky-bot bot commented Oct 6, 2020

commit: 85ea173
buildURL: Build Status, Sponge
status: failed

Test output
Traceback (most recent call last):
  File "/workspace/ml_engine/online_prediction/predict_test.py", line 69, in test_predict_examples
    PROJECT, MODEL, [BYTESTRING, BYTESTRING], version=EXAMPLES_VERSION)
  File "/workspace/ml_engine/online_prediction/predict.py", line 93, in predict_examples
    for example_bytes in example_bytes_list
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/_helpers.py", line 134, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/http.py", line 901, in execute
    headers=self.headers,
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/http.py", line 204, in _retry_request
    raise exception
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/googleapiclient/http.py", line 177, in _retry_request
    resp, content = http.request(uri, method, *args, **kwargs)
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/google_auth_httplib2.py", line 201, in request
    uri, method, body=body, headers=request_headers, **kwargs)
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/httplib2/__init__.py", line 1994, in request
    cachekey,
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/httplib2/__init__.py", line 1651, in _request
    conn, request_uri, method, body, headers
  File "/workspace/ml_engine/online_prediction/.nox/py-3-6/lib/python3.6/site-packages/httplib2/__init__.py", line 1589, in _conn_request
    response = conn.getresponse()
  File "/usr/local/lib/python3.6/http/client.py", line 1354, in getresponse
    response.begin()
  File "/usr/local/lib/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/local/lib/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/local/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
  File "/usr/local/lib/python3.6/ssl.py", line 1012, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/local/lib/python3.6/ssl.py", line 874, in read
    return self._sslobj.read(len, buffer)
  File "/usr/local/lib/python3.6/ssl.py", line 631, in read
    v = self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

gcf-merge-on-green bot pushed a commit that referenced this issue Oct 6, 2020
Fix AI Platform online prediction tests (#4791)
e087818 
## Description

Fixes #4776 and fixes #4777 by using a new model version (created in the Cloud Console based on the same trained ML model) and updating code accordingly. It's unknown why the old model version that the test used stopped working.
Fixes #4778 by removing the code in question, which is no longer used in documentation.

## Checklist
- [x] I have followed [Sample Guidelines from AUTHORING_GUIDE.MD](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/AUTHORING_GUIDE.md)
- [ ] README is updated to include [all relevant information](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/AUTHORING_GUIDE.md#readme-file)
- [x] **Tests** pass:   `nox -s py-3.6` (see [Test Environment Setup](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/AUTHORING_GUIDE.md#test-environment-setup))
- [x] **Lint** pass:   `nox -s lint` (see [Test Environment Setup](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/AUTHORING_GUIDE.md#test-environment-setup))
- [ ] These samples need a new **API enabled** in testing projects to pass (let us know which ones)
- [ ] These samples need a new/updated **env vars** in testing projects set to pass (let us know which ones)
- [x] Please **merge** this PR for me once it is approved.
- [ ] This sample adds a new sample directory, and I updated the [CODEOWNERS file](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/.github/CODEOWNERS) with the codeowners for this sample
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@alecglassford alecglassford

Labels
api: ml Issues related to the AI Platform Training & Prediction API API. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. samples Issues that are directly related to samples. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix AI Platform online prediction tests GoogleCloudPlatform/python-docs-samples
2 participants
@tmatsuo @alecglassford