pubsublite.spark-connector.spark_streaming_test: test_spark_streaming_from_pubsublite failed

[flaky-bot]

Note: #8124 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.

---

commit: d4d26d4
buildURL: Build Status, Sponge
status: failed

Test output

Traceback (most recent call last):
  File "/workspace/pubsublite/spark-connector/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/grpc_helpers.py", line 50, in error_remapped_callable
    return callable_(*args, **kwargs)
  File "/workspace/pubsublite/spark-connector/.nox/py-3-10/lib/python3.10/site-packages/grpc/_channel.py", line 946, in __call__
    return _end_unary_response_blocking(state, call, False, None)
  File "/workspace/pubsublite/spark-connector/.nox/py-3-10/lib/python3.10/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.ALREADY_EXISTS
	details = "Already exists: Failed to submit job: Job projects/python-docs-samples-tests/regions/us-west1/jobs/spark-streaming-subscription-6f77"
	debug_error_string = "{"created":"@1661259629.027539865","description":"Error received from peer ipv4:74.125.199.95:443","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Already exists: Failed to submit job: Job projects/python-docs-samples-tests/regions/us-west1/jobs/spark-streaming-subscription-6f77","grpc_status":6}"
>
The above exception was the direct cause of the following exception:
Traceback (most recent call last):

File "/workspace/pubsublite/spark-connector/spark_streaming_test.py", line 256, in test_spark_streaming_from_pubsublite

operation = job_client.submit_job_as_operation(

File "/workspace/pubsublite/spark-connector/.nox/py-3-10/lib/python3.10/site-packages/google/cloud/dataproc_v1/services/job_controller/client.py", line 651, in submit_job_as_operation

response = rpc(

File "/workspace/pubsublite/spark-connector/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/gapic_v1/method.py", line 154, in call

return wrapped_func(*args, **kwargs)

File "/workspace/pubsublite/spark-connector/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/retry.py", line 283, in retry_wrapped_func

return retry_target(

File "/workspace/pubsublite/spark-connector/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/retry.py", line 190, in retry_target

return target()

File "/workspace/pubsublite/spark-connector/.nox/py-3-10/lib/python3.10/site-packages/google/api_core/grpc_helpers.py", line 52, in error_remapped_callable

raise exceptions.from_grpc_error(exc) from exc

google.api_core.exceptions.AlreadyExists: 409 Already exists: Failed to submit job: Job projects/python-docs-samples-tests/regions/us-west1/jobs/spark-streaming-subscription-6f77

[flaky-bot]

Looks like this issue is flaky. 😟

I'm going to leave this open and stop commenting.

A human should fix and close this.

---

When run at the same commit (d4d26d4), this test passed in one build (Build Status, Sponge) and failed in another build (Build Status, Sponge).