dlp.risk_test: test_k_map_estimate_analysis_single_field failed

[flaky-bot]

This test failed!

To configure my behavior, see the Build Cop Bot documentation.

If I'm commenting on this issue too often, add the buildcop: quiet label and
I will stop commenting.

---

commit: 87eb8a0
buildURL: Build Status, Sponge
status: failed

Test output

Traceback (most recent call last):
  File "/tmpfs/src/github/python-docs-samples/dlp/risk_test.py", line 310, in test_k_map_estimate_analysis_single_field
    ["AGE"],
  File "/tmpfs/src/github/python-docs-samples/dlp/risk.py", line 661, in k_map_estimate_analysis
    subscription.result(timeout=timeout)
  File "/tmpfs/src/github/python-docs-samples/dlp/.nox/py-3-6/lib/python3.6/site-packages/google/cloud/pubsub_v1/futures.py", line 102, in result
    err = self.exception(timeout=timeout)
  File "/tmpfs/src/github/python-docs-samples/dlp/.nox/py-3-6/lib/python3.6/site-packages/google/cloud/pubsub_v1/futures.py", line 122, in exception
    raise exceptions.TimeoutError("Timed out waiting for result.")
concurrent.futures._base.TimeoutError: Timed out waiting for result.

[flaky-bot]

Looks like this issue is flaky. 😟

I'm going to leave this open and stop commenting.

A human should fix and close this.

---

When run at the same commit (87eb8a0), this test passed in one build (Build Status, Sponge) and failed in another build (Build Status, Sponge).

[flaky-bot]

Oops! Looks like this issue is still flaky. It failed again. 😬

I reopened the issue, but a human will need to close it again.

---

commit: cfe21fa
buildURL: Build Status, Sponge
status: failed

Test output

Traceback (most recent call last):
  File "/workspace/dlp/risk_test.py", line 302, in test_k_map_estimate_analysis_single_field
    risk.k_map_estimate_analysis(
  File "/workspace/dlp/risk.py", line 661, in k_map_estimate_analysis
    subscription.result(timeout=timeout)
  File "/workspace/dlp/.nox/py-3-8/lib/python3.8/site-packages/google/cloud/pubsub_v1/futures.py", line 102, in result
    err = self.exception(timeout=timeout)
  File "/workspace/dlp/.nox/py-3-8/lib/python3.8/site-packages/google/cloud/pubsub_v1/futures.py", line 122, in exception
    raise exceptions.TimeoutError("Timed out waiting for result.")
concurrent.futures._base.TimeoutError: Timed out waiting for result.

[tmatsuo]

I observed the test behavior a bit.
When the test fails, all the tests in risk_test.py fail. These tests share the module scoped fixtures for Pub/Sub topic and subscription.

I have a hypothesis. Sometimes DLP service somehow looses the connection to a particular Pub/Sub topic, when it happens our tests all fail.

I'll try few things.

1. make the Pub/Sub fixture function level.
2. shorten the timeout for the tests from 300 secs to 30 secs.
3. retring all the tests in risk_test.py 3 times

I think it will significantly improve the situation.