[Failing Test]: PostCommit Java Dataflow V1 - testFhirIO_Import & SpannerWriteIT > testSequentialWrite

[damondouglas]

What happened?

PostCommit Java Dataflow V1 shows repeated failures, for example:

org.apache.beam.sdk.io.gcp.healthcare.FhirIOWriteIT > testFhirIO_Import[DSTU2] FAILED	
    java.lang.NullPointerException at FhirIOWriteIT.java:194	
org.apache.beam.sdk.io.gcp.healthcare.FhirIOWriteIT > testFhirIO_Import[STU3] FAILED	
    java.lang.NullPointerException at FhirIOWriteIT.java:194	
org.apache.beam.sdk.io.gcp.healthcare.FhirIOWriteIT > testFhirIO_Import[R4] FAILED	
    java.lang.NullPointerException at FhirIOWriteIT.java:194	
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testSequentialWrite FAILED	
    java.lang.NullPointerException at SpannerWriteIT.java:292

Issue Failure

Failure: Test is continually failing

Issue Priority

Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the product is healthy)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[svetakvsundhar]

I am not able to currently reproduce this issue locally. Additionally, this test has not failed in the last 7 runs over the last 2 days.

I looked at the quotas page in the apache-beam-testing project as well, which does not seems to be an issue. Given this, the most probable cause for this NullPointer failure in the test is a null parameter passed into the fhirStoresImport transform, but this is merely speculation. Will monitor for 2 more days and then mark as WAI, if there are no issues.

[damondouglas]

@svetakvsundhar It looks like things have resolved: https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_DataflowV1.yml. Thank you for taking the time to look into this.