[Bug]: New option in KafkaIO.Read breaks upgrade compatibility

[Abacn]

What happened?

Already signaled by the test failure of :sdks:java:io:kafka:upgrade:test: https://github.com/apache/beam/actions/runs/8709671441

and also reported in #30197 (comment)

Introduced in #30877 and seems not completely resolved after #30915

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[Abacn]

Mark as a release blocker because it affects Java IOs PreCommit (actually it should be caught by KafkaIO PreCommit, adding the test suite in #30996)

[Abacn]

CC: @damccorm @xianhualiu

[liferoad]

should be fixed by #30998