Replace kafka-python with kafka-python-ng on Jupyter notebooks

[atheo89]

Related to: https://issues.redhat.com/browse/RHOAIENG-4475

Description

Replace kafka-python with kafka-python-ng as it is the same api but from different working fork: https://github.com/wbarnha/kafka-python-ng

How Has This Been Tested?

• Spin up a jupyter notebook generated from this PR
  podman run -it -p 8888:8888 ghcr.io/atheo89/notebooks/workbench-images:jupyter-trustyai-ubi9-python-3.11-RHOAIENG-4475_dad8405dfc6b16ff6318147ce47ce656b479056e
• Run the following mockup code to test kafka python api functionality

from kafka import KafkaProducer, KafkaConsumer
from unittest import mock
import json

# Mocking KafkaProducer to simulate sending a message
@mock.patch('kafka.producer.KafkaProducer.send')
@mock.patch('kafka.producer.KafkaProducer.__init__', return_value=None)
def test_producer(mock_producer_init, mock_send):
    # Create a mock producer instance
    producer = KafkaProducer(value_serializer=lambda v: json.dumps(v).encode('utf-8'))

    # Simulate sending a message
    test_message = {'key': 'value'}
    producer.send('test-topic', value=test_message)

    # Assert that the send method was called with the correct topic and value
    mock_send.assert_called_once_with('test-topic', value=test_message)
    print("Producer test passed: Message sent successfully.")

# Mocking KafkaConsumer to simulate receiving a message
@mock.patch('kafka.consumer.KafkaConsumer.__iter__', return_value=iter([mock.Mock(value=json.dumps({'key': 'value'}).encode('utf-8'))]))
@mock.patch('kafka.consumer.KafkaConsumer.__init__', return_value=None)
def test_consumer(mock_consumer_init, mock_consumer_iter):
    # Create a mock consumer instance
    consumer = KafkaConsumer(value_deserializer=lambda v: json.loads(v.decode('utf-8')))

    # Simulate consuming a message
    for message in consumer:
        print(f"Consumer test passed: Received message - {message.value}")
        break

if __name__ == '__main__':
    test_producer()
    test_consumer()

expected output

Producer test passed: Message sent successfully.
Consumer test passed: Received message - {'key': 'value'}

Merge criteria:

• The commits are squashed in a cohesive manner and have meaningful messages.
• Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
• The developer has manually tested the changes and verified that the changes work

[jstourac]

/lgtm

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

Approval requirements bypassed by manually added approval.

This pull-request has been approved by:

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[atheo89]

/override ci/prow/rocm-notebooks-e2e-tests
/override ci/prow/notebooks-ubi9-e2e-tests
/override ci/prow/images

[openshift-ci]

@atheo89: Overrode contexts on behalf of atheo89: ci/prow/images, ci/prow/notebooks-ubi9-e2e-tests, ci/prow/rocm-notebooks-e2e-tests

In response to this:

/override ci/prow/rocm-notebooks-e2e-tests
/override ci/prow/notebooks-ubi9-e2e-tests
/override ci/prow/images

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.