Cannot import module with callback

[mfocko]

Hi, during today's production deployment (packit/agile#552) of Packit Service I hit multiple issues with the Fedora Messaging.

Missing requests

The easiest one to fix (at least I hope) is missing requests dependency for the new replay feature. I have a feeling that this is related to the way it's being packaged into RPM, so right now the requests doesn't get installed. I've installed manually on our side as of now and hopefully will open a PR that will fix this.

Failing import

Right now (Fedora Messaging 3.5.0 from RPM) I'm getting:

Error: Failed to import the callback module (No module named 'packit_service_fedmsg') provided in the --callback argument

The way we build the image can be seen here.

I was trying to debug this issue:

1. I can import the module from python3 REPL in the image

2. I can import using your own function _callback_from_python_path():

   mfocko@ampere main*​​ ≡
   packit-service-fedmsg % podman run --rm -ti quay.io/packit/packit-service-fedmsg:dev python3
   Python 3.9.18 (main, Jan 24 2024, 00:00:00) 
   [GCC 11.4.1 20231218 (Red Hat 11.4.1-3)] on linux
   Type "help", "copyright", "credits" or "license" for more information.
   >>> from fedora_messaging.cli import _callback_from_python_path
   /usr/lib/python3.9/site-packages/requests/__init__.py:87: RequestsDependencyWarning: urllib3 (2.2.1) or chardet (4.0.0) doesn't match a supported version!
     warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
   >>> m = _callback_from_python_path("packit_service_fedmsg.consumer:Consumerino")
   [INFO fedora_messaging.cli] Starting consumer with packit_service_fedmsg.consumer:Consumerino callback
   >>> 
   

3. This bug has been introduced in between 3.4.1 (works as intended) and 3.5.0 releases.

   I've briefly went through the commits in between those tags, checked the git blame on the cli.py for any changes of importing the callbacks, haven't managed to find anything suspicious.

Additional information

• Base image for container: C9S
• Source of Fedora Messaging: RPM from EPEL

[mfocko]

Upon closer inspection and discussion with @nforro, it appears that the issue comes from the fact that we do global pip install from the sources which installs to /usr/local/ and it's missing in the sys.path, while it's being present when running the Python REPL.