Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Llama index pipeline not working #258

Open
moophlo opened this issue Sep 12, 2024 · 1 comment
Open

Llama index pipeline not working #258

moophlo opened this issue Sep 12, 2024 · 1 comment

Comments

@moophlo
Copy link

moophlo commented Sep 12, 2024

Hello guys,
I understand that the examples doesn't need to be perfect, but at least working. They're meant to be a trace to implement more stuff but how can be a starting point be broken?
None of the lama index rag pipelines install properly. I've two suggestions, first is to have all the examples working and installable, the second is to build a database of trusted pipelines which are verified and safe to be installed

@wabbajack1
Copy link

wabbajack1 commented Sep 20, 2024

I encountered an issue where the pipelines function is required. Specifically, when loading models, the code expects a pipelines function to exist and be callable.

The relevant error trace is:
File "/app/main.py", line 216, in load_modules_from_directory PIPELINES = get_all_pipelines()

File "/app/main.py", line 53, in get_all_pipelines if callable(pipeline.pipelines):

As you can see, the pipelines function is called using callable, but the interface or documentation for this is unclear.

Proposed Solution

To resolve this, I suggest implementing a pipelines function (for self.id="pipe") in the module as shown below:

def pipelines(self) -> List[dict]:
    # Implementation goes here
    return [{"id": self.name+"1234", "name": self.name}]

When this is not working, change the id to "manifold".

This needs to be fixed, the interface is not consistent in docs and implementation.....

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants