Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Partial NULL embeddings #35

Open
Nishanth-Gobi opened this issue Jun 5, 2024 · 2 comments
Open

Partial NULL embeddings #35

Nishanth-Gobi opened this issue Jun 5, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@Nishanth-Gobi
Copy link

Bug report

Describe the bug

On file uploads, the embedding function fails to create vectors for some of the chunks with the below message,

InvalidWorkerCreation: worker did not respond in time
    at async UserWorker.create (ext:sb_user_workers/user_workers.js:155:15)
    at async Object.handler (file:///home/deno/main/index.ts:153:22)
    at async respond (ext:sb_core_main_js/js/http.js:162:14) {
  name: "InvalidWorkerCreation"
}

I am using the new Supabase.ai.Session() API and am on Edge v1.53.3, but it still happens sometimes at random.

To Reproduce

Steps to reproduce the behavior, please provide code snippets or a repository:

  1. Run main locally
  2. Upload a couple of markdown files one after the other

Expected behavior

All chunks to have their corresponding vectors.

Screenshots

image

System information

  • OS: macOS
  • Version of supabase-js: latest
  • Version of Node.js: 22.1.0

Additional context

@gregnr this seems to be different from what you mentioned could be the reason for partial NULLs in #30

@Nishanth-Gobi Nishanth-Gobi added the bug Something isn't working label Jun 5, 2024
@gregnr
Copy link
Collaborator

gregnr commented Jun 5, 2024

Very strange @Nishanth-Gobi, thanks for reporting. You're the first I've seen that has experienced this with the new Supabase.ai API. Would you mind submitting an issue on the edge-runtime repo with this error (and link back to this issue)?

@landmann
Copy link

landmann commented Sep 17, 2024

Ahh ok I found the issue @Nishanth-Gobi - you have a bug in your functions/embed/index.ts file. Mine was that I didn't generate the typescript type into _lib/database.ts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants