Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: Add chatbot example files and dependencies #3052

Draft
wants to merge 101 commits into
base: main
Choose a base branch
from
Draft

chore: Add chatbot example files and dependencies #3052

wants to merge 101 commits into from

Commits on Jul 17, 2024

  1. add: auth dropbox

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    6f205a4 View commit details
    Browse the repository at this point in the history

  2. fix: dropbox sync creds

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    483db0a View commit details
    Browse the repository at this point in the history

  3. add: list dropbox items

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    c587456 View commit details
    Browse the repository at this point in the history

  4. add: weblink

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    1d9070f View commit details
    Browse the repository at this point in the history

  5. feat: poetry lock

    @StanGirard @chloedia
    StanGirard authored and chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    d55f411 View commit details
    Browse the repository at this point in the history

  6. feat: Add Dropbox sync functionality

    @StanGirard @chloedia
    StanGirard authored and chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    9d98792 View commit details
    Browse the repository at this point in the history

  7. fix: DropBox integration link & front dropbox

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    78d161f View commit details
    Browse the repository at this point in the history

  8. add: notification to DropBox

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    ac0d211 View commit details
    Browse the repository at this point in the history

  9. fix: delete Session middleware

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    36a4ecd View commit details
    Browse the repository at this point in the history

  10. fix: refacto syncs

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    98c216a View commit details
    Browse the repository at this point in the history

  11. fix: remove useless debug & fix dropbox refresh

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    6631975 View commit details
    Browse the repository at this point in the history

  12. fix: merge problems

    @chloedia
    chloedia committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    3b00e66 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. feat: Update sync datetime formats for Google Drive and Azure Drive &… 

    … Fix PR comments
    @chloedia
    chloedia committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    7625182 View commit details
    Browse the repository at this point in the history

  2. add: retry fetch_files Azure

    @chloedia
    chloedia committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    806af03 View commit details
    Browse the repository at this point in the history

  3. add : notion auth

    @chloedia
    chloedia committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    f002a09 View commit details
    Browse the repository at this point in the history

  4. feat: Add Notion sync functionality and update dependencies

    @chloedia
    chloedia committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    e1c2742 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. add: download file for notion

    @chloedia
    chloedia committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    1a7a961 View commit details
    Browse the repository at this point in the history

  2. add: notion front

    @chloedia
    chloedia committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    e02d273 View commit details
    Browse the repository at this point in the history

  3. fix: add notion icon url

    @chloedia
    chloedia committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    c90f08b View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. add: is_subfolder, fix: notif failures,

    @chloedia
    chloedia committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    6e76108 View commit details
    Browse the repository at this point in the history

  2. add: icon

    @chloedia
    chloedia committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    36ae406 View commit details
    Browse the repository at this point in the history

  3. add: front show emoji

    @chloedia
    chloedia committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    8f07c79 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. add: add async to notion integration

    @chloedia
    chloedia committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    8d18ba9 View commit details
    Browse the repository at this point in the history

  2. feat: Add Notion sync functionality and update dependencies

    @chloedia
    chloedia committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    df73259 View commit details
    Browse the repository at this point in the history

  3. add: redis

    @chloedia
    chloedia committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    86a4721 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. add: store in db + get_files from db

    @chloedia
    chloedia committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    693d9c3 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. add: migration notion sync

    @chloedia
    chloedia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    4e8b8f0 View commit details
    Browse the repository at this point in the history

  2. tests sync notion

    @AmineDiro
    AmineDiro committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    4fa4f6e View commit details
    Browse the repository at this point in the history

  3. fix test notion session sync

    @AmineDiro
    AmineDiro committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    3443586 View commit details
    Browse the repository at this point in the history

  4. fix test sync

    @AmineDiro
    AmineDiro committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    9971d2b View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. moved parsed to worker and update packages

    @AmineDiro
    AmineDiro committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    24672c0 View commit details
    Browse the repository at this point in the history

  2. add: get_file, upload, add notion page to db

    @chloedia
    chloedia committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    8819379 View commit details
    Browse the repository at this point in the history

  3. add: get_file, upload, add notion page to db

    @chloedia
    chloedia committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    8ca9e53 View commit details
    Browse the repository at this point in the history

  4. add: get_file, upload, add notion page to db

    @chloedia
    chloedia committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    5b50f80 View commit details
    Browse the repository at this point in the history

  5. fix: merge with main

    @chloedia
    chloedia committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    794e3ad View commit details
    Browse the repository at this point in the history

  6. fix: merge with main

    @chloedia
    chloedia committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    95bf927 View commit details
    Browse the repository at this point in the history

  7. fix: merge with main

    @chloedia
    chloedia committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    c0a7fec View commit details
    Browse the repository at this point in the history

  8. feat: add sync logic

    @chloedia
    chloedia committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    03fa348 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2024

  1. init quivr_worker

    @AmineDiro
    AmineDiro committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    13709b6 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into feat/separate-celery-… 

    …workers
    @AmineDiro
    AmineDiro committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    0d3b698 View commit details
    Browse the repository at this point in the history

  3. moved parsers

    @AmineDiro
    AmineDiro committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    837f33d View commit details
    Browse the repository at this point in the history

  4. merged main

    @AmineDiro
    AmineDiro committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    bd8763f View commit details
    Browse the repository at this point in the history

  5. refacto file

    @AmineDiro
    AmineDiro committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    a4150f1 View commit details
    Browse the repository at this point in the history

  6. add: sync in sync cron job

    @chloedia
    chloedia committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    de8ae64 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. moved pdf parsing to megaparse

    aminediro committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    0584a79 View commit details
    Browse the repository at this point in the history

  2. moved md5 in core to sha1

    aminediro committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    5a9d27a View commit details
    Browse the repository at this point in the history

  3. moved check_premium + changed qfile to sha1

    aminediro committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    cd01abc View commit details
    Browse the repository at this point in the history

  4. finish: regular notion sync

    @chloedia
    chloedia committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    e775644 View commit details
    Browse the repository at this point in the history

  5. finish: regular notion sync

    @chloedia
    chloedia committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    9a93dbb View commit details
    Browse the repository at this point in the history

  6. quivr_core qfile changes

    @AmineDiro
    AmineDiro committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    1397d49 View commit details
    Browse the repository at this point in the history

  7. refacto processing + tasks

    @AmineDiro
    AmineDiro committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    67bf3a0 View commit details
    Browse the repository at this point in the history

  8. parse simple tests

    aminediro committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    b1d5f45 View commit details
    Browse the repository at this point in the history

  9. added llama-parse dep

    aminediro committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    207e4f5 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2024

  1. added processing audio to parsers + tests

    aminediro committed Aug 3, 2024
    Configuration menu
    Copy the full SHA
    071670b View commit details
    Browse the repository at this point in the history

  2. crawler celery workers

    aminediro committed Aug 3, 2024
    Configuration menu
    Copy the full SHA
    e8b7423 View commit details
    Browse the repository at this point in the history

  3. dockerfile.dev workers

    aminediro committed Aug 3, 2024
    Configuration menu
    Copy the full SHA
    5a38a98 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2024

  1. dockerfile.dev workers

    aminediro committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    7a463f5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feat/notion-oauth-sync

    @chloedia
    chloedia committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    e918c73 View commit details
    Browse the repository at this point in the history

  3. fix: double mime type in file name

    @chloedia
    chloedia committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    3c2cae2 View commit details
    Browse the repository at this point in the history

  4. working docker-compose

    @AmineDiro
    AmineDiro committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    94f7948 View commit details
    Browse the repository at this point in the history

  5. patch json dump tests

    @AmineDiro
    AmineDiro committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    dbd2191 View commit details
    Browse the repository at this point in the history

  6. logger + placeholder test

    @AmineDiro
    AmineDiro committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    99491e7 View commit details
    Browse the repository at this point in the history

  7. Delete backend/supabase/migrations/20240107152745_ollama.sql 

    deleted
    @AmineDiro
    AmineDiro committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    499b907 View commit details
    Browse the repository at this point in the history

  8. add: normalize async for BaseSync & SyncUtils

    @chloedia
    chloedia committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    6c29231 View commit details
    Browse the repository at this point in the history

  9. remove prints

    @chloedia
    chloedia committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    1a27e23 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. changed dockerfile

    @AmineDiro
    AmineDiro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    e8ac203 View commit details
    Browse the repository at this point in the history

  2. default venv

    @AmineDiro
    AmineDiro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    64207c4 View commit details
    Browse the repository at this point in the history

  3. fix original file_name

    @AmineDiro
    AmineDiro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    52b5037 View commit details
    Browse the repository at this point in the history

  4. skip all known processors checks

    @AmineDiro
    AmineDiro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    5144275 View commit details
    Browse the repository at this point in the history

  5. rolled back crawler

    @AmineDiro
    AmineDiro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    12c2d92 View commit details
    Browse the repository at this point in the history

  6. production docker images

    @AmineDiro
    AmineDiro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    61d9b47 View commit details
    Browse the repository at this point in the history

  7. ignore tox env

    @AmineDiro
    AmineDiro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    c129cd0 View commit details
    Browse the repository at this point in the history

  8. rolled back crawler

    @AmineDiro
    AmineDiro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    71733e4 View commit details
    Browse the repository at this point in the history

  9. fix: sync update only modified files

    @chloedia
    chloedia committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    803f425 View commit details
    Browse the repository at this point in the history

  10. merge with main

    @chloedia
    chloedia committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    704b47d View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. sync utils rewrite

    @AmineDiro
    AmineDiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    3f4f323 View commit details
    Browse the repository at this point in the history

  2. push new lock

    @chloedia
    chloedia committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    0463c8a View commit details
    Browse the repository at this point in the history

  3. push new lock

    @chloedia
    chloedia committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    4016da9 View commit details
    Browse the repository at this point in the history

  4. push new lock

    @chloedia
    chloedia committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    adc71b7 View commit details
    Browse the repository at this point in the history

  5. remove duplicate NotionService

    @chloedia
    chloedia committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    32d3b57 View commit details
    Browse the repository at this point in the history

  6. Merged feat/notion-oauth

    @AmineDiro
    AmineDiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    46df016 View commit details
    Browse the repository at this point in the history

  7. lock files ok

    @AmineDiro
    AmineDiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    dafda78 View commit details
    Browse the repository at this point in the history

  8. feat: separate celery workers (#2948) 

    # Description

- Complete refacto of workers
- New docker image for worker 

NOTE: 

Syncs are under heavy refacto !

---------

Co-authored-by: chloedia <[email protected]>
Co-authored-by: Stan Girard <[email protected]>
Co-authored-by: Antoine Dewez <[email protected]>
Co-authored-by: aminediro <[email protected]>
Co-authored-by: Stan Girard <[email protected]>
Co-authored-by: Chloé Daems <[email protected]>
    @AmineDiro @chloedia
    @StanGirard @Zewed
    7 people committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    995420c View commit details
    Browse the repository at this point in the history

  9. updated router

    @AmineDiro
    AmineDiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    e5aba1a View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. merge frontend main

    @AmineDiro
    AmineDiro committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    4fada64 View commit details
    Browse the repository at this point in the history

  2. fix notion

    @AmineDiro
    AmineDiro committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    7f71a6b View commit details
    Browse the repository at this point in the history

  3. remerged notion and main

    @AmineDiro
    AmineDiro committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    86cc06b View commit details
    Browse the repository at this point in the history

  4. fixed notion error front

    @AmineDiro
    AmineDiro committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    fd47ed7 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/release/quivr-core-0.1' into fea… 

    …t/separate-celery-workers
    @AmineDiro
    AmineDiro committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    4517af8 View commit details
    Browse the repository at this point in the history

  6. Merge pull request #2965 from QuivrHQ/feat/separate-celery-workers 

    fix: notion+ frontend release
    @chloedia
    chloedia committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    5012df4 View commit details
    Browse the repository at this point in the history

  7. Feat/fix tests (#2971) 

    # Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):

---------

Co-authored-by: aminediro <[email protected]>
    @StanGirard @AmineDiro
    StanGirard and AmineDiro committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    95e184f View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Merge branch 'main' into release/quivr-core-0.1

    @StanGirard
    StanGirard committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    9b3178b View commit details
    Browse the repository at this point in the history

  2. feat: 🎸 utils 

    changed destination uuid_generator
    @StanGirard
    StanGirard committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    b3ea3c2 View commit details
    Browse the repository at this point in the history

  3. feat(models): add more tests on service (#2977) 

    # Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
    @StanGirard
    StanGirard committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    053ce71 View commit details
    Browse the repository at this point in the history

  4. feat(tests): improve bash script with select (#2978) 

    # Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
    @StanGirard
    StanGirard committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    d19d01e View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. fix: Knowledge (#2966) 

    fix core-142

---------

Co-authored-by: Stan Girard <[email protected]>
Co-authored-by: aminediro <[email protected]>
    @chloedia @StanGirard @AmineDiro
    3 people committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    8337af3 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. fix: syncs workers + notifier (#2996) 

    # Description

- Complete rewrite of Syncutils
- Eager processing Syncs on Create and Update Sync.
- Simplified a LOT of filtering logic on files
- Fixed notifier async knowledge
    @AmineDiro
    AmineDiro committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f832940 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. feat: add knowledge_brain (#2988) 

    I have made changes to the knowledge table schema and models to improve
functionality and data organization. This includes adding new columns,
modifying existing columns, and updating relationships. These changes
will enhance the overall performance and usability of the application.

---------

Co-authored-by: Stan Girard <[email protected]>
Co-authored-by: aminediro <[email protected]>
    @chloedia @StanGirard @AmineDiro
    3 people committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    3f4c256 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. feat(rye): changed package manager (#3019) 

    Needs export UV_INDEX_STRATEGY=unsafe-first-match to work

Completes CORE-153
    @StanGirard
    StanGirard committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    ea0c240 View commit details
    Browse the repository at this point in the history

  2. fix: sync folders + notion sync (#3021) 

    # Description

- Deserialization of notion results + fetching logic
- Fixed migration `notion_sync`
- Test deserialization of notion
    @AmineDiro
    AmineDiro committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    d303982 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. chore: Add chatbot example files and dependencies

    @StanGirard
    StanGirard committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    5496b4a View commit details
    Browse the repository at this point in the history