Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix and refactor FTS field generation #998

Merged
merged 3 commits into from
Nov 10, 2024
Merged

Fix and refactor FTS field generation #998

merged 3 commits into from
Nov 10, 2024

Conversation

ml-evs
Copy link
Member

@ml-evs ml-evs commented Nov 7, 2024

Closes #997, and is related to #993

This PR improves how we choose which fields to use in the FTS.

Previously, some IDs were being included, which will no longer happen.

Also, some field names were being added by aliases that are not present in the database, so were excluded (mostly starting materials fields).

Copy link

cypress bot commented Nov 7, 2024

datalab    Run #2754

Run Properties:  status check passed Passed #2754  •  git commit 4aeb75bf57 ℹ️: Merge 6a8feac9c4a9f8159743efb294cc596366ad5da6 into 0cca3103c7bf20d2d106896222d1...
Project datalab
Branch Review ml-evs/fix-fts-fields
Run status status check passed Passed #2754
Run duration 10m 30s
Commit git commit 4aeb75bf57 ℹ️: Merge 6a8feac9c4a9f8159743efb294cc596366ad5da6 into 0cca3103c7bf20d2d106896222d1...
Committer Matthew Evans
View all properties for this run ↗︎

Test results
Tests that failed  Failures 0
Tests that were flaky  Flaky 0
Tests that did not run due to a developer annotating a test with .skip  Pending 0
Tests that did not run due to a failure in a mocha hook  Skipped 0
Tests that passed  Passing 405
View all changes introduced in this branch ↗︎

@ml-evs ml-evs changed the title Refactor and remove some unecessary FTS fields Fix and refactor FTS field generation Nov 10, 2024
Copy link

codecov bot commented Nov 10, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 68.35%. Comparing base (0cca310) to head (6a8feac).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #998      +/-   ##
==========================================
- Coverage   68.38%   68.35%   -0.04%     
==========================================
  Files          62       62              
  Lines        3941     3937       -4     
==========================================
- Hits         2695     2691       -4     
  Misses       1246     1246              
Files with missing lines Coverage Δ
pydatalab/src/pydatalab/models/entries.py 82.75% <ø> (ø)
pydatalab/src/pydatalab/mongo.py 79.10% <100.00%> (-1.18%) ⬇️

@ml-evs ml-evs merged commit d7a35a8 into main Nov 10, 2024
17 checks passed
@ml-evs ml-evs deleted the ml-evs/fix-fts-fields branch November 10, 2024 15:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Extraneous and missing fields in MongoDB text search index
1 participant