Adding additional default use cases

[amitgalitz]

Description

• Adding two additional default use cases for pretrained model for hybrid and semantic search
• removing id field from some of the use case templates
• removing weights from hybrid search template
• making the text and image type dynamic for multimodal search as most customers don't actually just use binary for images.
• Adding e2e integration test for local semantic search template all the way to neural search

Issues Resolved

part of #666

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov]

Codecov Report

Attention: Patch coverage is 61.53846% with 5 lines in your changes missing coverage. Please review.

Project coverage is 74.35%. Comparing base (a941b68) to head (50b44eb).

Files	Patch %	Lines
...opensearch/flowframework/workflow/ReindexStep.java	28.57%	2 Missing and 3 partials ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main     #731      +/-   ##
============================================
- Coverage     74.41%   74.35%   -0.06%     
  Complexity      744      744              
============================================
  Files            84       84              
  Lines          3811     3822      +11     
  Branches        330      333       +3     
============================================
+ Hits           2836     2842       +6     
- Misses          823      825       +2     
- Partials        152      155       +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[joshpalis]

Interesting that the windows single node integration tests are failing due to :

EPRODUCE WITH: gradlew ':integTest' --tests "org.opensearch.flowframework.rest.FlowFrameworkRestApiIT.testSemanticSearchWithLocalModelEndToEnd" -Dtests.seed=F9C1F84B83F9D1C6 -Dtests.security.manager=false -Dtests.locale=mk -Dtests.timezone=PLT -Druntime.java=11

org.opensearch.flowframework.rest.FlowFrameworkRestApiIT > testSemanticSearchWithLocalModelEndToEnd FAILED
    java.lang.AssertionError: expected:<0> but was:<1>
Suite: Test class org.opensearch.flowframework.rest.FlowFrameworkRestApiIT
        at __randomizedtesting.SeedInfo.seed([F9C1F84B83F9D1C6:9469A614D9123AA7]:0)
  2> SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".  2> 
        at org.junit.Assert.fail(Assert.java:89)

Looking at the test, its failing during this line : assertEquals(neuralSearchResponse.getHits().getHits().length, 1);
Given that the other integration tests passed, perhaps this failure is due to the GHA runner memory limitation. I see that the model used in the semantic search local model template is msmarco-distilbert-base-tas-b, which is about 254 mb.

Can we use a smaller model here for this test? I think that should help mitigate the flakiness.

Edit :
Smallest sentence transformer pretrained model is huggingface/sentence-transformers/paraphrase-MiniLM-L3-v2, which is about 67 MB

[ohltyler]

At a high level LGTM.

[opensearch-trigger-bot]

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 128

To backport manually, run these commands in your terminal:

# Navigate to the root of your repository
cd $(git rev-parse --show-toplevel)
# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add ../.worktrees/flow-framework/backport-2.x 2.x
# Navigate to the new working tree
pushd ../.worktrees/flow-framework/backport-2.x
# Create a new branch
git switch --create backport/backport-731-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 53126cbe1a7b6bb6bf41196039b811d5436328a5
# Push it to GitHub
git push --set-upstream origin backport/backport-731-to-2.x
# Go back to the original working tree
popd
# Delete the working tree
git worktree remove ../.worktrees/flow-framework/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-731-to-2.x.