Skip to content

Commit

Permalink
Merge pull request #2325 from telefonicaid/task/add_mongo_index_note
Browse files Browse the repository at this point in the history
add a note about index recreation
  • Loading branch information
fgalan authored Nov 29, 2023
2 parents e78c746 + 78758d7 commit e4c7a60
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 0 deletions.
2 changes: 2 additions & 0 deletions doc/cygnus-ngsi/flume_extensions_catalogue/ngsi_mongo_sink.md
Original file line number Diff line number Diff line change
Expand Up @@ -298,6 +298,8 @@ Since version 3.0.0 of cygnus an index named `cyg_raw_opt` is created in this wa

Note that attempting to use any other datamodel different from these ones will cause a "Unknown data model" ERROR in log traces. In addition, note that default datamodel for NGSIMongoSink is dm-by-entity as all others sinks which uses datamodel.

When datamodel changes Cygnus tries to recreate index (delete current and create a new one) depending on keys related to datamodel. This procedure could takes much time depending on data volume and existence of mongo cluster deploy. In order to reduce this time, an expected index could be created in advance (i.e. before doing the datamodel change) when cygnus and mongo loads allow it.

## <a name="section2"></a>Administration guide
### <a name="section2.1"></a>Configuration
`NGSIMongoSink` is configured through the following parameters:
Expand Down
2 changes: 2 additions & 0 deletions doc/cygnus-ngsi/flume_extensions_catalogue/ngsi_sth_sink.md
Original file line number Diff line number Diff line change
Expand Up @@ -302,6 +302,8 @@ Since version 3.0.0 of cygnus index named `cyg_agg_opt` is created in this way b

Note that attempting to use any other datamodel different from these ones will cause a "Unknown data model" ERROR in log traces. In addition, note that default datamodel for NGSISTHSink is dm-by-entity as all others sinks which uses datamodel.

When datamodel changes Cygnus tries to recreate index (delete current and create a new one) depending on keys related to datamodel. This procedure could takes much time depending on data volume and existence of mongo cluster deploy. In order to reduce this time, an expected index could be created in advance (i.e. before doing the datamodel change) when cygnus and mongo loads allow it.

## <a name="section2"></a>Administration guide
### <a name="section2.1"></a>Configuration
`NGSISTHSink` is configured through the following parameters:
Expand Down

0 comments on commit e4c7a60

Please sign in to comment.