Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RELEASE] Release version 2.12.0 #4115

Closed
87 of 88 tasks
github-actions bot opened this issue Oct 10, 2023 · 107 comments
Closed
87 of 88 tasks

[RELEASE] Release version 2.12.0 #4115

github-actions bot opened this issue Oct 10, 2023 · 107 comments
Assignees

Comments

@github-actions
Copy link
Contributor

github-actions bot commented Oct 10, 2023

Release OpenSearch and OpenSearch Dashboards 2.12.0

I noticed that a manifest was automatically created in manifests/2.12.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the Release Process OpenSearch Guide.

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Entrance Criteria

Criteria Status Description Comments
Documentation draft PRs are up and in tech review for all component changes 🟢 #4115 (comment)
Sanity testing is done for all components 🟢
Release notes are ready and available for all components 🟢 OS Components,
OSD Components
Roadmap is up-to-date (information is available to create release highlights) 🟢
Release ticket is cut 🟢
Any necessary security reviews are complete 🟢

OpenSearch 2.12.0 exit criteria status:

Criteria Status Description Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions 🟢 #4115 (comment)
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days 🟢
Documentation has been fully reviewed and signed off by the documentation community. 🟢 #4115 (comment)
All integration tests are passing 🟢 Integration Failures Open Issues Manual sign off from comment.
Release blog is ready 🟢 #4115 (comment)

OpenSearch-Dashboards 2.12.0 exit criteria status:

Criteria Status Description Comments
Documentation has been fully reviewed and signed off by the documentation community 🟢 #4115 (comment)
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days 🟢
All integration tests are passing 🟢 Integration Failures Open Issues Manual sign off from comment
Release blog is ready 🟢 #4115 (comment)

Preparation

Campaigns

Release Branch and Version Increment - End of February 4th, 2024

Feature Freeze - End of February 5th, 2024

  • OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - End of February 5th, 2024

Release Candidate Creation and Testing - First RC Generated (release window opens) on February 6th, 2024

Performance testing validation - End of February 17th, 2024

  • Post the benchmark-tests
  • Longevity tests do not show any issues.

Pre Release - End of February 20th, 2024

Release - February 20th, 2024

Release Checklist.


Release Checklist

Pre-Release activities

Release activities

  • Docker Promotion: https://build.ci.opensearch.org/job/docker-promotion/62/console
  • Release Validation part 1.
      • OpenSearch and OpenSearch Dashboard Validation.
      • Validate the native plugin installation.
  • Merge consolidated release notes PR.
  • Website and Documentation Changes.
      • Merge staging website PR.
      • Promote the website changes to prod.
      • Add website alert.
  • Release Validation part 2.
      • Validate the artifact download URL's and signatures.
  • Release Validation part 3.
      • Trigger the validation build (Search for Completed validation for <> in the logs).
  • Maven Promotion: https://build.ci.opensearch.org/job/publish-to-maven/28/
  • Publish blog posts.
  • Advertise on Social Media.
  • Post on public slack and Github Release issue.

Post-Release activities


Post Release

Components

OpenSearch

Component Issues tagged with 2.12.0
opensearch-project/OpenSearch#10517
opensearch-project/common-utils#548
opensearch-project/k-NN#1224
opensearch-project/geospatial#543
opensearch-project/security#3513
opensearch-project/cross-cluster-replication#1242
opensearch-project/ml-commons#1471
opensearch-project/neural-search#424
opensearch-project/notifications#782
opensearch-project/observability#1725
opensearch-project/reporting#884
opensearch-project/sql#2269
opensearch-project/asynchronous-search#478
opensearch-project/anomaly-detection#1079
opensearch-project/alerting#1243
opensearch-project/security-analytics#653
opensearch-project/index-management#997
opensearch-project/performance-analyzer#580
opensearch-project/flow-framework#414

OpenSearch Dashboards

Component Issues tagged with 2.12.0
opensearch-project/OpenSearch-Dashboards#5257
opensearch-project/opensearch-dashboards-functional-test#914
opensearch-project/dashboards-observability#1104
opensearch-project/dashboards-reporting#207
opensearch-project/dashboards-visualizations#265
opensearch-project/dashboards-query-workbench#152
opensearch-project/dashboards-maps#521
opensearch-project/anomaly-detection-dashboards-plugin#619
opensearch-project/ml-commons-dashboards#275
opensearch-project/index-management-dashboards-plugin#894
opensearch-project/dashboards-notifications#128
opensearch-project/alerting-dashboards-plugin#758
opensearch-project/security-analytics-dashboards-plugin#751
opensearch-project/security-dashboards-plugin#1606
opensearch-project/dashboards-search-relevance#321
opensearch-project/dashboards-assistant#100

Documentation

Component Issues tagged with 2.12.0
https://github.com/opensearch-project/documentation-website/
Legend

Symbol Meaning
🟢 On track with overall release
🟡 Missed last milestone
🔴 Missed multiple milestones

@github-actions github-actions bot added release untriaged Issues that have not yet been triaged v2.12.0 labels Oct 10, 2023
This was referenced Oct 10, 2023
@AWSHurneyt
Copy link
Contributor

Providing manual sign off for alertingDashboards.

The tests pass with security in this run from earlier today - https://build.ci.opensearch.org/blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5633/pipeline/117#step-638-log-678

And the tests pass without security in this run from 3 days ago - https://build.ci.opensearch.org/blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/5621/pipeline/#step-1046-log-162

Since the last new changes merged to the 2.12 branch 5 days ago, this suggests the tests are flaky. PR opensearch-project/opensearch-dashboards-functional-test#1115 updated our functional test repo to increase wait times as we noticed it was taking a long time for pages to load, which was causing tests to fail. The tests became much more reliable when executed locally after these changes.

@kavilla
Copy link
Member

kavilla commented Feb 20, 2024

For OpenSearch Dashboards,

When looking without-security results. I see the following:

    Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  core-opensearch-dashboards/opensear       94ms        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/aa                                                         │
  │    a_before.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:10        4        4        -        -        - │
  │    ch-dashboards/apps/data_explorer/da                                                         │
  │    ta_source_selector.spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:12        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/da                                                         │
  │    te_nanos_mixed.spec.js                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:11        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/da                                                         │
  │    te_nanos.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      01:36        3        3        -        -        - │
  │    ch-dashboards/apps/data_explorer/di                                                         │
  │    scover_histogram.spec.js                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      01:42       17       14        -        3        - │
  │    ch-dashboards/apps/data_explorer/di                                                         │
  │    scover.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:52        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/do                                                         │
  │    c_navigation.spec.js                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:21        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/do                                                         │
  │    c_table.spec.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:08        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/er                                                         │
  │    rors.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:47        6        6        -        -        - │
  │    ch-dashboards/apps/data_explorer/fi                                                         │
  │    eld_data.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:47        5        5        -        -        - │
  │    ch-dashboards/apps/data_explorer/fi                                                         │
  │    eld_visualize.spec.js                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:34        3        3        -        -        - │
  │    ch-dashboards/apps/data_explorer/fi                                                         │
  │    lter_editor.spec.js                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:11        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/in                                                         │
  │    dex_pattern_with_encoded_id.spec.js                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:13        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/in                                                         │
  │    dex_pattern_without_field.spec.js                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:16        2        2        -        -        - │
  │    ch-dashboards/apps/data_explorer/in                                                         │
  │    spector.spec.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:14        4        3        -        1        - │
  │    ch-dashboards/apps/data_explorer/la                                                         │
  │    rge_string.spec.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear       34ms       11        -        -       11        - │
  │    ch-dashboards/apps/data_explorer/sa                                                         │
  │    ved_queries.spec.js                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:37        6        6        -        -        - │
  │    ch-dashboards/apps/data_explorer/sh                                                         │
  │    ared_links.spec.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:06        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/si                                                         │
  │    debar.spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:07        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/so                                                         │
  │    urce_filter.spec.js                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:05        1        1        -        -        - │
  │    ch-dashboards/apps/data_explorer/zz                                                         │
  │    z_after.spec.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:35        5        5        -        -        - │
  │    ch-dashboards/apps/vis_builder/basi                                                         │
  │    c.spec.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  core-opensearch-dashboards/opensear      04:19        4        2        2        -        - │
  │    ch-dashboards/apps/vis_builder/dash                                                         │
  │    board.spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:21        4        4        -        -        - │
  │    ch-dashboards/apps/vis_builder/expe                                                         │
  │    rimental.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:13        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/area.spec.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:14        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/bar.spec.js                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:13        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/line.spec.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:12        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/metric.spec.js                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:16        1        1        -        -        - │
  │    ch-dashboards/apps/vis_builder/vis_                                                         │
  │    types/table.spec.js                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:22        4        4        -        -        - │
  │    ch-dashboards/apps/vis_type_table/b                                                         │
  │    asic.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      01:02        9        9        -        -        - │
  │    ch-dashboards/apps/vis_type_table/d                                                         │
  │    ata.spec.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  core-opensearch-dashboards/opensear      01:43        4        3        1        -        - │
  │    ch-dashboards/apps/vis_type_table/e                                                         │
  │    mbed.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:41       11       11        -        -        - │
  │    ch-dashboards/apps/vis_type_table/o                                                         │
  │    ptions.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear       16ms        7        -        -        7        - │
  │    ch-dashboards/apps/vis_type_table/s                                                         │
  │    plit.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  core-opensearch-dashboards/opensear      03:28        2        -        2        -        - │
  │    ch-dashboards/apps/vis-augmenter/da                                                         │
  │    shboard_spec.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        2ms        -        -        -        -        - │
  │    ch-dashboards/dashboard_sample_data                                                         │
  │    _with_datasource_spec.js                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear      00:38       34       34        -        -        - │
  │    ch-dashboards/dashboard_sanity_test                                                         │
  │    _spec.js                                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        1ms        -        -        -        -        - │
  │    ch-dashboards/dashboard_share_copy_                                                         │
  │    link_test.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        1ms        -        -        -        -        - │
  │    ch-dashboards/datasource-management                                                         │
  │    -plugin/1_create_datasource.spec.js                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        1ms        -        -        -        -        - │
  │    ch-dashboards/datasource-management                                                         │
  │    -plugin/2_datasource_table.spec.js                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  core-opensearch-dashboards/opensear        1ms        -        -        -        -        - │
  │    ch-dashboards/datasource-management                                                         │
  │    -plugin/3_update_datasource.spec.js                                                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  3 of 41 failed (7%)                      23:41      165      138        5       22        - 

Running locally, the first two spec files succeed every time. With and without security:

Screenshot 2024-02-20 at 9 23 34 AM

Screenshot 2024-02-20 at 9 17 12 AM.

The last test failure is due to it trying to open the doc site from the branch 2.12 in the test: https://opensearch.org/docs/2.12/ which doesn't exist yet.

The last one I will associate a PR to ensure that it doesn't kill the test when the doc site tries to open but spins. And I will fix the flakiness of the first two but not seeing anything that worries me there. Manual sign off for me.

@ylwu-amzn
Copy link
Contributor

For ml-commons, the test looks flaky as they only failed on ARM64. From the log , seems all tests failed, that's not normal. I guess the integ test cluster has some issue. All failed test throw same error Connection refused, that seems test cluster not ready or has some issue. Possible reason is the cluster heap size is too small and deploying ML model crashed the cluster.

@rishabh6788
Copy link
Collaborator

For ml-commons, the test looks flaky as they only failed on ARM64. From the log , seems all tests failed, that's not normal. I guess the integ test cluster has some issue. All failed test throw same error Connection refused, that seems test cluster not ready or has some issue. Possible reason is the cluster heap size is too small and deploying ML model crashed the cluster.

The stderr log has the following:

/opt/java/openjdk-17/bin/java: relocation error: /tmp/tmp3mw_9esm/1/local-test-cluster/opensearch-2.12.0/data/ml_cache/pytorch/1.13.1-cpu-precxx11-linux-aarch64/libstdc++.so.6: symbol __cxa_thread_atexit_impl, version GLIBC_2.18 not defined in file libc.so.6 with link time reference

@ylwu-amzn

@peterzhuamazon
Copy link
Member

For ml-commons, the test looks flaky as they only failed on ARM64. From the log , seems all tests failed, that's not normal. I guess the integ test cluster has some issue. All failed test throw same error Connection refused, that seems test cluster not ready or has some issue. Possible reason is the cluster heap size is too small and deploying ML model crashed the cluster.

The stderr log has the following:

/opt/java/openjdk-17/bin/java: relocation error: /tmp/tmp3mw_9esm/1/local-test-cluster/opensearch-2.12.0/data/ml_cache/pytorch/1.13.1-cpu-precxx11-linux-aarch64/libstdc++.so.6: symbol __cxa_thread_atexit_impl, version GLIBC_2.18 not defined in file libc.so.6 with link time reference

@ylwu-amzn

If this is tar we are testing on CentOS7 and the highest version of glibc is 2.17:

# CentOS7
ldd (GNU libc) 2.17

@ylwu-amzn
Copy link
Contributor

For ml-commons, the test looks flaky as they only failed on ARM64. From the log , seems all tests failed, that's not normal. I guess the integ test cluster has some issue. All failed test throw same error Connection refused, that seems test cluster not ready or has some issue. Possible reason is the cluster heap size is too small and deploying ML model crashed the cluster.

The stderr log has the following:

/opt/java/openjdk-17/bin/java: relocation error: /tmp/tmp3mw_9esm/1/local-test-cluster/opensearch-2.12.0/data/ml_cache/pytorch/1.13.1-cpu-precxx11-linux-aarch64/libstdc++.so.6: symbol __cxa_thread_atexit_impl, version GLIBC_2.18 not defined in file libc.so.6 with link time reference

@ylwu-amzn

If this is tar we are testing on CentOS7 and the highest version of glibc is 2.17:

# CentOS7
ldd (GNU libc) 2.17

Thanks Peter, that's the issue. We don't guarantee supporting all hardwares/Operation Systems. Obviously, CentOS7 has some issue with glibc. It's ok for ml-commons release as this is not our SLA to support this. Can we run integ test on other platforms? I manually tested on ARM64 Ubuntu , looks good.

@bbarani
Copy link
Member

bbarani commented Feb 20, 2024

For ml-commons, the test looks flaky as they only failed on ARM64. From the log , seems all tests failed, that's not normal. I guess the integ test cluster has some issue. All failed test throw same error Connection refused, that seems test cluster not ready or has some issue. Possible reason is the cluster heap size is too small and deploying ML model crashed the cluster.

The stderr log has the following:

/opt/java/openjdk-17/bin/java: relocation error: /tmp/tmp3mw_9esm/1/local-test-cluster/opensearch-2.12.0/data/ml_cache/pytorch/1.13.1-cpu-precxx11-linux-aarch64/libstdc++.so.6: symbol __cxa_thread_atexit_impl, version GLIBC_2.18 not defined in file libc.so.6 with link time reference

@ylwu-amzn

If this is tar we are testing on CentOS7 and the highest version of glibc is 2.17:

# CentOS7
ldd (GNU libc) 2.17

Thanks Peter, that's the issue. We don't guarantee supporting all hardwares/Operation Systems. Obviously, CentOS7 has some issue with glibc. It's ok for ml-commons release as this is not our SLA to support this. Can we run integ test on other platforms? I manually tested on ARM64 Ubuntu , looks good.

@ylwu-amzn Is this documented somewhere? We still support CentOS 7 at OpenSearch product level so want to make sure that this gap is documented.

@ylwu-amzn
Copy link
Contributor

@ylwu-amzn Is this documented somewhere? We still support CentOS 7 at OpenSearch product level so want to make sure that this gap is documented.

I think no for now. Will add this to our document.

@bbarani
Copy link
Member

bbarani commented Feb 20, 2024

All, OpenSearch 2.12.0 version has been released to public 🎉! This is a power packed release with multiple new features, enhancements and bug fixes as listed on the release notes.

A BIG thank you to everyone who participated in the release !

@bbarani
Copy link
Member

bbarani commented Feb 22, 2024

Please add your comments and feedback to this retrospective issue.

The public retro meeting is scheduled for March 5th 2024 at 9:00AM PDT.

@prudhvigodithi
Copy link
Collaborator

Thanks everyone, closing this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Development

No branches or pull requests