[ENG-6266][ENG-6241] send monthly usage to trove as supplementary metadata

[aaxelb]

Purpose

add monthly view counts to metadata indexed for search

Changes

• add monthly report(er) to compute views/downloads in a COUNTER-compliant way (from [ENG-6264] add monthly "item usage" report #10760)
• support sending metadata to SHARE in multiple parts with different query params (is_supplementary and expiration_date; see [ENG-6265] supplementary metadata SHARE#825 and [ENG-6313] allow raw data to expire SHARE#826 )
• partition each item's osfmap metadata (in osf.metadata.osf_gathering) into three parts that are handled differently:
  • OsfmapPartition.MAIN
    • the same old descriptive metadata record we know and love
    • sent to SHARE without is_supplementary nor expiration_date
  • OsfmapPartition.SUPPLEMENT
    • includes metadata less about the information content of the resource and more about how it's handled on osf (currently empty; will include stuff like addons used and osfstorage region)
    • sent to SHARE with is_supplementary but without expiration_date
  • OsfmapPartition.MONTHLY_SUPPLEMENT
    • includes monthly view/download counts
    • sent to SHARE with is_supplementary and an expiration_date two months after the reporting period

QA Notes

Please make verification statements inspired by your code and what your code touches.

• Verify search indexing still works
• Verify last month's view/download counts show in (dashboards powered by) the search api shortly after the monthly reporter completes

What are the areas of risk?

Any concerns/considerations/questions that development raised?

Documentation

Side Effects

Ticket

ENG-6266

[aaxelb]

comments from group code review (with @mfraezz @felliott )

[mfraezz]

In pair review, explored one rabbit-hole regarding efficiency/persistence of supplements. Once that's filled in, should be good to go 🐇

[cslzchen]

LGTM 🎆 and left a few random questions out of curiosity.

(I love the unit tests coverage though I didn't go over them as carefully as the code).