Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Import of summary data from CSV #9773

Closed
magnesj opened this issue Jan 31, 2023 · 0 comments
Closed

Import of summary data from CSV #9773

magnesj opened this issue Jan 31, 2023 · 0 comments
Assignees
@kriben
Labels
Enhancement An addition that can be observed by the user
Milestone
Reveal Backlog

Comments

@magnesj
Copy link
Member

magnesj commented Jan 31, 2023 •
edited
Loading

Add support for import of single summary data and ensemble data from CSV files.

  • add RimCsvSummaryCase derived from RimSummaryCase
  • import data from Reveal, Stimplan and FMU summary files in CSV format
  • support import into summary case using file dialog and ensemble dialog
  • support import using Python Import CSV ensemble from Python #10106
  • extend Imported category to allow optionally extra levels before summary data is available. This can be used to represent folders in a data structure
  • complete the display of vector in Summary Data Sources to ensure that all vectors are available for drag/drop
  • consider using a template concept to identify parts of path to be represented in the level definitions
  • add handling of text header before data rows
    • reveal: header lines, table data, new header, table data, new header, table data, ....
    • stimplan: first line: title, second line: column names, third line units

Other tasks

  • adjust import of observed data to support import of time with unknown start date. Add optional specification of simulation start

Related issues
#5154

Testdata is located at "\CeeSol All\Projects\maintenance\CsvSummaryCase"

Example file layout for StimPlan
image
@magnesj magnesj added the Enhancement An addition that can be observed by the user label Jan 31, 2023
@magnesj magnesj added this to the Reveal 2023 Sprint 01 milestone Jan 31, 2023
@magnesj magnesj mentioned this issue Feb 17, 2023
Closed
kriben added a commit that referenced this issue Mar 8, 2023
@kriben
#9773 Add summary reader for Reveal csv data.
d97fb79
kriben added a commit that referenced this issue Mar 8, 2023
@kriben
#9773 Add context menu for importing Reveal csv summary data.
ccb947c
kriben added a commit that referenced this issue Mar 10, 2023
@kriben
#9773 Add summary reader for Reveal csv data.
8a9072d
kriben added a commit that referenced this issue Mar 10, 2023
@kriben
#9773 Add context menu for importing Reveal csv summary data.
027f8c6
kriben added a commit that referenced this issue Mar 10, 2023
@kriben
#9773 Extract unit from names, and default category if provided.
af7de0c
kriben added a commit that referenced this issue Mar 10, 2023
@kriben
fixup! #9773 Add summary reader for Reveal csv data.
e831307
kriben added a commit that referenced this issue Mar 10, 2023
@kriben
fixup! #9773 Add summary reader for Reveal csv data.
c188ebb
kriben added a commit that referenced this issue Mar 10, 2023
@kriben
#9773 Add summary reader for Reveal csv data.
7074e2c
kriben added a commit that referenced this issue Mar 10, 2023
@kriben
#9773 Add context menu for importing Reveal csv summary data.
af0589d
kriben added a commit that referenced this issue Mar 10, 2023
@kriben
#9773 Extract unit from names, and default category if provided.
9dfbad7
kriben added a commit that referenced this issue Mar 13, 2023
@kriben
#9773 Add summary reader for Reveal csv data.
19d9bb6
kriben added a commit that referenced this issue Mar 13, 2023
@kriben
#9773 Add context menu for importing Reveal csv summary data.
363a88c
kriben added a commit that referenced this issue Mar 13, 2023
@kriben
#9773 Extract unit from names, and default category if provided.
48c7074
kriben added a commit that referenced this issue Mar 13, 2023
@kriben
#9773: import StimPlan time series data.
5792b93
kriben added a commit that referenced this issue Mar 15, 2023
@kriben
#9773 Add summary reader for Reveal csv data.
b95340f
kriben added a commit that referenced this issue Mar 15, 2023
@kriben
#9773 Add context menu for importing Reveal csv summary data.
a954308
kriben added a commit that referenced this issue Mar 15, 2023
@kriben
#9773 Extract unit from names, and default category if provided.
75400c6
kriben added a commit that referenced this issue Mar 15, 2023
@kriben
#9773: import StimPlan time series data.
eba9368
kriben added a commit that referenced this issue Mar 15, 2023
@kriben
#9773 Add summary reader for Reveal csv data.
04cbc24
kriben added a commit that referenced this issue Mar 15, 2023
@kriben
#9773 Add context menu for importing Reveal csv summary data.
d4194ef
kriben added a commit that referenced this issue Mar 15, 2023
@kriben
#9773 Extract unit from names, and default category if provided.
2c3bed1
kriben added a commit that referenced this issue Mar 15, 2023
@kriben
#9773: import StimPlan time series data.
be79381
kriben added a commit that referenced this issue Mar 17, 2023
@kriben
#9773 Add summary reader for Reveal csv data.
d707c95
kriben added a commit that referenced this issue Mar 17, 2023
@kriben
#9773 Add context menu for importing Reveal csv summary data.
942c755
kriben added a commit that referenced this issue Mar 17, 2023
@kriben
#9773 Extract unit from names, and default category if provided.
068bdb4
kriben added a commit that referenced this issue Mar 17, 2023
@kriben
#9773: import StimPlan time series data.
7d01015
kriben added a commit that referenced this issue Mar 17, 2023
@kriben
#9773 Fix case name in import.
1810935
kriben added a commit that referenced this issue Apr 12, 2023
@kriben
#9773 Fix parameters.txt lookup for StimPlan summaries
e9b65a3
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Refactor ensemble import dialog.
fea1940
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add support for ensemble import of StimPlan/Reveal summary data.
88042db
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add method for finding min and max time steps.
aaa45d9
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add option for resampling to hour intervals.
4aa3f7b
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add option for resampling to minute intervals.
7d5e6ba
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Ensemble statistics: determine sub-sampling period dynamically.
d49affc
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Generate better ensembles for StimPlan summaries.
e3a3c1a
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Fix parameters.txt lookup for StimPlan summaries
e867857
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add method for finding min and max time steps.
6e59272
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add option for resampling to hour intervals.
7c49267
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add option for resampling to minute intervals.
35bea12
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Ensemble statistics: determine sub-sampling period dynamically.
2e06c41
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Generate better ensembles for StimPlan summaries.
894514e
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Fix parameters.txt lookup for StimPlan summaries
46a9930
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Generate better ensembles for StimPlan summaries.
f0c13ed
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Fix parameters.txt lookup for StimPlan summaries
f976a8e
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add support for ensemble import of StimPlan/Reveal summary data.
e899043
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add method for finding min and max time steps.
3dd514a
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add option for resampling to hour intervals.
7f14d22
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Add option for resampling to minute intervals.
e7061fa
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Ensemble statistics: determine sub-sampling period dynamically.
731543e
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Generate better ensembles for StimPlan summaries.
95f9719
kriben added a commit that referenced this issue Apr 19, 2023
@kriben
#9773 Fix parameters.txt lookup for StimPlan summaries
1090d00
@magnesj magnesj mentioned this issue Apr 20, 2023
Merged
magnesj added a commit that referenced this issue Apr 20, 2023
@kriben @magnesj
Refactor ensemble import dialog
ff209ad 
* #9773 Refactor ensemble import dialog.
* #9773 Add support for ensemble import of StimPlan/Reveal summary data.
* #9773 Add method for finding min and max time steps.
* #9773 Add option for resampling to hour intervals.
* #9773 Add option for resampling to minute intervals.
* #9773 Ensemble statistics: determine sub-sampling period dynamically.
* Use RiaWeightedMeanCalculator for curve resampling.
* Add HOUR and MINUTE to date time app enum.
* #9773 Generate better ensembles for StimPlan summaries.
* #9773 Fix parameters.txt lookup for StimPlan summaries
* Refactor: Improve interface of RicImportSummaryCasesFreature::createSummaryCasesFromFiles

Co-authored-by: Magne Sjaastad <[email protected]>
@kriben kriben closed this as completed Sep 27, 2023
@github-actions github-actions bot added the PendingRelease Issues is fixed and will be available in next release label Sep 27, 2023
@magnesj magnesj removed the PendingRelease Issues is fixed and will be available in next release label Oct 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kriben kriben

Labels
Enhancement An addition that can be observed by the user
Projects
None yet
Milestone
Reveal Backlog
Development

No branches or pull requests
2 participants
@kriben @magnesj