Skip to content

Issues: materialsproject/matbench

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

32 Open 26 Closed
32 Open 26 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Maintenance status of matbench
#357 opened Nov 8, 2024 by ml-evs
1 of 3 tasks
installation error with python3.10
#269 opened Aug 3, 2023 by hspark1212
3
Unable to add label to pull request
#266 opened Jul 27, 2023 by desmond-molloy-mcl
Follow-up of Benchmark Confirmation on coGN and MODNet
#262 opened Jun 23, 2023 by chao1224
Need to upgrade to newer version of EndBug add-and-commit soon, as features from v7 are being deprecated dependencies Pull requests that update a dependency file
#260 opened May 17, 2023 by ardunn
3
Doesn't seem like per-task plots are being regenerated correctly? docs Anything having to do with changes to the documentation
#259 opened May 17, 2023 by ardunn
5
FSGN new_benchmark PR containing a new benchmark. May ONLY contain a new benchmark.
#246 opened Mar 16, 2023 by ardunn
@ardunn @hrushikesh-s
Datestamps are not loaded correctly code Anything having to do with matbench python package code
#234 opened Feb 12, 2023 by ardunn
@ardunn
How to convert to torch_geometric
#207 opened Nov 16, 2022 by vict0rsch
1
[Feature Request] add task.unload() function to free up memory
#197 opened Oct 7, 2022 by sgbaird
Can the Matbench submission process be handled entirely within a Google Colab notebook?
#196 opened Oct 7, 2022 by sgbaird
2
Potential for a kaggle competition
#195 opened Oct 5, 2022 by sgbaird
2
Documenting which algorithms/repos have installation problems
#194 opened Oct 5, 2022 by sgbaird
setup.py should read requirements files for single source of truth
#193 opened Oct 5, 2022 by ardunn
@ardunn
Consider Elo-based system for scoring/comparing algorithms
#190 opened Oct 1, 2022 by ardunn
score_array computes roc-auc values on discretized predictions
#181 opened Sep 8, 2022 by pbenner
1
Pymatviz figures need refinement before they can be shown on main website/MP docs Anything having to do with changes to the documentation
#172 opened Aug 13, 2022 by ardunn
25
Add more info on how data was collected/snapshotted/filtered etc.
#165 opened Jul 28, 2022 by ardunn
@ardunn
Look into docker for reproducibility
#163 opened Jul 27, 2022 by ardunn
Tasks with uncertainty should enforce all folds have uncertainty code Anything having to do with matbench python package code high priority
#162 opened Jul 27, 2022 by ardunn
@ardunn
Citing matbench and automated archival of releases
#156 opened Jun 28, 2022 by ml-evs
2
hash not matching, (failing tests) seems related to matminer high priority
#155 opened Jun 27, 2022 by sgbaird
@ardunn
2
Discussion on a matbench-generative benchmark: what it might look like and where to put it
#150 opened Jun 11, 2022 by sgbaird
19
How does ROCAUC work in score_array()? code Anything having to do with matbench python package code high priority
#137 opened May 12, 2022 by janosh
@ardunn
1
Trying to load a partially recorded benchmark from disk raises ValueError
#134 opened May 3, 2022 by janosh
2
ProTip! Adding no:label will show everything without a label.