Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolidate directories for writing out files #302

Open
neubig opened this issue Aug 29, 2023 · 0 comments
Open

Consolidate directories for writing out files #302

neubig opened this issue Aug 29, 2023 · 0 comments

Comments

@neubig
Copy link
Collaborator

neubig commented Aug 29, 2023

Currently prompt2model writes out many files, which can be basically split into two categories:

Cache

These are all of the files that are used by the various models that generate the result. These should include:

  • dataset_info.json
  • model_info.json
  • The retrieval indices generated from these two files

These should be written to a cache directory, specified by the following function:

def get_prompt2model_cache_dir() -> str:
    """Get the cache directory for prompt2model."""
    default_cache = os.path.join(os.environ["HOME"], ".cache", "prompt2model")
    return os.environ.get("PROMPT2MODEL_CACHE", default_cache)

Experiment outputs

These are outputs of a particular experiment. It would be good if the default directories for these outputs could be consolidated to all be beneath a single directory, such as output or something. Currently the results are output to several different directories, which is confusing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant