v0.0.41

Fixes

• Add requirements_docs.txt to releases. (10fdb6d)

v0.0.40

Features and updates

• Add unique flag to CSVParameter. (ec151e1)
• Add profiling contrib package with profile_by_line decorator. (335f870)
• Add deregister to BaseTask. (0a76c56)
• Add available_packages to law.contrib. (872aab9)
• Add is_iterable and make_unique to util. (9ab2a7f)
• Add get_cmdline_arg to parser, update flag_to_bool util. (718ff75)
• Add ipython base task. (fecfaa5)
• Require luigi>=2.8.2. (51d0092)
• Add interrupt_callback and kill_timeout to util.interruptable_popen. (6f3e7d7)

Improvements and fixes

• Identify IPython output stream as tty handler. (ce25088)
• Refactor handling of local-scheduler flag in docker and singularity sandboxes. (9c3bb2f)
• Add flag to remote file system for using caching. (a4bf003)
• Add scheduler flag to publish_message method. (3414fa0)
• Forward keyboard interrupts to docker sandboxes. (8cb0092)
• Fix syntax of replacing directories when forwarding volumes into sandboxes. (fb2e135)
• Disable pip caching in docker images. (e3913a4)
• More verbose error on failing imports in law run. (6208c0b)
• Disentangle docs requirements. (33635cf)
• Consistent handling of target directory creation. (dcefd94)

v0.0.39

• Pin correct luigi version in requirements. (8ec4761)

v0.0.38

Improvements and fixes

• Fix completeness check of local workflow and requiring branches. (31d45df)
• Fix negative delays in delay decorator. (a5d1cf1)
• Ensure lists in util.multi_match. (fcb9d75)
• Refactor all interactive task methods. (26202a2)
• Refactor remove_task_output, handle collections interactively. (afe2b6f)
• Print output structure information in print_task_status. (bd14729)
• Improve keras model formatters, add weight file formatters. (6f28850, 3b9d0b9)
• Refactor job argument handling (#97). (6f1136a)
• Refactor util.flatten, configure types to be flattened. (31f264c)
• Handle KeyboardInterrupt in decorator errors and util.join_generators. (62718dd)

Features and updates

• Cleanup patches, standardize names. (4817a22, 415a901)
• Patch luigi interface logging. (549d9e2)
• A contrib module rich logging (#98). (7e4b4ff)
• Add common_task_params to util. (7f036ad)
• Make file modes in localize decorator configurable. (8dba932)
• Make number of parallel jobs in remote workflow dynamic via scheduler messages. (680dc99, cac6ef6)
• Add ForestMerge to contrib tasks, deprecate CascadeMerge. (1070c44)
• Add complete_on_success decorator to RunOnceTask in tasks contrib. (73159c9)
• Add from_directory factory function to SiblingFileCollection. (cc08be9)
• Add docker image for examples, close #68. (6933cdb)
• Add %ilaw magic in ipython contrib. (7bb4393)
• Add law_run util. (0604d93)
• Update python and boost versions in docker images. (a85e12e)

v0.0.37

• Refactor tensorflow formatter. (70a9238)
• Refactor target formatters, allow mode dependence. (0a87c91)
• Add ROOTPandasFormatter to root contrib. (52c4733)
• Add coffea formatter (#94) (6c8ca77)
• Add --show parameter to 'law index' completion. (5796d4f)
• Add ipython contrib with %law magic (#96) (716221f)
• Add loremipsum example notebook. (97a9bf8)
• Fix collisions in local copies. (7c0f272)
• Fix cli completion for mac. (47fe76a)

v0.0.36

• Big refactoring of the config, add config example with all possible options. (689af21, cafd9c8, 42436e9)
• Fix task parameter encoding for remote jobs. (588cd2a)
• Make job operation chunk sizes configurable. (dd8083a)
• Add optional checksumming to cmssw bundling contrib task. (94e4ab5)
• Refactor and document remote job script. (c7a0a5a)
• Refactor batched job operations, especially accelerate arc submissions. (7c9a5dd)

v0.0.35

• Add option -limit to condor_history and condor_q commands (#86, @mschnepf) (c8c1fe4)
• Quote commands in all remote job managers. (05a10ac)
• Fix usage of CSVParameter. (5fcdc68)
• Add is_number to util. (7ea2dc6)
• Enable dumping of intermediate submission data in contrib remote workflows. (87192df)
• Add wlcg shell grid tools to contrib. (90efb7d)
• Add return_all option to GFALInterface.{uri,get_base}. (65bc9a2)

v0.0.34

• Use symlinks to input files instead if copies in job script when changing into job home directory. (3a12c0c)
• Cleanup sandbox environment variable handling. (183dd59)
• Fix typo in option retrieval in contrib workflows. (086659d)

v0.0.33

• Update python, boost and gfal versions in dockerfiles. (8fe27b5)
• Refactor utils in wlcg and arc contrib packages. (8f60922)
• Refactor random base path selection for all remote target operations. (2950a66)
• Add brace_expand to util. (57c54c5)
• Improve docker sandbox loading. (7d2cfd7)
• Fix singularity env loading for disabled overlay. (cf648ba)
• Add DurationParameter. (8f929ec)
• Make slack notifications agnostic of slackclient version. (a9d535b)
• Fix interplay with sandboxed worker and central scheduler. (0b2d76f)
• Enable running singularity containers without bind access. (807306d)
• Setup non-law loggers defined in logging setup. (ac7cd9c)
• Use expanded config values across law. (a76d9a7)
• Allow tasks to exclude parameters from repr. (9c5db7b)

v0.0.32

• Remove py36 and add py38 docker image.
• Allow skipping the process shutdown in interactive task methods.
• Make task attribute in Sandbox definition optional.
• Fix typo in CascadeMerge contrib task that lead to wrong branch ranges in dependencies.
• Refactor and automate quoting in shell commands.