Skip to content

Latest commit

 

History

History
21 lines (17 loc) · 819 Bytes

TODO-items.md

File metadata and controls

21 lines (17 loc) · 819 Bytes
Raw

TODO

read_partitioned_dataframe_csv

TODO: dump ENV to screen prettyprinting like ENV | grep

# a macro or command for this, with filtering would be best
using Printf
[(@printf "%-40s  %s\n" k v) for (k,v) in ENV];

TODO: add AWS as explicit dependency TODO: default args date_format = nothing, column_types = nothing, call CSV.read as kwargs TODO: explicitly list Union type of S3Path/Abs Path, make note that AWSConfig is component of S3Path TODO: ["csv", "txt", "tsv"] extensions should be OK, add as vector membership check TODO: spin off PartitionedDataReader.jl to a repo

kwargs information

https://docs.julialang.org/en/v1/manual/functions/ CSV.read is a great example

  • must pass arguments in to CSV.read, sometimes none are needed