Skip to content

kontextfrei 0.8.0

Latest
Latest
Compare
Choose a tag to compare
@dwestheide dwestheide released this 26 Jan 21:13
· 3 commits to master since this release
v0.8.0
020d936

This release is about three things:

  • adding support for more recent major Spark versions, in particular Spark 2.3 and Spark 2.4; since the latter is the first Spark version available for Scala 2.12, this release of kontextfrei is also the first one cross-compiled against Scala 2.12, at least for that specific Spark version
  • adding a few RDD operators that were still missing: repartitionAndSortWithinPartitions, partitionBy, filterByRange andsortByKey; there is also an empty method now in DistributionOps, which invokes emptyRDD in the RDD implementation
  • finally, and most importantly, improving the developer experience by supporting the setName method and by setting the proper call site; both of these lead to a better experience in the Spark UI when using kontextfrei

Issues

The following issues have been closed as part of this release:

#55, #56, #57, #59, #61, #62, #64, #66

Contributors

This is the first release including external contributions. Thanks a lot to Simon J. Scott for his invaluable contributions regarding the Spark UI, the creation of empty RDDs and the partitionBy operator.

Assets 2
Loading