Skip to content

Latest commit

 

History

History
62 lines (62 loc) · 2.6 KB

RELEASE_NOTES.md

File metadata and controls

62 lines (62 loc) · 2.6 KB
Raw

1.5.0

  • Enable struct approx equality (recursive calling)
  • Improve java.math.BigDecimal tolerance
  • Add scala.math.BigDecimal tolerance
  • Change java.sql.Timestamp tolerance:
    • New param tolTimestamp based on java.time.Duration
    • Previous timestamp tolerance was based on tol param

1.4.0

  • Minimum supported version is now 2.4.8
  • We have Scala 2.11,2.12, and 2.13 support
  • Fix dependency that had CVE-2020-15250 (older versions you can work around by pinning junit forward)
  • Add better Iceberg support
  • Add better support for custom per-test SQL properties
  • Simplify testing codegen & non-codegen expressions :D

1.0.0

  • Minimum supported version of Spark is now 2.4
  • Add support for Spark 3.0 & 3.0.1
  • Drop scala 2.10.X & 2.11.X support
  • Switch JDK target to JDK8 (drop JDK7 support)
  • Clean up a lot of dead code (yay!)

0.10.0

  • Add support for Spark 2.3.1, 2.1.3
  • Add better sized generators
  • Improve logging for differing output sizes

0.9.0

  • Add Spark 2.1.2
  • Add Spark 2.3.0

0.8.1

  • Add support for Spark 2.2.1

0.8.0

  • Add initial draft support for structured streaming.

0.7.4

  • Fix Scala 2.10 Spark 2.0.X, 2.1.X context reuse reflection issue.

0.7.3

  • Re-add Scala 2.10 support up to and including Spark 2.2.X series
  • Attempt to make it so that users doing SQL tests without Hive don't need the hive jars.
  • Don't reset the SparkSession provider when in reuse mode.
  • Add workaround for inaccessible active context info in Spark 2.0
  • Upgrade to Hadoop 2.8.1 for mini cluster
  • Change build env after travis changes

0.7.2

  • Add experimental support to for reusing a SparkContext/Session across multiple suites. For Spark 2.0+ only.

0.7.1

  • Upgrade mini cluster hadoop dependencies
  • Add support for Spark 2.2.0
  • YARNCluster now requires SPARK_HOME to be set so as to configure spark.yarn.jars (workaround for YARN bug from deprecated code in Spark 2.2).

0.7

  • Add Python RDD comparisons
  • Switch to JDK8 for Spark 2.1.1+
  • Add back Kafka tests
  • Make it easier to disable Hive support when running tests
  • Add Spark 2.1.1 to the build
  • Misc internal style cleanup (more help always welcome!)
  • README update
  • Some methods made protected which used to be public, recompile required.

0.6

  • Updated scalatest dependency to 3.0.1 (from 2.X) minor breaking changes with RNG
  • Updated scalacheck to 1.13.4
  • Added support for specifying custom generators for fields nested in StructTypes
    • Renamed ColumnGenerator to Column
    • Changed ColumnGenerator to the base class of column generators
    • Added ColumnList to specify custom generators for a list of columns