What's Changed

Upgrades

• Add Spark 3.5 support by@jhchee in#514

New Features

• New type of MetricsRepository by@VenkataKarthikP:
  • Using Spark tables as the data source in#518
• Row Level Result Treatment Options by@eycho-am:
  • Uniqueness and Completeness in#532
  • Miminum and Maximum in#535
• Anomaly Detection Changes by@zeotuan:
  • Add Daily Season with Hourly Interval to HoltWinter in#546
• New analyzers:
  • RatioOfSums by@scott-gunn in#552
  • Column Count Analyzer and Check by@mentekid in#555

Maintenance/Fixes

• Fix Breeze dependency conflict in Anomaly Detection Spark 3.4+ by@zeotuan in#545
• Data Sync / DatasetMatch changes by@VenkataKarthikP:
  • add data synchronization test to verification Suite in#526
  • support col match and change to DatasetMatch in#529
• Row level results fixes:
  • Add analyzerOption to add filteredRowOutcome for isPrimaryKey Check by@eycho-am in#537
  • Fix bug in MinLength and MaxLength when NullBehavior.EmptyString by@eycho-am in#538
  • [Min/Max] Apply filtered row behavior at the row level evaluation by@rdsharma26 in#543
  • [MinLength/MaxLength] Apply filtered row behavior at the row level evaluation by@rdsharma26 in#547
  • Fix for satisfies row level results bug by@rdsharma26 in#553

New Contributors

• @VenkataKarthikP made their first contribution in#518
• @scott-gunn made their first contribution in#552

Full Changelog:2.0.6...2.0.7

Contributors