v1.10.1

What's Changed

• #516 Fix JDBC source and other sources error handling in #517
• #510 Improve the way schema queries are generated in #518

Full Changelog: v1.10.0...v1.10.1

v1.10.0

What's Changed

• #374 Incremental Ingestion in #487
• #493 Allow metastore to have non-partitioned data in Delta Lake format in #513
• #495 Add operation definitions to the task results object used in notifications in #514

Full Changelog: v1.9.11...v1.10.0

v1.9.11

What's Changed

• Fix Spark Application Description not always being set in #506
• #508 Fix the way descriptions are fetched for JDBC tables in #509
• Fix jobs being re-run are marked as started because of an obsolete dependency in email notifications in #509

Full Changelog: v1.9.10...v1.9.11

v1.9.10

What's Changed

• #496 Fix handling of retrospectively updated jobs in #497
• #499 Escape HTML in error messages in #503
• #501 Fix Jdbc Native treating of nullable fields in #502
• #498 Allow dynamically setting job descriptions in #500

Full Changelog: v1.9.9...v1.9.10

v1.9.9

What's Changed

• #489 Fix date expressions calculation for JDBC with SQL queries in #490

Full Changelog: v1.9.7...v1.9.9

v1.9.8

What's Changed

• #480 Fix 'schemas' table not being properly created when Delta Lake is used for bookkeeping in #480
• #483 Fix count() queries with MS SQL and other SQL dialects in #484
• #482 Fix reading of column description for tables that are specified in quotes in #485

Full Changelog: v1.9.7...v1.9.8

v1.9.7

What's Changed

• #476 Allow configuring maximum length of error messages in email notifications in #477
• #475 Add [experimental] Delta Lake location or managed table as a bookkeeping storage option in #478

Full Changelog: v1.9.6...v1.9.7

v1.9.6

What's Changed

• #451 Add spark_application_id to journal by @VladimirRybalko in #467
• #469 Add options to fail on late and new data separately by @yruslan in #470
• #468 Take into account maximum string length when comparing schemas. by @yruslan in #471
• #472 Fix Denodo dialect handling of Time columns. by @yruslan in #473

Full Changelog: v1.9.5...v1.9.6

v1.9.5

What's Changed

• #339. Use more effective record count when JDBC source is used by @VladimirRybalko in #460
• #461 Add the ability to set hard timeouts for Pramen operations by @yruslan in #462
• #463 Add pipeline-wide warning flag so that transformers can change the state of the pipeline. by @yruslan in #465

New Contributors

• @VladimirRybalko made their first contribution in #460

Full Changelog: v1.9.4...v1.9.5

v1.9.4

What's Changed

• #434 Add experimental save mode option for metastore tables in #455
• #456 Fix schema changes detection logic in #457
• #454 Allow disabling of logging the effective configuration in #458

Full Changelog: v1.9.3...v1.9.4