Release v0.221.1

Private Datasets: process acceptance testing feedback: Vol. 1 (#1054)

* TransformInput: after validation, use alias only for error messages

* OsoDatasetAuthorizer: be prepared to work with duplicates

* Release (patch): 0.221.1

Release v0.221.0

[0.221.0] - 2025-01-29

Added

• GQL suport to query and update email on the currently logged account
• Account registration sends AccountLifecycleEvent to Outbox

Changed

• Emails are mandatory for Kamu accounts now:
  • predefined users need to specify an email in config
  • predefined users are auto-synced at startup in case they existed before
  • GitHub users are queried for primary verified email, even if it is not public
  • migration code for the database existing users

Release v0.220.0

[0.220.0] - 2025-01-27

Changed

• Private Datasets:
  • GQL, DatasetFlowRunsMut::trigger_flow(): added check of input datasets for accessibility for ExecuteTransform
  • GQL, TransformInput::input_dataset(): dataset may not be accessible
  • GQL, MetadataChainMut::commit_event: added check of dataset inputs for availability for SetTransform
  • HTTP: added access check for the dataset router (DatasetAuthorizationMiddleware), affected:
    • POST /:dataset/ingest
    • GET /:dataset/metadata
    • GET /:dataset/tail
  • HTTP, GET /datasets/:id: access check corrected
  • HTTP: replaced access errors with not found errors
  • CLI, kamu pull: replaced access errors with not found errors
• Continued work on use cases extracting:
  • ViewDatasetUseCase
  • EditDatasetUseCase
  • GetDatasetDownstreamDependenciesUseCaseImpl
  • GetDatasetUpstreamDependenciesUseCaseImpl

Release v0.219.2

[0.219.2] - 2025-01-24

Added

• Reusable static database migrators

Release v0.219.1

[0.219.1] - 2029-01-18

Fixed

• Reverted unstable AWS API dependencies

Release v0.219.0

[0.219.0] - 2029-01-17

Changed

• Massive crates restructuring around Open Data Fabric code:
  • src/odf concentrates large number of related crates now, preparing for future separation in different Git repo
  • old opendatafabric crate becamse odf-metadata
  • low-level repository implementations became odf-storage[-...] crates
  • specific storage technologies are gated via features (lfs, s3, http)
  • DatasetFactory, Dataset, DatasetSummary, DatasetLayout, BlockRef,
    MetadataChain and visiting logic now are residents of odf-dataset
  • kamu-data-utils became odf-data-utils
  • multiple utility libraries introduced, shared both via ODF and main Kamu code
    (async-utils, file-utils, s3-utils, test-utils)
  • DatasetRepository still stays in Kamu core, renamed to DatasetStorageUnit to better match it's current purpose
  • import statements pointing at ODF code have been cleaned all over the code base (use odf meta-crate only outside src/odf)

Release v0.218.0

[0.218.0] - 2029-01-17

Changed

• Private Datasets:
  • OSO: using user actors / dateset resources that come from the database
    • Thus, any access check relies on real entities
  • GQL, added Dataset.visibility() to get the current visibility value
  • GQL, added DatasetMut.setVisibility() to be able to change the dataset visibility after it has been created
  • Deletion of previously created (and unused) ReBAC-properties and reindexing
  • OSO: updating the schema to use identifiers instead of names
  • OSO: added resource storage for access speed
  • E2E: Using the correct account in multi-tenant mode
    • And also the possibility of set it up
  • DatasetOwnershipService: moved to the kamu-dataset crate area & implemented via DatasetEntryServiceImpl
  • GQL, DatasetMetadata.currentUpstreamDependencies: indication if datasets not found/not accessed
  • GQL, DatasetMetadata.currentDownstreamDependencies: exclude datasets that cannot be accessed
  • E2E: added the ability to create an account using CLI

Release v0.217.3

[0.217.3] - 2025-01-14

Fixed

• Fix crash on resolving dataset by non existing account
• Minor improvements in event sourcing aggregation

Release v0.217.2

[0.217.2] - 2025-01-10

Changed

• Updated to latest datafusion and alloy dependencies
• Performance improvements with batch loading of event sourcing aggregates

Release v0.217.1

[0.217.1] - 2025-01-09

Changed

• Extended database config options with next fields: maxConnections, maxLifeTimeSecs and acquireTimeoutSecs