TileDB 2.24.2

TileDB v2.24.2 Release Notes

Defects removed

• Fix serialization issue with schema evolution for query v3. #5154

TileDB 2.24.1

TileDB v2.24.1 Release Notes

Defects removed

• Fix segfaults in WebP queries ran in parallel. #5065

Configuration changes

• Add vfs.s3.storage_class config option to set the storage class of newly uploaded S3 objects. #5053
• Add rest.custom_headers.* config option to set custom headers on REST requests. #5104
• Add rest.payer_namespace config option to set the namespace to be charged for REST requests. #5105

TileDB 2.23.1

TileDB v2.23.1 Release Notes

Improvements

• Add array uri to tiledb_array_deserialize #4961

Defects removed

• Fix segfaults in WebP queries ran in parallel. #5065

Configuration changes

• Add rest.custom_headers.* config option to set custom headers on REST requests. #5104
• Add vfs.s3.storage_class config option to set the storage class of newly uploaded S3 objects. #5053
• Add rest.payer_namespace config option to set the namespace to be charged for REST requests. #5105

TileDB 2.24.0

TileDB v2.24.0 Release Notes

Deprecation announcements

In version 2.26.0, the superbuild architecture of the build system will be removed and TileDB will become a single-level CMake project with no CMake sub-build for libtiledb after dependencies are built (as of TileDB 2.24, dependencies are built at configuration time with vcpkg). make install-tiledb will continue to work, but will become effectively an alias for make install, which will always produce an up-to-date install after this change. Other build commands of the form make && make -C tiledb <targets> will have to be replaced by make <targets>. You can preview the effects of this change by configuring with CMake and passing the -DTILEDB_CMAKE_IDE=ON option.

Configuration changes

• Implement consolidation memory budget variables. #5011

New features

• Add stats counter memory_budget_exceeded for when a query goes over budget. #4993
• Support VFS ls_recursive API for Azure filesystem. #4981
• Support VFS ls_recursive API for Google Cloud Storage filesystem. #4997

Defects removed

• Fix SEG faults in the SparseGlobalOrderReader when using a Query Condition. #5012
• Throw error on dimension drop in schema evolution. #4958
• Reject unordered tile/cell order when creating an ArraySchema. #4973
• Disallow possibly-invalid reinterpret datatypes for delta and double delta compression filters. #4992
• Fix performance regression in group::dump(). #5002
• Fix traversal limit in array metadata serialization. #4971

API changes

C API

• Experimental APIs related to groups, deleting arrays and upgrading the format version of arrays were moved to stable. You can use them without including <tiledb_experimental.h>. #4919
• Add array uri to tiledb_array_deserialize. #4961

C++ API

• The experimental Group class was moved to stable. You can use it without including <tiledb_experimental>. #4919

Build System Changes

• Fix AVX2 support detection. #4969
• Fix configuration errors when cross-compiling. #4995
• Fix build errors where the fmt headers could not be found for spdlog. #5008

Internal Improvements

• Implement zip_view for external sort. #4930
• Write iter_swap for zip_view for external sort. #4943
• Implement proxy sort permutation for external sort. #4944
• Implemented offset/length conversion functions for external sort. #4948

TileDB 2.24.0-rc1

TileDB v2.24.0 Release Notes

Deprecation announcements

In version 2.26.0, the superbuild architecture of the build system will be removed and TileDB will become a single-level CMake project with no CMake sub-build for libtiledb after dependencies are built (as of TileDB 2.24, dependencies are built at configuration time with vcpkg). make install-tiledb will continue to work, but will become effectively an alias for make install, which will always produce an up-to-date install after this change. Other build commands of the form make && make -C tiledb <targets> will have to be replaced by make <targets>. You can preview the effects of this change by configuring with CMake and passing the -DTILEDB_CMAKE_IDE=ON option.

Configuration changes

• Implement consolidation memory budget variables. #5011

New features

• Add stats counter memory_budget_exceeded for when a query goes over budget. #4993
• Support VFS ls_recursive API for Azure filesystem. #4981
• Support VFS ls_recursive API for Google Cloud Storage filesystem. #4997

Defects removed

• Fix SEG faults in the SparseGlobalOrderReader when using a Query Condition. #5012
• Throw error on dimension drop in schema evolution. #4958
• Reject unordered tile/cell order when creating an ArraySchema. #4973
• Disallow possibly-invalid reinterpret datatypes for delta and double delta compression filters. #4992
• Fix performance regression in group::dump(). #5002
• Fix traversal limit in array metadata serialization. #4971

API changes

C API

• Experimental APIs related to groups, deleting arrays and upgrading the format version of arrays were moved to stable. You can use them without including <tiledb_experimental.h>. #4919
• Add array uri to tiledb_array_deserialize. #4961

C++ API

• The experimental Group class was moved to stable. You can use it without including <tiledb_experimental>. #4919

Build System Changes

• Fix AVX2 support detection. #4969
• Fix configuration errors when cross-compiling. #4995
• Fix build errors where the fmt headers could not be found for spdlog. #5008

Internal Improvements

• Implement zip_view for external sort. #4930
• Write iter_swap for zip_view for external sort. #4943
• Implement proxy sort permutation for external sort. #4944
• Implemented offset/length conversion functions for external sort. #4948

TileDB 2.24.0-rc0

TileDB v2.24.0 Release Notes

Deprecation announcements

In version 2.26.0, the superbuild architecture of the build system will be removed and TileDB will become a single-level CMake project with no CMake sub-build for libtiledb after dependencies are built (as of TileDB 2.24, dependencies are built at configuration time with vcpkg). make install-tiledb will continue to work, but will become effectively an alias for make install, which will always produce an up-to-date install after this change. Other build commands of the form make && make -C tiledb <targets> will have to be replaced by make <targets>. You can preview the effects of this change by configuring with CMake and passing the -DTILEDB_CMAKE_IDE=ON option.

Configuration changes

• Implement consolidation memory budget variables. #5011

New features

• Enable array open v2 and query v3 by default. #4974
• Add stats counter memory_budget_exceeded for when a query goes over budget. #4993
• Support VFS ls_recursive API for Azure filesystem. #4981
• Support VFS ls_recursive API for Google Cloud Storage filesystem. #4997

Defects removed

• Fix SEG faults in the SparseGlobalOrderReader when using a Query Condition. #5012
• Throw error on dimension drop in schema evolution. #4958
• Reject unordered tile/cell order when creating an ArraySchema. #4973
• Disallow possibly-invalid reinterpret datatypes for delta and double delta compression filters. #4992
• Fix performance regression in group::dump(). #5002
• Fix traversal limit in array metadata serialization. #4971

API changes

C API

• Experimental APIs related to groups, deleting arrays and upgrading the format version of arrays were moved to stable. You can use them without including <tiledb_experimental.h>. #4919
• Add array uri to tiledb_array_deserialize. #4961

C++ API

• The experimental Group class was moved to stable. You can use it without including <tiledb_experimental>. #4919

Build System Changes

• Fix AVX2 support detection. #4969
• Fix configuration errors when cross-compiling. #4995
• Fix build errors where the fmt headers could not be found for spdlog. #5008

Internal Improvements

• Implement zip_view for external sort. #4930
• Write iter_swap for zip_view for external sort. #4943
• Implement proxy sort permutation for external sort. #4944
• Implemented offset/length conversion functions for external sort. #4948

TileDB 2.23.0

TileDB v2.23.0 Release Notes

Deprecation announcements

• All deprecated APIs will be removed in version 2.26. TileDB can be built with --remove-deprecations (bootstrap) or -DTILEDB_REMOVE_DEPRECATIONS (CMake) to validate that projects are not using any deprecated APIs.

Improvements

• Improve diagnostics when an Azure endpoint is not configured. #4845
• Do not attempt Azure shared key authentication if no account name is specified. #4856
• Clarify the documentation for the non empty domain CAPI. #4885
• Make closing a group that is not open a no-op. #4917

Defects removed

• Fix wrong fallback cell order for Hilbert. #4924
• Config serialization should take into account environment variables. #4865
• Vac files should only be removed if paths removal was fully successful. #4889
• Fix C query condition examples. #4912

C++ API

• Query::submit_async is deprecated. Call Query::submit() on another thread instead. #4879
• Overloads of methods and constructors in Array and ArraySchema that accept encryption keys are deprecated. Specify the encryption key with the sm.encryption_type and sm.encryption_key config options instead. #4879
• Add C++ API for tiledb_array_consolidate_fragments. #4884

Build System Changes

• Vcpkg is always enabled; turning the TILEDB_VCPKG option off is no longer supported and fails. #4570
• Update the TILEDB_REMOVE_DEPRECATIONS option to exclude all deprecated C and C++ APIs from the library binary and the headers. #4887

Internal Improvements

• Implement iterator facade for external sort. #4914
• Implement var_length_view and unit tests for external sort. #4918
• Implement permutation view for external sort. #4920
• Implement proxy sort for external sort. #4922
• Implement alt var length view for external sort. #4925

TileDB 2.23.0-rc0

TileDB v2.23.0 Release Notes

Deprecation announcements

• All deprecated APIs will be removed in version 2.26. TileDB can be built with --remove-deprecations to validate that projects are not using any deprecated APIs.

Improvements

• Improve diagnostics when an Azure endpoint is not configured. #4845
• Do not attempt Azure shared key authentication if no account name is specified. #4856
• Clarify the documentation for the non empty domain CAPI. #4885
• Make closing a group that is not open a no-op. #4917

Defects removed

• Fix wrong fallback cell order for Hilbert. #4924
• Config serialization should take into account environment variables. #4865
• Vac files should only be removed if paths removal was fully successful. #4889
• Fix C query condition examples. #4912

C++ API

• Query::submit_async is deprecated. Call Query::submit() on another thread instead. #4879
• Overloads of methods and constructors in Array and ArraySchema that accept encryption keys are deprecated. Specify the encryption key with the sm.encryption_type and sm.encryption_key config options instead. #4879
• Add C++ API for tiledb_array_consolidate_fragments. #4884

Build System Changes

• Vcpkg is always enabled; turning the TILEDB_VCPKG option off is no longer supported and fails. #4570
• Update the TILEDB_REMOVE_DEPRECATIONS option to exclude all deprecated C and C++ APIs from the library binary and the headers. #4887

Internal Improvements

• Implement iterator facade for external sort. #4914
• Implement var_length_view and unit tests for external sort. #4918
• Implement permutation view for external sort. #4920
• Implement proxy sort for external sort. #4922
• Implement alt var length view for external sort. #4925

TileDB 2.18.5

TileDB v2.18.5 Release Notes

Defects removed

• Fix out of order consolidation. #4597
• Vac files should only be removed if paths removal was fully successful. #4889

Build System Changes

• Fix linker errors when building with MSVC. #4759

TileDB 2.22.0

TileDB v2.22.0 Release Notes

Deprecation announcements

• Support for downloading dependencies with CMake ExternalProjects by specifying -DTILEDB_VCPKG=OFF will be removed in 2.23. Vcpkg will be downloaded and used to manage dependencies by default. See https://github.com/TileDB-Inc/TileDB/blob/dev/doc/dev/BUILD.md for help on how to disable automatically downloading vcpkg and acquire dependencies from the system.

Configuration changes

• Add vfs.gcs.service_account_credential config option that specifies a Google Cloud service account credential JSON string. #4855
• Add vfs.gcs.external_account_credential config option that specifies a Google Cloud Workload Identity Federation credential JSON string. #4855

New features

• Support Microsoft Entra ID authentication to Azure. #4126

Improvements

• Allow to set buffers for geometry types with CPP API more easily. #4826

Defects removed

• Throw error when an upload fails due to bad state. #4815
• Single-process sub-millisecond temporal disambiguation of random labels. #4800
• Expose VFSExperimental and relocate CallbackWrapperCPP. #4820
• Do not load group metadata when getting it from REST. #4821
• Fix crash getting file size on non existent blob on Azure. #4836