diff --git a/CHANGELOG.md b/CHANGELOG.md index 7bedcc42ccf..62637fa9742 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,293 @@ +# [2023-10-23] (Chart Release 4.39.0) + +## Release notes + + +* New field for Supported protocols in Galley's MLS feature config + + Galley will refuse to start if the list `supportedProtocols` does not contain + the value of the field `defaultProtocol`. Galley will also refuse to start if + MLS migration is enabled and MLS is not part of `supportedProtocols`. + + The default value for `supportedProtocols` is: + ``` + [proteus, mls] + ``` (#3374) + + +## API changes + + +* The JSON schema of `NonConnectedBackends` has changed to have its single field now called `non_connected_backends`. (#3518) + +* Remove de-federation (to avoid a scalability issue). (#3582) + +* Replace the placeholder self conversation id with the qualified conversation id for welcome events. (#3335) + +* Add new endpoint `DELETE /mls/key-packages/self/:client` (#3295) + +* Introduce an endpoint for deleting a subconversation (#2956, #3119, #3123) + +* Remove MLS endpoints from API v4 and finalise it (#3545) + +* Add new endpoint `GET /conversations/one2one/:domain/:uid` to fetch the MLS 1-1 conversation with another user (#3345) + +* Introduce a subconversation GET endpoint (#2869, #2995) + +* Add `GET /conversations/:domain/:cid/subconversations/:id/groupinfo` endpoint to fetch the group info object for a subconversation (#2932) + +* Introduce v5 development version (#3527) + +* It is now possible to use `PUT /conversation/:domain/:id/protocol` to transition from Mixed to MLS (#3334) + +* Report a failure to add remote users to an MLS conversation (#3304) + +* The key package API has gained a `ciphersuite` query parameter, which should be the hexadecimal value of an MLS ciphersuite, defaulting to `0x0001`. The `ciphersuite` parameter is used by the claim and count endpoints. For uploads, the API is unchanged, and the ciphersuite is taken directly from the uploaded key package. (#3454) + +* Add MLS migration feature config (#3299) + +* Switch to MLS draft 20. The following endpoints are affected by the change: + + - All endpoints with `message/mls` content type now expect and return draft-20 MLS structures. + - `POST /conversations` does not require `creator_client` anymore. + - `POST /mls/commit-bundles` now expects a "stream" of MLS messages, i.e. a sequence of TLS-serialised messages, one after the other, in any order. Its protobuf interface has been removed. + - `POST /mls/welcome` has been removed. Welcome messages can now only be sent as part of a commit bundle. + - `POST /mls/message` does not accept commit messages anymore. All commit messages must be sent as part of a commit bundle. (#3172) + +* Key packages and leaf nodes with x509 credentials are now supported (#3532) + + +## Features + + +* Add reason field to conversation.member-leave (#3640) + +* Support deleting a remote subconversation (#2964) + +* Introduce support for resetting a subconversation (#2956) + +* Introduce a "mixed" conversation protocol type. A conversation of "mixed" protocol functions as a Proteus converation as well as a MLS conversations. It's intended to be used for migrating conversations from Proteus to MLS. (#3258) + +* Added support for post-quantum ciphersuite 0xf031. Correspondingly, MLS groups with a non-default ciphersuite are now supported. The first commit in a group determines the group ciphersuite. (#3454) + +* Remove conversation size limit for MLS conversations (#3468) + +* Added support for MSL 1-1 conversations (#3360) + +* MLS application messages for older epochs are now rejected (#3438) + +* The public key in an x509 credential is now checked against that of the client (#3542) + +* Add federated endpoints to get subconversations (#2952) + +* Add Helm chart (`rabbitmq-external`) to interface RabbitMQ instances outside of the Kubernetes cluster. (#3626) + +* Removing or kicking a user from a conversation also removes the user's clients from any subconversation. (#2942) + +* Add support for subconversations in `POST /mls/commit-bundles` (#2932) + +* Implement endpoint for leaving a subconversation (#2969, #3080, #3085, #3107) + + +## Bug fixes and other updates + + +* Fix nix derivations for rust packages (#3628) + +* Ensure benchmarking dependencies are provided by nix development environment (#3628) + +* Disable a guest user from creating a group conversation (#3622) + +* Adding users to a conversation now enforces that all federation domains that will be in the conversation are federated with each other. (#3514) + +* Fix ES migration script. (#3558) + +* Fixed add user to conversation when one of the other participating backends is offline (#3585) + +* Create a new http2 connection in every federator client request instead of using a shared connection. (#3602) + +* list-clients returns with partial success even if one of the remote backends is unreachable (#3611) + +* Defederation notifications, federation.delete and federation.connectionRemoved, now deduplicate the user list so that we don't send them more notifications than required. (#3515) + +* Fix memory and TCP connection leak in brig, galley, caroghold and background-worker. (#3663) + +* Fix bug where notifications for MLS messages were not showing up in all notification streams of clients (#3610) + +* Map the MLS self-conversation creator's key package reference in Brig (#3055) + +* This fixes a bug where a remote member is removed from a conversation while their backend is unreachable, and the backend does not receive the removal notification once it is reachable again. (#3537) + +* Welcome messages are not sent anymore to the creator of an MLS group on the first commit (#3392) + + +## Documentation + + +* Fix: support api versions other than v0 in swagger docs. (#3619) + +* Updating the route documentation from Swagger 2 to OpenAPI 3. (#3570) + +* Elaborate on internal user creation in prod (#3596) + +* Adding a testing config entry to the PR guidelines. (#3624) + + +## Internal changes + + +* remove leaving clients immediately from subconversations (#3096) + +* Servantify internal end-points: brig/teams (#3634) + +* add conversation type to group ID serialisation (#3344) + +* Do not cache federation remote configs on non-brig services (#3612) + +* JSON derived schemas have been changed to no longer pre-process record fields to drop prefixes that were required to disambiguate fields. + Prefix processing still exists to drop leading underscores from field names, as we are using prefixed field names with `makeLenses`. + Code has been updated to use `OverloadedRecordDot` with the changed field names. (#3518) + +* Updating the route documentation library from swagger2 to openapi3. + + This also introduced a breaking change in how we track what federation calls each route makes. + The openapi3 library doesn't support extension fields, and as such tags are being used instead in a similar way. (#3570) + +* - Extending the information returned in errors for Federator. Paths and response bodies, if available, are included in error logs. + - Prometheus metrics for outgoing and incoming federation requests added. They can be enabled by setting `metrics.serviceMonitor.enabled`, like in other charts. (#3556) + +* CLI tool to consume messages from a RabbitMQ queue (#3589, #3655) + +* Removed user and client threshold fields from mls migration feature. (#3364) + +* Include timestamp in s3 upload path for test logs (#3621) + +* Migrating the following routes to the Servant API form. + + POST /provider/services + GET /provider/services + GET /provider/services/:sid + PUT /provider/services/:sid + PUT /provider/services/:sid/connection + DELETE /provider/services/:sid + GET /providers/:pid/services + GET /providers/:pid/services/:sid + GET /services + GET /services/tags + GET /teams/:tid/services/whitelisted + POST /teams/:tid/services/whitelist (#3554) + +* Provider API has been migrated to servant (#3547) + +* background-worker: Get list of domains from RabbitMQ instead of brig for pushing backend notifications (#3588) + +* Avoid including MLS application messages in the sender client's event stream. (#3379) + +* Avoid empty pushes when chunking pushes in galley (#PR_NOT_FOUND) + +* Introduce a Galley DB table for subconversations (#2869) + +* Support mapping MLS group IDs to subconversations (#2869) + +* change version and conversation type to 16 bit in group ID serialisation (#3353) + +* Brig does not perform key package ref mapping anymore. Claimed key packages are simply removed from the `mls_key_packages` table. The `mls_key_package_refs` table is now unused, and will be removed in the future. (#3172) + +* Add intermediate "mixed" protocol for migrating from Proteus to MLS (#3292) + +* - Do not perform client checks for add and remove proposals in mixed conversations + - Restrict protocol updates to team conversations + - Disallow MLS application messages in mixed conversations + - Send remove proposals when users leave mixed conversations (#3303) + +* New cron job to save data usable to watch the progress of the Proteus to MLS migration in S3 bucket. + + **IMPORTANT:** This cron job is _not_ meant for general use! It can leak data about one team to other teams. (#3579) + +* Subconversations are now created on their first commit (#3355) + +* Propagate messages in MLS subconversations (#2937) + +* Move some MLS tests to new integration suite (#3286) + +* Check validity of notification IDs in the notification API (#3550) + +* stern: Optimize RAM usage of /i/users/meta-info (#3522) + +* Additional integration test for federated connections (#3538) + +* The bot API is now migrated to servant (#3540) + +* `rusty-jwt-tools` is upgraded to version 0.5.0 (#3572) + +* Refactored schema version tracking from manually managed to automatic. (#3643) + +* Avoid unnecessary error logs on service shutdown (#3592) + +* Introduce an effect for subconversations (#2869) + +* Via the update path update the key package of the committer in epoch 0 of a subconversation (#2975) + +* Add more tests for joining a subconversation (#2974) + +* Added `/tools/db/repair-brig-clients-table` to clean up after the fix in #3504 (#3507) + +* Distinguish between update and upsert cassandra commands (follow-up to #3504) (#3513) + +* Truncate `galley.mls_group_member_client` table and drop `galley.member_client` table. + + The data in `mls_group_member_client` could contain nulls from client testing in prod. So, its OK to truncate it. + The `member_client` table is unused. (#3648) + +* All integration tests can generate XML reports. + + To generate the report in brig-integration, galley-integration, + cargohold-integration, gundeck-integration, stern-integration and the new + integration suite pass `--xml=` to generate the XML file. + + For spar-integration and federator-integration pass `-f junit` and set + `JUNIT_OUTPUT_DIRECTORY` and `JUNIT_SUITE_NAME` environment variables. The XML + report will be generated at `$JUNIT_OUTPUT_DIRECTORY/junit.xml`. + + (#3568, #3633) + + +## Federation changes + + +* Add subconversation ID to onMLSMessageSent request payload. (#3270) + +* Derive group ID from qualified conversation ID and, if applicable, + subconversation ID. + + Retire mapping from group IDs to conversation IDs. (group_id_conv_id) + + Remove federation endpoints + - on-new-remote-conversation, + - on-new-remote-subconversation, and + - on-delete-mls-conversation + which were used to synchronise the group to conversation mapping. (#3309) + +* Reorganise the federation API such that queueing notification endpoints are separate from synchronous endpoints. Also simplify queueing federation notification endpoints. (#3647) + +* Introduce an endpoint for resetting a remote subconversation (#2964) + +* Split federation endpoint into on-new-remote-conversation and on-new-remote-subconversation + Call on-new-remote-subconversation when a new subconversation is created + Call on-new-remote-subconversation for all existing subconversations when a new backend gets involved + Call on-new-remote-subconversation when a subconversation is reset (#2997) + +* federator: Allow setting TCP connection timeout for HTTP2 requests + + The helm chart defaults it to 5s which should be best for most installations. (#3595) + +* Constrain which federation endpoints can be used via the queueing federation client (#3629) + +* There is a breaking change in the "on-mls-message-sent" federation endpoint due to queueing. Now that there is retrying because of queueing, the endpoint can no longer respond with a list of unreachable users. (#3629) + +* Remote MLS messages get queued via RabbitMQ (#PR_NOT_FOUND) + + # [2023-08-16] (Chart Release 4.38.0) ## Bug fixes and other updates diff --git a/changelog.d/0-release-notes/supported-protocols b/changelog.d/0-release-notes/supported-protocols deleted file mode 100644 index 0de4e14e8af..00000000000 --- a/changelog.d/0-release-notes/supported-protocols +++ /dev/null @@ -1,10 +0,0 @@ -New field for Supported protocols in Galley's MLS feature config - -Galley will refuse to start if the list `supportedProtocols` does not contain -the value of the field `defaultProtocol`. Galley will also refuse to start if -MLS migration is enabled and MLS is not part of `supportedProtocols`. - -The default value for `supportedProtocols` is: -``` -[proteus, mls] -``` diff --git a/changelog.d/1-api-changes/WPB-3798 b/changelog.d/1-api-changes/WPB-3798 deleted file mode 100644 index 42435b4730f..00000000000 --- a/changelog.d/1-api-changes/WPB-3798 +++ /dev/null @@ -1 +0,0 @@ -The JSON schema of `NonConnectedBackends` has changed to have its single field now called `non_connected_backends`. \ No newline at end of file diff --git a/changelog.d/1-api-changes/WPB-4668-disable-defederation b/changelog.d/1-api-changes/WPB-4668-disable-defederation deleted file mode 100644 index baef31417a9..00000000000 --- a/changelog.d/1-api-changes/WPB-4668-disable-defederation +++ /dev/null @@ -1 +0,0 @@ -Remove de-federation (to avoid a scalability issue). \ No newline at end of file diff --git a/changelog.d/1-api-changes/add-conv-id-to-welcome-event b/changelog.d/1-api-changes/add-conv-id-to-welcome-event deleted file mode 100644 index ae5e423b297..00000000000 --- a/changelog.d/1-api-changes/add-conv-id-to-welcome-event +++ /dev/null @@ -1 +0,0 @@ -Replace the placeholder self conversation id with the qualified conversation id for welcome events. diff --git a/changelog.d/1-api-changes/delete-keypackages b/changelog.d/1-api-changes/delete-keypackages deleted file mode 100644 index c6ce843eb50..00000000000 --- a/changelog.d/1-api-changes/delete-keypackages +++ /dev/null @@ -1 +0,0 @@ -Add new endpoint `DELETE /mls/key-packages/self/:client` diff --git a/changelog.d/1-api-changes/delete-subconversation b/changelog.d/1-api-changes/delete-subconversation deleted file mode 100644 index c3a53610acd..00000000000 --- a/changelog.d/1-api-changes/delete-subconversation +++ /dev/null @@ -1 +0,0 @@ -Introduce an endpoint for deleting a subconversation (#2956, #3119, #3123) diff --git a/changelog.d/1-api-changes/finalise-v4 b/changelog.d/1-api-changes/finalise-v4 deleted file mode 100644 index 41a18ee0ca5..00000000000 --- a/changelog.d/1-api-changes/finalise-v4 +++ /dev/null @@ -1 +0,0 @@ -Remove MLS endpoints from API v4 and finalise it diff --git a/changelog.d/1-api-changes/get-mls-one2one b/changelog.d/1-api-changes/get-mls-one2one deleted file mode 100644 index b34d49e3c21..00000000000 --- a/changelog.d/1-api-changes/get-mls-one2one +++ /dev/null @@ -1 +0,0 @@ -Add new endpoint `GET /conversations/one2one/:domain/:uid` to fetch the MLS 1-1 conversation with another user diff --git a/changelog.d/1-api-changes/get-subconversation b/changelog.d/1-api-changes/get-subconversation deleted file mode 100644 index 6a632571f6b..00000000000 --- a/changelog.d/1-api-changes/get-subconversation +++ /dev/null @@ -1 +0,0 @@ -Introduce a subconversation GET endpoint (#2869, #2995) diff --git a/changelog.d/1-api-changes/get-subconversation-groupinfo b/changelog.d/1-api-changes/get-subconversation-groupinfo deleted file mode 100644 index 32845ff8279..00000000000 --- a/changelog.d/1-api-changes/get-subconversation-groupinfo +++ /dev/null @@ -1 +0,0 @@ -Add `GET /conversations/:domain/:cid/subconversations/:id/groupinfo` endpoint to fetch the group info object for a subconversation diff --git a/changelog.d/1-api-changes/introduce-v5 b/changelog.d/1-api-changes/introduce-v5 deleted file mode 100644 index 0d2498b3d31..00000000000 --- a/changelog.d/1-api-changes/introduce-v5 +++ /dev/null @@ -1 +0,0 @@ -Introduce v5 development version diff --git a/changelog.d/1-api-changes/mixed-to-mls b/changelog.d/1-api-changes/mixed-to-mls deleted file mode 100644 index 3eafd6734cc..00000000000 --- a/changelog.d/1-api-changes/mixed-to-mls +++ /dev/null @@ -1 +0,0 @@ -It is now possible to use `PUT /conversation/:domain/:id/protocol` to transition from Mixed to MLS diff --git a/changelog.d/1-api-changes/mls-conv-add-across-federation b/changelog.d/1-api-changes/mls-conv-add-across-federation deleted file mode 100644 index 6c86f1106bf..00000000000 --- a/changelog.d/1-api-changes/mls-conv-add-across-federation +++ /dev/null @@ -1 +0,0 @@ -Report a failure to add remote users to an MLS conversation diff --git a/changelog.d/1-api-changes/mls-key-package-ciphersuites b/changelog.d/1-api-changes/mls-key-package-ciphersuites deleted file mode 100644 index 9ed10cbd19f..00000000000 --- a/changelog.d/1-api-changes/mls-key-package-ciphersuites +++ /dev/null @@ -1 +0,0 @@ -The key package API has gained a `ciphersuite` query parameter, which should be the hexadecimal value of an MLS ciphersuite, defaulting to `0x0001`. The `ciphersuite` parameter is used by the claim and count endpoints. For uploads, the API is unchanged, and the ciphersuite is taken directly from the uploaded key package. diff --git a/changelog.d/1-api-changes/mls-migration-feature b/changelog.d/1-api-changes/mls-migration-feature deleted file mode 100644 index 67470870c70..00000000000 --- a/changelog.d/1-api-changes/mls-migration-feature +++ /dev/null @@ -1 +0,0 @@ -Add MLS migration feature config diff --git a/changelog.d/1-api-changes/mls-upgrade b/changelog.d/1-api-changes/mls-upgrade deleted file mode 100644 index de9bd3f4d81..00000000000 --- a/changelog.d/1-api-changes/mls-upgrade +++ /dev/null @@ -1,7 +0,0 @@ -Switch to MLS draft 20. The following endpoints are affected by the change: - - - All endpoints with `message/mls` content type now expect and return draft-20 MLS structures. - - `POST /conversations` does not require `creator_client` anymore. - - `POST /mls/commit-bundles` now expects a "stream" of MLS messages, i.e. a sequence of TLS-serialised messages, one after the other, in any order. Its protobuf interface has been removed. - - `POST /mls/welcome` has been removed. Welcome messages can now only be sent as part of a commit bundle. - - `POST /mls/message` does not accept commit messages anymore. All commit messages must be sent as part of a commit bundle. diff --git a/changelog.d/1-api-changes/mls-x509 b/changelog.d/1-api-changes/mls-x509 deleted file mode 100644 index 5f07ef57782..00000000000 --- a/changelog.d/1-api-changes/mls-x509 +++ /dev/null @@ -1 +0,0 @@ -Key packages and leaf nodes with x509 credentials are now supported diff --git a/changelog.d/2-features/WPB-4547 b/changelog.d/2-features/WPB-4547 deleted file mode 100644 index 54a98f7352a..00000000000 --- a/changelog.d/2-features/WPB-4547 +++ /dev/null @@ -1 +0,0 @@ -Add reason field to conversation.member-leave diff --git a/changelog.d/2-features/delete-remote-subconversation b/changelog.d/2-features/delete-remote-subconversation deleted file mode 100644 index 01c7da857e0..00000000000 --- a/changelog.d/2-features/delete-remote-subconversation +++ /dev/null @@ -1 +0,0 @@ -Support deleting a remote subconversation diff --git a/changelog.d/2-features/delete-subconversation b/changelog.d/2-features/delete-subconversation deleted file mode 100644 index 08ab83679d9..00000000000 --- a/changelog.d/2-features/delete-subconversation +++ /dev/null @@ -1 +0,0 @@ -Introduce support for resetting a subconversation diff --git a/changelog.d/2-features/mixed-protocol b/changelog.d/2-features/mixed-protocol deleted file mode 100644 index 507a8a7d586..00000000000 --- a/changelog.d/2-features/mixed-protocol +++ /dev/null @@ -1 +0,0 @@ -Introduce a "mixed" conversation protocol type. A conversation of "mixed" protocol functions as a Proteus converation as well as a MLS conversations. It's intended to be used for migrating conversations from Proteus to MLS. diff --git a/changelog.d/2-features/mls-ciphersuites b/changelog.d/2-features/mls-ciphersuites deleted file mode 100644 index 7886487e8bb..00000000000 --- a/changelog.d/2-features/mls-ciphersuites +++ /dev/null @@ -1 +0,0 @@ -Added support for post-quantum ciphersuite 0xf031. Correspondingly, MLS groups with a non-default ciphersuite are now supported. The first commit in a group determines the group ciphersuite. diff --git a/changelog.d/2-features/mls-conv-limits b/changelog.d/2-features/mls-conv-limits deleted file mode 100644 index 6a499746c4d..00000000000 --- a/changelog.d/2-features/mls-conv-limits +++ /dev/null @@ -1 +0,0 @@ -Remove conversation size limit for MLS conversations diff --git a/changelog.d/2-features/mls-one-to-one b/changelog.d/2-features/mls-one-to-one deleted file mode 100644 index 2f2603aa07b..00000000000 --- a/changelog.d/2-features/mls-one-to-one +++ /dev/null @@ -1 +0,0 @@ -Added support for MSL 1-1 conversations diff --git a/changelog.d/2-features/mls-stale-app-messages b/changelog.d/2-features/mls-stale-app-messages deleted file mode 100644 index 5005ccbac9d..00000000000 --- a/changelog.d/2-features/mls-stale-app-messages +++ /dev/null @@ -1 +0,0 @@ -MLS application messages for older epochs are now rejected diff --git a/changelog.d/2-features/mls-x509-improvements b/changelog.d/2-features/mls-x509-improvements deleted file mode 100644 index 36e3d457df8..00000000000 --- a/changelog.d/2-features/mls-x509-improvements +++ /dev/null @@ -1 +0,0 @@ -The public key in an x509 credential is now checked against that of the client diff --git a/changelog.d/2-features/pr-2952 b/changelog.d/2-features/pr-2952 deleted file mode 100644 index 0bfe30efe71..00000000000 --- a/changelog.d/2-features/pr-2952 +++ /dev/null @@ -1 +0,0 @@ -Add federated endpoints to get subconversations diff --git a/changelog.d/2-features/rabbitmq-external_helm_chart b/changelog.d/2-features/rabbitmq-external_helm_chart deleted file mode 100644 index 57a9f4e7ccc..00000000000 --- a/changelog.d/2-features/rabbitmq-external_helm_chart +++ /dev/null @@ -1 +0,0 @@ -Add Helm chart (`rabbitmq-external`) to interface RabbitMQ instances outside of the Kubernetes cluster. diff --git a/changelog.d/2-features/reflect-user-removal-from-parent-in-sub b/changelog.d/2-features/reflect-user-removal-from-parent-in-sub deleted file mode 100644 index 8f411ae91f2..00000000000 --- a/changelog.d/2-features/reflect-user-removal-from-parent-in-sub +++ /dev/null @@ -1 +0,0 @@ -Removing or kicking a user from a conversation also removes the user's clients from any subconversation. diff --git a/changelog.d/2-features/subconv-commit-bundles b/changelog.d/2-features/subconv-commit-bundles deleted file mode 100644 index a6db49b6183..00000000000 --- a/changelog.d/2-features/subconv-commit-bundles +++ /dev/null @@ -1 +0,0 @@ -Add support for subconversations in `POST /mls/commit-bundles` diff --git a/changelog.d/2-features/subconv-leave b/changelog.d/2-features/subconv-leave deleted file mode 100644 index 0fac932a479..00000000000 --- a/changelog.d/2-features/subconv-leave +++ /dev/null @@ -1 +0,0 @@ -Implement endpoint for leaving a subconversation (#2969, #3080, #3085, #3107) diff --git a/changelog.d/3-bug-fixes/WBP-4959 b/changelog.d/3-bug-fixes/WBP-4959 deleted file mode 100644 index c053654fa0b..00000000000 --- a/changelog.d/3-bug-fixes/WBP-4959 +++ /dev/null @@ -1 +0,0 @@ -Fix nix derivations for rust packages diff --git a/changelog.d/3-bug-fixes/WBP-4961 b/changelog.d/3-bug-fixes/WBP-4961 deleted file mode 100644 index ef17d4d7bab..00000000000 --- a/changelog.d/3-bug-fixes/WBP-4961 +++ /dev/null @@ -1 +0,0 @@ -Ensure benchmarking dependencies are provided by nix development environment diff --git a/changelog.d/3-bug-fixes/WPB-1908-guest-creating-conversation b/changelog.d/3-bug-fixes/WPB-1908-guest-creating-conversation deleted file mode 100644 index 2e06f0b2bb3..00000000000 --- a/changelog.d/3-bug-fixes/WPB-1908-guest-creating-conversation +++ /dev/null @@ -1 +0,0 @@ -Disable a guest user from creating a group conversation diff --git a/changelog.d/3-bug-fixes/WPB-3842-federation-completeness-checks b/changelog.d/3-bug-fixes/WPB-3842-federation-completeness-checks deleted file mode 100644 index 47959209790..00000000000 --- a/changelog.d/3-bug-fixes/WPB-3842-federation-completeness-checks +++ /dev/null @@ -1 +0,0 @@ -Adding users to a conversation now enforces that all federation domains that will be in the conversation are federated with each other. \ No newline at end of file diff --git a/changelog.d/3-bug-fixes/WPB-4425-fix-es-migration-script b/changelog.d/3-bug-fixes/WPB-4425-fix-es-migration-script deleted file mode 100644 index 66cbb384787..00000000000 --- a/changelog.d/3-bug-fixes/WPB-4425-fix-es-migration-script +++ /dev/null @@ -1 +0,0 @@ -Fix ES migration script. diff --git a/changelog.d/3-bug-fixes/WPB-4629 b/changelog.d/3-bug-fixes/WPB-4629 deleted file mode 100644 index 5d1724fe66e..00000000000 --- a/changelog.d/3-bug-fixes/WPB-4629 +++ /dev/null @@ -1 +0,0 @@ -Fixed add user to conversation when one of the other participating backends is offline diff --git a/changelog.d/3-bug-fixes/WPB-4787 b/changelog.d/3-bug-fixes/WPB-4787 deleted file mode 100644 index 97cb562182e..00000000000 --- a/changelog.d/3-bug-fixes/WPB-4787 +++ /dev/null @@ -1 +0,0 @@ -Create a new http2 connection in every federator client request instead of using a shared connection. diff --git a/changelog.d/3-bug-fixes/WPB-4835 b/changelog.d/3-bug-fixes/WPB-4835 deleted file mode 100644 index 148ded40f27..00000000000 --- a/changelog.d/3-bug-fixes/WPB-4835 +++ /dev/null @@ -1 +0,0 @@ -list-clients returns with partial success even if one of the remote backends is unreachable diff --git a/changelog.d/3-bug-fixes/duplicate-member-notifications b/changelog.d/3-bug-fixes/duplicate-member-notifications deleted file mode 100644 index 120b5bc7ebf..00000000000 --- a/changelog.d/3-bug-fixes/duplicate-member-notifications +++ /dev/null @@ -1 +0,0 @@ -Defederation notifications, federation.delete and federation.connectionRemoved, now deduplicate the user list so that we don't send them more notifications than required. \ No newline at end of file diff --git a/changelog.d/3-bug-fixes/federator-disconnect b/changelog.d/3-bug-fixes/federator-disconnect deleted file mode 100644 index 1731c0dc807..00000000000 --- a/changelog.d/3-bug-fixes/federator-disconnect +++ /dev/null @@ -1 +0,0 @@ -Fix memory and TCP connection leak in brig, galley, caroghold and background-worker. \ No newline at end of file diff --git a/changelog.d/3-bug-fixes/mls-notification-bug b/changelog.d/3-bug-fixes/mls-notification-bug deleted file mode 100644 index cfe1d68289d..00000000000 --- a/changelog.d/3-bug-fixes/mls-notification-bug +++ /dev/null @@ -1 +0,0 @@ -Fix bug where notifications for MLS messages were not showing up in all notification streams of clients diff --git a/changelog.d/3-bug-fixes/mls-self-conv-creator-ref b/changelog.d/3-bug-fixes/mls-self-conv-creator-ref deleted file mode 100644 index 8ba14ebd2f9..00000000000 --- a/changelog.d/3-bug-fixes/mls-self-conv-creator-ref +++ /dev/null @@ -1 +0,0 @@ -Map the MLS self-conversation creator's key package reference in Brig diff --git a/changelog.d/3-bug-fixes/remote-member-removal-notification b/changelog.d/3-bug-fixes/remote-member-removal-notification deleted file mode 100644 index a94c916a689..00000000000 --- a/changelog.d/3-bug-fixes/remote-member-removal-notification +++ /dev/null @@ -1 +0,0 @@ -This fixes a bug where a remote member is removed from a conversation while their backend is unreachable, and the backend does not receive the removal notification once it is reachable again. diff --git a/changelog.d/3-bug-fixes/sender-welcome b/changelog.d/3-bug-fixes/sender-welcome deleted file mode 100644 index 22503e2aab9..00000000000 --- a/changelog.d/3-bug-fixes/sender-welcome +++ /dev/null @@ -1 +0,0 @@ -Welcome messages are not sent anymore to the creator of an MLS group on the first commit diff --git a/changelog.d/4-docs/WPB-1103 b/changelog.d/4-docs/WPB-1103 deleted file mode 100644 index ff6644084df..00000000000 --- a/changelog.d/4-docs/WPB-1103 +++ /dev/null @@ -1 +0,0 @@ -Fix: support api versions other than v0 in swagger docs. \ No newline at end of file diff --git a/changelog.d/4-docs/WPB-4240 b/changelog.d/4-docs/WPB-4240 deleted file mode 100644 index d7dd76196ec..00000000000 --- a/changelog.d/4-docs/WPB-4240 +++ /dev/null @@ -1 +0,0 @@ -Updating the route documentation from Swagger 2 to OpenAPI 3. \ No newline at end of file diff --git a/changelog.d/4-docs/WPB-4556-internal-user-creation b/changelog.d/4-docs/WPB-4556-internal-user-creation deleted file mode 100644 index 399ec6b8b86..00000000000 --- a/changelog.d/4-docs/WPB-4556-internal-user-creation +++ /dev/null @@ -1 +0,0 @@ -Elaborate on internal user creation in prod \ No newline at end of file diff --git a/changelog.d/4-docs/hotfix-pr-guidelines b/changelog.d/4-docs/hotfix-pr-guidelines deleted file mode 100644 index 940c66b8fff..00000000000 --- a/changelog.d/4-docs/hotfix-pr-guidelines +++ /dev/null @@ -1 +0,0 @@ -Adding a testing config entry to the PR guidelines. \ No newline at end of file diff --git a/changelog.d/5-internal/FS-1564 b/changelog.d/5-internal/FS-1564 deleted file mode 100644 index 9bb9235cc7a..00000000000 --- a/changelog.d/5-internal/FS-1564 +++ /dev/null @@ -1 +0,0 @@ -remove leaving clients immediately from subconversations diff --git a/changelog.d/5-internal/WBP-1224 b/changelog.d/5-internal/WBP-1224 deleted file mode 100644 index 12dd7e6cbab..00000000000 --- a/changelog.d/5-internal/WBP-1224 +++ /dev/null @@ -1 +0,0 @@ -Servantify internal end-points: brig/teams diff --git a/changelog.d/5-internal/WPB-1925 b/changelog.d/5-internal/WPB-1925 deleted file mode 100644 index cc2af9f8948..00000000000 --- a/changelog.d/5-internal/WPB-1925 +++ /dev/null @@ -1 +0,0 @@ -add conversation type to group ID serialisation diff --git a/changelog.d/5-internal/WPB-3797-do-not-cache-federation-remote-domain-config b/changelog.d/5-internal/WPB-3797-do-not-cache-federation-remote-domain-config deleted file mode 100644 index dfd7ed0f27f..00000000000 --- a/changelog.d/5-internal/WPB-3797-do-not-cache-federation-remote-domain-config +++ /dev/null @@ -1 +0,0 @@ -Do not cache federation remote configs on non-brig services diff --git a/changelog.d/5-internal/WPB-3798 b/changelog.d/5-internal/WPB-3798 deleted file mode 100644 index 625e4d9b15a..00000000000 --- a/changelog.d/5-internal/WPB-3798 +++ /dev/null @@ -1,3 +0,0 @@ -JSON derived schemas have been changed to no longer pre-process record fields to drop prefixes that were required to disambiguate fields. -Prefix processing still exists to drop leading underscores from field names, as we are using prefixed field names with `makeLenses`. -Code has been updated to use `OverloadedRecordDot` with the changed field names. \ No newline at end of file diff --git a/changelog.d/5-internal/WPB-4240 b/changelog.d/5-internal/WPB-4240 deleted file mode 100644 index bca7dcb1fc6..00000000000 --- a/changelog.d/5-internal/WPB-4240 +++ /dev/null @@ -1,4 +0,0 @@ -Updating the route documentation library from swagger2 to openapi3. - -This also introduced a breaking change in how we track what federation calls each route makes. -The openapi3 library doesn't support extension fields, and as such tags are being used instead in a similar way. \ No newline at end of file diff --git a/changelog.d/5-internal/WPB-4406 b/changelog.d/5-internal/WPB-4406 deleted file mode 100644 index 6c064b7594b..00000000000 --- a/changelog.d/5-internal/WPB-4406 +++ /dev/null @@ -1,2 +0,0 @@ -- Extending the information returned in errors for Federator. Paths and response bodies, if available, are included in error logs. -- Prometheus metrics for outgoing and incoming federation requests added. They can be enabled by setting `metrics.serviceMonitor.enabled`, like in other charts. diff --git a/changelog.d/5-internal/WPB-4748 b/changelog.d/5-internal/WPB-4748 deleted file mode 100644 index 823b14baece..00000000000 --- a/changelog.d/5-internal/WPB-4748 +++ /dev/null @@ -1 +0,0 @@ -CLI tool to consume messages from a RabbitMQ queue (#3589, #3655) diff --git a/changelog.d/5-internal/WPB-485 b/changelog.d/5-internal/WPB-485 deleted file mode 100644 index a35171937fd..00000000000 --- a/changelog.d/5-internal/WPB-485 +++ /dev/null @@ -1 +0,0 @@ -Removed user and client threshold fields from mls migration feature. diff --git a/changelog.d/5-internal/WPB-4910 b/changelog.d/5-internal/WPB-4910 deleted file mode 100644 index 4d2155b181c..00000000000 --- a/changelog.d/5-internal/WPB-4910 +++ /dev/null @@ -1 +0,0 @@ -Include timestamp in s3 upload path for test logs diff --git a/changelog.d/5-internal/WPB-663 b/changelog.d/5-internal/WPB-663 deleted file mode 100644 index 303cf529f7b..00000000000 --- a/changelog.d/5-internal/WPB-663 +++ /dev/null @@ -1,14 +0,0 @@ -Migrating the following routes to the Servant API form. - -POST /provider/services -GET /provider/services -GET /provider/services/:sid -PUT /provider/services/:sid -PUT /provider/services/:sid/connection -DELETE /provider/services/:sid -GET /providers/:pid/services -GET /providers/:pid/services/:sid -GET /services -GET /services/tags -GET /teams/:tid/services/whitelisted -POST /teams/:tid/services/whitelist \ No newline at end of file diff --git a/changelog.d/5-internal/WPB-664 b/changelog.d/5-internal/WPB-664 deleted file mode 100644 index 764b4019042..00000000000 --- a/changelog.d/5-internal/WPB-664 +++ /dev/null @@ -1 +0,0 @@ -Provider API has been migrated to servant diff --git a/changelog.d/5-internal/background-worker-nosync b/changelog.d/5-internal/background-worker-nosync deleted file mode 100644 index b9eda2712c5..00000000000 --- a/changelog.d/5-internal/background-worker-nosync +++ /dev/null @@ -1 +0,0 @@ -background-worker: Get list of domains from RabbitMQ instead of brig for pushing backend notifications \ No newline at end of file diff --git a/changelog.d/5-internal/dont-return-to-sender b/changelog.d/5-internal/dont-return-to-sender deleted file mode 100644 index 3e3df3c04db..00000000000 --- a/changelog.d/5-internal/dont-return-to-sender +++ /dev/null @@ -1 +0,0 @@ -Avoid including MLS application messages in the sender client's event stream. diff --git a/changelog.d/5-internal/empty-push b/changelog.d/5-internal/empty-push deleted file mode 100644 index f30fe164e8f..00000000000 --- a/changelog.d/5-internal/empty-push +++ /dev/null @@ -1 +0,0 @@ -Avoid empty pushes when chunking pushes in galley diff --git a/changelog.d/5-internal/galley-db-subconv b/changelog.d/5-internal/galley-db-subconv deleted file mode 100644 index d57f71df5a6..00000000000 --- a/changelog.d/5-internal/galley-db-subconv +++ /dev/null @@ -1 +0,0 @@ -Introduce a Galley DB table for subconversations diff --git a/changelog.d/5-internal/group-id-subconv b/changelog.d/5-internal/group-id-subconv deleted file mode 100644 index 2706db951bf..00000000000 --- a/changelog.d/5-internal/group-id-subconv +++ /dev/null @@ -1 +0,0 @@ -Support mapping MLS group IDs to subconversations diff --git a/changelog.d/5-internal/group-id-subconv-2 b/changelog.d/5-internal/group-id-subconv-2 deleted file mode 100644 index 75eb7947025..00000000000 --- a/changelog.d/5-internal/group-id-subconv-2 +++ /dev/null @@ -1 +0,0 @@ -change version and conversation type to 16 bit in group ID serialisation diff --git a/changelog.d/5-internal/key-package-mapping b/changelog.d/5-internal/key-package-mapping deleted file mode 100644 index e861208c19d..00000000000 --- a/changelog.d/5-internal/key-package-mapping +++ /dev/null @@ -1 +0,0 @@ -Brig does not perform key package ref mapping anymore. Claimed key packages are simply removed from the `mls_key_packages` table. The `mls_key_package_refs` table is now unused, and will be removed in the future. diff --git a/changelog.d/5-internal/mixed-protocol b/changelog.d/5-internal/mixed-protocol deleted file mode 100644 index 235a1f2ac41..00000000000 --- a/changelog.d/5-internal/mixed-protocol +++ /dev/null @@ -1 +0,0 @@ -Add intermediate "mixed" protocol for migrating from Proteus to MLS diff --git a/changelog.d/5-internal/mls-mixed b/changelog.d/5-internal/mls-mixed deleted file mode 100644 index 7e35c12b3b1..00000000000 --- a/changelog.d/5-internal/mls-mixed +++ /dev/null @@ -1,4 +0,0 @@ -- Do not perform client checks for add and remove proposals in mixed conversations -- Restrict protocol updates to team conversations -- Disallow MLS application messages in mixed conversations -- Send remove proposals when users leave mixed conversations diff --git a/changelog.d/5-internal/mls-save-migration-statistics b/changelog.d/5-internal/mls-save-migration-statistics deleted file mode 100644 index c418bae2040..00000000000 --- a/changelog.d/5-internal/mls-save-migration-statistics +++ /dev/null @@ -1,3 +0,0 @@ -New cron job to save data usable to watch the progress of the Proteus to MLS migration in S3 bucket. - -**IMPORTANT:** This cron job is _not_ meant for general use! It can leak data about one team to other teams. diff --git a/changelog.d/5-internal/mls-subconv-creation b/changelog.d/5-internal/mls-subconv-creation deleted file mode 100644 index f87217e5d42..00000000000 --- a/changelog.d/5-internal/mls-subconv-creation +++ /dev/null @@ -1 +0,0 @@ -Subconversations are now created on their first commit diff --git a/changelog.d/5-internal/mls-subconv-messages b/changelog.d/5-internal/mls-subconv-messages deleted file mode 100644 index ba9d2579d12..00000000000 --- a/changelog.d/5-internal/mls-subconv-messages +++ /dev/null @@ -1 +0,0 @@ -Propagate messages in MLS subconversations diff --git a/changelog.d/5-internal/mls-tests b/changelog.d/5-internal/mls-tests deleted file mode 100644 index 2320d5ebf67..00000000000 --- a/changelog.d/5-internal/mls-tests +++ /dev/null @@ -1 +0,0 @@ -Move some MLS tests to new integration suite diff --git a/changelog.d/5-internal/notification-500 b/changelog.d/5-internal/notification-500 deleted file mode 100644 index 7af7198c513..00000000000 --- a/changelog.d/5-internal/notification-500 +++ /dev/null @@ -1 +0,0 @@ -Check validity of notification IDs in the notification API diff --git a/changelog.d/5-internal/optimize-stern b/changelog.d/5-internal/optimize-stern deleted file mode 100644 index ad7c8c83a55..00000000000 --- a/changelog.d/5-internal/optimize-stern +++ /dev/null @@ -1 +0,0 @@ -stern: Optimize RAM usage of /i/users/meta-info \ No newline at end of file diff --git a/changelog.d/5-internal/pr-3538 b/changelog.d/5-internal/pr-3538 deleted file mode 100644 index 37868aea9ef..00000000000 --- a/changelog.d/5-internal/pr-3538 +++ /dev/null @@ -1 +0,0 @@ -Additional integration test for federated connections diff --git a/changelog.d/5-internal/pr-3540 b/changelog.d/5-internal/pr-3540 deleted file mode 100644 index f1c0ef4f559..00000000000 --- a/changelog.d/5-internal/pr-3540 +++ /dev/null @@ -1 +0,0 @@ -The bot API is now migrated to servant diff --git a/changelog.d/5-internal/pr-3572 b/changelog.d/5-internal/pr-3572 deleted file mode 100644 index 2b6825bd5e5..00000000000 --- a/changelog.d/5-internal/pr-3572 +++ /dev/null @@ -1 +0,0 @@ -`rusty-jwt-tools` is upgraded to version 0.5.0 diff --git a/changelog.d/5-internal/refactored-schema-version-tracking b/changelog.d/5-internal/refactored-schema-version-tracking deleted file mode 100644 index 16d655ef96a..00000000000 --- a/changelog.d/5-internal/refactored-schema-version-tracking +++ /dev/null @@ -1 +0,0 @@ -Refactored schema version tracking from manually managed to automatic. diff --git a/changelog.d/5-internal/shutdown-cleanup b/changelog.d/5-internal/shutdown-cleanup deleted file mode 100644 index 86579b0906b..00000000000 --- a/changelog.d/5-internal/shutdown-cleanup +++ /dev/null @@ -1 +0,0 @@ -Avoid unnecessary error logs on service shutdown diff --git a/changelog.d/5-internal/subconv-store b/changelog.d/5-internal/subconv-store deleted file mode 100644 index ef3798fdc6c..00000000000 --- a/changelog.d/5-internal/subconv-store +++ /dev/null @@ -1 +0,0 @@ -Introduce an effect for subconversations diff --git a/changelog.d/5-internal/subconv-update-path b/changelog.d/5-internal/subconv-update-path deleted file mode 100644 index 11737cb0bec..00000000000 --- a/changelog.d/5-internal/subconv-update-path +++ /dev/null @@ -1 +0,0 @@ -Via the update path update the key package of the committer in epoch 0 of a subconversation diff --git a/changelog.d/5-internal/test-joining-subconversation b/changelog.d/5-internal/test-joining-subconversation deleted file mode 100644 index 41a2a42111e..00000000000 --- a/changelog.d/5-internal/test-joining-subconversation +++ /dev/null @@ -1 +0,0 @@ -Add more tests for joining a subconversation diff --git a/changelog.d/5-internal/wpb-3888 b/changelog.d/5-internal/wpb-3888 deleted file mode 100644 index d18f4de6508..00000000000 --- a/changelog.d/5-internal/wpb-3888 +++ /dev/null @@ -1 +0,0 @@ -Added `/tools/db/repair-brig-clients-table` to clean up after the fix in #3504 \ No newline at end of file diff --git a/changelog.d/5-internal/wpb-3915 b/changelog.d/5-internal/wpb-3915 deleted file mode 100644 index fcaeeec676c..00000000000 --- a/changelog.d/5-internal/wpb-3915 +++ /dev/null @@ -1 +0,0 @@ -Distinguish between update and upsert cassandra commands (follow-up to #3504) (#3513) \ No newline at end of file diff --git a/changelog.d/5-internal/wpb-5033 b/changelog.d/5-internal/wpb-5033 deleted file mode 100644 index 4a16fe7e78f..00000000000 --- a/changelog.d/5-internal/wpb-5033 +++ /dev/null @@ -1,4 +0,0 @@ -Truncate `galley.mls_group_member_client` table and drop `galley.member_client` table. - -The data in `mls_group_member_client` could contain nulls from client testing in prod. So, its OK to truncate it. -The `member_client` table is unused. \ No newline at end of file diff --git a/changelog.d/5-internal/xml-reports b/changelog.d/5-internal/xml-reports deleted file mode 100644 index 6e1a44781e6..00000000000 --- a/changelog.d/5-internal/xml-reports +++ /dev/null @@ -1,11 +0,0 @@ -All integration tests can generate XML reports. - -To generate the report in brig-integration, galley-integration, -cargohold-integration, gundeck-integration, stern-integration and the new -integration suite pass `--xml=` to generate the XML file. - -For spar-integration and federator-integration pass `-f junit` and set -`JUNIT_OUTPUT_DIRECTORY` and `JUNIT_SUITE_NAME` environment variables. The XML -report will be generated at `$JUNIT_OUTPUT_DIRECTORY/junit.xml`. - -(#3568, #3633) diff --git a/changelog.d/6-federation/FS-1868 b/changelog.d/6-federation/FS-1868 deleted file mode 100644 index 208bebcf0c3..00000000000 --- a/changelog.d/6-federation/FS-1868 +++ /dev/null @@ -1 +0,0 @@ -Add subconversation ID to onMLSMessageSent request payload. diff --git a/changelog.d/6-federation/FS-1974 b/changelog.d/6-federation/FS-1974 deleted file mode 100644 index f3dd1419254..00000000000 --- a/changelog.d/6-federation/FS-1974 +++ /dev/null @@ -1,10 +0,0 @@ -Derive group ID from qualified conversation ID and, if applicable, -subconversation ID. - -Retire mapping from group IDs to conversation IDs. (group_id_conv_id) - -Remove federation endpoints -- on-new-remote-conversation, -- on-new-remote-subconversation, and -- on-delete-mls-conversation -which were used to synchronise the group to conversation mapping. diff --git a/changelog.d/6-federation/WPB-4928-notification-endpoints b/changelog.d/6-federation/WPB-4928-notification-endpoints deleted file mode 100644 index b900bd95735..00000000000 --- a/changelog.d/6-federation/WPB-4928-notification-endpoints +++ /dev/null @@ -1 +0,0 @@ -Reorganise the federation API such that queueing notification endpoints are separate from synchronous endpoints. Also simplify queueing federation notification endpoints. diff --git a/changelog.d/6-federation/delete-remote-subconversation b/changelog.d/6-federation/delete-remote-subconversation deleted file mode 100644 index 816d9435eb1..00000000000 --- a/changelog.d/6-federation/delete-remote-subconversation +++ /dev/null @@ -1 +0,0 @@ -Introduce an endpoint for resetting a remote subconversation diff --git a/changelog.d/6-federation/on-new-remote-subconversation b/changelog.d/6-federation/on-new-remote-subconversation deleted file mode 100644 index edb9c811d3d..00000000000 --- a/changelog.d/6-federation/on-new-remote-subconversation +++ /dev/null @@ -1,4 +0,0 @@ -Split federation endpoint into on-new-remote-conversation and on-new-remote-subconversation -Call on-new-remote-subconversation when a new subconversation is created -Call on-new-remote-subconversation for all existing subconversations when a new backend gets involved -Call on-new-remote-subconversation when a subconversation is reset diff --git a/changelog.d/6-federation/tcp-timeout b/changelog.d/6-federation/tcp-timeout deleted file mode 100644 index db622b73022..00000000000 --- a/changelog.d/6-federation/tcp-timeout +++ /dev/null @@ -1,3 +0,0 @@ -federator: Allow setting TCP connection timeout for HTTP2 requests - -The helm chart defaults it to 5s which should be best for most installations. \ No newline at end of file diff --git a/changelog.d/6-federation/wpb-3867-queue-endpoints b/changelog.d/6-federation/wpb-3867-queue-endpoints deleted file mode 100644 index b3f9efb6b7d..00000000000 --- a/changelog.d/6-federation/wpb-3867-queue-endpoints +++ /dev/null @@ -1 +0,0 @@ -Constrain which federation endpoints can be used via the queueing federation client diff --git a/changelog.d/6-federation/wpb-3867-unreachable-users b/changelog.d/6-federation/wpb-3867-unreachable-users deleted file mode 100644 index 19dde73310e..00000000000 --- a/changelog.d/6-federation/wpb-3867-unreachable-users +++ /dev/null @@ -1 +0,0 @@ -There is a breaking change in the "on-mls-message-sent" federation endpoint due to queueing. Now that there is retrying because of queueing, the endpoint can no longer respond with a list of unreachable users. diff --git a/changelog.d/6-federation/wpb-4984-queueing b/changelog.d/6-federation/wpb-4984-queueing deleted file mode 100644 index c258c8eabda..00000000000 --- a/changelog.d/6-federation/wpb-4984-queueing +++ /dev/null @@ -1 +0,0 @@ -Remote MLS messages get queued via RabbitMQ