[Storage][DataMovement] Add resource specific checkpoint data classes #38842
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jalauzon-msft
requested review from
KrzysztofCwalina,
tg-msft,
seanmcc-msft,
amnguye,
jaschrep-msft and
schaabs
as code owners
|
API change check APIView has identified API level changes in this PR and created following API reviews. |
jalauzon-msft
commented
Sep 19, 2023
sdk/storage/Azure.Storage.DataMovement.Blobs/src/BlobJobPlanExtensions.cs
Show resolved
Hide resolved
amnguye
approved these changes
Sep 19, 2023
m-nash
added a commit
that referenced
this pull request
Sep 21, 2023
* Add TraceSpan * Add TraceSpan * version funkiness for diagnostics * Update readme and troubleshooting guide (#38825) * test utilities (#38828) * test utilities * fix usings * [Storage] Storage Client Options Support Audiences (#38438) * Initial work for Blob Clients to support Audience * Export API * Moved BlobAudience to Models; Added Audience support in DataLake; Addressed PR commeents * Added audience support for Shares and Queues; Recorded tests; Cannot record tests for files audience tests * Rerecord failure expected tests * Adding default scope after resource id is set; Recorded Share Files tests * Actually removing /.default from tests and correct order of what default to use * Trying to resolve CI issues with Audience.Equals(string) * Attempt to fix CI issues * Cleanup * Timeout for httpclient for VM metadata service and suppress statsbeat instrumentation (#38801) * timeout for httpclient and suppress instrument * Update AzureMonitorExporterEventSource.cs update EventSource message --------- Co-authored-by: Timothy Mothra <[email protected]> * Fix offline storage during network errors (#38832) * Fix offline storage during network errors * fix net462 * changelog * remove TraceSpan types * Fix multiple triggers of the same type adding to DI (#38756) * Fix multiple triggers of the same type adding to DI * Compare with created instance * Enabling ScaleHostEndToEndTest again * Adding a comment * export API * Refactor TryGetHeader on Response * undo KeyVault * backout Personalizer * undo storage * undo web pub sub * Fix naming in AddAzureStorageQueuesScaleForTrigger (#38843) * Add tracing types * renames * Support MaxConcurrentCallsPerSession (#38836) * Storage STG 91 (#38839) * Fix the ValidateInheritance naming test failures (#38844) * update * [RecoveryServicesBackup] Fix LRO issue (#38784) * Add LRO * Update CHANGELOG.md * Update comments * Add regression tests * Update assets.json * update --------- Co-authored-by: Chengming <[email protected]> Co-authored-by: Wei Hu <[email protected]> * Fix the IPAddress serialization issue for Peering (#38824) * Remove Credential * API * refactor * remove net461 target * Update AutoRest C# version to 3.0.0-beta.20230920.1 (#38852) * Update Generator Version 3.0.0-beta.20230920.1 * Update SDK codes * Update SDK codes * Update SDK codes * undo kv * updates * missed fies * Richardcho/cancel add participant (#38794) * update swagger * update swagger * apply swagger updates * update api * Revert "apply swagger updates" This reverts commit 99ebc37. * auto generate * add method * add internal events * update api * update api * update swagger * auto generate * add events * add event processor changes * fix build * update api * update code * update typo * fix typo * add unit tests * remove dupe file * update swagger * fix typo * fix typo * fix test * address PR comments --------- Co-authored-by: root <root@DESKTOP-6GBNLER> * [AzureMonitorDistro] disable test (#38840) * fix test * investigating test... * investigating tests * disable test * IUtf8JsonSerializable * Argument * [AzureMonitorDistro] update OTel ResourceDetectors (#38833) * update ResourceDetectors * changelog * [AzureMonitorExporter] prepare new release. Exporter 1.0.0. Distro beta7 (#38838) * bump version * update Readme * fix date * fix changelog header * prepare Distro * [Storage][DataMovement] Add resource specific checkpoint data classes (#38842) * RawRequestUriBuilder * HttpExtensions - 1 * temp * WIP: HttpPipelineExtensions * WIP: HttpPipelineExtensions * Increment version for monitor releases (#38864) * Increment package version after release of Azure.Monitor.OpenTelemetry.Exporter * Increment package version after release of Azure.Monitor.OpenTelemetry.AspNetCore * PipelineProtocolExtensions * export API * Increment package version after release of Azure.Identity (#38667) * add CreateMessage to pipeline * Add constructor to HttpMessage * API * .NET SDK release changes for dataprotection (#38408) * generating sdk for 2023-05-01 Signed-off-by: SHASHANK SINGH <[email protected]> * Addressing breaking change comment Signed-off-by: SHASHANK SINGH <[email protected]> * Changes Signed-off-by: SHASHANK SINGH <[email protected]> * Handling breaking changes Signed-off-by: SHASHANK SINGH <[email protected]> * generating sdk for 2023-05-01 Signed-off-by: SHASHANK SINGH <[email protected]> * Addressing breaking change comment Signed-off-by: SHASHANK SINGH <[email protected]> * Changes Signed-off-by: SHASHANK SINGH <[email protected]> * Handling breaking changes Signed-off-by: SHASHANK SINGH <[email protected]> * Updated DataProtectionBackupVaultProperties * resolved breaking changes in ArmDataProtectionBackupModelFactory * Add changelog Signed-off-by: SHASHANK SINGH <[email protected]> * fixes Signed-off-by: SHASHANK SINGH <[email protected]> * Renaming parameters Signed-off-by: SHASHANK SINGH <[email protected]> * Update changelog Signed-off-by: SHASHANK SINGH <[email protected]> * Added expected release date Signed-off-by: SHASHANK SINGH <[email protected]> * Renamed NamespacedNameResource Signed-off-by: SHASHANK SINGH <[email protected]> --------- Signed-off-by: SHASHANK SINGH <[email protected]> Co-authored-by: SHASHANK SINGH <[email protected]> Co-authored-by: Himanshu Agarwal <[email protected]> * fix chainingclassifier * Optional * API * Utf8JsonRequestBody * Update MSAL dependencies to latest (#38866) * STJ type extensions * move generated oai client into this branch * pipeline builder for custom policies * implement Pipeline.Send * make shared source RawRequestUriBuilder still work without new project ref * starting to think about policy * fix --------- Signed-off-by: SHASHANK SINGH <[email protected]> Co-authored-by: Anne Thompson <[email protected]> Co-authored-by: Christopher Scott <[email protected]> Co-authored-by: Jocelyn <[email protected]> Co-authored-by: Amanda Nguyen <[email protected]> Co-authored-by: Vishwesh Bankwar <[email protected]> Co-authored-by: Timothy Mothra <[email protected]> Co-authored-by: Alexey Rodionov <[email protected]> Co-authored-by: JoshLove-msft <[email protected]> Co-authored-by: Sean McCullough <[email protected]> Co-authored-by: Arthur Ma <[email protected]> Co-authored-by: Minghao Chen <[email protected]> Co-authored-by: Chengming <[email protected]> Co-authored-by: Wei Hu <[email protected]> Co-authored-by: Azure SDK Bot <[email protected]> Co-authored-by: richardcho-msft <[email protected]> Co-authored-by: root <root@DESKTOP-6GBNLER> Co-authored-by: Jacob Lauzon <[email protected]> Co-authored-by: Shashank Singh <[email protected]> Co-authored-by: SHASHANK SINGH <[email protected]> Co-authored-by: Himanshu Agarwal <[email protected]>
yaotongms
pushed a commit
to yaotongms/azure-sdk-for-net
that referenced
this pull request
Oct 12, 2023
meslubi2021
added a commit
to Unity-and-wireless-communications/azure-sdk-for-net
that referenced
this pull request
Jul 25, 2024
* Experiment * dependencies * add System.ServiceModel.Rest to ci * digital twins * updates * revert all changes except for core * update keyvault samples * Add TraceSpan * Add TraceSpan * change keyvault samples project to projectref on core * version funkiness for diagnostics * remove TraceSpan types * export API * Refactor TryGetHeader on Response * undo KeyVault * backout Personalizer * undo storage * undo web pub sub * Add tracing types * renames * update * Remove Credential * API * refactor * remove net461 target * undo kv * updates * missed fies * Core experiment2 client (Azure#38893) * Add TraceSpan * Add TraceSpan * version funkiness for diagnostics * Update readme and troubleshooting guide (Azure#38825) * test utilities (Azure#38828) * test utilities * fix usings * [Storage] Storage Client Options Support Audiences (Azure#38438) * Initial work for Blob Clients to support Audience * Export API * Moved BlobAudience to Models; Added Audience support in DataLake; Addressed PR commeents * Added audience support for Shares and Queues; Recorded tests; Cannot record tests for files audience tests * Rerecord failure expected tests * Adding default scope after resource id is set; Recorded Share Files tests * Actually removing /.default from tests and correct order of what default to use * Trying to resolve CI issues with Audience.Equals(string) * Attempt to fix CI issues * Cleanup * Timeout for httpclient for VM metadata service and suppress statsbeat instrumentation (Azure#38801) * timeout for httpclient and suppress instrument * Update AzureMonitorExporterEventSource.cs update EventSource message --------- Co-authored-by: Timothy Mothra <[email protected]> * Fix offline storage during network errors (Azure#38832) * Fix offline storage during network errors * fix net462 * changelog * remove TraceSpan types * Fix multiple triggers of the same type adding to DI (Azure#38756) * Fix multiple triggers of the same type adding to DI * Compare with created instance * Enabling ScaleHostEndToEndTest again * Adding a comment * export API * Refactor TryGetHeader on Response * undo KeyVault * backout Personalizer * undo storage * undo web pub sub * Fix naming in AddAzureStorageQueuesScaleForTrigger (Azure#38843) * Add tracing types * renames * Support MaxConcurrentCallsPerSession (Azure#38836) * Storage STG 91 (Azure#38839) * Fix the ValidateInheritance naming test failures (Azure#38844) * update * [RecoveryServicesBackup] Fix LRO issue (Azure#38784) * Add LRO * Update CHANGELOG.md * Update comments * Add regression tests * Update assets.json * update --------- Co-authored-by: Chengming <[email protected]> Co-authored-by: Wei Hu <[email protected]> * Fix the IPAddress serialization issue for Peering (Azure#38824) * Remove Credential * API * refactor * remove net461 target * Update AutoRest C# version to 3.0.0-beta.20230920.1 (Azure#38852) * Update Generator Version 3.0.0-beta.20230920.1 * Update SDK codes * Update SDK codes * Update SDK codes * undo kv * updates * missed fies * Richardcho/cancel add participant (Azure#38794) * update swagger * update swagger * apply swagger updates * update api * Revert "apply swagger updates" This reverts commit 99ebc37. * auto generate * add method * add internal events * update api * update api * update swagger * auto generate * add events * add event processor changes * fix build * update api * update code * update typo * fix typo * add unit tests * remove dupe file * update swagger * fix typo * fix typo * fix test * address PR comments --------- Co-authored-by: root <root@DESKTOP-6GBNLER> * [AzureMonitorDistro] disable test (Azure#38840) * fix test * investigating test... * investigating tests * disable test * IUtf8JsonSerializable * Argument * [AzureMonitorDistro] update OTel ResourceDetectors (Azure#38833) * update ResourceDetectors * changelog * [AzureMonitorExporter] prepare new release. Exporter 1.0.0. Distro beta7 (Azure#38838) * bump version * update Readme * fix date * fix changelog header * prepare Distro * [Storage][DataMovement] Add resource specific checkpoint data classes (Azure#38842) * RawRequestUriBuilder * HttpExtensions - 1 * temp * WIP: HttpPipelineExtensions * WIP: HttpPipelineExtensions * Increment version for monitor releases (Azure#38864) * Increment package version after release of Azure.Monitor.OpenTelemetry.Exporter * Increment package version after release of Azure.Monitor.OpenTelemetry.AspNetCore * PipelineProtocolExtensions * export API * Increment package version after release of Azure.Identity (Azure#38667) * add CreateMessage to pipeline * Add constructor to HttpMessage * API * .NET SDK release changes for dataprotection (Azure#38408) * generating sdk for 2023-05-01 Signed-off-by: SHASHANK SINGH <[email protected]> * Addressing breaking change comment Signed-off-by: SHASHANK SINGH <[email protected]> * Changes Signed-off-by: SHASHANK SINGH <[email protected]> * Handling breaking changes Signed-off-by: SHASHANK SINGH <[email protected]> * generating sdk for 2023-05-01 Signed-off-by: SHASHANK SINGH <[email protected]> * Addressing breaking change comment Signed-off-by: SHASHANK SINGH <[email protected]> * Changes Signed-off-by: SHASHANK SINGH <[email protected]> * Handling breaking changes Signed-off-by: SHASHANK SINGH <[email protected]> * Updated DataProtectionBackupVaultProperties * resolved breaking changes in ArmDataProtectionBackupModelFactory * Add changelog Signed-off-by: SHASHANK SINGH <[email protected]> * fixes Signed-off-by: SHASHANK SINGH <[email protected]> * Renaming parameters Signed-off-by: SHASHANK SINGH <[email protected]> * Update changelog Signed-off-by: SHASHANK SINGH <[email protected]> * Added expected release date Signed-off-by: SHASHANK SINGH <[email protected]> * Renamed NamespacedNameResource Signed-off-by: SHASHANK SINGH <[email protected]> --------- Signed-off-by: SHASHANK SINGH <[email protected]> Co-authored-by: SHASHANK SINGH <[email protected]> Co-authored-by: Himanshu Agarwal <[email protected]> * fix chainingclassifier * Optional * API * Utf8JsonRequestBody * Update MSAL dependencies to latest (Azure#38866) * STJ type extensions * move generated oai client into this branch * pipeline builder for custom policies * implement Pipeline.Send * make shared source RawRequestUriBuilder still work without new project ref * starting to think about policy * fix --------- Signed-off-by: SHASHANK SINGH <[email protected]> Co-authored-by: Anne Thompson <[email protected]> Co-authored-by: Christopher Scott <[email protected]> Co-authored-by: Jocelyn <[email protected]> Co-authored-by: Amanda Nguyen <[email protected]> Co-authored-by: Vishwesh Bankwar <[email protected]> Co-authored-by: Timothy Mothra <[email protected]> Co-authored-by: Alexey Rodionov <[email protected]> Co-authored-by: JoshLove-msft <[email protected]> Co-authored-by: Sean McCullough <[email protected]> Co-authored-by: Arthur Ma <[email protected]> Co-authored-by: Minghao Chen <[email protected]> Co-authored-by: Chengming <[email protected]> Co-authored-by: Wei Hu <[email protected]> Co-authored-by: Azure SDK Bot <[email protected]> Co-authored-by: richardcho-msft <[email protected]> Co-authored-by: root <root@DESKTOP-6GBNLER> Co-authored-by: Jacob Lauzon <[email protected]> Co-authored-by: Shashank Singh <[email protected]> Co-authored-by: SHASHANK SINGH <[email protected]> Co-authored-by: Himanshu Agarwal <[email protected]> * update api * update api * revert non core * revert added file * fix bug in shared Utf8JsonRequestContent * fix --------- Signed-off-by: SHASHANK SINGH <[email protected]> Co-authored-by: Anne Thompson <[email protected]> Co-authored-by: m-nash <[email protected]> Co-authored-by: m-nash <[email protected]> Co-authored-by: Christopher Scott <[email protected]> Co-authored-by: Jocelyn <[email protected]> Co-authored-by: Amanda Nguyen <[email protected]> Co-authored-by: Vishwesh Bankwar <[email protected]> Co-authored-by: Timothy Mothra <[email protected]> Co-authored-by: Alexey Rodionov <[email protected]> Co-authored-by: JoshLove-msft <[email protected]> Co-authored-by: Sean McCullough <[email protected]> Co-authored-by: Arthur Ma <[email protected]> Co-authored-by: Minghao Chen <[email protected]> Co-authored-by: Chengming <[email protected]> Co-authored-by: Wei Hu <[email protected]> Co-authored-by: Azure SDK Bot <[email protected]> Co-authored-by: richardcho-msft <[email protected]> Co-authored-by: root <root@DESKTOP-6GBNLER> Co-authored-by: Jacob Lauzon <[email protected]> Co-authored-by: Shashank Singh <[email protected]> Co-authored-by: SHASHANK SINGH <[email protected]> Co-authored-by: Himanshu Agarwal <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This change is the next step in the checkpoint schema refactoring and introduces the mechanism for resource type specific checkpoint data for source and destination resources.
A new base abstract class
StorageCheckpointDatais added with package specific implementations for source and destination. APIs are added to the resource items to fetch this data so the base package is able to serialize it into the job part plan files accordingly. The Blob destination schema is also added as that is currently the only resource specific schema we support.