From 29e026e60c753a3d53f68b402634fe2c667b9a1a Mon Sep 17 00:00:00 2001 From: Waqas Javed <7674577+w-javed@users.noreply.github.com> Date: Mon, 27 Jan 2025 11:32:20 -0800 Subject: [PATCH] Azure AI Evaluation Release 1.2.0 (#39335) * Azure AI Evaluation Release 1.2.0 * Azure AI Evaluation Release 1.2.0 * fix the intersphinx references for a new reference methodology (#39332) * handle only deleted files in a - pullrequest build (#39266) Co-authored-by: Scott Beddall * fix tests weekly (#39338) * [Storage] update perf tests core baseline (#39336) * [Storage] update perf tests core baseline * update storage file baselien * [AutoRelease] t2-computeschedule-2025-01-10-50036(can only be merged by SDK owner) (#39105) * code and test * Update CHANGELOG.md for new model properties --------- Co-authored-by: azure-sdk Co-authored-by: ChenxiJiang333 <119990644+ChenxiJiang333@users.noreply.github.com> * [AutoRelease] t2-quota-2025-01-16-93059(can only be merged by SDK owner) (#39215) * code and test * update testcases * Update CHANGELOG.md to remove method details * Update changelog for quota operations changes * Update release date in CHANGELOG.md --------- Co-authored-by: azure-sdk Co-authored-by: ChenxiJiang333 Co-authored-by: ChenxiJiang333 <119990644+ChenxiJiang333@users.noreply.github.com> * [AutoRelease] t2-servicenetworking-2025-01-21-47646(can only be merged by SDK owner) (#39322) * code and test * Remove duplicate method overloads from changelog * Update CHANGELOG.md to remove instance variables * Fix typo in changelog entry * Update CHANGELOG for version 2.0.0 --------- Co-authored-by: azure-sdk Co-authored-by: ChenxiJiang333 <119990644+ChenxiJiang333@users.noreply.github.com> * Fix urls (#39259) * Fix urls (#39251) * fix url (#39255) * Fix urls (#39248) * Fix urls (#39246) * Content safety evals aggregate max from conversations (#39083) * add convo agg type, and have harm evals use max * analysis * correct enum name in docs * refactor checked enum into function field * cl and analysis * change enum name and update CL * change function names to private, allow agg type retrieval * PR comments * test serialization * CL * CI adjustment * try again * perf * skip perf * remove skip * Fix urls (#39129) * Fix urls (#39262) * Sync eng/common directory with azure-sdk-tools for PR 9668 (#39347) * Support incrementing semver prereleases with 'zero' versions * Make tests more explicit --------- Co-authored-by: Patrick Hallisey * [ServiceBus/EventHub] lock pending deliveries on send (#38067) * [ServiceBus/EventHub] lock pending deliveries on send * remove misc logging * changelog + test * fix tests, remove session lock * remove logging from test * sync with sb * add todo in sender.py tfor temporary fix * bumped versions after jan 22 patch release (#39355) * Sync eng/common directory with azure-sdk-tools for PR 9656 (#39356) * Added label handle sdk-gen pipeline template Added common script to delete label from a PR * Update eng/common/scripts/Invoke-GitHubAPI.ps1 Co-authored-by: Ben Broderick Phillips --------- Co-authored-by: ray chen Co-authored-by: Ben Broderick Phillips * Update package_utils.py (#39361) * [AutoRelease] t2-web-2024-11-15-26155(can only be merged by SDK owner) (#38561) * code and test * Update app_service_environments_create_or_update_multi_role_pool.py * udpate version * update-testcase * update testcases * update format * Update CHANGELOG.md * Update CHANGELOG.md * update version --------- Co-authored-by: azure-sdk Co-authored-by: Yuchao Yan Co-authored-by: msyyc <70930885+msyyc@users.noreply.github.com> Co-authored-by: ChenxiJiang333 Co-authored-by: ChenxiJiang333 <119990644+ChenxiJiang333@users.noreply.github.com> * fix: Loosen psutil version requirement (#39354) * Enable sample type checking for cosmos (#39334) This is already passing so enabling in CI so we can continue to validate samples with mypy * update change log * change date format * change date format * change date format --------- Co-authored-by: Scott Beddall <45376673+scbedd@users.noreply.github.com> Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Scott Beddall Co-authored-by: Krista Pratico Co-authored-by: swathipil <76007337+swathipil@users.noreply.github.com> Co-authored-by: ChenxiJiang333 <119990644+ChenxiJiang333@users.noreply.github.com> Co-authored-by: ChenxiJiang333 Co-authored-by: Xiang Yan Co-authored-by: MilesHolland <108901744+MilesHolland@users.noreply.github.com> Co-authored-by: Patrick Hallisey Co-authored-by: Peter Wu <162184229+weirongw23-msft@users.noreply.github.com> Co-authored-by: ray chen Co-authored-by: Ben Broderick Phillips Co-authored-by: Yuchao Yan Co-authored-by: msyyc <70930885+msyyc@users.noreply.github.com> Co-authored-by: kdestin <101366538+kdestin@users.noreply.github.com> --- sdk/evaluation/azure-ai-evaluation/CHANGELOG.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/sdk/evaluation/azure-ai-evaluation/CHANGELOG.md b/sdk/evaluation/azure-ai-evaluation/CHANGELOG.md index 11197099ce42..bf33c5c3122d 100644 --- a/sdk/evaluation/azure-ai-evaluation/CHANGELOG.md +++ b/sdk/evaluation/azure-ai-evaluation/CHANGELOG.md @@ -1,11 +1,12 @@ # Release History -## 1.2.0 (Unreleased) +## 1.2.0 (2025-01-27) ### Features Added -- CSV files are now supported as data file inputs with `evaluate()` API. The CSV file should have a header row with column names that match the `data` and `target` fields in the `evaluate()` method and the filename should be passed as the `data` parameter. +- CSV files are now supported as data file inputs with `evaluate()` API. The CSV file should have a header row with column names that match the `data` and `target` fields in the `evaluate()` method and the filename should be passed as the `data` parameter. Column name 'Conversation' in CSV file is not fully supported yet. ### Breaking Changes +- `ViolenceMultimodalEvaluator`, `SexualMultimodalEvaluator`, `SelfHarmMultimodalEvaluator`, `HateUnfairnessMultimodalEvaluator` and `ProtectedMaterialMultimodalEvaluator` will be removed in next release. ### Bugs Fixed - Removed `[remote]` extra. This is no longer needed when tracking results in Azure AI Studio.