Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure AI Evaluation Release 1.2.0 #39335

Open
wants to merge 30 commits into
base: main
Choose a base branch
from
Open
Changes from 28 commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
bef42ee
Azure AI Evaluation Release 1.2.0
w-javed Jan 21, 2025
e965115
Azure AI Evaluation Release 1.2.0
w-javed Jan 21, 2025
43f56b5
fix the intersphinx references for a new reference methodology (#39332)
scbedd Jan 21, 2025
ff0989e
handle only deleted files in a <language> - pullrequest build (#39266)
azure-sdk Jan 21, 2025
4c3bf15
fix tests weekly (#39338)
kristapratico Jan 21, 2025
4bf375e
[Storage] update perf tests core baseline (#39336)
swathipil Jan 21, 2025
f4091cb
[AutoRelease] t2-computeschedule-2025-01-10-50036(can only be merged …
azure-sdk Jan 22, 2025
f8390ab
[AutoRelease] t2-quota-2025-01-16-93059(can only be merged by SDK own…
azure-sdk Jan 22, 2025
9c4268f
[AutoRelease] t2-servicenetworking-2025-01-21-47646(can only be merge…
azure-sdk Jan 22, 2025
4b7bd46
Fix urls (#39259)
xiangyan99 Jan 22, 2025
1363c0d
Fix urls (#39251)
xiangyan99 Jan 22, 2025
00fcdab
fix url (#39255)
xiangyan99 Jan 22, 2025
bfff293
Fix urls (#39248)
xiangyan99 Jan 22, 2025
7db4551
Fix urls (#39246)
xiangyan99 Jan 22, 2025
a5860cc
Content safety evals aggregate max from conversations (#39083)
MilesHolland Jan 22, 2025
e40d5d1
Fix urls (#39129)
xiangyan99 Jan 22, 2025
03d10c0
Fix urls (#39262)
xiangyan99 Jan 22, 2025
6547d92
Sync eng/common directory with azure-sdk-tools for PR 9668 (#39347)
azure-sdk Jan 22, 2025
11efc59
[ServiceBus/EventHub] lock pending deliveries on send (#38067)
swathipil Jan 22, 2025
28d13e0
bumped versions after jan 22 patch release (#39355)
weirongw23-msft Jan 22, 2025
f0d430c
Sync eng/common directory with azure-sdk-tools for PR 9656 (#39356)
azure-sdk Jan 22, 2025
8318f4a
Update package_utils.py (#39361)
ChenxiJiang333 Jan 23, 2025
2fdfa59
[AutoRelease] t2-web-2024-11-15-26155(can only be merged by SDK owner…
azure-sdk Jan 23, 2025
10f4aae
fix: Loosen psutil version requirement (#39354)
kdestin Jan 23, 2025
74d3c06
Enable sample type checking for cosmos (#39334)
kristapratico Jan 23, 2025
23c3720
Merge branch 'main' into Prepare-Release-Evaluation-1-2-0
w-javed Jan 23, 2025
d30dd29
update change log
w-javed Jan 23, 2025
00368ea
change date format
w-javed Jan 24, 2025
b3d6401
change date format
w-javed Jan 24, 2025
f7018cd
change date format
w-javed Jan 25, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions sdk/evaluation/azure-ai-evaluation/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,11 +1,12 @@
# Release History

## 1.2.0 (Unreleased)
## 1.2.0 (2024-01-24)

### Features Added
- CSV files are now supported as data file inputs with `evaluate()` API. The CSV file should have a header row with column names that match the `data` and `target` fields in the `evaluate()` method and the filename should be passed as the `data` parameter.
- CSV files are now supported as data file inputs with `evaluate()` API. The CSV file should have a header row with column names that match the `data` and `target` fields in the `evaluate()` method and the filename should be passed as the `data` parameter. Column name 'Conversation' in CSV file is not supported.
w-javed marked this conversation as resolved.
Show resolved Hide resolved

### Breaking Changes
- In release 1.1.0, Multimodal image support was added in `ContentSafetyEvaluator`, `ViolenceEvaluator`, `SexualEvaluator`, `SelfHarmEvaluator`, `HateUnfairnessEvaluator` and `ProtectedMaterialEvaluator`. Hence, `ContentSafetyMultimodalEvaluator`, `ViolenceMultimodalEvaluator`, `SexualMultimodalEvaluator`, `SelfHarmMultimodalEvaluator`, `HateUnfairnessMultimodalEvaluator` and `ProtectedMaterialMultimodalEvaluator` will be removed in next release azure-ai-evaluation:1.3.0.

### Bugs Fixed
- Removed `[remote]` extra. This is no longer needed when tracking results in Azure AI Studio.
Expand Down
Loading