Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement entropy change measure #62

Open
sachinn12 opened this issue Feb 12, 2025 · 0 comments
Open

Implement entropy change measure #62

sachinn12 opened this issue Feb 12, 2025 · 0 comments
Assignees
Labels
enhancement New feature or request high priority

Comments

@sachinn12
Copy link
Collaborator

sachinn12 commented Feb 12, 2025

Implement a measure of change like apd_compare_all as entropy of the density of wic predictions.

Generally: Copy APD function, get histogram of similarities, get entropy of histogram.

More specifically: implement these different measures:

  • H_COMPARE: H(COMPARE)
  • H_ALL: H(ALL)
  • H_ALL_COMPARE: H(ALL)-H(COMPARE)
  • H_COMPARE_EARLIER_LATER: H(COMPARE)-0.5*((H(EARLIER)+H(LATER)))
  • H_ALL_EARLIER_LATER: H(ALL)-0.5*((H(EARLIER)+H(LATER)))

where H is entropy of the histogram of similarities. Keep the number of bins fixed to some number, maybe bins=10 or 20, we need to look at some histograms to decide that, i.e., please plot some of these histograms and paste them here in the issue.

Please test the above-described measures on the English and German DWUG datasets and report graded change performance here.

After implementation discuss the code.

@sachinn12 sachinn12 added enhancement New feature or request high priority labels Feb 12, 2025
@sachinn12 sachinn12 added this to the LSCD experiments milestone Feb 12, 2025
@sachinn12 sachinn12 self-assigned this Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request high priority
Projects
None yet
Development

No branches or pull requests

1 participant