[CVAT][Recording Oracle] Add Inter Rater Agreement Measures to Recording Oracle Output

[simulacrum6]

Description

This PR adds Agreement Measures to the results of the CVAT Recording Oracle and changes the output format.
Closes #761.

Summary of changes

Agreement Package cvat/recording-oracle/modules/agreement

• Minor refactoring of module structure.
  • Validation functions moved to new file (validations.py).
  • utils.py file added.
• Added new convenience function (./utils/confusion_matrix_from_sequence to convert sequences of data into an incidence matrix. Needed in recording oracle.
• Relaxed some validations, as the constraints were harsher than intended.

Recording Oracle cvat/recording-oracle/modules/webhook/process_intermediate_results.py

• Rewrote existing processing of results of process_image_label_binary_intermediate_results using pandas. Should be more flexible for additions / changes in the future. The output format now looks like this

How test the changes

I added a rudimentary unit test for the process_intermediate_results.py function.

Related issues

Closes #761.

Operational checklist

• All new functionality is covered by tests
• Any related documentation has been changed or added

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
escrow-dashboard	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 18, 2023 10:29am
faucet-server	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 18, 2023 10:29am
fortune-exchange-oracle	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 18, 2023 10:29am
fortune-exchange-oracle-server	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 18, 2023 10:29am
fortune-job-launcher-client	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 18, 2023 10:29am
fortune-job-launcher-server	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 18, 2023 10:29am
fortune-recording-oracle	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 18, 2023 10:29am
fortune-reputation-oracle	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 18, 2023 10:29am