Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BRISQUE metric doesn't work #108

Closed
zakajd opened this issue Jun 22, 2020 · 1 comment · Fixed by #110
Closed

BRISQUE metric doesn't work #108

zakajd opened this issue Jun 22, 2020 · 1 comment · Fixed by #110
Assignees
Labels
bug Something isn't working

Comments

@zakajd
Copy link
Collaborator

zakajd commented Jun 22, 2020

Describe the bug
I experimented with BRISQUE score today and found it to have nearly 0 correlation with Mean Opinion Scores for TID2013 dataset.
I compared result with pybrisque lib and found that they are very different for real images.

To Reproduce
Steps to reproduce the behavior:

  1. Install pybrisque
  2. Compute value for 2 attached images
  3. Result will be different.

goldhill.gif: 27.8 pybrisque / 111.07 piq.brisque
I01.BMP: 42.1 pybrisque / 95.5 piq.brisque

Expected behavior
I don't know correct value for first image, but for the second it definitely must be ~42, see plot with MATLAB comparison in pybrisque repo

images.zip

@zakajd zakajd added the bug Something isn't working label Jun 22, 2020
@denproc
Copy link
Collaborator

denproc commented Jun 23, 2020

The problem is due to data range, used for BRISQUE estimation. pybrisque.BRISQUE().getscore() uses 0-255, while piq.brisque uses 0-1. Changed it at PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants