This repository implements a methodology to evaluate the reliability and truthfulness of user reviews. The scoring is based on metrics such as helpfulness votes, review recency, and reviewer ranking. The dataset used is the Amazon 500ECE dataset.
- Helpfulness Score: Calculated using the ratio of helpful votes to total votes, weighted by their squared value.
- Reliability Score: Assessed using two approaches:
- Most Recent Reviewer: Prioritizes the recency of reviews.
- Top-Ranking Reviewer: Prioritizes highly ranked reviewers.
- Truthfulness Score: Combines helpfulness and reliability scores.
The methodology follows the formulas outlined below:
For a review by user uᵢ
on item pⱼ
, the helpfulness score is computed as: