Professional reviews as service: A mix method approach to assess the value of recommender systems in the entertainment industry

As a recommender system, Metacritic (metacritic.com) quantifies and aggregates reviews of entertainment products. The metascore published by Metacritic is controversial in its process for gathering, translating, and aggregating reviews. This study aims to assess the quality of Metacritic’s scoring of movie critics’ reviews. By using a mixed methods approach integrating content analysis and multilevel analysis, we found that the movie review scores assigned by Metacritic reflecting the reviews’ semantic contents, being unbiased across the critics, and differentiating the movies reviewed. The paper provides, also, both theoretical implications, referred to an original framing of professional reviews in the service science, service systems and service quality; and practical implications related to the potential customers and for the entertainment industry.