Follow G4 on Twitter
X

New Study Suggests Video Game Reviews Actually Important To Success

pklepek
36 Comments

Posted July 6, 2010 - By pklepek


  • News
    (1)
  • Previews
  • Review

New Study Suggests Video Game Reviews Actually Important To Success

Video game reviews are a required pillar of any video gaming website, but it's hard to say what impact the reviews actually have on...well, anything. Does a chorus of praise help sales? Can a series of critical lashings doom an upcoming game? Gaming research firm Electronic Entertainment Design and Research (EEDAR) recently conducted a study to try and understand the impact of professional game reviews. Don't worry, game reviewers: you still have a job. Here's why.

The Influence of Video Game Reviews »



The study was conducted during the week of March 29 at Southern Methodist University in Dallas, Texas. 188 individuals participated, though due to various reasons, only 165 of participant data was used to draw conclusions. Participants were required to have no prior experience with the test game.

New Study Suggests Video Game Reviews Actually Important To SuccessEEDAR picked one game, PopCap Games' Plants vs. Zombies, as their test product. Plants vs. Zombies was chosen because the group believed it was "regarded by the gaming community and by critics as a high quality title of broad appeal, which should result in minimal variance based on participants personal gaming preferences," according to the report, released to me a few days ahead of publication.

The study, dubbed "The Influence of Professional Critic Reviews," relies on a psychological behavior called "anchoring." Anchoring involves subconsciously influencing an individual's response to something based on previous influence or "anchor." In this case, the anchor becomes mocked up professional game reviews. Divided into three groups -- one exposed to positive reviews of Plants vs. Zombies, one shown negative reviews and another shown none -- participants were then given 20 minutes to play Plants vs. Zombies before being asked to fill out an exit survey, assign their own review score and either receive a free copy of Plants vs. Zombies or $10.

The result? Study participants who read the positive game reviews prior to playing Plants vs. Zombies "were twice as likely to take a copy of Plants vs. Zombies over the $10 cash and 85% more likely to take the game than the control group [who were not expose to game reviews]."

There's no reason for game developers to panic, however. You are not entirely at the whim of notoriously finicky game critics. For one, this particularly study only examined the impact of reviews, not taking into account marketing, pricing, brand awareness, etc. Plus, and perhaps more encouraging, is quality seemed to tip the scales. Good games are, simply, good games.

"The must surprising result is Group B (low review exposure)," reads the report, "where the majority (65%) indicated they would still recommend the game to a friend even though 73% of the group would not purchase it themselves. Group B's review score was higher than the anchored review score of 61 [out of 100], indicating that, while reviews influenced their behavior, they still felt that the game was much better than what the 'experts' suggested."

"[Those] who read positive game reviews prior to playing 'were twice as likely to take a copy over the $10 cash"

EEDAR suggested this information gives companies more informed player data on whether to pursue a playable demo. Some companies love them, others hate them, but EEDAR's study "suggests that if a company releases an inherently good game that receives lower than 'deserved' review scores, the company may be able to increase sales through a widely played demo. People that enjoy the demo might overcome the influence of negative critic reviews or may tell their friends about the game even if they do not purchase the product."

A hole in the study's conclusions (which EEDAR admitted to within the study itself) is its recommendations are limited to some of the industry's best games, given the test game's renowned appeal. What the results mean for what EEDAR cites as "medium quality" or "low quality" games isn't really known. Additionally, the mock reviews handed out to participants used both quantitative (90/100) and qualitative ("game of the year"!) evaluations, meaning in this case, there's no way to distinguish whether one or the other better impacted consumer behavior.

The industry places an enormous importance on game reviews. The success and impact of controversial review aggregation sites like Metacritic, which influence everything from sequel potential to developer royalty payments, underscore that. EEDAR's study simply adds to the pile.

When's the last time you remember a video game review directly influencing you? Then again, based on EEDAR's findings, maybe you weren't even aware that review was influencing you at all.

[image credit: flickr / mastershambler]

Have something to share? Sitting on a news tip? E-mail me. You can also follow me on Twitter.

Tags: Videogames
New Study Suggests Video Game Reviews Actually Important To Success
http://www.g4tv.com/thefeed/blog/post/706037/new-study-suggests-video-game-reviews-actually-important-to-success/
http://images.g4tv.com/ImageDb3/244558_LGST/as20100706_theloop.jpg
BlogThread_706037
  • Diggerclan

    I always read reviews before buying a game. Any time I DIDN'T listen to a review I always ended out regretting it.

    Posted: July 9, 2010 11:54 AM | Reply | Report
    Diggerclan
  • yiggypow

    Oh wow, that makes a lot of sense dude.

    Lou
    www.web-anonymity.au.tc

    Posted: July 8, 2010 7:12 AM | Reply | Report
    yiggypow
  • shantavius.taylor

    Summer s just around the corner,so what better gifts to present to your friends,families ever?For those of you that canot find time to see more details. Here are the best sellings in quick clicking links.
    Factory prices.Guranteened quality.Free shipping.Credit Card payment safer,faster,convinient.
    $ 18 cool hats : http://www.nikeexpert.com/disc ount-caphat-polo-cap-c-91_113. html
    $ 18 cool sunglasses: http://www.nikeexpert.com/sung lasses-a-a-c-122.html
    $ 18 women t-shirt: http://www.nikeexpert.com/bran d-tshirt-women-baby-tshirt-c-1 44_177.html
    Hot seller R4 shoes: http://www.nikeexpert.com/men- shoes-shox-r4r5-series-c-55_63 .html
    For more detailed brand Jeans,belts,sneakers, bags,dunks,running shoes at : www.nikeexpert.com

    Enjoy your party in your locals with saving over 40% this summer and cheer up for the 2010 FIFA world cup team you ve been supporting.

    Posted: July 8, 2010 2:25 AM | Reply | Report
    shantavius.taylor
  • shantavius.taylor

    Summer s just around the corner,so what better gifts to present to your friends,families ever?For those of you that canot find time to see more details. Here are the best sellings in quick clicking links.
    Factory prices.Guranteened quality.Free shipping.Credit Card payment safer,faster,convinient.
    $ 18 cool hats : http://www.nikeexpert.com/disc ount-caphat-polo-cap-c-91_113. html
    $ 18 cool sunglasses: http://www.nikeexpert.com/sung lasses-a-a-c-122.html
    $ 18 women t-shirt: http://www.nikeexpert.com/bran d-tshirt-women-baby-tshirt-c-1 44_177.html
    Hot seller R4 shoes: http://www.nikeexpert.com/men- shoes-shox-r4r5-series-c-55_63 .html
    For more detailed brand Jeans,belts,sneakers, bags,dunks,running shoes at : www.nikeexpert.com

    Enjoy your party in your locals with saving over 40% this summer and cheer up for the 2010 FIFA world cup team you ve been supporting.

    Posted: July 8, 2010 2:22 AM | Reply | Report
    shantavius.taylor
  • Galloway

    no haha lol

    Posted: July 8, 2010 2:02 AM | Reply | Report
  • Spybreak

    Oh is that why I watch Xplay, read my Official Xbox Magazine, PC Gamer and read Gamesradar?! Dumbasses

    Posted: July 7, 2010 1:41 PM | Reply | Report
    Spybreak
  • CamperHunter1

    While I do believe critic reviews play a role in influencing us to buy or at least try a game, I believe it is only half of the equation.

    For those who live off of reviews ----> ONLY <---- when making purchasing decisions, I think the equation stacks up a little more like the following:

    50% Critic reviews
    50% Demo impressions/fan reviews
    = % chance of purchase

    Money doesn't play any part in that equation because I'm solely analyzing what is going through our heads after we take those factors into consideration. If we want it bad enough, we'll buy it at the first opportune moment, regardless of whether it is as full price or on sale (or even in the bargain bin for really old titles).

    Posted: July 7, 2010 1:14 PM | Reply | Report
    CamperHunter1
  • abaddon1977

    Unfortunately this study means absolutely nothing at all. It was a small study, fundamentally flawed, with more holes in it than swiss cheese. I will say one thing though, it gave results (hahahahhahaha). Here is a study for everyone, let's judge the actions of what is done. Yes game reviews make a difference and may and do sway certain people to buy certain games,but to try and nail this to a certain percentage and with such a pathetically flawed study is ridiculous. Here is the facts and just the facts 1) we know words are very powerful and have influenced people for years 2) another one is people follow the strong or tend to allign themselves with people knowledgeable about a subject 3) now knowing if someone was to print certain things about something or give a certain score to something and is perceived as a knowledgeable then influence by some or many may ensue The best way to see if a study is legit and to give merit is to look at the actions of what is going on LIVE in life,and then evaluate actions. WORDS DO INFLUENCE : PEOPLE PERCEIVED AS KNOWING WHAT THEY ARE TALLKING ABOUT ARE FOLLOWED : PEOPLE WRITE REVIEWS : PEOPLE READ THEM : WORDS INFLUENCE : HAHAHAHAHAHAHAHAHAHAHA study done. and I didn't even have to get 200 students and put them in a position to choose a certain way hahahahahaha and those 2 times as much numbers stuff ridiculous with such a pathetically flawed study. who knows maybe some people choose the game think that that was what the people doing it wanted them to do. Save your study money monkeys, and this is for Adam, yes what you do is very relevant, look at all that follow your lead. Long live the King hahahahahahahahahahaha

    Posted: July 7, 2010 10:54 AM | Reply | Report
    abaddon1977
  • j_soap

    i'll always check out reviews, whether for movies or games, to see what people thought about them and what the reviewer felt the game/movie did right or wrong, but whether the review is good or bad, it's still just some persons opinion and i always like to check games, and especially movies, for myself, to see if i may like them. i often find (although more so with movies than video games) that if something is given bad reviews i can still enjoy it, which doesn't mean that the game or movie or whatever is good or bad, it just means that it appeals to me.

    Posted: July 7, 2010 12:13 AM | Reply | Report
    j_soap
  • YamiKarasu

    Depending on my financial situation I may react a number of ways to reviews. I remember distinctly watching an old episode of X-Play praising Final Fantasy XII and so I went ahead and bought it cheap, was one of the best video games I've ever played and since have followed G4's reviews very closely. So I tend to take each review to heart however chances are I'll know what games I want to play when they're announced regardless of what reviews are going to say. Sometimes this pays off (Mirror's Edge) and sometimes it doesn't (Sonic Unleashed). However, nowadays there's so many high profile games and so much news to accompany it essentially creating a non-stop hype train that by the time games come out I've all but lost complete interest before I read the reviews, which I know will be good anyway. This occurred with Assassin's Creed 2 and Final Fantasy XIII (until about a month after it came out then I was excited again). My point being sometimes your mind is made up well in advance and no critic is going to deter you, and sometimes too much information turns your anticipation into resentment.

    Posted: July 6, 2010 11:37 PM | Reply | Report
    YamiKarasu

Add a Comment

Limit 5,000 characters | 5,000 characters remaining
Log in to Comment
Post to Facebook
Post to Facebook

SPONSORED AD

ADVERTISEMENT

Blog Tags

g4tv.com

  • Alan Wake In-Game Verizon Commercial

    Posted: May 21, 2010

    76,916 Views | 01:37 | 16 Comments

    5 / 5

  • The Elder Scrolls 5: Skyrim "Dawnguard" DLC Trailer

    Posted: Today 7:39 AM

    6,014 Views | 01:37 | 1 Comment

    5 / 5

  • E3 2012 Heavy Hitters

    Posted: 2 days ago

    26,155 Views | 03:57 | 4 Comments

    5 / 5

  • Alan Wake In-Game "Night Springs" Video Game Footage

    Posted: May 21, 2010

    29,278 Views | 01:37 | 2 Comments

    3 / 5

  • X-List: Top 5 Most Anticipated Sequels At E3 2012

    Posted: Yesterday 4:01 PM

    5,708 Views | 01:23

    4 / 5

AdChoices