News
(8)Previews
Review
Videos
(7)Screenshots
Cheats and Walkthroughs
(8)

Video game reviews are a required pillar of any video gaming website, but it's hard to say what impact the reviews actually have on...well, anything. Does a chorus of praise help sales? Can a series of critical lashings doom an upcoming game? Gaming research firm Electronic Entertainment Design and Research (EEDAR) recently conducted a study to try and understand the impact of professional game reviews. Don't worry, game reviewers: you still have a job. Here's why.
The study was conducted during the week of March 29 at Southern Methodist University in Dallas, Texas. 188 individuals participated, though due to various reasons, only 165 of participant data was used to draw conclusions. Participants were required to have no prior experience with the test game.
EEDAR picked one game, PopCap Games' Plants vs. Zombies, as their test product. Plants vs. Zombies was chosen because the group believed it was "regarded by the gaming community and by critics as a high quality title of broad appeal, which should result in minimal variance based on participants personal gaming preferences," according to the report, released to me a few days ahead of publication.
The study, dubbed "The Influence of Professional Critic Reviews," relies on a psychological behavior called "anchoring." Anchoring involves subconsciously influencing an individual's response to something based on previous influence or "anchor." In this case, the anchor becomes mocked up professional game reviews. Divided into three groups -- one exposed to positive reviews of Plants vs. Zombies, one shown negative reviews and another shown none -- participants were then given 20 minutes to play Plants vs. Zombies before being asked to fill out an exit survey, assign their own review score and either receive a free copy of Plants vs. Zombies or $10.
The result? Study participants who read the positive game reviews prior to playing Plants vs. Zombies "were twice as likely to take a copy of Plants vs. Zombies over the $10 cash and 85% more likely to take the game than the control group [who were not expose to game reviews]."
There's no reason for game developers to panic, however. You are not entirely at the whim of notoriously finicky game critics. For one, this particularly study only examined the impact of reviews, not taking into account marketing, pricing, brand awareness, etc. Plus, and perhaps more encouraging, is quality seemed to tip the scales. Good games are, simply, good games.
"The must surprising result is Group B (low review exposure)," reads the report, "where the majority (65%) indicated they would still recommend the game to a friend even though 73% of the group would not purchase it themselves. Group B's review score was higher than the anchored review score of 61 [out of 100], indicating that, while reviews influenced their behavior, they still felt that the game was much better than what the 'experts' suggested."
"[Those] who read positive game reviews prior to playing 'were twice as likely to take a copy over the $10 cash"
EEDAR suggested this information gives companies more informed player data on whether to pursue a playable demo. Some companies love them, others hate them, but EEDAR's study "suggests that if a company releases an inherently good game that receives lower than 'deserved' review scores, the company may be able to increase sales through a widely played demo. People that enjoy the demo might overcome the influence of negative critic reviews or may tell their friends about the game even if they do not purchase the product."
A hole in the study's conclusions (which EEDAR admitted to within the study itself) is its recommendations are limited to some of the industry's best games, given the test game's renowned appeal. What the results mean for what EEDAR cites as "medium quality" or "low quality" games isn't really known. Additionally, the mock reviews handed out to participants used both quantitative (90/100) and qualitative ("game of the year"!) evaluations, meaning in this case, there's no way to distinguish whether one or the other better impacted consumer behavior.
The industry places an enormous importance on game reviews. The success and impact of controversial review aggregation sites like Metacritic, which influence everything from sequel potential to developer royalty payments, underscore that. EEDAR's study simply adds to the pile.
When's the last time you remember a video game review directly influencing you? Then again, based on EEDAR's findings, maybe you weren't even aware that review was influencing you at all.
[image credit: flickr / mastershambler]
Have something to share? Sitting on a news tip? E-mail me. You can also follow me on Twitter.




Comments
Displaying 1–20 of 36
122
Diggerclan
I always read reviews before buying a game. Any time I DIDN'T listen to a review I always ended out regretting it.
yiggypow
Oh wow, that makes a lot of sense dude.
Lou
www.web-anonymity.au.tc
shantavius.taylor
Summer s just around the corner,so what better gifts to present to your friends,families ever?For those of you that canot find time to see more details. Here are the best sellings in quick clicking links.
Factory prices.Guranteened quality.Free shipping.Credit Card payment safer,faster,convinient.
$ 18 cool hats : http://www.nikeexpert.com/disc ount-caphat-polo-cap-c-91_113. html
$ 18 cool sunglasses: http://www.nikeexpert.com/sung lasses-a-a-c-122.html
$ 18 women t-shirt: http://www.nikeexpert.com/bran d-tshirt-women-baby-tshirt-c-1 44_177.html
Hot seller R4 shoes: http://www.nikeexpert.com/men- shoes-shox-r4r5-series-c-55_63 .html
For more detailed brand Jeans,belts,sneakers, bags,dunks,running shoes at : www.nikeexpert.com
Enjoy your party in your locals with saving over 40% this summer and cheer up for the 2010 FIFA world cup team you ve been supporting.
shantavius.taylor
Summer s just around the corner,so what better gifts to present to your friends,families ever?For those of you that canot find time to see more details. Here are the best sellings in quick clicking links.
Factory prices.Guranteened quality.Free shipping.Credit Card payment safer,faster,convinient.
$ 18 cool hats : http://www.nikeexpert.com/disc ount-caphat-polo-cap-c-91_113. html
$ 18 cool sunglasses: http://www.nikeexpert.com/sung lasses-a-a-c-122.html
$ 18 women t-shirt: http://www.nikeexpert.com/bran d-tshirt-women-baby-tshirt-c-1 44_177.html
Hot seller R4 shoes: http://www.nikeexpert.com/men- shoes-shox-r4r5-series-c-55_63 .html
For more detailed brand Jeans,belts,sneakers, bags,dunks,running shoes at : www.nikeexpert.com
Enjoy your party in your locals with saving over 40% this summer and cheer up for the 2010 FIFA world cup team you ve been supporting.
Galloway
no haha lol
Spybreak
Oh is that why I watch Xplay, read my Official Xbox Magazine, PC Gamer and read Gamesradar?! Dumbasses
CamperHunter1
While I do believe critic reviews play a role in influencing us to buy or at least try a game, I believe it is only half of the equation.
For those who live off of reviews ----> ONLY <---- when making purchasing decisions, I think the equation stacks up a little more like the following:
50% Critic reviews
50% Demo impressions/fan reviews
= % chance of purchase
Money doesn't play any part in that equation because I'm solely analyzing what is going through our heads after we take those factors into consideration. If we want it bad enough, we'll buy it at the first opportune moment, regardless of whether it is as full price or on sale (or even in the bargain bin for really old titles).
abaddon1977
Unfortunately this study means absolutely nothing at all. It was a small study, fundamentally flawed, with more holes in it than swiss cheese. I will say one thing though, it gave results (hahahahhahaha). Here is a study for everyone, let's judge the actions of what is done. Yes game reviews make a difference and may and do sway certain people to buy certain games,but to try and nail this to a certain percentage and with such a pathetically flawed study is ridiculous. Here is the facts and just the facts 1) we know words are very powerful and have influenced people for years 2) another one is people follow the strong or tend to allign themselves with people knowledgeable about a subject 3) now knowing if someone was to print certain things about something or give a certain score to something and is perceived as a knowledgeable then influence by some or many may ensue The best way to see if a study is legit and to give merit is to look at the actions of what is going on LIVE in life,and then evaluate actions. WORDS DO INFLUENCE : PEOPLE PERCEIVED AS KNOWING WHAT THEY ARE TALLKING ABOUT ARE FOLLOWED : PEOPLE WRITE REVIEWS : PEOPLE READ THEM : WORDS INFLUENCE : HAHAHAHAHAHAHAHAHAHAHA study done. and I didn't even have to get 200 students and put them in a position to choose a certain way hahahahahaha and those 2 times as much numbers stuff ridiculous with such a pathetically flawed study. who knows maybe some people choose the game think that that was what the people doing it wanted them to do. Save your study money monkeys, and this is for Adam, yes what you do is very relevant, look at all that follow your lead. Long live the King hahahahahahahahahahaha
j_soap
i'll always check out reviews, whether for movies or games, to see what people thought about them and what the reviewer felt the game/movie did right or wrong, but whether the review is good or bad, it's still just some persons opinion and i always like to check games, and especially movies, for myself, to see if i may like them. i often find (although more so with movies than video games) that if something is given bad reviews i can still enjoy it, which doesn't mean that the game or movie or whatever is good or bad, it just means that it appeals to me.
YamiKarasu
Depending on my financial situation I may react a number of ways to reviews. I remember distinctly watching an old episode of X-Play praising Final Fantasy XII and so I went ahead and bought it cheap, was one of the best video games I've ever played and since have followed G4's reviews very closely. So I tend to take each review to heart however chances are I'll know what games I want to play when they're announced regardless of what reviews are going to say. Sometimes this pays off (Mirror's Edge) and sometimes it doesn't (Sonic Unleashed). However, nowadays there's so many high profile games and so much news to accompany it essentially creating a non-stop hype train that by the time games come out I've all but lost complete interest before I read the reviews, which I know will be good anyway. This occurred with Assassin's Creed 2 and Final Fantasy XIII (until about a month after it came out then I was excited again). My point being sometimes your mind is made up well in advance and no critic is going to deter you, and sometimes too much information turns your anticipation into resentment.
psych0_j1m
188 people in the study... how is this even creditable? Not that i disagree with the results because they were obvious to begin with
ronaldo99
I personally look at reviews very seriously because of the price of games and game rentals. It's like $8 to rent a game from blockbuster. I think demos are helping this problem out a bit though...
Spartan593
If i see a game that looks good but nobodys talking about it, i usually read the reviews. Like Split/Second. I though the concept was good, and i hadnt played a decent racing game in a while. Of course, I still think 60 dollars is unreasonable for a racing game, I borrowed it from a friend and must say that it is probably one of the most fun racing games I've played. Reviews were postiive, and they were the reason I let my friend borrow Borderlands, a game i was still very invested in. Probably will buy Split/Second when teh price drops.
gamerTonester
i bought shattered memories even what people said about it
everyone is entitled to there own opinion
i like to read the review to see what its like glitches etc.
jdionio
I don't go with reviews. Yeah they are nice for people to put out and get a basis for what you plan on getting, but only 2 things will help: Yourself and your friends/peers. I know I suggested COD: MW2 to lots of people and they picked it up due to knowing that I'm a gamer and I'm knowledgeable in what they like. Likewise, when I heard nothing but great things about Borderlands from my friends, I went and picked it up and was instantly hooked. Peer pressure is a strong tool for getting a game and honestly, I don't feel that a lot of reviewers are my peers. They are people paid to give their opinions on games. Your friends and you aren't. Plus, as I've seen on another site, not all reviews are written by people that care about the game. They are either paid off by the publisher to give the game a high score or can't be bothered to play the actual game that they just view the trailer, forget the name of the game and just toss a piss poor review out, which if most people read them and try the game out, find that the review is a load of trash. Can it get fixed? Yes, but it has to start from the top downwards.
Nub Salad
Whatever you do, don't go by the reviews you hear in the gamestop stores. I've seen some of the worst games get praised on that Gamestop TV crap. "with great movies come great video games" and that's a direct quote from gamestop tv about iron man 2.
firefist
I've found reviews very helpful the majority of the times and I've grown to trust them here and there. Sometimes I end up kicking myself in the ass after I've bought a game before reading a review. So they do work. Sorta like a buyer beware. And to me, any help not selecting a bad game and wasting my money is greatly appreciated.
sandboxgamer
I wont buy a game unless i read a review first and if their is a demo I also will play that to see if i like it or not. If a game gets lower than a three i have learned its not the best idea to buy it. if i really want to play a game that got a low scorce I just wait for it to hit the bargin bin and then regret buying it later lol. ex. Dark sector, Star wars: The force unleahsed and turok. Now i just have to wait for Dead to rights: retribution to hit the bin. Reviews definatly save me money and Im very greatful.
sandboxgamer
I wont buy a game unless i read a review first and if their is a demo I also will play that to see if i like it or not. If a game gets lower than a three i have learned its not the best idea to buy it. if i really want to play a game that got a low scorce I just wait for it to hit the bargin bin and then regret buying it later lol. ex. Dark sector, Star wars: The force unleahsed and turok. Now i just have to wait for Dead to rights: retribution to hit the bin. Reviews definatly save me money and Im very greatful.
bonfireclark
I find game reviews helpful and tend to stick to a select few of review outlets that I have come to trust over time. For me, it comes down to which games am I willing to spend $60 on and which games will I wait and spend $20 or less to buy it used? Or even better, borrow from a friend who was kind enough to pay the $60. Games are expensive and I want to make sure I get the most for my money. I find demos VERY helpful in determining which games I want to buy. Reviews give me a heading, marketing gets me pumped up but nothing tips the scales like a demo. Getting your hands on hands-on-play is priceless. I'm looking forward to demo time at Comic Con in a few weeks to be sure!
Displaying 1–20 of 36
122
Add a Comment