Do Customer Reviews Help or Hurt?

As the previous post explored the question whether Freshdirect would see increased revenues from user generated content, one of my most resourceful colleagues, Jay Henderson, pointed out an interesting study by Bazaarvoice.

Bazaarvoice, if you didn’t know this already, is a solutions vendor that facilitates customer reviews for retailers and other eCommerce companies. In their own words, they bring “the power of social commerce to the world’s best brands.”

This study was done for Bazaarvoice’s client Bath and Body Works in 2007. Just as Freshdiretc’s CEO likely would, they asked the good question whether customer reviews contribute to increasing revenues. After all, what do we care which soap the customer buys if they are going to buy some soap anyway?

So, the client and/or Bazaarvoice measured whether an email containing customer ratings and reviews would be more successful than ‘the average email” that includes the company’s typical marketing messaging.

And what did the study find?

The email with peer reviews led to increased average order values by 10 percent!

Wow. In addition to this monetary success indicator, session length was higher and bounce rates were lower when peer reviews were included in the email.

This is especially fun to point out since our recommendation to Freshdirect was similar. In the discussion the conclusion was that user generated content around recipes could raise average order by values not by persuading people to buy more food, but more refined food.

Now, admittedly, the Bazaarvoice study isn’t saying that they created the same email content twice, once with reviews and once without, and then did split testing. So the question would be valid to ask whether the test really compares emails that would qualify as an apples to apples comparison.

But still, there is a great indicator here that customer generated reviews do seem to bring  great, tangible business value. And best of all, it is relatively easy for Bazaarvoice customers to run similar tests, measure outcomes, and convince themselves.

Incidentally, I was speaking with John Grech at PowerReviews who are a vendor in the same market as Bazaarvoice. PowerReviews uses a “tag-based” approach to capturing customer reviews. That is to say that reviewers can enter social tags describing products they review.

For example if you  are reviewing a sneaker you might tag it as “Great for running”.

Merchandisers can obtain a data feed from PowerReviews that correlate tags vs. merchandise. Merchandisers can then offer navigation based on these tags, e.g. “Which shoes are great for running?”

Interestingly, there is also a promise for extensible web analytics solutions to make use of the same tag data feed. When integrated, web analytics can then roll up web visitor activity, e.g. by “shoes that are great for running.” The web analytics solution would then also be enabled to correlate that to keywords or referrers that attract visitors that end up viewing or buying shoes “that are great for running”.

And let’s not forget about the offline marketers too.

Marketers can use the user generated tag content as a type of focus group. So if you designed a direct mail catalog about shoes that are great for running you could tap into this peer advice.

PowerReviews too have their case studies available online.

More power to these vendors. And many thanks to Jay for pointing it out.

2 Responses to “Do Customer Reviews Help or Hurt?”

  1. Akin, thanks for the post! Adding reviews to the site is step 1, but the trusted content that results can be integrated in a number of ways…in paid search results, e-mail marketing, and even off line material such as catalogs. Top rated products should be promoted anywhere retailers sell!

  2. Hey Dan,

    Looks like your company is in the same market. Give us a quick intro if you like of what one should know about Last Piece software.

    Thanks for leaving a comment!
    Akin