There’s an article doing the rounds at the moment from the Washington Post suggesting that the Amazon is undergoing some kind of fake review crisis. There are problems with Amazon reviews, of course, but this article is based on some pretty flawed data. At least in how it pertains to the world of books, which is what I know, and what I’ll focus on here. I can’t speak to the world of diet supplements or fake tan or giant tubs of lube – alas.
The article’s claims are largely based on a flaky site called ReviewMeta, which seems far better at getting publicity for itself than correctly analyzing the trustworthiness of reviews, which is a pity as it would be a wonderful tool if it was in any way accurate.
I first heard about ReviewMeta back in 2016 and was very excited to test it out. Naturally, I started with my own books, as I can be pretty sure there are no fake reviews there, being the author, publisher, and marketer of all these titles, and someone who is fastidious about the rules as my name is literally my brand.
However, ReviewMeta seems to call into question a large number of my reviews and reviewers. And by extension me, I guess. And all of you too, because many of the random selection of books I checked had similar issues. The ReviewMeta site helpfully gives explanations for why its system made these determinations, and you can actually break down each component and get a further explanation. This transparency is hugely commendable. Read More…