On reviewing, publons and privacy

Recently I came across Publons as a way to get credit for your reviewing efforts. At first I was rather intrigued. It does sound like a good idea as I often bemoan the burden which is reviewing at times, and the little reward it brings (often because of the quality of the work). I was even more intrigued as five years ago I was runner-up in Elsevier’s peer-review challenge, trying to resolve the ailing peer-review system. The winner suggested something along the lines of Publons.

However, Publons or any badge system want to make you believe that your review is worth something outside it’s academic context. Yet, it does not contribute to a workable solution for the core problem of the academic peer-review process which is ease-of-use and the quality of the review. It perverts the peer-review system with false incentives and a race to the bottom if poorly executed. Publons claims for publishers state a decrease in review, times and more worryingly a increase in acceptance rates of up to 65%. This suggests that Publons change incentives to accept manuscripts which otherwise would have been rejected. Food for thought I would say!

Even less surprising is that given that this is a for profit venture and they do not go lightly when it comes to privacy. Checking the privacy statement (below) basically states that all the data you submit (full reviews if possible) can be used for data mining, and reselling to advertisers or publishers alike.

In short, Publons is a niche data broker, contrary to sweeping approach Google and Facebook use. Added value is generated in the form of a virtual badge, with little or no real world value, providing only an extra account to track and performance anxiety that goes with it and the privacy you sign away. The badges also seem to shift the reviewer acceptance rates unwarranted. We should not be speeding up science, we should be increasing rigour, reproducibility and quality.