Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Peer review is broken not because the process of review is broken but because the peers are broken. Reviewers, like all academics, have screwed up incentives to get there name on as many papers as possible and those papers cited widely, regardless of the quality of the science involved. They will always find a way game the system to their benefit.

Recently heard about reviewers of a friend's paper blocking publication until the reviewer could publish his research on the same topic first. The whole system is just too screwed up to be fixed.



Yes this sort of bad thing happens, but more in the real high stakes games of grant reviews than publications. You can easily kill the grant of one of your competitors by just giving it a mediocre review (without any basis of course). I would see this happen all the time to my colleagues where they would get a spiteful review on a grant that would kill it and there was nothing they could do.


At the NIH, at least, I know that enormous effort is put into ensuring that there are not conflicts of interest between the reviewers and those being reviewed.

I'm not particularly surprised to hear that some places do not put in that effort - it is a slow, painstaking process - but there are places where this is less of a problem.


I am in Australia where the pool of potential grant reviewers is pretty small for most areas. When you have a grant success rate of 15% it is all too easy to nobble your competitors via the review process.


Why is science viewed as a competition there?


For exactly the same reasons it is everywhere in the world: because there isn't enough funding to go around - and the grant application process is explicitly designed to be competitive.


It doesn't seem to be everywhere though. I know in the US, research is often collaborative and a single grant may fund many researchers. Those researchers do not seem to be competing internally for funding (though, I have seen conflict as to whose name should appear first on a publication!). I presume the same is likely true in Australia. Why is some research able to be collaborative while other must (apparently) be competitive?


Note also that collaborations compete with other collaborations for program grants, and R01s (the measure of a "real" PI) are inherently not collaborative. They are by their very nature competitive. And they are the metric by which principal investigators are judged.


Many real PIs support collaborating researchers and students though.


Right, but students are written into the grant. Ultimately, nobody gives a shit which post doc or student you put on a project; the assumption (often flawed) is that they're all the same as far as the modular budget is concerned.

If they were special, the reasoning goes, they'd have their own F32 or T32 to work on the project.


You are quite mistaken, imho. The pay line for NIH grants is around 15% and for NSF grants it's more like 10%.


It is a competitive everywhere, just in Australia you are playing in a much smaller pool. There just is not enough money to fund all good grant applications.


Because there's a finite pool of money.


I'm only shocked that this is the first time you'd heard of adversarial delaying. When that fails, sometimes PIs will call up their editorially inclined pals and suggest a "bundle" issue to sneak in their lab's work. There are many ways to avoid ceding priority for discovery.

If preprint deposition is the default, this all goes away. The people who lose from such a shift are editors of major journals, publishers of journals, and senior PIs who know how to rig the game. A cynical mind might propose that these are the major forces resisting such a shift.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: