So you got a null result. Will anyone publish it?
So you got a null result. Will anyone publish it?
Researchers have tried a bunch of strategies to get more negative results into the literature. Nature asks whether they are working.
I think we need a fundamentally different approach to scientific publishing. It's completely absurd that there's probably a bunch of unintended replication studies because the research groups can't know that their study has already been done.
And the expectation to actually read that avalanche of articles in even a niche subject is absolutely bonkers. 95% of articles are effectively write-only and will never have any impact whatsoever.
I know little of the ins-and-outs of scientific publishing, but that didn't stop me from having a dumb thought: could the fediverse be a potential solution? Each university or research group could host their own instance of some software specifically for publishing papers, papers can cross-link citations to papers on other instances, people can make comments across instances that are tied to their own identities from their home instance, paper revisions can be tracked easily and bad citations spotted when a paper is updated or retracted, that kind of thing. The currency then becomes the reputation of the organizations and individuals, and this opens up a ton of data for automated analysis. I just don't know enough to know what problems would arise.
but that didn’t stop me from having a dumb thought:
Nothing should.
Anyway, essentially something like this kind of already exists, just that "instances" are journals, that sift through the submissions and only publish peer-reviewed articles.
The real problems that would need to be adressed are:
- How can I make sure that the citations are real and actually useful? Citations-cartels are already a thing.
- How can the review process be ported to that approach without losing the independence of the reviews? They are supposed to be anonymous and not affiliated with the authors in any way?
- How can the amount of articles be reduced? Currently, you're forced to publish as much as possible, published articles in "good" journals are your currency as a reseacher.
The idea is far from bad or inpractical, but it can't really adress the cultural issues in science. The entire scientific publication ecosystem and culture is essentially stuck in the early 20th century, but with 1000 times as many people involved and much much higher stakes.
Agreed and I wonder if this isn’t a job that an AI might be able to help with: reading all the papers and at the very least, looking for key research subjects to compile for readers?
Two organizations that are trying to make a difference:
The Journal of Trial and Error.
[The journal's editor-in-chief was interviewed by Nature.]SURE: Series of Unsurprising Results in Economics
I found out about these today by the comments linked below:
So is Nature itself taking any steps to address the issue?