Critical Science

  • Home
  • Critical Science

Critical Science A critical look at goings on in the world of science. Submit interesting links here: [email protected]

Nature welcomes Registered Reportshttps://www.nature.com/articles/d41586-023-00506-2"From this week, Nature will be publ...
23/02/2023

Nature welcomes Registered Reports

https://www.nature.com/articles/d41586-023-00506-2

"From this week, Nature will be publishing an additional type of research paper — designed to encourage rigour and replication.

This year marks the 50th anniversary of Nature’s decision to mandate peer review for all papers. It’s an appropriate time to introduce readers and authors to Registered Reports, a research-article format that Nature is offering from this week for studies designed to test whether a hypothesis is supported.

The fundamental principle underpinning a Registered Report is that a journal commits to publishing a paper if the research question and the methodology chosen to address it pass peer review, with the result itself taking a back seat. For now, Nature is offering Registered Reports in the field of cognitive neuroscience and in the behavioural and social sciences. In the future, we plan to extend this to other fields, as well as to other types of study, such as more exploratory research.

Why are we introducing this format? In part to try to address publication bias, the tendency of the research system — editors, reviewers and authors — to favour the publication of positive over negative results. Registered Reports help to incentivize research regardless of the result. An elegant and robust study should be appreciated as much for its methodology as for its results.

Submitting a study

As for how it works, authors of Registered Reports are asked to make a pre-submission enquiry with their research plan before they embark on a study. Typically, this plan should include the research question being asked, an explanation of why this work fits the Registered Reports format and a brief explanation of the methods to be used and how data will be collected. The research question must meet Nature’s existing editorial criteria for scientific impact and the strength of the underpinning evidence. If these criteria are satisfied, the plan will be sent for peer review. Reviewers will judge submissions on the basis of a question’s importance, either to a research field or more broadly (to an economy, the environment or society, for example). They will also assess the robustness of a study’s design and analysis. If the reviewers are satisfied, the journal will commit to publishing the findings, as long as the methodology does not change during the course of a study.

To be clear, Registered Reports are not new. They have been around for at least a decade. The format is already offered by a number of Nature Portfolio journals, including Nature Human Behaviour, Nature Methods, Nature Communications and Scientific Reports. According to the Center for Open Science, more than 300 journals already offer this format, up from around 200 in 2019. But despite having been around for a while, Registered Reports are still not widely known — or widely understood — among researchers. This must change. And, at Nature, we want to play a part in changing it.

The lack of awareness is partly the result of systemic factors that favour the conventional research paper. Studies in which the main emphasis is on results are valuable — and are used in assessing promotions and grant applications. They are also important to institutions, which can use them to obtain funding, for example.

Clearly, more needs to be done to emphasize the benefits of Registered Reports. The format helps to reinforce the necessity of rigour in study design and methodology. At the same time, it provides in-built opportunities for feedback. Both of these help researchers to spot problems in studies before it is too late to fix them. Registered Reports are becoming a marker of quality — peers, institutions and funders are beginning to realize that the format represents a high standard of work. Moreover, the format can make the peer-review process more constructive and amicable.

Collaborative potential

Registered Reports (along with other formats) might also have a role in helping to resolve disagreements within disciplines. For example, psychology researchers have disagreed on whether individuals’ subjective experiences of emotion are influenced by their own facial expressions. Researchers with different views saw the Registered Reports format as a way to collaborate to test the hypothesis. Their findings were published last October.

A decade ago, Nature developed a reporting summary for authors of manuscripts — a checklist in which authors are asked to state, for example, whether experimental findings have been replicated or whether a sample size is appropriate. Registered Reports are a progression towards greater emphasis on rigour and study design. They are also a format that recognizes both how science is done and that good research starts well before the paper is written."

From this week, Nature will be publishing an additional type of research paper — designed to encourage rigour and replication.

01/07/2022

Psychology needs to get tired of winning

https://royalsocietypublishing.org/doi/10.1098/rsos.220099

"Psychological science is on an extraordinary winning streak. A review of the published literature shows that nearly all study hypotheses are supported. This means that either all the theories are correct, or the literature is biased towards positive findings. Results from large-scale replication projects and the prevalence of questionable research practices indicate the latter. This is a problem because science progresses from being wrong. For decades, there have been calls for better theories and the adoption of a strong inference approach to science. However, there is little reason to believe that psychological science is ready to change. Although recent developments like the open science movement have improved transparency and replicability, they have not addressed psychological science's method-oriented (rather than problem-oriented) mindset. Psychological science still does not embrace the scientific method of developing theories, conducting critical tests of those theories, detecting contradictory results, and revising (or disposing of) the theories accordingly. In this article, I review why psychologists must embrace being wrong and how the Registered Report format might be one strategy for stopping psychology's winning streak."

Address


Website

Alerts

Be the first to know and let us send you an email when Critical Science posts news and promotions. Your email address will not be used for any other purpose, and you can unsubscribe at any time.

Contact The Business

Send a message to Critical Science:

Shortcuts

  • Address
  • Alerts
  • Contact The Business
  • Claim ownership or report listing
  • Want your business to be the top-listed Media Company?

Share