Journal of Trial and Error

Startpagina
Nederland
Utrecht
Journal of Trial and Error

The Journal of Trial and Error aims to close the gap between what is researched and what is published

18/06/2024

Looking for blog writers!

JOTE is looking for opinion pieces and background articles.

Have you been bottling up your frustrations about the scientific publishing system or academic culture? Or do you have interesting academia or publishing related insights/experiences that you want to share?

Then come write as a guest-editor for our blog!

Interested? Mail [email protected]

Aside from our blog, we also have an ongoing call for anecdotes about serendipity in scientific practice. See here for more info: https://journal.trialanderror.org/pub/call-serendipity/release/1?readingCollection=d235496a

12/06/2024

ARTICLE SPOTLIGHT:

This week, we showcase a psychological study on the relation between smiling and inner emotional states.

Many studies support the theory that facial expressions reflect people's inner feelings. This study, in which individuals had to self-report using TikTok-like videos, shows an opposite result: smiling correlated with stress and anxiety.

This 'negative' finding opens up the door for new research on this relation, and show how selfie-apps can help study these topics.

Check the study here: https://journal.trialanderror.org/pub/smile-camera/release/1

05/06/2024

ARTICLE SPOTLIGHT:

This week, we showcase an essay by professor Moin Syed, on myths about Open Science.

Drawing from his own field of psychology, he identifies three persistent arguments (or myths).

First is the myth that Open Science reproduces existing power balances, and therefore conflicts with global and ethnic diversity. Second, it is implied that open data is a binary choice: either you make your data accessible, including sensitive data of participants, or you close it off completely. Lastly, it is believed that only studies with experimental designs should be preregistered.

Syed argues that these myths are based on insufficient information, and pleads for a more open and constructive stance towards new Open Science practices.

Read the article here: https://journal.trialanderror.org/pub/three-persistent-myths/release/2

27/05/2024

We're thrilled to present you our latest special issue on the scientific reform movement!!

In response to the replication crisis and many fraud cases in the behavioral and social sciences, a scientific reform movement has arisen.

This young movement pleads for a different academic culture and has initiated new practices, like preregistration and increased transparency. But despite clear benefits, the effects of these practices are unclear. With this special issue, we aim to critically reflect on the reform movement and its practices, in order to further improve science.

Check the special issue here: https://journal.trialanderror.org/special-issue-consequences-of-the-scientific-reform-movement

Thanks to all our editors and authors, as well as Lieve Visser for the beautiful cover design.

23/05/2024

ARTICLE SPOTLIGHT:

This week, we showcase a study by Sigrid Heinsbroek, et al. on the negative decisions of Dutch Medical Research Ethics Committees.

Although negative decisions can be valuable for other researchers, the committees generally do not report on them, or their rationales.

In this article, the authors give an insight in the decision process, and show that negative decisions are issued due to incomplete research files (like a lack of information on the safety or quality of a trial), an unacceptable way to obtain informed consent, or a lack of a risk-benefit assessments for study participants.

Interested? Read the study here: https://journal.trialanderror.org/pub/negative-decisions-studies/release/3

29/04/2024

ARTICLE SPOTLIGHT:

This week, we showcase an article by Joeri van Hugten on the use of Complementary Explanation as a novel way to counteract the underreporting of scientific evidence.

The underreporting of negative findings is very common in the social sciences, and can be the result of post-hoc hypothesis creation - or HARKing. Hugten suggests to use these findings in a falsificationist way, by checking what implications they have for theories that would be rejected by these findings. Researchers can do this by drawing up complementary explanations - explanations for the opposite of a result.

"CE is like transparently making a hypothesis after the result is known, that is opposite to that result. That shift in focus counteracts the threat of HARKing to research reliability."

Interested? Read the study here: https://journal.trialanderror.org/pub/complementary-explanation/release/3

16/04/2024

We are pleased to welcome three new board members!

With the coming of spring, we've changed our board. Stefan Gaillard will take up Martijn van der Meer's position as chair of JOTE, and we will add three new general members to our board: Alex Visser, Sarahanne Field and Marcel Hobma.

Alex Visser graduated with a BA in Political Philosophy and Ethics from Utrecht University. They have been involved with the Centre of Trial and Error since the beginning in various positions, such as copyeditor, head of operations, and project lead. They study European history with a focus on activism and advocacy groups in the Research Master European Studies at Maastricht University.

Sarahanne Field is a metascientist who studies how and why science goes wrong, and how scientists in the open science movement address these problems. She is an assistant professor at Groningen University, and has been involved with JOTE for several years. Currently, she is the editor-in-chief of our journal. Aside from metascience, she is also interested in scientific methodologies, research ethics, preregistration practices and replication.

Marcel Hobma graduated in History and Philosophy of Science with a thesis on the cultural evolution of values in nutrition science. As an investigative & science journalist, he writes about the relations between science, industry and society, with a focus on the (bio)medical sciences. He is the editor-in-chief of JOTE's blog as well as its social media manager.

Lastly, we want to thank parting board members Martijn van der Meer and Maura Burke for their essential role in the establishment and ongoing development of JOTE!

15/04/2024

ARTICLE SPOTLIGHT

Could it be profitable for labs to advocate open science, but not practice it? In this week's article spotlight we show a metascience study by Linde, et al. that concludes against this: "... labs that practice and advocate open science dominate in a scientific community that values open science."

The authors explored different kinds of academic behaviour in an evolutionary computational model. It shows that in an environment with an incentive structure that values open science, labs that only advocate (and not practice) OS do not thrive.
"These results are encouraging to those who feel practicing open science “is not worth it”: in addition to benefits to science at large, our results suggest engaging with open science can benefit individual researchers if open science is sufficiently rewarded."

The whole article can be read here: https://journal.trialanderror.org/pub/reputation-without-practice/release/2

11/04/2024

Exciting news! This week we published an editorial on serendipity in science!

Some like to think of science as a systematic progression, based on rationality and meticulously planned experiments, but in reality it can be quite messy. Many important discoveries follow from accidents and lucky incidents - although seizing these opportunities still require the right skills and knowledge.

To give it the attention it deserves, we have started collecting anecdotes on serendipity from researchers, and published an encompassing editorial by Wendy Ross, Samantha Copeland and Stuart Firestein.

Interested? Read the editorial here: https://journal.trialanderror.org/pub/serendipity-in-scientific/release/2

Stumbled upon a case of serendipity in your own research? Reach out to [email protected] and share your anecdote with us!

03/04/2024

Our new Blogpost is out!

For our "JOTE in Conversation" series, we interviewed Leo Tiokhin, PhD about scientific evaluation platform Red Team Market and his career.

"When I began working on my PhD, it felt somewhat trivial relative to issues surrounding reproducibility and scientific integrity, so I told my supervisor: I can't do it, I need to focus on metascience'."

Read the whole interview here: https://blog.trialanderror.org/jote-in-conversation-leo-tiokhin-criticism-in-science-should-be-rewarded

Follow us for more!

02/04/2024

The Journal of Trial & Error is looking for donations!

As a journal for 'failed' research and metascience, we aim to push against the replication crisis and the publication pressure that researchers face.

To realise this, we've chosen to become a Diamond Open Access journal and not charge Article Processing Costs or subscription fees. Our income is therefore based on commercial publishing assignments and (mostly) funding and donations by people and organisations that support our cause.

Do you want to contribute as well, and help us make science more open and reflective? Then please donate here: https://trialanderror.org/donate

Aside from publishing empirical and reflective articles in our Journal, we also organize events like the Trial and Error Reward, and publish interviews and opinion pieces on our blog: https://blog.trialanderror.org/

Thank you for your support!

26/03/2024

Today, psychologist Floor van Meer won the Trial and Error award for her research on the effect of driving on snack consumption!

Together with Utrecht Young Academy, we looked for a way to acknowledge the important role of failure - or trial and error - in scientific research. The result: a price for 'failed' research!

The award aims to create a healthier research environment and publication culture by encouraging researchers to publish their negative and null results.

"Publishing these kind of studies can prevent colleagues from making the same mistakes, and gives a more realistic view of science in practice", says JOTE co-founder Stefan Gaillard.

The award was created by Isolde Eickmans in cooperation with the Sint Lucas college.

You can read Van Meer's study here: https://journal.trialanderror.org/pub/driven-to-snack/release/1

21/03/2024

We are still accepting applications for the position of Life Sciences editor!

Are you interested in methodology, open science and metascience - especially when it is related to the biological and (bio)medical sciences? Then join our Diamond Open Access Journal as a Life Sciences editor!

Apply by March 31th: [email protected]

18/03/2024

Starting from March 25, 2024, we will welcome submissions for registered reports (RRs) in our journal! We see the move to publishing RRs as part of a broader, cultural movement in academia towards more rigorous, responsible, and transparent research practice. We're proud to become another journal accepting the format.

The RR format allows researchers to submit their plans for a study for peer review prior to conducting the study (including data collection). When these 'Stage 1' research plans meet good standards for methodological and statistical soundness, and a logical linkage to existing theory, they will be granted in-principle acceptance (IPA) at JOTE. Providing the planned protocol is carried out faithfully (and any deviations are transparently, and clearly reported), the full 'Stage 2' study will be published with us.

Please note that the RR format does not 'put science in chains', nor suppress exploration, nor is it a 'prison' for your ideas, nor are they a panacea for all the problems with science. Put simply, RRs can be a powerful tool in helping authors avoid the pitfalls of hindsight and confirmation bias, and give us an opportunity to provide clear delineation between confirmatory and exploratory research in our research reports. They encourage detailed and transparent reporting, and are likely to lead to better planned studies.

Are you currently conducting original (meta-science) research - for example on the role of error, transparency, publishing culture or the reward-structures in science? Feel welcome to submit it to us in the RR-format - we look forward to seeing your Stage 1 protocol!

The RR-format will initially be included in our journal as a one-year pilot, and details of how this process will be followed at JOTE will soon be available in our author guidelines page. Until then, learn more on RRs from the Center for Open Science's explanation on the format here: https://www.cos.io/initiatives/registered-reports

14/03/2024

The Journal of Trial & Error is hiring a Life Sciences editor!

Our Diamond Open Access journal is receiving more and more submissions of articles related to the biological and (bio)medical sciences. Are you qualified to review them, and interested in scientific methodology and gaining copy-editing experience? Then join our team of open science and metascience enthusiasts!

Apply by March 31th, via [email protected]

04/03/2024

>> ARTICLE SPOTLIGHT

26/02/2024

We're glad to announce our new Editor-In-Chief: Sarahanne Field!

Sarahanne Field is a metascientist who studies how and why science goes wrong, and how scientists in the open science movement address these problems. She is currently an assistant professor at Groningen University, and has been involved with JOTE for several years as metascientist editor.

Aside from metascience, she is also interested in scientific methodologies, research ethics, preregistration practices and replication.

13/02/2024

We're glad to present you the nominees of the Trial and Error Award 2024!

The award is a tribute to failure in science, and consists of Isolde Eickmans' excellent work of art on the ups and downs of the scientific process. The award is an initiative of JOTE and Utrecht Young Academy, and will be granted to the winner on March 26th.

In the meantime, feel free to check out the Trial and Error awards exhibited in the Library Hall of Utrecht University!

The nominees:
Florencia Abinzano, Wendy Ross, Caroline Fischer, Tamal Kumar De, Joshua Maxwell, James Bartlett, Trisha H. and Floor van Meer, PhD

06/02/2024

ARTICLE SPOTLIGHT

This week we want to showcase a study by Fieke Terstappen, et al. on the effect of prenatal sildenafil on the genetic programming in pregnancies complicated by Fetal Growth Restriction. The article is part of our special issue on "Scientific failure and uncertainty in the health domain"

The authors studied the gene expression in human umbilical vein cells and placental tissue, but found that sildenafil did not change cardiovascular or renal programming in pregnancies with FGR.

The study shows that sildenafil can alter the placental, but not the fetal expression of relevant gene sets. Although negative, the results enable the authors to make clear suggestions for future research directions.

The whole article can be read here: https://journal.trialanderror.org/pub/prenatal-sildenafil-pregnancies/release/1?readingCollection=2fec5059

30/01/2024

🚨 CALL FOR ANECDOTES 🚨

We are looking for contributions on serendipity in scientific practice for a special series on serendipity!

Serendipity, broadly construed, is the phenomenon of finding valuable or agreeable results not sought for. Famous examples of serendipity – such as the discovery of penicillin, the invention of the microwave, and the development of Vi**ra – show the importance of following up on failures and subsequent perseverance.

We invite you to share anecdotes about incidents of serendipity or failure during your scientific research. By analyzing stories of both serendipity and failure, we hope to develop a deeper understanding of the importance of timing, opportunity, funding, and perseverance in scientific discovery. This analysis will be conducted by three experts on serendipity: philosopher Samantha Copeland, biologist and historian Stuart Firestein, and psychologist Wendy Ross.

The anecdote should contain a brief outline (250 words max), 4-5 keywords, and an indication of the research discipline of the author(s). We aim to provide feedback within a month after submission. Send your anecdotes to [email protected].

Check out the full text of the call via: https://journal.trialanderror.org/.../call.../release/1

29/01/2024

We proudly present JOTE Volume 3, Issue 1!

In this edition of the Journal of Trial and Error you can find six empirical articles, ranging from inoculation against misinformation in India to facial emotion recognition, as well as a philosophical piece on complementary explanation. Interested? Click on the link below:

https://journal.trialanderror.org/volume-3-issue-1

Enjoy reading!

25/01/2024

We are thrilled to announce an exhibition with the Utrecht Young Academy in the University Library Hall on failure in science: the Trial and Error Award!

This award is a tribute to learning from failure, and our aim is to spotlight the resilience and insights gained from overcoming research challenges.

In an inspiring partnership with Sint Lucas creative school in Boxtel, we witnessed the combination of art and failed research. Fifteen talented students visualized the concept of failure, each crafting a unique award. Isolde Eickmans’ exceptional work (see below) has been selected as our official award, but every creation tells its own story of perseverance and learning.

From 18 January to 12 February, all designed awards can be admired in the University Library Hall at Drift 27!

23/05/2023

🚨 New Article Alert! 🚨

“Rethinking Transparency and Rigor from a Qualitative Open Science Perspective” by Crystal N. Steltenpohl, Hilary Lustick, Melanie S. Meyer, Lindsay Ellis Lee, Sondra M. Stegenga, Laurel Standiford Reyes, and Rachel L. Renbarger.

Follow the link in our bio or read this article directly via https://doi.org/10.36850/mr7.

23/05/2023

🚨 New Article Alert! 🚨

“Reflections on Preregistration: Core Criteria, Badges, Complementary Workflows” by Robert T. Thibault, Charlotte R. Pennington, and Marcus R. Munafò.

Follow the link in our bio or read this article directly via https://doi.org/10.36850/mr6.

13/05/2023

🚨 New Article Alert! 🚨

“The Invisible Workload of Open Research” by Thomas J. Hostler.

Follow the link in our bio or read this article directly via https://doi.org/10.36850/mr5.

13/05/2023

🚨 New Article Alert! 🚨

“Challenges of Using Signaling Data From Telecom Network in Non-Urban Areas” by Håvard Toft, Alexey Sirotkin, Markus Landrø, Rune Verpe Engeset, and Jordy Hendrikx.

Follow the link in our bio or read this article directly via https://doi.org/10.36850/e14.

06/05/2023

🚨 New Article Alert! 🚨

“Driven to Snack: Simulated Driving Increases Subsequent Consumption” by Floor van Meer, Stephen Murphy, Wilhelm Hofmann, Henk van Steenbergen, and Lotte F. van Dillen.

Follow the link in our bio or read this article directly via https://doi.org/10.36850/e13

06/05/2023

🚨 New Article Alert! 🚨

“Questionable Metascience Practices” by Mark Rubin
Follow the link in our bio or read this article directly via https://doi.org/10.36850/mr4

28/04/2023

A new blogpost from the Journal of Trial and Error is out now! Head over to the Trial and Error blog and read Marcel Hobma’s “Evaluative Measures or Game-able Targets? Academic Competition Can Turn Even Qualitative Measures into Targets for Researchers”.

Many research councils and journals are abandoning quantitative measures for evaluating research because they tend to gradually turn into game-able targets for researchers, and lead to biased evaluations. Replacing quantitative with qualitative measures will however not be sufficient to prevent this. Instead, only when the harsh competition for research funding and academic jobs cools down, researchers might stop treating evaluative measures as targets that need to be gamed.

Read the blogpost now at https://blog.trialanderror.org/evaluative-measures-or-game-able-targets-high-competition-can-turn-even-qualitative-measures-into-targets-for-researchers and continue to follow us for more news and updates about our work!

16/04/2023

🚨 CALL FOR ANECDOTES 🚨

We are looking for contributions on serendipity in scientific practice for a special series on serendipity!

Serendipity, broadly construed, is the phenomenon of finding valuable or agreeable results not sought for. It often accompanies failure since the outcomes of research are not as originally planned.

Famous examples of serendipity – such as the discovery of penicillin, the invention of the microwave, and the development of Vi**ra – show the importance of following up on failures and subsequent perseverance.

We invite you to share anecdotes about incidents of serendipity or failure during your scientific research. By analyzing stories of both serendipity and failure, we hope to develop a deeper understanding of the importance of timing, opportunity, funding, and perseverance in scientific discovery. This analysis will be conducted by three experts on serendipity: philosopher Samantha Copeland, biologist and historian Stuart Firestein, and psychologist Wendy Ross.

Please submit an anecdote about a serendipitous discovery or a failure that could have been a discovery in different circumstances. The anecdote should contain a brief outline (250 words max), 4-5 keywords, and an indication of the research discipline of the author(s). We aim to provide feedback within a month after submission. Send your anecdotes to [email protected].

Check out the full text of the call via: https://journal.trialanderror.org/pub/call-serendipity/release/1

Adres

Utrecht

Website

https://journal.trialanderror.org/

Meldingen

Wees de eerste die het weet en laat ons u een e-mail sturen wanneer Journal of Trial and Error nieuws en promoties plaatst. Uw e-mailadres wordt niet voor andere doeleinden gebruikt en u kunt zich op elk gewenst moment afmelden.