Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum With an Interim Payment: A Registered Report
| dc.citation.issue | 3 | |
| dc.citation.volume | 8 | |
| dc.contributor.author | Neville CM | |
| dc.contributor.author | Williams MN | |
| dc.contributor.editor | Sbarra DA | |
| dc.date.accessioned | 2025-08-04T00:00:39Z | |
| dc.date.available | 2025-08-04T00:00:39Z | |
| dc.date.issued | 2025-07-07 | |
| dc.description.abstract | Self-report data are vital in psychological research, but biases such as careless responding and socially desirable responding can compromise their validity. Although various methods are employed to mitigate these biases, they have limitations. The Bayesian truth serum (BTS) offers a survey scoring method to incentivize truthfulness by leveraging correlations between personal and collective opinions and rewarding “surprisingly common” responses. In this study, we evaluated the effectiveness of the BTS in mitigating socially desirable responding to sensitive questions and tested whether an interim payment could enhance its efficacy by increasing trust. In a between-subjects experimental survey, 877 participants were randomly assigned to one of three conditions: BTS, BTS with interim payment, and regular incentive (RI). Contrary to the hypotheses, participants in the BTS conditions displayed lower agreement with socially undesirable statements compared with the RI condition. The interim payment did not significantly enhance the BTS’s effectiveness. Instead, response patterns diverged from the mechanism’s intended effects, raising concerns about its robustness. As the second registered report to challenge its efficacy, this study’s results cast serious doubt on the BTS as a reliable tool for mitigating socially desirable responding and improving the validity of self-report data in psychological research. | |
| dc.description.confidential | false | |
| dc.edition.edition | July-September 2025 | |
| dc.format.pagination | 1-13 | |
| dc.identifier.citation | Neville CM, Williams MN. (2025). Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum With an Interim Payment: A Registered Report. Advances in Methods and Practices in Psychological Science. 8. 3. (pp. 1-13). | |
| dc.identifier.doi | 10.1177/25152459251343043 | |
| dc.identifier.eissn | 2515-2467 | |
| dc.identifier.elements-type | journal-article | |
| dc.identifier.issn | 2515-2459 | |
| dc.identifier.uri | https://mro.massey.ac.nz/handle/10179/73273 | |
| dc.language | English | |
| dc.publisher | SAGE Publications on behalf of the Association for Psychological Science | |
| dc.publisher.uri | https://journals.sagepub.com/doi/10.1177/25152459251343043 | |
| dc.relation.isPartOf | Advances in Methods and Practices in Psychological Science | |
| dc.rights | (c) The author/s | en |
| dc.rights.license | CC BY | en |
| dc.rights.uri | https://creativecommons.org/licenses/by/4.0/ | en |
| dc.subject | Bayesian truth serum | |
| dc.subject | BTS | |
| dc.subject | data integrity | |
| dc.subject | incentivizing truthfulness | |
| dc.subject | response biases | |
| dc.subject | self-report data | |
| dc.subject | sensitive questions | |
| dc.subject | socially desirable responding | |
| dc.subject | SDR | |
| dc.subject | survey methodology | |
| dc.subject | open data | |
| dc.subject | open materials | |
| dc.subject | preregistration | |
| dc.title | Does Truth Pay? Investigating the Effectiveness of the Bayesian Truth Serum With an Interim Payment: A Registered Report | |
| dc.type | Journal article | |
| pubs.elements-id | 501707 | |
| pubs.organisational-group | Other |