Refine
Document Type
- Article (1)
- Postprint (1)
- Working Paper (1)
Language
- English (3)
Is part of the Bibliography
- yes (3)
Keywords
- organic search (2)
- referral propensity (2)
- social media advertising (2)
- social referrals (2)
- website stickiness (2)
- conomics (1)
- open science (1)
- political science (1)
- replication (1)
- reproduction (1)
This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. The analysis involves computational reproducibility checks and robustness assessments. It reveals several patterns. First, we uncover a high rate of fully computationally reproducible results (over 85%). Second, excluding minor issues like missing packages or broken pathways, we uncover coding errors for about 25% of studies, with some studies containing multiple errors. Third, we test the robustness of the results to 5,511 re-analyses. We find a robustness reproducibility of about 70%. Robustness reproducibility rates are relatively higher for re-analyses that introduce new data and lower for re-analyses that change the sample or the definition of the dependent variable. Fourth, 52% of re-analysis effect size estimates are smaller than the original published estimates and the average statistical significance of a re-analysis is 77% of the original. Lastly, we rely on six teams of researchers working independently to answer eight additional research questions on the determinants of robustness reproducibility. Most teams find a negative relationship between replicators' experience and reproducibility, while finding no relationship between reproducibility and the provision of intermediate or even raw data combined with the necessary cleaning codes.
Do all roads lead to Rome?
(2020)
Content website providers have two main goals: They seek to attract consumers and to keep them on their websites as long as possible. To reach potential consumers, they can utilize several online channels, such as paid search results or advertisements on social media, all of which usually require a substantial marketing budget. However, with rising user numbers of online communication tools, website providers increasingly integrate social sharing buttons on their websites to encourage existing consumers to facilitate referrals to their social networks. While little is known about this social form of guiding consumers to a content website, the study proposes that the way in which consumers reach a website is related to their stickiness to the website and their propensity to refer content to others. By using a unique clickstream data set of a video-on-demand website, the study compares consumers referred by their social network to those consumers arriving at the website via organic search or social media advertisements in terms of stickiness to the website (e.g., visit length, number of page views, video starts) and referral likelihood. The results show that consumers referred through social referrals spend more time on the website, view more pages, and start more videos than consumers who respond to social media advertisements, but less than those coming through organic search. Concerning referral propensity, the results indicate that consumers attracted to a website through social referrals are more likely to refer content to others than those who came through organic search or social media advertisements. The study offers direct insights to managers and recommends an increase in their efforts to promote social referrals on their websites.
Do all roads lead to Rome?
(2020)
Content website providers have two main goals: They seek to attract consumers and to keep them on their websites as long as possible. To reach potential consumers, they can utilize several online channels, such as paid search results or advertisements on social media, all of which usually require a substantial marketing budget. However, with rising user numbers of online communication tools, website providers increasingly integrate social sharing buttons on their websites to encourage existing consumers to facilitate referrals to their social networks. While little is known about this social form of guiding consumers to a content website, the study proposes that the way in which consumers reach a website is related to their stickiness to the website and their propensity to refer content to others. By using a unique clickstream data set of a video-on-demand website, the study compares consumers referred by their social network to those consumers arriving at the website via organic search or social media advertisements in terms of stickiness to the website (e.g., visit length, number of page views, video starts) and referral likelihood. The results show that consumers referred through social referrals spend more time on the website, view more pages, and start more videos than consumers who respond to social media advertisements, but less than those coming through organic search. Concerning referral propensity, the results indicate that consumers attracted to a website through social referrals are more likely to refer content to others than those who came through organic search or social media advertisements. The study offers direct insights to managers and recommends an increase in their efforts to promote social referrals on their websites.