Crowdsourcing and Peer Production II


May 10, 2012 @ 11:30, Room: 19AB

Chair: Erika Poole, Penn State, USA
Habit as an Explanation of Participation in an Online Peer-production Community - Paper
Community: user experience
Contribution & Benefit: We examine the construct of habit as a type of non-conscious behavior in online peer-production communities; and how motivations and habits explain people's use of specific features.
Abstract » User activities in peer-production communities have mainly been examined under the assumption that individuals are rational individuals who are always cognizant of what they are doing and why. We argue that not all use is the same; while some behaviors are governed by conscious motivations, others may be a habitual response that is developed out of routine. We take a more granular approach to explaining what people are doing in online communities and how motivations and habits explain their use of specific features. In the context of the peer-production community Everything2 we employ both server log data and self-report, finding that habit is a non-conscious-driven behavior that is more associated with less cognitively-demanding tasks than content production.
Evaluating Compliance-Without-Pressure Techniques for Increasing Participation in Online Communities - Paper
Contribution & Benefit: Field study and follow-up survey evaluating two compliance-without-pressure techniques in a working social production community. Can assist researchers and practitioners boost participation in online communities they manage.
Abstract » Social psychology offers several theories of potential use for designing techniques to increase user contributions to online communities. Some of these techniques follow the "compliance without pressure" approach, where users are led to comply with a request without being subjected to any obvious external pressure. We evaluated two such techniques -- foot-in-the-door and low-ball -- in the context of Cyclopath, a geographic wiki. We found that while both techniques succeeded, low-ball elicited more work than foot-in-the-door. We discuss design and research implications of applying these (and other such techniques) in online communities.
Social Desirability Bias and Self-Reports of Motivation: A Cross-Cultural Study of Amazon Mechanical Turk in the US and India - Paper
Contribution & Benefit: Demonstrates that survey self-reports of motivation to participate in crowdsourcing can be inaccurate due to social desirability bias. Shows differential patterns of motivation and bias between US and India samples.
Abstract » In this study we extend research on online collaboration
by examining motivation to do work on the crowdsoucing
service Amazon Mechanical Turk (MTurk). We address a
challenge to many existing studies of motivation in online contexts:
they are based on survey self-reports, which are
susceptible to effects such as social desirability bias. In
addition we investigate a second challenge to the extant research on
motivation in the context of MTurk: a failure to examine potential
differences between MTurk workers (Turkers) from different parts
of the world, especially those from the US and India, MTurk's two
largest worker groups. Using a survey technique called the list
experiment, we observe distinct profiles of motivation and patterns of
social desirability effects among Turkers in the US and India.
Among US Turkers, we find that social desirability
encourages over-reporting of each of four motivating
factors we examined. The over-reporting was particularly large in
the case of money as a motivator. In contrast, among Turkers in
India we find a more complex pattern of social desirability effects,
with workers under-reporting ``killing time'' and ``fun'' as
motivations, and drastically over-reporting ``sense of purpose.''
We conclude by discussing these results and proposing implications
for future research and design.
Deploying MonoTrans Widgets in the Wild - Note
Community: engineering
Contribution & Benefit: Our first attempt to deploy a crowd-sourced monolingual translation system to the wild finds interesting lesson dealing with crowds with different sizes simultaneously.
Abstract » In this paper, we report our experience deploying the MonoTrans Widgets system in a public setting. Our work follows a line of crowd-sourced monolingual translation systems, and it is the first attempt to deploy such a system "in the wild". The results are promising, but we also found out that simultaneously drawing from multiple crowds with different expertise and sizes poses unique problems in the design of such crowd-sourcing systems.
A Quantitative Explanation of Governance in an Online Peer-Production Community - Note
Contribution & Benefit: Decision making processes are an integral part of online community governance.Understanding the relationship between user feedback and editorial deletion decisions has broader implications for design, infrastructure, and sustainability for communities.
Abstract » In this paper, we examine how user ratings of content produced for an online community are taken into account by administrators when they decide whether to delete content. Incorporating about 10 years of server data from the online peer-production community Everything2, we looked at how specific features of voting predicted deletion of posts. We found that not all types of voting are the same: negative voting of users was the strongest factor explaining deletion of a Write-up. Receiving a positive vote from a member with higher status decreases the chances of deletion, while receiving a positive vote from a user with neutral status has a very little effect on the deletion of content.