Internet science

Behavioral research and data collection via the Internet.

by Ulf-Dietrich Reips

Co-authored with Birnbaum, M. H., published 2005 In R. W. Proctor and K.-P. L. Vu (Eds.), The handbook of human factors in Web design (pp. 471-492). Mahwah, New Jersey: Erlbaum.

see 2nd edition in 2011 see 2nd edition in 2011

Design and formatting in Internet-based research

by Ulf-Dietrich Reips

Published 2010. In S. Gosling & J. Johnson, Advanced Internet Methods in the Behavioral Sciences (pp. 29-43). Washington, DC: American Psychological Association.

Web-based versus lab-based studies: A response to Kendall (2008)

by Ulf-Dietrich Reips

published in Empirical Musicology Review, 3(2), 73-77.

While in an earlier commentary (Honing & Ladinig, 2008) we stressed the potential of Web-delivered experiments for... more While in an earlier commentary (Honing & Ladinig, 2008) we stressed the potential of Web-delivered experiments for music perception research, the ongoing discussion on Web-based versus lab-based studies seems to circle around issues of method and control (Mehler, 1999; Kendall, 2008). We agree with the importance of these issues from a methodological point of view. However, we continue to stress that these issues are not essentially different for Web-based as compared to lab-based studies.

Development of measures of online privacy concern and protection for use on the Internet.

by Ulf-Dietrich Reips

Co-authored with Buchanan, T., Paine, C., Joinson, A., published 2007 in Journal of the American Society for Information Science and Technology, 58, 157-165.

How Internet-mediated research changes science

by Ulf-Dietrich Reips

published 2008 in A. Barak (Ed.), Psychological aspects of cyberspace: Theory, research, applications (pp. 268-294). Cambridge University Press.

Internet experiments: methods, guidelines, metadata

by Ulf-Dietrich Reips

published 2009 in Human Vision and Electronic Imaging XIV 7240(1), 724008. (Invited paper by the SPIE-IS&T Science and Technology Electronic Imaging societies)

The Internet experiment is now a well-established and widely used method. The present paper describes guidelines for... more The Internet experiment is now a well-established and widely used method. The present paper describes guidelines for the proper conduct of Internet experiments, e.g. handling of dropout, unobtrusive naming of materials, and pre-testing. Several methods are presented that further increase the quality of Internet experiments and help to avoid frequent errors. These methods include the "seriousness check", "warm-up," "high hurdle," and "multiple site entry" techniques, control of multiple submissions, and control of motivational confounding. Finally, metadata from sites like WEXTOR (http://wextor.org) and the web experiment list (http://wexlist.net/) are reported that show the current state of Internet-based research in terms of the distribution of fields, topics, and research designs used.

Sliders for the smart: Type of rating scale on the Web interacts with educational level

by Ulf-Dietrich Reips

Published 2011 in Social Science Computer Review, 29, 221-231. Co-authored with Frederik Funke and Randall Thomas.

Slider scales and radio buttons scales were experimentally compared in horizontal and vertical orientation. Slider... more Slider scales and radio buttons scales were experimentally compared in horizontal and vertical orientation. Slider scales lead to statistically significantly higher break-off rates (odds ratio 1/4 6.9) and substantially higher response times. Problems with slider scales were especially prevalent in participants with less than average education, suggesting the slider scale format is more challenging in terms of previous knowledge needed or cognitive load. An alternative explanation, technologydependent sampling (Buchanan & Reips, 2001), cannot fully account for the current results. The authors clearly advise against the use of Java-based slider scales and advocate low-tech solutions for the design of Web-based data collection. Orientation on screen had no observable effect on data quality or usability of rating scales. Implications of item format for Web-based surveys are discussed.

Why semantic differentials in Web-based research should be made from visual analogue scales and not from 5-point scales

by Ulf-Dietrich Reips

in press in Field Methods, co-authored with Frederik Funke. Featured in Visual Turn blog (http://www.visualturn.com/post/10590032374/say-bye-bye-to-the-likert-scale-a-really) and reblogged in tumblr's Science section (http://www.tumblr.com/tagged/science?before=1316868457), with >8000 notes.

In a Web experiment, participants were randomly assigned to 2 semantic differentials either made from discrete 5-point... more In a Web experiment, participants were randomly assigned to 2 semantic differentials either made from discrete 5-point ordinal rating scales or from continuous visual analogue scales (VASs) with 250 gradations. Respondents adjusted their ratings with VASs more often to maximize the precision of answers, which had a beneficial effect on data quality. No side effects like differences in means, higher dropout, more nonresponse, or higher response times were observed. Overall, the combination of semantic differentials and VASs results in a number of
advantages. Potential for further research is discussed.

Interval level measurement with visual analogue scales in Internet-based research: VAS Generator

by Ulf-Dietrich Reips

published 2008 in Behavior Research Methods, 40, 699–704, co-authored by Frederik Funke

The present article describes VAS Generator (more The present article describes VAS Generator (www.vasgenerator.net), a free Web service for creating a wide
range of visual analogue scales that can be used as measurement devices in Web surveys and Web experimentation, as well as for local computerized assessment. A step-by-step example for creating and implementing a visual analogue scale with visual feedback is given. VAS Generator and the scales it generates work independently of platforms and use the underlying languages HTML and JavaScript. Results from a validation study with 355 participants are reported and show that the scales generated with VAS Generator approximate an interval-scale level. In light of previous research on visual analogue versus categorical (e.g., radio button) scales in Internet-based research, we conclude that categorical scales only reach ordinal-scale level, and thus visual analogue scales are to be preferred whenever possible.

Standards for Internet-Based Experimenting.

by Ulf-Dietrich Reips

Internet-based psychological experimenting: Five dos and five don'ts.

by Ulf-Dietrich Reips

published 2002 in Social Science Computer Review, 20 (3), 241-249.

Internet Science and Open Access: First day of a honeymoon.

by Ulf-Dietrich Reips

Co-authored by Matzat, U., published 2006 in International Journal of Internet Science, 1, 1-3.

Internet-Forschung in der Entwicklungspsychologie [Internet research in developmental psychology].

by Ulf-Dietrich Reips

Published 2005 In G. Mey (Hrsg.) Handbuch Qualitative Entwicklungspsychologie, S. 455-475. Kölner Studien Verlag.

Task-specific knowledge of the law of pendulum motion in children and adults.

by Ulf-Dietrich Reips

Co-authored by Frick, A., Huber, S., & Krist, H., published 2005 in Swiss Journal of Psychology, 64, 103-114.

Datenautobahn nutzen: Formen der internetgestützten Datenerhebung [Using the data highway: Types of Internet-supported data collection].

by Ulf-Dietrich Reips

Published 2005 in Psychoscope, 26(8), 6-9. (Invited paper by the magazine of the Swiss Society of Psychology).

Internet Co-Regulation: European Law, Regulatory Governance and Legitimacy in Cyberspace

by Chris Marsden

Monograph published 18 August - launch at SLS, Cambridge Uk 6 September

Chris Marsden argues that co-regulation is the defining feature of the Internet in Europe. Co-regulation offers the... more Chris Marsden argues that co-regulation is the defining feature of the Internet in Europe. Co-regulation offers the state a route back into questions of legitimacy, governance and human rights, thereby opening up more interesting conversations than a static no-regulation versus state regulation binary choice. The basis for the argument is empirical investigation, based on a multi-year, European Commission-funded study and is further reinforced by the direction of travel in European and English law and policy, including the Digital Economy Act 2010. He places Internet regulation within the regulatory mainstream, as an advanced technocratic form of self- and co-regulation which requires governance reform to address a growing constitutional legitimacy gap. The literature review, case studies and analysis shed a welcome light on policymaking at the centre of Internet regulation in Brussels, London and Washington, revealing the extent to which states, firms and, increasingly, citizens are developing a new type of regulatory bargain.

High impact of a start-up journal: Surprisingly so?

by Ulf-Dietrich Reips

Co-authored by Uwe Matzat, published 2008 in International Journal of Internet Science, 3, 1-6.

Was Ist Online-Forschung

by Ulf-Dietrich Reips

Oxford Handbook of Internet Psychology (Paperback)(Series: Oxford Library of Psychology)

by Ulf-Dietrich Reips

The Web Experiment List: A Web Service for the Recruitment of Participants and Archiving of Internet-Based Experiments

by Ulf-Dietrich Reips