How do social scientists obtain fast results for their experiments? This course is intended for undergraduate students, graduate students, post-doctoral researchers, and primary investigators who want to crowdsource their social science experiments across a wide range of design complexity. This course will help social scientists build their programming skills and inform them about current crowdsourcing efforts.
The first goal of this course is for you, students, to identify current crowdsourcing platforms and develop basic skills for running online participants using the online crowdsourcing platform, Amazon Mechanical Turk (MTurk). You will learn how to ethically use the MTurk platform as a user and experimenter, write an Institutional Review Board application designed for collecting crowdsourced responses, and recognize the benefits and pitfalls of crowdsourced research.
The third and final goal of this course is for you to apply what you have learned in terms of programming and experimental skills by posting your own social science experiment online.
In short, you will 1) learn about and apply your knowledge of crowdsourcing and 2) read and write code for online experiments.
This is an unofficial course or workshop offered for interested researchers. Nonetheless, there are some assessments so that you can test yourself and encode the skills you have learned.
Every tutorial has quizzes that should act as formative assessment testing how well you encoded the material that was discussed. Every week has suggested assignments and readings, such as writing an IRB, testing your code on MTurk sandbox, obtaining feedback on your experiment, posting your own code, and interpreting your output file. Since this is not an official course/workshop and the course is self-paced, the instructor has no control over whether you actually do these assignments or take the quizzes seriously. However, the ultimate goal of this course is to help you, the student, obtain enough knowledge and experience with programming an online social science experiment so that you can post your own experiment. All of the assignments and videos/tutorials are designed with that in mind.