Total Survey Design is a podcast for explaining the complexities of survey design. This podcast serves a diverse audience, including academics, small business owners, nonprofits, industry professionals, and students. Each season features episodes covering topics from survey utility to sample sizes, and question design to total survey error. Episode content includes insightful discussions, expert interviews, and special event coverage to enhance your survey skills and understanding.
…
continue reading
Survey Methodology Podcasts
We talk to political scientists about what field research looks like on the ground. In each episode, we bring on expert guests to discuss different ethical and logistical aspects of the field research process, based on the book we co-edited with the same title: Stories From the Field: A Guide to Navigating Fieldwork in Political Science (Columbia University Press, 2020).
…
continue reading
A series of conversations with Survey Methodologists about the challenges they face and how they are trying to solve them. Author - ESRA, ODISSEI
…
continue reading

1
A Critique of Microsoft Word’s Feedback Survey
12:44
12:44
Play later
Play later
Lists
Like
Liked
12:44In this episode, I talk about a survey I didn’t plan to analyze—one that popped up the moment I opened Microsoft Word. Microsoft asked for feedback, and well… I had some. I break down the flaws in their opening question, including directional bias, vague wording, and unlabeled scale points. I also reflect on how these design choices impact data qua…
…
continue reading

1
An Interview with Jon Krosnick on Survey Design, Public Opinion, and Scientific Rigor
58:24
58:24
Play later
Play later
Lists
Like
Liked
58:24In this episode of Total Survey Design, Dr. Azdren Coma and Dr. Seon Yup Lee interview Dr. Jon Krosnick, a leading expert on political behavior, survey methodology, and public opinion. Dr. Krosnick is a professor at Stanford University who has advised the U.S. Census Bureau, led national studies on voting behavior and climate change, and published …
…
continue reading
In this episode I sat down with Thom to talk about surveys. We talked about his time at the Social and Economic Sciences Research Center, working with Don Dillman on various projects including the 2000 U.S. Census, some of his favorite projects, my dissertation survey, the application of the Tailored Design Method on a wide variety of cultures, and…
…
continue reading
In this episode, we do a small retrospective on the first season. We also look ahead to see what is to come. We also give a call to action, seeking your support to ensure that this project continues to exist into the future. If you would like to support us, you can do so by visiting our Ko-fi page at: https://ko-fi.com/totalsurveydesign Thank you. …
…
continue reading

1
Essential Considerations When Creating a Survey
12:14
12:14
Play later
Play later
Lists
Like
Liked
12:14In this episode, we explore essential considerations for crafting effective surveys. We begin by emphasizing the importance of defining the purpose of your survey, which serves as a guide through each step of its creation. We discuss how understanding your main goal—whether it's measuring customer satisfaction or academic variables—shapes your ques…
…
continue reading
In this episode, we discuss the target population. We emphasize the importance of a well-defined target population, in context of the goal of your survey, and in relation to your sampling frame. We offer examples of target populations of various studies, and offer suggestions for the types of variables that you may want to consider when thinking ab…
…
continue reading

1
An Interview with James McCall, Survey Methodologist
28:05
28:05
Play later
Play later
Lists
Like
Liked
28:05In this episode, we interview James McCall, a survey methodologist at Westat. James shares what first drew him to surveys, and what drove him into a career of surveys. We talk about his role as a survey methodologist in industry. We discuss cognitive testing, data scripts, and other elements of the art and science of survey design. We also discuss …
…
continue reading

1
Design Elements - Progress Bars, Back Buttons, Forced Responses, and More!
27:09
27:09
Play later
Play later
Lists
Like
Liked
27:09In this episode, we explore the key design elements of effective surveys, emphasizing the importance of user-friendly experiences and reliable data collection. But first, in our free talk segment we discuss the compensation structure of the YouGov platform. Then, we highlight practical tips like strategic question ordering, clear language use, and …
…
continue reading

1
A Conversation About the Trust and Distrust of Surveys
21:59
21:59
Play later
Play later
Lists
Like
Liked
21:59In this episode, we introduce a new free talk segment, where we discuss and celebrate Seon Yup's new job as chief survey methodologist at Kansas State University. We then explore why many people distrust surveys and some things we can do to regain their trust. We discuss key issues like sensitive topics, the impact of interviewer identity, and the …
…
continue reading

1
The Monetary Costs of Conducting Surveys - Part 1
17:29
17:29
Play later
Play later
Lists
Like
Liked
17:29In this episode, we explore the costs associated with conducting surveys. We start by debunking the common misconception that surveys are free, highlighting the significant expenses involved in various survey methods—from internet to mixed-mode surveys which are needed to collect useful data. We explore the astronomical costs of large-scale efforts…
…
continue reading

1
Sample Design - Part 2. The Sampling Frame
19:53
19:53
Play later
Play later
Lists
Like
Liked
19:53In our second episode focusing on sample design, we dive into the intricacies of creating a sampling frame. We explain what a sampling frame is and why it's crucial for ensuring your survey reaches the right target population. We discuss the four key elements of an ideal sampling frame: comprehensiveness, accuracy, specificity, and accessibility. A…
…
continue reading

1
Writing Good Survey Questions - Part 2. Response Options
9:39
9:39
Play later
Play later
Lists
Like
Liked
9:39This episode is the second in a series of writing good survey questions, where we dive deep into the intricacies of response options for survey questions, a crucial component often overlooked in survey design. We explore the significance of well-constructed response options in enhancing data quality and the pitfalls of poorly designed ones that can…
…
continue reading

1
Writing Good Survey Questions - Part 1. Base Questions
11:54
11:54
Play later
Play later
Lists
Like
Liked
11:54In this episode, we delve into the art of crafting effective survey questions. We discuss the importance of clear and precise wording, avoiding biases, and the impact of question formats on data quality. Learn practical tips for designing questions that yield accurate and meaningful data, whether for academic research, market analysis, or feedback …
…
continue reading

1
The Total Survey Design Method - Reducing Costs, Increasing Benefits, and How to Get the Best Data!
10:55
10:55
Play later
Play later
Lists
Like
Liked
10:55In this episode, we explore the Total Survey Design Method to maximize data quality. Discover how reducing errors, rooted in social exchange theory, can enhance your survey's effectiveness. We'll delve into the three key factors—cost, benefit, and trust—discussing strategies to minimize respondent burden, highlight benefits, and establish trust. Le…
…
continue reading

1
The introduction of large language models (LLMs) and AI to social science research
25:40
25:40
Play later
Play later
Lists
Like
Liked
25:40In this episode, Tom Emery and Ethan Busby discuss the implications of the introduction of large language models (LLMs) and AI to social science research. Surveys on extremism, conflict and polarisation are hard to study using surveys due to high sensitivity and sample specificity, but can we use large language models (LLMs) to address these challe…
…
continue reading
This episode is a tribute and commemoration of Don Dillman, who is known for his contributions to survey methodology, particularly the development of the Tailored Design Method (TDM) for conducting surveys. The episode reflects on his work as a professor and a mentor, his impact on our careers, and his legacy. Our unscripted conversation includes p…
…
continue reading
In this episode of the Total Survey Design Podcast, we explore the four main sources of survey error through the engaging story of Mario, a local pizzeria owner aiming to conduct an ethical survey. We delve into coverage error, sampling error, measurement error, and non-response error, explaining how each can distort survey results. By using Mario'…
…
continue reading

1
Sample Design - Part 1. Sample Size - or why just over 1000 responses is enough to generalize findings to millions of people!
13:18
13:18
Play later
Play later
Lists
Like
Liked
13:18In this episode of the Total Survey Design Podcast, we explore the fascinating concept of sample size and its impact on survey accuracy. Discover why just about 1000 responses can represent the views of millions, debunking common misconceptions about survey sampling. We'll dive into the key parameters for calculating sample size, such as margin of …
…
continue reading
In this episode, hosts Seon Yup Lee and Azdren Coma explore the ways surveys can mislead us, inspired by the book "How to Lie with Maps." They discuss common survey pitfalls, from bad question design to poor sampling, and provide real-world examples, such as misleading questions in political surveys and biased sampling in product ratings. This epis…
…
continue reading

1
FAIR principles implementation in survey research with Steve McEachern
41:49
41:49
Play later
Play later
Lists
Like
Liked
41:49In this episode, Dr. Tom Emery discusses the WorldFAIR project and FAIR principles implementation with regard to survey research methods with Dr. Steve McEachern, focusing on several key points: What are the FAIR principles, and why are they important? What challenges arise when implementing FAIR principles in survey research? What is machine actio…
…
continue reading
In this episode of the Total Survey Design Podcast, Seon Yup and Azdren dive into the utility of surveys and their vital role in understanding public opinion and decision-making. They share examples, like A&W's marketing mishap with their third-pound burger, and the importance of surveys in evaluating high-cost programs. From business insights to e…
…
continue reading
In this debut episode of "Total Survey Design," hosts Azdren Coma and Seon Yup Lee introduce listeners to the intricacies and importance of surveys. Exploring the basics of survey creation and analysis, they discuss their professional backgrounds and the podcast's goals, including helping various audiences—from small business owners to academics—ma…
…
continue reading
Listen to this episode to get a preview of everything that the Total Survey Design podcast is all about. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: [email protected] Azdren
…
continue reading

1
Crafting a Comparative Longitudinal Study on Child Well-being: Methodological Insights of GUIDE project
26:27
26:27
Play later
Play later
Lists
Like
Liked
26:27In this podcast episode of our newly introduced series, Dr. Tom Emery, Director of ODISSEI and Associate Professor at Erasmus University Rotterdam engages in a comprehensive exploration of an ambitious birth cohort study spanning across Europe. Joined by esteemed guest Professor Gary Pollock from Manchester Metropolitan University, the discussion f…
…
continue reading

1
Sensors and Apps in Surveys with Bella Struminskaya
50:40
50:40
Play later
Play later
Lists
Like
Liked
50:40In the ESRA (European Survey Research Association) Podcast Series, dr. Tom Emery, the director of ODISSEI (Open Data Infrastructure for Social Science and Economic Innovations in the Netherlands) and associate professor at the Erasmus University Rotterdam, connects with the leading experts in survey research to get an understanding of the field dev…
…
continue reading

1
Lessons from the Field: What We Love About Field Research (and this Podcast!)
1:07:02
1:07:02
Play later
Play later
Lists
Like
Liked
1:07:02In this special final episode, we weave together numerous lessons from throughout the book and podcast, from the value of unstructured time in the field to the surprising parallels between hosting a podcast and doing fieldwork. Using some of our favorite interview clips and book readings, we reflect on the excellent advice our contributors shared a…
…
continue reading

1
COVID-19 and Field Research with Fotini Christia, Aliyu Zakayo, and Aidan Milliff
1:09:52
1:09:52
Play later
Play later
Lists
Like
Liked
1:09:52Fotini Christia, Aliyu Zakayo, and Aidan Milliff offer their perspectives as a full professor, a medical doctor and researcher, and an advanced graduate student, respectively, on the ethical and logistical challenges posed by COVID-19 for field research. Each guest draws on their own experiences to offer insights and suggestions for how to adjust y…
…
continue reading

1
Learning Field Research with Vierelina Fernandez, Leah Hickert, Ayse Lokmanoglu, Jack MacDonald, and Renata Martinez
1:13:00
1:13:00
Play later
Play later
Lists
Like
Liked
1:13:00We trace the process of learning field research by talking to a group of excellent undergraduate students (Leah Hickert, Jack MacDonald, and Renata Martinez) and advanced graduate students (Vierelina Fernandez, Ayse Lokmanoglu) about how they first encountered and began to conduct field research in their own communities and all over the world. Thes…
…
continue reading

1
Teaching Field Research with Jesse Driscoll, Milli Lake, and Sarah Parkinson
1:21:32
1:21:32
Play later
Play later
Lists
Like
Liked
1:21:32We welcome Jesse Driscoll from UCSD, Milli Lake from the London School of Economics, and Sarah Parkinson from Johns Hopkins University to talk about teaching field research. How can we teach others how to think about, prepare for, and carry out ethical, valuable field research? All of our guests have taught field research methods to undergraduate a…
…
continue reading

1
Health and Safety in the Field with Ravi Perry and Sarah Zukerman Daly
49:41
49:41
Play later
Play later
Lists
Like
Liked
49:41We welcome Ravi Perry from Howard University and Sarah Zukerman Daly from Columbia University to talk about the crucial but oft-overlooked issues of health and safety in the field—whether in one's home community or in a foreign location. Ravi and Sarah share some of the personal challenges they've faced in the course of their fascinating research o…
…
continue reading

1
Research in China with Enze Han and Robert Ross
57:50
57:50
Play later
Play later
Lists
Like
Liked
57:50We talk to Enze Han from the University of Hong Kong and Robert Ross from Boston College about the significant potential and challenges of doing research in China. Our guests reflect on everything from their experiences building academic relationships with colleagues at Chinese universities to how local perceptions of researchers' own identities ca…
…
continue reading

1
Field Surveys and Experiments with Matthew Cancian, Kristin Fabbe, and Kristin Michelitch
1:04:11
1:04:11
Play later
Play later
Lists
Like
Liked
1:04:11We welcome Matthew Cancian from MIT, Kristin Fabbe from Harvard Business School, and Kristin Michelitch from Vanderbilt University to talk about conducting field surveys and experiments. We discuss what goes into designing an experiment or survey, developing local relationships, and navigating the ethical and logistical challenges of conducting com…
…
continue reading

1
Conducting Research Amidst Conflict with Zoe Marks and Will Reno
55:51
55:51
Play later
Play later
Lists
Like
Liked
55:51We welcome Zoe Marks from Harvard Kennedy School and Will Reno from Northwestern University to talk about doing research in insecure or conflict-affected situations, and learning how to keep our research participants, our teams, and ourselves safe in difficult environments. Producers: Harper Barbaree, John Gehman Editors: Hannah Jones, Garrett Madd…
…
continue reading

1
Creatively Collecting Information with John McCauley, Rich Nielsen, and Lindsey O'Rourke
59:49
59:49
Play later
Play later
Lists
Like
Liked
59:49Once you're in "the field," how can you most effectively gain knowledge and collect information? How do you build trust and connections with local leaders? How to show respect and become part of a new community? How to access and decipher classified archival documents? We welcome John McCauley from The University of Maryland, Rich Nielsen from MIT,…
…
continue reading

1
Positionality, Emotions, and Research in the Middle East with Carla Abdo-Katsipis, Nadya Hajj, and Ian Lustick
1:12:48
1:12:48
Play later
Play later
Lists
Like
Liked
1:12:48How do our identities and lives outside of academia shape our fieldwork? And what does that look like in a region like the Middle East? We talk to Carla Abdo-Katsipis from Wesleyan University, Nadya Hajj from Wellesley College, and Ian Lustick from the University of Pennsylvania about doing research across the Middle East, and reflect on how our pe…
…
continue reading

1
The Ethics of Field Research with Erica Chenoweth and Zachariah Mampilly
1:06:43
1:06:43
Play later
Play later
Lists
Like
Liked
1:06:43Peter and Ora welcome Erica Chenoweth from Harvard Kennedy School and Zachariah Mampilly from the Marxe School of International Affairs at Baruch College to discuss research ethics, including whether political scientists should have an individual and/or shared code of ethics, tough decisions about accepting funding from government and non-governmen…
…
continue reading

1
Introduction: Welcome to Stories from the Field
29:20
29:20
Play later
Play later
Lists
Like
Liked
29:20In this introductory episode, Peter and Ora discuss the evolving definition of "field research," which is conventionally defined as research conducted outside of one’s institution to observe, interact with, and interview people, work in the archives, and otherwise learn about a place and its politics and society. Regardless of where and how it is c…
…
continue reading

1
Developing Local Knowledge with Christina Greer, Wendy Pearlman, and Paul Staniland
1:07:36
1:07:36
Play later
Play later
Lists
Like
Liked
1:07:36Ora and Peter welcome Christina Greer from Fordham University, Wendy Pearlman from Northwestern University, and Paul Staniland from the University of Chicago to discuss local knowledge, perhaps the most important aspect of field research. Local knowledge is a collection of facts, beliefs, and perceptions used by people in a specific region to inter…
…
continue reading