UX Research Screeners: Recruiting Participants Without Bias
Research findings depend on who takes part. A screener helps a team find people whose experiences are relevant to a study, but a poorly written one can reveal the desired answer, exclude useful perspectives, or collect more personal information than necessary.
UX Research Repositories: Governance, Search, and Reuse
Recruitment is part of research design. Eligibility criteria should come from the research question, and the screener should make it possible to apply those criteria consistently.
Define eligibility before writing questions
Translate the research question into observable participant criteria. If the study concerns managing a recurring task, define a relevant timeframe and behavior rather than asking whether someone considers themselves an “experienced user.”
Separate essential criteria from preferences. A requirement such as having completed a specific workflow may be necessary; preferring a particular device brand may not be. Every criterion can narrow the pool and introduce bias, so ask why it is needed.
Plan for diversity that matters to the study. This may include a range of experience, access needs, devices, roles, or contexts. Do not use demographic quotas without considering the research purpose and how those categories are defined.
Ask neutral, behavior-based questions
Ask about recent actions rather than opinions about what a participant might do. “When was the last time you booked an appointment online?” is more concrete than “Would you use an online appointment service?”
Avoid revealing the answer that qualifies someone. A question such as “Are you a frequent user of our app?” may invite people to interpret “frequent” in a way that helps them qualify. Use a defined period and examples where helpful.
Put eligibility questions early enough to avoid collecting unnecessary details from people who do not qualify. Do not make the screener so obvious that participants must guess which persona the researcher wants.
Keep the screener short and accessible
Each question should earn its place. Ask only what is required to determine fit, schedule the session, or meet an explicit research inclusion goal. Provide clear answer choices and an “Other” or “Prefer not to say” option when appropriate.
Use plain language and avoid jargon that participants may interpret differently. Make the form work on mobile, with a keyboard, and with assistive technology. Do not require a long narrative answer if a simpler response will establish eligibility.
Be thoughtful with demographic information
Demographic data can be useful when the research question depends on it, but it should not be collected out of habit. Explain why a question is being asked and how the information will be used. Offer response options that reflect how people describe themselves, and allow non-response where the data is not essential.
Protect screener responses. Do not expose sensitive eligibility details to people who do not need them, and define how long recruitment data will be retained. Recruitment vendors and internal teams should follow the same privacy expectations.
Handle recruitment fairly
Use more than one recruitment source when a single panel or customer list would overrepresent a particular type of user. Existing customers can be valuable participants, but their familiarity may not represent new or prospective users.
Describe the study, time commitment, compensation, and participation requirements honestly. Compensation should reflect the effort and any extra accessibility or technology needs. Avoid pressuring people to participate or making it difficult to withdraw.
Keep a record of why a participant qualified or was excluded, using only the necessary information. This helps the team understand who is represented and identify gaps without retaining excessive personal data.
Pilot and review the screener
Ask someone outside the project team to complete the screener and describe how they interpreted each question. Check for ambiguous terms, leading language, and answer choices that do not fit real experiences.
Review the resulting sample before sessions begin. If everyone comes from one source or has the same background, adjust recruitment rather than assuming the screeners produced a representative group.
Screener checklist
- Are eligibility criteria linked to the research question?
- Are essential requirements separated from preferences?
- Do questions ask about concrete behavior without revealing desired answers?
- Is demographic information necessary and explained?
- Are response choices inclusive and accessible?
- Is the screener short and mobile-friendly?
- Are recruitment sources and sample limitations documented?
- Are responses stored and retained appropriately?
A good screener does not find the “right” answers. It helps a research team recruit people with relevant experiences while reducing avoidable bias and respecting their time and privacy.