Research Sampling: Methods, Audiences & Examples
Research sampling defines who supplies the evidence. Compare methods, contact-list gaps and counting units before choosing a sample size for the decision.
Research sampling selects people, accounts or other units to provide evidence about a defined population. Start with whose experiences or outcomes the decision concerns, then check how the contact list and selection method cover them. A larger sample cannot repair missing groups or turn several perspectives on one purchase into separate purchases.
Example: one software renewal, several roles
In this hypothetical B2B software study, one account has one renewal event but several people can explain it. The customer relationship management system (CRM) lists administrators and may miss roles or accounts. Decide whether you need administrator experiences, linked committee perspectives or account outcomes. Finance and security may influence the same renewal.
One renewal event, several linked perspectives
Record level | Details |
|---|---|
Account renewal event | Evidence: One eligible event in the stated period What is counted: One account outcome |
Administrator | Evidence: Workflow experience linked to account What is counted: One person perspective |
Finance / technical roles | Evidence: Relevant approval requirements linked to account What is counted: Additional perspectives, not additional renewals |
CRM frame gap | Evidence: Missing or stale eligible contacts What is counted: Access problem to repair |
The table shows why several role interviews should not become several renewal events. Keep each perspective linked to the account it explains.
A random selection of administrators is still a sample of administrators in that frame. It is not automatically a sample of all buying-committee members. The team must decide whether the question concerns administrator experience, account outcomes or committee decisions, then obtain evidence appropriate to that unit.
Example: what a customer email list misses
A DTC email list may exclude marketplace customers, guest orders, non-subscribers and people who considered the category but bought elsewhere. If the decision concerns existing identifiable customers, say so. If it concerns acquisition, add a suitable route to prospects and competing-option buyers. Randomizing names on the email list cannot repair the list's scope.
Define the accounts and renewal period. Require recent direct involvement in the evaluation, including renewed, declined or delayed decisions when relevant. Check the CRM account and contact list for stale or missing records. That defines the target population, qualifying rules and contact frame.
Find the administrator and other relevant roles for each account. Record how contacts are verified and what each person decided. Keep role-to-account IDs so several perspectives do not multiply renewal outcomes. Report the requirements that change the offer and which roles or accounts remain missing.
Selection determines what the result can represent
Evidence design | Details |
|---|---|
Human probability sample | Selection and information to disclose: Random selection from a defined contact/selection frame with known nonzero inclusion probabilities. Report population, frame, selection, response and analysis design. Precision limit: Sampling error depends on the design; other errors remain. |
Human nonprobability sample | Selection and information to disclose: Opt-in, convenience, purposive or quota recruitment. Report recruitment, eligibility, quotas, missing groups and inferential assumptions. Precision limit: Conventional random-sample precision does not automatically apply. |
Synthetic population | Selection and information to disclose: Generated or modeled units from grounding and construction choices. Report sources, coverage, model, scenario settings and validation. Precision limit: Generated N is not an independent human sample size. |
The AAPOR disclosure standards distinguish probability and nonprobability recruitment and call for explicit assumptions when reporting precision from nonprobability research. An online survey can use either human sampling design; the screen does not determine it.
“Online” is a mode, not a probability design. A frame and selection procedure establish how human records enter. Opt-in or quota recruitment has different assumptions from known random inclusion. A simulated population requires an explanation of sources and audience construction rather than a human sampling margin derived from its profile count.
For a human consumer study, our panel provider guide explains how to agree on recruitment sources and handle a delivery that differs from that agreement. Eligible, unique records don't by themselves resolve whether the agreed audience was delivered.
Access comes before the recruitment procedure
These examples are design choices, not guarantees of representativeness.
Method and business use | Details |
|---|---|
Simple random: estimate one customer-list proportion | How to select the units: Randomly select eligible accounts from a complete defined list. Practical limit: Missing accounts and nonresponse still matter. |
Stratified: include new and repeat accounts in a probability design | How to select the units: Divide the frame into defined groups, or strata, then randomly select within each. Practical limit: Analysis must reflect selection and stratum sizes. |
Cluster: study customers across sampled outlets | How to select the units: Randomly select groups such as stores, then the specified units within them. Practical limit: Within-store similarity affects precision. |
Systematic: select from an eligible account register | How to select the units: Use a random start, then every kth unit in a suitable ordered frame. Practical limit: Periodic ordering can distort selection. |
Purposive: interview abandoners, continuers and alternative users | How to select the units: Deliberately select relevant or contrasting experiences. Practical limit: Supports depth and contrast, not a random-sample margin. |
Quota: include purchase occasions in opt-in concept work | How to select the units: Recruit until predefined group counts are filled. Practical limit: Quotas do not supply known inclusion probabilities. |
Convenience: pilot wording with reachable category buyers | How to select the units: Include readily accessible eligible units. Practical limit: Findings may reflect who was easy to reach. |
Synthetic construction is a separate evidence design. A generated group labeled a quota is still a simulated population, with source data and shared-model assumptions to disclose.
One account can contain conflicting perspectives
Decide whether the report concerns administrator experiences, linked committee perspectives or account renewal events. A person-level distribution cannot become an account outcome by changing the chart title. Reconcile multiple role accounts and count the event once.
Keep disagreement within the account: the administrator may favor a feature while finance objects to cost. That conflict can explain a purchase requirement; averaging it can hide the decision.
Our home improvement market research guide applies the same counting problem to a hypothetical cabinet study. Keep homeowner and installer accounts linked when they concern the same job; independent samples cannot establish a shared project history.
Fix contact coverage when experiences are missing. Fix links when role perspectives are miscounted. Collect more answers when an appropriate design lacks enough valid responses. A larger count from the wrong list cannot support the original conclusion.
Plan valid answer counts for each analysis
Quotas can ensure selected characteristics or experiences are present in a nonprobability study. For example, a concept exploration might include new and repeat category buyers so the team can examine both perspectives. Quotas alone do not establish known inclusion probabilities or remove unmeasured selection differences.
For qualitative research, purposive selection can investigate varied experiences and contrary cases. Its purpose is explanatory coverage, not an implied population percentage. Describe the selection logic in the report.
For a simple random human sample estimating one proportion, agree the target confidence level, anticipated proportion and desired precision before setting the completed-answer requirement. Subgroup comparisons, clustered units, weighting, rare populations, experiments and nonresponse may require other planning. A whole-study total does not guarantee usable bases for every segment.
For synthetic work, plan scenario diversity, audience data and independent validation. A human margin-of-error formula does not establish precision for generated responses.
Use our research bias guide to examine missing groups and our B2B research guide for committee roles. Discuss a simulated audience with Sapien to explore how specified roles interpret a renewal offer. Agree which data supports those roles, and keep actual account outcomes tied to the real renewal events.
The useful result is an audience definition, contact and selection method, expected gaps, counting unit and the conclusions supported. With those clear, sample size answers a specific need instead of supplying a reassuring round number.
