Leading and Double-Barreled Questions: 12 Examples
Twelve before-and-after repairs, two clear definitions and a refill-order task for checking questions, answer labels and price understanding.
Leading questions steer people toward an answer. Double-barreled questions ask about two things at once, making the response hard to interpret.
What is a leading question?
A leading question suggests the answer the writer wants. “How much do you love our convenient new refill?” supplies praise before asking for a reaction. A neutral question permits an unfavorable or uncertain response.
What is a double-barreled question?
A double-barreled question combines two judgments in one answer. “Is the service affordable and easy to use?” cannot show whether the respondent agrees about price, task ease or both. Ask about each separately, with the price or task they need to judge.
Loaded questions and unverified assumptions
A loaded question assumes something you haven't checked. “Why do you buy sustainable products?” assumes that purchase behavior before asking for a reason. Check the behavior first, then ask what influenced it. A question can be loaded and leading at the same time; removing praise doesn't repair an unverified assumption.
Testing revised survey wording? Discuss a simulated study of the questions and check our comparisons with human research.
A quick check before rewriting a question
Check each row before changing the wording or answer options. More than one problem can apply to the same question.
Quick check | Repair |
|---|---|
Leading: Is praise, a preferred answer or a one-sided premise built into the question? | Remove that cue and offer balanced answers. |
Loaded: Does the question assume an unverified behavior or fact? | Check the premise first, then route any follow-up to people it fits. |
Double-barreled: Must one answer cover separate judgments? | Split them and give each its own response options and relevant base. |
AAPOR’s questionnaire guidance recommends one concept per question, neutral wording and answer options that cover the relevant responses.
12 leading and double-barreled question examples
This hypothetical refill survey needs answers the business can use. Each revision below explains the problem it fixes. The fee task checks whether household buyers understand the complete order price.
Original question | Repair and interpretation |
|---|---|
1. “How much do you love our convenient new refill?” | Ask “What is your overall impression of the refill described?” Use very unfavorable / somewhat unfavorable / neither / somewhat favorable / very favorable / cannot judge. The original supplies both a favorable emotion and a benefit before collecting the response. |
2. “Is the service affordable and easy to use?” | Split it: “How affordable or unaffordable is the price shown for your circumstances?” and “How easy or difficult was it to complete the task?” A person may find the price manageable while struggling with the interface. |
3. “Wouldn’t you agree the premium package is better?” | Show comparable packages and ask which the participant would investigate further, including neither and no preference. Follow with “What led you to that answer?” The original asks for agreement and leaves “better” undefined. |
4. “Why do you buy sustainable products?” | First ask about a recent category purchase and what influenced it. Only ask a sustainability follow-up if relevant. The original assumes both the behavior and the reason. |
5. “How satisfied are you with delivery and customer support?” | Ask separately about the most recent delivery and, for those who used support, the support interaction. Add a clear not-applicable route. Someone may have received a late order but excellent help resolving it. |
6. “Do you agree that nobody should have to pay hidden fees?” | For a fee-disclosure test, use the complete order task below. Moral agreement does not show whether buyers understand the price. |
7. “How often do you regularly use the app?” | Ask “On how many days in the past seven days did you use the app?” Use 0 through 7 and do not know. The defined period and count replace an ambiguous qualifier. |
8. “Which useful feature should we add next?” | Ask which, if any, of the described features would be useful for the defined task, with none and cannot judge. If prioritization is required, use a specified ranking or choice design. The original assumes every feature merits development. |
9. “Are you happy with the speed and accuracy of recommendations?” | Measure response time or perceived speed separately from relevance or correctness. Define the task and evidence available. One favorable response cannot reveal whether fast but irrelevant recommendations are acceptable. |
10. “Why did our ad persuade you to buy?” | Check whether the person saw the ad and bought, then ask what influenced the decision without assigning causation. A reported influence is different from an experimentally measured effect. |
11. “Do you oppose not offering a discount?” | Show the actual price alternatives and ask for consideration or choice under the specified offer. If asking a policy opinion, use a direct favor/oppose question. The double negative makes response direction harder to interpret. |
12. “Compared with unreliable competitors, how trustworthy is our brand?” | Remove the unsupported competitor description. Ask about trust in each defined offer with equivalent information, or ask what creates or reduces trust. Insulting competitors changes what people judge before you collect an answer. |
Worked example: checking refill price understanding
Test price understanding with an order
Original question: Do you agree that nobody should have to pay hidden fees?
Order receipt
2 refills × USD 8 = USD 16 before tax
1 delivery charge per order = USD 3 before tax
Total before tax: USD 19
What total would you expect to pay before tax for this order?
Respondents type the amount, say how they worked it out, or choose 'Cannot judge.'
The receipt shows the calculation for you. In fieldwork, show the unit price, quantity and per-order fee, then collect the total before supplying it.
How to choose balanced answer options
Even with neutral wording, response options can push the answer. “Good / very good / excellent” excludes negative and neutral views. Overlapping frequency categories make it unclear where some respondents belong. “Other,” “none,” “do not know” and “not applicable” serve different purposes and should be added when the question needs them.
Keep ordered scales in order. Randomize unordered alternatives when the design calls for it, and save the display order in the data. Pew’s question-writing guidance explains why wording and question sequence affect interpretation.
Unknown, none and not applicable are different answers. A person without the relevant experience needs a route that does not force a fabricated judgment; a person with an unfavorable view needs an actual unfavorable option. Pretest those labels as well as the sentence.
How to test delivery-fee understanding
Replace “Do you agree that nobody should have to pay hidden fees?” with a shown offer: two refills at USD 8 each and one USD 3 per-order delivery charge, both before tax. Ask: “What total would you expect to pay before tax for this order?” Record the amount and explanation, with Cannot judge available.
The expected total is USD 19 before tax. If a response counts one refill, check quantity; if it applies delivery per refill, check fee scope; if the amount is right for the wrong reason, keep that contradiction. Complete terms and reasoning make the answer useful. This is a hypothetical diagnostic, not a measured improvement.
The moral-agreement original can't supply those price facts. The replacement is useful when buyers see the complete offer and explain their calculation, allowing the team to distinguish a quantity error from a delivery-fee error.
Routing for split questions
Splitting “affordable and easy to use” creates two measures. The affordability question needs a complete price offer; task ease needs the relevant attempted task or an explicitly labeled expectation. An unexposed person cannot report an experience they never had.
Ask respondents to restate each question, explain which information they used and describe their chosen answer. Repair the wording, offer, routing or labels causing the mismatch. Save the original item, replacement and actual pretest observations together so another analyst can check what changed.
How to use the repaired questions
A repaired question should ask one neutral thing that the person has enough information or experience to answer. Allow reasonable negative, unknown and not-applicable answers. Use the result for a price, product or communication decision.
Apply the same care to simulated responses and disclose the audience and context assumptions. Use our Likert scales guide for balanced labels and our silicon sampling guide for prompt sensitivity. Discuss the repaired refill questions with Sapien to explore a simulated survey that keeps overall impression, price fit and task ease separate.
Use the question review records to keep the original item, replacement and intended measure together. In a tracker, compare old and new wording under comparable conditions or mark a break when the measure changes. The record should say which business answer the revised item can supply and whether the questions people see can support that answer.
Record what each repair changes
The two supplied records keep the original question, intended measure, failure, replacement, response options and rationale. Pilot notes are blank in both; add actual pretest observations when you have them.
Review record 1
Field | Recorded value |
|---|---|
| How much do you love our convenient new refill? |
| Overall impression |
| Leading benefit and emotion |
| What is your overall impression of the refill described? |
| Very unfavorable to very favorable plus cannot judge |
| Permits unfavorable and neutral reactions |
|
Review record 2
Field | Recorded value |
|---|---|
| Is the service affordable and easy to use? |
| Price fit and task ease |
| Double barrel |
| Ask affordability and task ease separately |
| Separate balanced labels for each question |
| Price and ease can differ |
|
Complete question-review CSV
original,intended_measure,failure,replacement,response_options,rationale,pilot_notes
How much do you love our convenient new refill?,Overall impression,Leading benefit and emotion,What is your overall impression of the refill described?,Very unfavorable to very favorable plus cannot judge,Permits unfavorable and neutral reactions,
Is the service affordable and easy to use?,Price fit and task ease,Double barrel,Ask affordability and task ease separately,Separate balanced labels for each question,Price and ease can differ,
