Survey Question Design: Asking the Right Questions to Get the Right Answers

Think about the last time someone asked you a question that confused you. Maybe a friend asked, "Do you like movies?" and you weren't sure if they meant any movies, or just the one playing this weekend. Or a teacher asked, "How often do you study?" — and you wondered: every day? Last week? Compared to what?

That confusion is exactly what survey question design tries to avoid. In economics, surveys are how we gather data on what people earn, spend, save, and believe. If the questions are poorly designed, the data is useless — and so are the policies or business decisions built on it.

The Core Idea: A Good Question Gets One Clear Answer

A well-designed survey question has three properties:

1. It means the same thing to every respondent. If "income" could mean salary before tax, salary after tax, or total household earnings, different people will answer the same question differently — not because their situations differ, but because they interpreted the words differently.

2. It asks one thing at a time. A question like "Do you support the government's new tax policy and the accompanying subsidy cuts?" is actually two questions. Someone might support the tax policy but oppose the subsidy cuts — and have no way to say so.

3. It gives answer choices that are exhaustive and mutually exclusive. "Exhaustive" means every possible answer fits somewhere. "Mutually exclusive" means no answer fits into more than one category. If you ask "What is your monthly income?" and give options ₹0–₹10,000, ₹10,000–₹20,000, ₹20,000–₹30,000, a person earning exactly ₹10,000 doesn't know which box to tick.

Why This Matters in Economics

Economics is not a lab science. You cannot put a consumer in a test tube and measure their preferences. You have to ask them. And the answers you get depend entirely on how you ask.

Consider the Consumer Expenditure Survey, which the government uses to calculate the Consumer Price Index (CPI). If the survey asks, "How much did you spend on food last month?" — most people will guess, and guess badly. A better question might ask about the last week, or ask about specific items one by one. The design of the question directly affects the accuracy of the inflation rate the country reports.

The Key Types of Questions

Open-ended questions let the respondent answer in their own words. "What factors influenced your decision to buy this car?" These give rich data but are hard to tabulate. They are useful in pilot studies, not in large-scale surveys.

Closed-ended questions give fixed options. "Which of the following factors most influenced your decision to buy this car? (a) Price, (b) Fuel efficiency, (c) Brand reputation, (d) Resale value." These are easy to analyse but may force a respondent into a choice that does not truly reflect their thinking.

Rating scales ask respondents to rank something on a scale, typically 1 to 5 or 1 to 7. "On a scale of 1 to 5, how satisfied are you with your current bank?" The problem here is that different people use scales differently — one person's "3" might be another person's "4".

The Trap of Leading and Loaded Questions

A leading question nudges the respondent toward a particular answer. "Don't you agree that the new GST rates are unfair?" This question signals that the expected answer is "yes, they are unfair." A neutral version would be: "How would you describe the new GST rates — fair, unfair, or neither?"

A loaded question contains an assumption that may not be true. "How often do you waste money on unnecessary luxuries?" This assumes the respondent does waste money. A respondent who believes they spend wisely has no good way to answer.

The Double-Barreled Problem

This is so common it deserves its own warning. A double-barreled question asks about two things in one sentence. Example: "Should the government reduce taxes and increase spending on healthcare?" A respondent might want lower taxes but oppose higher healthcare spending — or vice versa. The question cannot separate these views.

What Makes a Good Answer Set

For closed-ended questions, the answer choices must follow two rules:

• Exhaustive: Every possible answer fits somewhere. If you ask "How many times did you visit a bank last month?" and give options 0, 1–2, 3–5, 6+, someone who visited 10 times is covered by 6+. But if you ask "What is your employment status?" and give only Employed and Unemployed, you miss students, homemakers, and retirees.

• Mutually exclusive: No answer fits into two categories. If you ask "What is your age group?" and give 18–25, 25–35, 35–45, a 25-year-old could tick either of the first two boxes. The correct ranges are 18–24, 25–34, 35–44.