Key points
A resident satisfaction survey asks residents how satisfied they are with government services and daily life.
You decide the purpose and target, go through questions, distribution, and tabulation, then publish the results and reflect them in policy.
Collecting reasons in free text, in addition to satisfaction figures, shows you what to do next.
Updated
Overview
A resident satisfaction survey asks residents how satisfied they are with government services and their living environment. Some municipalities run it under names such as "resident opinion survey" or "citizen opinion survey," asking about intention to stay and the importance of policies together with satisfaction.
The purpose is not to produce satisfaction figures for their own sake. It is to find areas with low satisfaction and high importance, as material for deciding where to direct limited budgets and staff. Continuing the same questions every year also lets you track changes.
However, satisfaction figures alone do not tell you "why people are dissatisfied" or "what should be changed." This is where free-text fields help. Collecting reasons and specific problems in words reveals the circumstances behind the numbers.
Steps
- Decide the purpose. Decide what the survey results will be used for, such as reviewing the comprehensive plan or evaluating a specific policy. The areas to ask about and the depth of the questions change with the purpose.
- Decide the target. Decide whether to select randomly from all residents or to focus on particular age groups or districts. If respondents are skewed, the results need to be interpreted with care.
- Write the questions. Combine satisfaction and importance by area, demographics (age group, district, and so on), and free text asking for reasons. For questions you want to compare with the previous survey, do not change the wording.
- Distribute. In addition to paper questionnaires sent by mail, offering a way to answer online via a QR code or link lets people choose how to answer.
- Tabulate. Tabulate satisfaction and importance by area and by demographic group. Classify free-text answers by theme and organize the issues raised most often and the issues where opinions divide.
- Publish and reflect in policy. Publish the results and show which areas will be reviewed. Also communicate how the results were reflected in the next fiscal year's programs and plans.
Example questions
| Area | Example question | Answer format |
|---|---|---|
| Overall | How satisfied are you with your current life in this area? | Satisfied / Somewhat satisfied / Somewhat dissatisfied / Dissatisfied / Don't know |
| Intention to stay | Would you like to keep living in this area? | I want to keep living here / Neither / I want to move |
| Satisfaction by area | How satisfied are you with child-rearing support? | 5-point scale |
| Importance by area | How much effort do you think should be put into child-rearing support going forward? | 5-point scale |
| Reasons | Please tell us why you chose the answer above | Free text |
| Suggestions | If there is anything you would like the local government to work on to improve the area, please tell us | Free text |
It is common to set areas to match the municipality's policy categories, such as child-rearing support, welfare for older people, disaster preparedness, public transportation, roads, and garbage collection. Too many areas increase the burden of answering, so narrow them to the areas closely related to this survey's purpose.
How to read the results
Combining satisfaction and importance shows where each area stands. Areas with low satisfaction and high importance are candidates for priority review. Areas with high satisfaction and high importance are areas where maintaining the current level matters.
Looking by demographic group can reveal differences that are not visible overall. For example, satisfaction with public transportation may differ greatly between the child-rearing generation and older generations. However, results for groups with few respondents can swing widely with small differences in answers, so they need to be interpreted with care.
The role of free-text fields
Free-text fields are for learning the reasons behind satisfaction figures. But when there are many answers, staff cannot read them all, and they tend to end up picking only some opinions to include in the report.
Shibuya City has announced that it analyzed 6,037 free-text answers from its FY2024 Ward Residents' Opinion Survey using "Kouchou AI," developed by Digital Democracy 2030 (DD2030). The analysis included automatic summarization, classification and visualization by topic, analysis of trends by generation and by area, and extraction of issues (source: Shibuya City press release (opens in a new tab), in Japanese). This is Shibuya City's own initiative, not work done by Plural Reality.
When making use of free-text answers, keep the following in mind.
- Use classification and summaries only as an entry point, and read the original answers before making decisions.
- Do not overlook specific problems even if they are raised by only a few, not just the opinions raised most often.
- Free-text answers can be skewed toward the voices of people who find it easy to express opinions, so do not treat them as statistical proportions of public opinion.
Running it with Baisoku Survey
Plural Reality's Baisoku Survey is a survey tool that digs into respondents' real views and thinking through dialogue with AI. Respondents proceed just by choosing from options, and depending on the answer, it follows up by asking "Why?" After respondents choose a satisfaction level, you can collect their reasons.
Answers are counted automatically, and an overall report is produced that shows "points of agreement," "points of disagreement," and "next steps." Clicking the marker after a sentence in the summary (for example, U24-Q5 is the 24th respondent's answer to question 5) shows the original answer, so you can go back from the summary to the original text to check. On the Pro plan and above, you can also write the angle you want to see and regenerate the summary.
Answers collected on paper can be entered on respondents' behalf by staff from the same screen. Results can be saved by printing, as PDF, or as CSV, and on the Pro plan and above they can be exported automatically to Google Sheets. The summary does not steer toward any particular conclusion. It is the local government that decides which policies to review.
Related case studies
Using AI to Overcome the Challenge of Translating Residents’ Voices into Policy
An example of turning residents' diverse voices into policy toward drafting a comprehensive plan, useful for the stage of reflecting survey results in policy.
Read articleBuilding a City Where Children and Young People Can Fulfill Their Dreams, Together with Citizens: Higashiosaka City's Effort to Uncover Honest Views Through Conversational AI
An example of getting at the honest views behind surface-level requests during plan drafting, which connects to the idea of digging into the reasons behind satisfaction figures.
Read articleFrequently asked questions
- Is a resident satisfaction survey different from a resident opinion survey?
- The name varies by municipality, and it is common to ask about satisfaction within a resident opinion survey. More important than the name is first deciding what the survey is meant to help decide.
- What should we do if there are too many free-text answers to read them all?
- One approach is to classify them by theme, first grasp the issues raised most often and the issues where opinions divide, and then read the original text. Some municipalities use AI to classify and summarize free-text answers. It is important not to judge from summaries alone and to keep a way to go back to the original answers.
- Can Baisoku Survey be used for a satisfaction survey?
- It asks about satisfaction with multiple-choice questions and, depending on the answer, follows up by asking "Why?" to get the reason. Answers are counted automatically, and clicking the marker in a summary sentence lets you check the original answer. You can also export to CSV and combine the results with your existing tabulation sheets.
- How should survey results be published?
- It is common to show, in addition to the tabulated results, what will be reviewed in response to them. Keeping the gist of minority opinions as well makes it easier for respondents to feel that their voices were read.
Try Baisoku Survey
Baisoku Survey starts with the Free plan (¥0, 10 per month). Write the questions, collect responses, and organize the free-text answers on one screen.
Open the Baisoku Survey site (opens in a new tab)