Difference between revisions of "Questionnaires"

From SurveyWiki
Jump to navigationJump to search
 
(9 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{Infobox
+
{{data_collection_tools
|above = Data Collection Tools
 
|abovestyle= background:#F4E8FF;
 
|image = [[Image:Tools.png|50px]]
 
|header1 = [[Interviews]]
 
|header2 = [[Observation]]
 
|header3  = [[Questionnaires]]
 
|header4  = [[RTTs]]
 
|header5  = [[SRTs]]
 
|header6  = [[Word Lists]]
 
 
}}
 
}}
The Max Planck Institute's Dept. of Linguistics has a long list of different questionnaire types [http://www.eva.mpg.de/lingua/tools-at-lingboard/questionnaires.php available here]
+
* The Max Planck Institute's Dept. of Linguistics has a long list of different questionnaire types [http://www.eva.mpg.de/lingua/tools-at-lingboard/questionnaires.php available here]
 +
* Bendor-Samuel, Bendor-Samuel & Jackson have a large number of suggestions of [[Questionnaire Topics]]
  
=Questionnaire Topics<ref>The content for this section is taken from Bendor-Samuel, Margaret and David Bendor-Samuel; Robert A. Jackson, editor. 1996. ''A manual for strategic planning and review for language programs''. Dallas: Summer Institute of Linguistics</ref>=
+
==Background==
At the micro level, the following areas of focus are recommended for data collection:
+
In western culture, questionnaires are often self-administered, but in pre-literate societies, this is impossible to carry out. Thus, what we often refer to in language survey as a questionnaire is similar in many ways to what social science calls an interview. Often though, in our contexts, one-on-one interviews are difficult to carry out as private locations to interview people may be hard to come by. In addition, it may not be socially acceptable for one person to speak on behalf of the entire community, nor may it be appropriate for a stranger to be in a room with a single member of the community, particularly if the participant is female.
  
==1. Historical Sketch==
+
We should therefore be aware of the social constraints that affect the administration of questionnaires in our particular context. The following guide is therefore simply an ideal and you may have to adapt it for your situation.
* Migrations
 
* Colonization
 
* Trade
 
* Past kingdoms
 
* Domination by/of other groups
 
* Introduction of other than traditional religions
 
* Relationship with the nation of which it is a part
 
===Notes===
 
"It has been found that groups that have been low in prestige because larger groups have some sort of control lover them may at first be resistant to change."<ref>ibid. p42</ref>
 
  
"A group that has been in transition and been uprooted for political reasons may be more responsive than more stable groups. A group that has designs on more political power or more prestige may see promise in the program."<ref>ibid. p42</ref>
+
==Designing a questionnaire==
 +
# Carry out thorough background research into your topic area. Through this, isolate 'holes' in your data or areas that you will need to collect data for.
 +
# Reduce each of these holes to a variable. For example, imagine that there is a language project planned for a particular town and you want to know if people from the surrounding villages will collaborate on this project if this town is the venue. Through your research, you discover that there are regular buses running to the villages the town. However, there are a number of holes in your data:
 +
## Do the people travel to the town? If not, why not?
 +
## Are there any communities that are not on bus routes? How might they travel?
 +
## Would there be any seasonal reasons why people might not travel? E.g. festivals, heavy rains
 +
## How reliable are the buses?
 +
## If people attend a workshop, what time must they finish to be sure of getting a bus home?
 +
:# each of these can be reduced to a variable that you are looking to identify e.g.  
 +
:# time of last bus
 +
:# weather
  
==2. Geography==
 
A map should be made including:
 
* note the extent of the area
 
* physical and political boundaries
 
* dialect areas, including the most prestigious (if any)
 
* distances between communities and modes of travel
 
* locations of infrastructure
 
* any features that would need special consideration for widespread literacy
 
* areas only accessible seasonally
 
  
===Notes===
+
* It is possible for the surveyor to greatly influence the responses through the way they administer the questionnaire.
"The data in this part... is highly significant. The danger is for the language team to get so absorbed in the technical task that they lose sight of the total environment." <ref>ibid. p43</ref>
+
* The length of the questionnaire will directly affect the amount of time it takes to administer and therefore the potential quality of the data collected, particularly in the latter stages of the process. However, if the surveyor is able to use the length of the questionnaire to develop rapport, latter questions may be able to go to a greater depth as this rapport strengthens the relationship.
 +
* Participants may find the process of their answers being recorded threatening, particularly if their personal details are noted.
 +
* Questionnaires must consider the educational and social background of the participants. If questions are too challenging, participants may need clarification and then the influence of the surveyor increases considerably.
 +
* Questions aimed at collecting factual data can be much easier to verify than those which collect data about opinions, attitudes and beliefs.
 +
* Open ended, multiple choice and closed questions are all different and which you choose when you design your questionnaire will affect the kind of data you end up with.
  
==3. Demographic survey==
 
* percentage of urban/rural dwellers
 
* total population of language group
 
* name of each significant settlement and estimated population
 
* community population composition, e.g. adult:child population ratio
 
* ethnic composition of settlements if relevant
 
* distribution of population over area surveyed
 
* perception of people of their distribution, e.g. do they group themselves by village, district, etc.
 
* percentage of language group population living outside the language group and where
 
* any political/other barriers which divide the language group
 
  
===Notes===
 
"There is often a marked difference between rural and urban people although they come from the same areas originally and speak the same language. Sometimes these differences are superficial; at other times they are very significant."<ref>ibid. p44</ref>
 
"We are interested in the composition of the community... in some areas many of the young adults leave the village for work in the towns and this needs to be noted. If there is a dearth of children it can point to a number of sociological factors, i.e., schooling outside the community, high infant mortality rate..."<ref>ibid. p44</ref>
 
  
==4. Economic factors==
+
==How to Administer a Questionnaire==
* occupations and income
 
** work
 
*** what is the main form of work
 
*** how do people earn money
 
*** average income
 
*** difficulties associated with earning an income
 
**local production
 
*** what goods are produced
 
*** what food crops are produced
 
*** what cash crops are produced
 
** wealth
 
*** what forms of wealth are there (animals, wives, gold)
 
*** how is wealth acquired
 
*** who acquires wealth
 
*** how is wealth stored/displayed/spent
 
** what do people buy/exchange
 
** how and where are goods distributed and/or sold
 
** how are sellers compensated
 
** services
 
*** what services are exchanged
 
*** how is compensation made for these services
 
** who works on different projects
 
*** do people work together
 
*** do different ages/sexes work together
 
*** what kinds of work are only done by men/women
 
*** do people give labour as a form of payment
 
*** do people expect to be paid for mental or physical labour
 
** time
 
*** how is time divided between men and women
 
*** what is the daily or yearly pattern of work and leisure for men/women/children
 
* Resources
 
** what financial help for development may come from outside or within the area
 
** what other help might be available
 
** are there resources available from any cultural or development associations organised by members of the language group either inside or outside the area
 
  
===Notes===
+
==Sample Questionnaires==
"The drive to survive or even to provide for a standard of living that is acceptable to the community is very strong and often takes precedence over other motivating forces... Where peopl eare genuinely hurting because of economic factors, this may be an area that needs to be taken care of before other aspects of [a development] program will appear relevant to them."<ref>ibid. p45</ref>
+
* [[Media:SILPNG_Contact_Patterns_Questionnaire_Sample.pdf|Contact Pattern Questionnaire]] from [[SIL]] Papua New Guinea‎
"In one West African project, two teachers had to be appointed to each class because no one expected to work alone on a project."<ref>ibid. p47</ref>
 
  
some of the areas where economics may affect [a development] program:
+
==Observation Schedule==
* it may determine how much time and resources people are prepared to spend developing literacy/numeracy
+
* [[media:Tonda Questionnaire Observation Schedule.doc‎|'''Interview Observation Checklist''']] An [[observation]] schedule designed for survey team members to observe a group who a colleague is using a questionnaire with. This example was used by the SIL-Papua New Guinea survey team to collect data to help inform questionnaire responses on [http://johnandsheena.co.uk/mission/?page_id=1826 a survey of the Tonda subgroup languages] in September 2011 (''Word doc @ 91 Kb'').
* it may affect a literature program because of lack of funds to buy materials
+
[[Category:Tools]]
* there may be a greater need for some to learn marketing skills and thus numeracy may be a priority over other forms of literacy
 
* it will determine who contributes to sustaining a community and thus who is available for language development
 
 
 
==5. Society and culture==
 
This is a vital section for a number of reasons
 
* it helps us to grasp relationships within the community
 
* we can understand structures and authority patterns
 
* it helps us judge motivation for the project
 
* it helps us avoid inappropriacy in our approach to development or our methodology
 
 
 
'''A. Focus of the Culture'''
 
# what aspects of life form the focus of the culture, e.g., prestige, group conformity, reciprocality, individuality, etc.
 
 
 
'''B. Problems and felt needs'''
 
# what are the problems and felt needs as expressed by the people themselves. [[Participatory methods]] can often help to reveal these.
 
# are the people looking to outside help to help meet their needs
 
# how much initiative for meeting needs or getting help comes from within the language group
 
# are there ways in which a language program might meet the felt needs of the group
 
# do the community recognise how literacy or literature in their language might meet their needs
 
# are there any areas of their lives where people recognise that they are disadvantaged if they are not able to read or write
 
# what significant dietary, medical or other health problems exist
 
# who sees these health problems and is anything being done to alleviate or prevent them
 
 
 
'''C. Activities of the target group'''
 
# are there any seasonal/daily/regular activities which would affect a program - if so note which members of the community take part
 
# art
 
## what part do art forms play in the culture (music, dance, drama, painting etc)
 
## who are the artisans
 
## what forms of art are un/acceptable
 
 
 
'''D. Cross-cultural contexts'''
 
# are there any tensions between the group and neighbouring groups? How is this dealt with?
 
# what is the level of cross-cultural tension?
 
# what is the attitude towards outsiders?
 
# in what ways has culture been influenced by outsiders? How receptive is the group to these influences?
 
# what degree of local emphasis or exclusiveness is there? Do people maintain their cultural identity versus that of others?
 
 
 
'''E. Reaction to change'''
 
# who are the innovators
 
# how do innovators introduce new ideas
 
# how do people react to innovation
 
# who accepts change first
 
# what dangers does change hold
 
# what attitudes accompany change
 
 
 
'''F. Infrastructure and leadership'''
 
# what kinds of authority/social structures are there (traditional/political/religious)
 
# what are the geographical and sociocultural boundaries of each infrastructure
 
## what are their areas of influence
 
## how do they overlap
 
## how do they interact
 
# for each type of infrastructure
 
## who makes decisions
 
## how are these made
 
## who do the decisions affect
 
## how are decisions implemented
 
# factions
 
## are there factions
 
## how are tensions resolved within the community
 
# does one person/group have absolute power
 
# how are people orientated, e.g., to their community, family, etc.
 
# who could effectively influence motivation and opinion
 
 
 
===Notes===
 
"In one PNG village... where there were different clans present within the same village, the school system had to be arranged along clan lines or the children would not come."<ref>ibid. p48</ref>
 
"For one group in Brazil, an artist pictured a pig being led along the trail with a cord tied around its neck. This was completely unacceptable for a primer because the people dragged pigs with cords tied to their hind legs."<ref>ibid. p48</ref>
 
"The people among whom we worked in Brazil had no felt need for better sanitation in the village, although we felt it would solve a great many health problems..."<ref>ibid. p48</ref>
 
"In some areas... the [language] group has purposely taught [development workers] incorrect forms of the language until they have established themselves as friends."<ref>ibid. p50</ref>
 
 
 
==6. External relationships/political factors==
 
===Notes===
 
==7. Linguistics==
 
===Notes===
 
==8. Education, literacy and literature==
 
===Notes===
 
==9. Religion==
 
 
 
 
 
===Notes===
 
"What people believe is at the center of their world view and has some effect on all other aspects of their life."<ref>ibid. p68</ref>
 
"Often there will be only a portion of the society that will thoroughly embrace the new religion, while many others will maintain their traditional beliefs and customs others will syncretize the new with the old, so that in form they are Christians or Muslims, but in fact they are still continuing to follow their traditional beleifs."<ref>ibid. p68</ref>
 
 
 
==References==
 
<references />
 

Latest revision as of 15:43, 18 October 2011

Data Collection Tools
Tools.png
Interviews
Observation
Questionnaires
Recorded Text Testing
Sentence Repetition Testing
Word Lists
Participatory Methods
Matched-Guise
  • The Max Planck Institute's Dept. of Linguistics has a long list of different questionnaire types available here
  • Bendor-Samuel, Bendor-Samuel & Jackson have a large number of suggestions of Questionnaire Topics

Background

In western culture, questionnaires are often self-administered, but in pre-literate societies, this is impossible to carry out. Thus, what we often refer to in language survey as a questionnaire is similar in many ways to what social science calls an interview. Often though, in our contexts, one-on-one interviews are difficult to carry out as private locations to interview people may be hard to come by. In addition, it may not be socially acceptable for one person to speak on behalf of the entire community, nor may it be appropriate for a stranger to be in a room with a single member of the community, particularly if the participant is female.

We should therefore be aware of the social constraints that affect the administration of questionnaires in our particular context. The following guide is therefore simply an ideal and you may have to adapt it for your situation.

Designing a questionnaire

  1. Carry out thorough background research into your topic area. Through this, isolate 'holes' in your data or areas that you will need to collect data for.
  2. Reduce each of these holes to a variable. For example, imagine that there is a language project planned for a particular town and you want to know if people from the surrounding villages will collaborate on this project if this town is the venue. Through your research, you discover that there are regular buses running to the villages the town. However, there are a number of holes in your data:
    1. Do the people travel to the town? If not, why not?
    2. Are there any communities that are not on bus routes? How might they travel?
    3. Would there be any seasonal reasons why people might not travel? E.g. festivals, heavy rains
    4. How reliable are the buses?
    5. If people attend a workshop, what time must they finish to be sure of getting a bus home?
  1. each of these can be reduced to a variable that you are looking to identify e.g.
  2. time of last bus
  3. weather


  • It is possible for the surveyor to greatly influence the responses through the way they administer the questionnaire.
  • The length of the questionnaire will directly affect the amount of time it takes to administer and therefore the potential quality of the data collected, particularly in the latter stages of the process. However, if the surveyor is able to use the length of the questionnaire to develop rapport, latter questions may be able to go to a greater depth as this rapport strengthens the relationship.
  • Participants may find the process of their answers being recorded threatening, particularly if their personal details are noted.
  • Questionnaires must consider the educational and social background of the participants. If questions are too challenging, participants may need clarification and then the influence of the surveyor increases considerably.
  • Questions aimed at collecting factual data can be much easier to verify than those which collect data about opinions, attitudes and beliefs.
  • Open ended, multiple choice and closed questions are all different and which you choose when you design your questionnaire will affect the kind of data you end up with.


How to Administer a Questionnaire

Sample Questionnaires

Observation Schedule