Difference between revisions of "Questionnaires"

From SurveyWiki
Jump to navigationJump to search
 
(5 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{Infobox
+
{{data_collection_tools
|above = Data Collection Tools
 
|abovestyle= background:#F4E8FF;
 
|image = [[Image:Tools.png|50px]]
 
|header1 = [[Interviews]]
 
|header2 = [[Observation]]
 
|header3  = [[Questionnaires]]
 
|header4  = [[RTTs]]
 
|header5  = [[SRTs]]
 
|header6  = [[Word Lists]]
 
 
}}
 
}}
The Max Planck Institute's Dept. of Linguistics has a long list of different questionnaire types [http://www.eva.mpg.de/lingua/tools-at-lingboard/questionnaires.php available here]
+
* The Max Planck Institute's Dept. of Linguistics has a long list of different questionnaire types [http://www.eva.mpg.de/lingua/tools-at-lingboard/questionnaires.php available here]
 +
* Bendor-Samuel, Bendor-Samuel & Jackson have a large number of suggestions of [[Questionnaire Topics]]
  
=Questionnaire Topics<ref>The content for this section is taken from Bendor-Samuel, Margaret and David Bendor-Samuel; Robert A. Jackson, editor. 1996. ''A manual for strategic planning and review for language programs''. Dallas: Summer Institute of Linguistics</ref>=
+
==Background==
At the micro level, the following areas of focus are recommended for data collection:
+
In western culture, questionnaires are often self-administered, but in pre-literate societies, this is impossible to carry out. Thus, what we often refer to in language survey as a questionnaire is similar in many ways to what social science calls an interview. Often though, in our contexts, one-on-one interviews are difficult to carry out as private locations to interview people may be hard to come by. In addition, it may not be socially acceptable for one person to speak on behalf of the entire community, nor may it be appropriate for a stranger to be in a room with a single member of the community, particularly if the participant is female.
  
==1. Historical Sketch==
+
We should therefore be aware of the social constraints that affect the administration of questionnaires in our particular context. The following guide is therefore simply an ideal and you may have to adapt it for your situation.
* Migrations
 
* Colonization
 
* Trade
 
* Past kingdoms
 
* Domination by/of other groups
 
* Introduction of other than traditional religions
 
* Relationship with the nation of which it is a part
 
===Notes===
 
"It has been found that groups that have been low in prestige because larger groups have some sort of control lover them may at first be resistant to change."<ref>ibid. p42</ref>
 
  
"A group that has been in transition and been uprooted for political reasons may be more responsive than more stable groups. A group that has designs on more political power or more prestige may see promise in the program."<ref>ibid. p42</ref>
+
==Designing a questionnaire==
 +
# Carry out thorough background research into your topic area. Through this, isolate 'holes' in your data or areas that you will need to collect data for.
 +
# Reduce each of these holes to a variable. For example, imagine that there is a language project planned for a particular town and you want to know if people from the surrounding villages will collaborate on this project if this town is the venue. Through your research, you discover that there are regular buses running to the villages the town. However, there are a number of holes in your data:
 +
## Do the people travel to the town? If not, why not?
 +
## Are there any communities that are not on bus routes? How might they travel?
 +
## Would there be any seasonal reasons why people might not travel? E.g. festivals, heavy rains
 +
## How reliable are the buses?
 +
## If people attend a workshop, what time must they finish to be sure of getting a bus home?
 +
:# each of these can be reduced to a variable that you are looking to identify e.g.  
 +
:# time of last bus
 +
:# weather
  
==2. Geography==
 
A map should be made including:
 
* note the extent of the area
 
* physical and political boundaries
 
* dialect areas, including the most prestigious (if any)
 
* distances between communities and modes of travel
 
* locations of infrastructure
 
* any features that would need special consideration for widespread literacy
 
* areas only accessible seasonally
 
  
===Notes===
+
* It is possible for the surveyor to greatly influence the responses through the way they administer the questionnaire.
"The data in this part... is highly significant. The danger is for the language team to get so absorbed in the technical task that they lose sight of the total environment." <ref>ibid. p43</ref>
+
* The length of the questionnaire will directly affect the amount of time it takes to administer and therefore the potential quality of the data collected, particularly in the latter stages of the process. However, if the surveyor is able to use the length of the questionnaire to develop rapport, latter questions may be able to go to a greater depth as this rapport strengthens the relationship.
 +
* Participants may find the process of their answers being recorded threatening, particularly if their personal details are noted.
 +
* Questionnaires must consider the educational and social background of the participants. If questions are too challenging, participants may need clarification and then the influence of the surveyor increases considerably.
 +
* Questions aimed at collecting factual data can be much easier to verify than those which collect data about opinions, attitudes and beliefs.
 +
* Open ended, multiple choice and closed questions are all different and which you choose when you design your questionnaire will affect the kind of data you end up with.
  
==3. Demographic survey==
 
* percentage of urban/rural dwellers
 
* total population of language group
 
* name of each significant settlement and estimated population
 
* community population composition, e.g. adult:child population ratio
 
* ethnic composition of settlements if relevant
 
* distribution of population over area surveyed
 
* perception of people of their distribution, e.g. do they group themselves by village, district, etc.
 
* percentage of language group population living outside the language group and where
 
* any political/other barriers which divide the language group
 
  
===Notes===
 
"There is often a marked difference between rural and urban people although they come from the same areas originally and speak the same language. Sometimes these differences are superficial; at other times they are very significant."<ref>ibid. p44</ref>
 
"We are interested in the composition of the community... in some areas many of the young adults leave the village for work in the towns and this needs to be noted. If there is a dearth of children it can point to a number of sociological factors, i.e., schooling outside the community, high infant mortality rate..."<ref>ibid. p44</ref>
 
  
==4. Economic factors==
+
==How to Administer a Questionnaire==
* occupations and income
 
** work
 
*** what is the main form of work
 
*** how do people earn money
 
*** average income
 
*** difficulties associated with earning an income
 
**local production
 
*** what goods are produced
 
*** what food crops are produced
 
*** what cash crops are produced
 
** wealth
 
*** what forms of wealth are there (animals, wives, gold)
 
*** how is wealth acquired
 
*** who acquires wealth
 
*** how is wealth stored/displayed/spent
 
** what do people buy/exchange
 
** how and where are goods distributed and/or sold
 
** how are sellers compensated
 
** services
 
*** what services are exchanged
 
*** how is compensation made for these services
 
** who works on different projects
 
*** do people work together
 
*** do different ages/sexes work together
 
*** what kinds of work are only done by men/women
 
*** do people give labour as a form of payment
 
*** do people expect to be paid for mental or physical labour
 
** time
 
*** how is time divided between men and women
 
*** what is the daily or yearly pattern of work and leisure for men/women/children
 
* Resources
 
** what financial help for development may come from outside or within the area
 
** what other help might be available
 
** are there resources available from any cultural or development associations organised by members of the language group either inside or outside the area
 
  
===Notes===
+
==Sample Questionnaires==
"The drive to survive or even to provide for a standard of living that is acceptable to the community is very strong and often takes precedence over other motivating forces... Where peopl eare genuinely hurting because of economic factors, this may be an area that needs to be taken care of before other aspects of [a development] program will appear relevant to them."<ref>ibid. p45</ref>
+
* [[Media:SILPNG_Contact_Patterns_Questionnaire_Sample.pdf|Contact Pattern Questionnaire]] from [[SIL]] Papua New Guinea‎
"In one West African project, two teachers had to be appointed to each class because no one expected to work alone on a project."<ref>ibid. p47</ref>
 
  
some of the areas where economics may affect [a development] program:
+
==Observation Schedule==
* it may determine how much time and resources people are prepared to spend developing literacy/numeracy
+
* [[media:Tonda Questionnaire Observation Schedule.doc‎|'''Interview Observation Checklist''']] An [[observation]] schedule designed for survey team members to observe a group who a colleague is using a questionnaire with. This example was used by the SIL-Papua New Guinea survey team to collect data to help inform questionnaire responses on [http://johnandsheena.co.uk/mission/?page_id=1826 a survey of the Tonda subgroup languages] in September 2011 (''Word doc @ 91 Kb'').
* it may affect a literature program because of lack of funds to buy materials
+
[[Category:Tools]]
* there may be a greater need for some to learn marketing skills and thus numeracy may be a priority over other forms of literacy
 
* it will determine who contributes to sustaining a community and thus who is available for language development
 
 
 
==5. Society and culture==
 
This is a vital section for a number of reasons
 
* it helps us to grasp relationships within the community
 
* we can understand structures and authority patterns
 
* it helps us judge motivation for the project
 
* it helps us avoid inappropriacy in our approach to development or our methodology
 
 
 
'''A. Focus of the Culture'''
 
# what aspects of life form the focus of the culture, e.g., prestige, group conformity, reciprocality, individuality, etc.
 
 
 
'''B. Problems and felt needs'''
 
# what are the problems and felt needs as expressed by the people themselves. [[Participatory methods]] can often help to reveal these.
 
# are the people looking to outside help to help meet their needs
 
# how much initiative for meeting needs or getting help comes from within the language group
 
# are there ways in which a language program might meet the felt needs of the group
 
# do the community recognise how literacy or literature in their language might meet their needs
 
# are there any areas of their lives where people recognise that they are disadvantaged if they are not able to read or write
 
# what significant dietary, medical or other health problems exist
 
# who sees these health problems and is anything being done to alleviate or prevent them
 
 
 
'''C. Activities of the target group'''
 
# are there any seasonal/daily/regular activities which would affect a program - if so note which members of the community take part
 
# art
 
## what part do art forms play in the culture (music, dance, drama, painting etc)
 
## who are the artisans
 
## what forms of art are un/acceptable
 
 
 
'''D. Cross-cultural contexts'''
 
# are there any tensions between the group and neighbouring groups? How is this dealt with?
 
# what is the level of cross-cultural tension?
 
# what is the attitude towards outsiders?
 
# in what ways has culture been influenced by outsiders? How receptive is the group to these influences?
 
# what degree of local emphasis or exclusiveness is there? Do people maintain their cultural identity versus that of others?
 
 
 
'''E. Reaction to change'''
 
# who are the innovators
 
# how do innovators introduce new ideas
 
# how do people react to innovation
 
# who accepts change first
 
# what dangers does change hold
 
# what attitudes accompany change
 
 
 
'''F. Infrastructure and leadership'''
 
# what kinds of authority/social structures are there (traditional/political/religious)
 
# what are the geographical and sociocultural boundaries of each infrastructure
 
## what are their areas of influence
 
## how do they overlap
 
## how do they interact
 
# for each type of infrastructure
 
## who makes decisions
 
## how are these made
 
## who do the decisions affect
 
## how are decisions implemented
 
# factions
 
## are there factions
 
## how are tensions resolved within the community
 
# does one person/group have absolute power
 
# how are people orientated, e.g., to their community, family, etc.
 
# who could effectively influence motivation and opinion
 
 
 
===Notes===
 
"In one PNG village... where there were different clans present within the same village, the school system had to be arranged along clan lines or the children would not come."<ref>ibid. p48</ref>
 
"For one group in Brazil, an artist pictured a pig being led along the trail with a cord tied around its neck. This was completely unacceptable for a primer because the people dragged pigs with cords tied to their hind legs."<ref>ibid. p48</ref>
 
"The people among whom we worked in Brazil had no felt need for better sanitation in the village, although we felt it would solve a great many health problems..."<ref>ibid. p48</ref>
 
"In some areas... the [language] group has purposely taught [development workers] incorrect forms of the language until they have established themselves as friends."<ref>ibid. p50</ref>
 
 
 
==6. External relationships/political factors==
 
# government (provincial/national) attitudes to local languages
 
## how is the language policy worked out in any school or adult programmes sponsored by the government
 
# local people's attitudes to the government
 
## what would help people integrate into the national scene
 
# what is the chain of command by which decisions made at national/provincial level are implemented at village level
 
## how effective is this
 
# local people
 
## who are the local people who you must relate to and interact with
 
## what degree of cooperation can you expect from local people
 
# what societal/political considerations or local problems at national level, locally or in relations to other groups might affect development
 
# in what ways does information come to the group
 
# are there any local pressure groups urging certain kinds of change
 
 
 
==7. Linguistic and Sociolinguistic factors==
 
'''A. Language use and attitudes'''
 
# what languages are in use as mother tongues in the area
 
# what other languages are used by the group
 
# what proportion of adults are monolingual, subordinate bilingual or coordinate bilingual.
 
# in what domains is each language used
 
# what is the attitude and how is this shown to each language
 
# how stable is the language situation
 
# which languages are permitted to be used in non/formal education
 
# which dialect is spoken in each community
 
# what is the prestige dialect
 
# has a dialect been chosen for literacy or other form of standardisation
 
# what is the attitude of the community an standard dialect
 
# will the whole community be able to use the same written materials
 
'''B. Orthography'''
 
# what orthographies have been produced
 
# who contributed to their development
 
# what is the status of the orthography in which it is proposed to develop literacy materials
 
# who developed it
 
# what still needs to be done for orthography to be approved by
 
## all leaders and groups in the area
 
## official agencies outside the area
 
# what groups have already used the orthography
 
# is there any disagreement about the orthography
 
# what to specialists consider are the problem areas of the orthography
 
===Notes===
 
"Many communities are so used to education in a trade or national language that they find the idea of a literature in their own language both strange and inapppropriate... It is tremendously important that we understand what the attitudes are to the use of the vernacular and what the motivation might be for wanting to read it."<ref>ibid. p55</ref>
 
"Where others have already reduced the language to writing and have already developed alphabets and literatures using them, there is potential for considerable conflict. It is not uncommon to find that several alphabets have already been in use by different agencies, and each feels that his is superior and is unwilling to change."<ref>ibid. p56</ref>
 
 
 
==8. Education, literacy and literature==
 
'''A. Attitudes to Education'''
 
# what is the attitude of traditional leaders and other opinion leaders to education for adults/children in general
 
# what would leaders like to see accomplished as the result of education
 
# what happens to students when they leave or finish school
 
'''B. Nonformal education'''
 
# what are the agencies or individuals who are concerned with education of local people through nonformal programmes e.g. agriculture, health, theology, etc
 
# how do these agencies view the possibility of mother tonge literacy in promiting their goals
 
# what would need to happen for a literacy programme to be integrated with the nonformal education programmes
 
# would a functional literacy programme in tandem with nonformal education meet the felt needs of the community
 
'''C. Formal education'''
 
# how seriously is the govt concerned with education children in this area
 
# are local attitudes preventing govt implementation of education
 
# what is the dropout rate within schools and what do the community say about the cause of this
 
# what languages do teachers speak and how might these differ from the medium of education or the language/s of the students
 
# what are all the agencies concerned with formal education in this area
 
# who makes decisions concerning educational policies and operations at local level
 
# what is the language of materials used for education
 
# how well do teachers use the medium of education
 
# for each school
 
## what is it's name and location
 
## what years does it teach
 
## what percentage of teachers/students are from the language group
 
## what proportions of students complete each year of education
 
## who pays for the school
 
'''D. Literacy Rate'''
 
# what is the distribution of non/semi/literacy between the sexes and different age groups
 
# are there any significant groups of the population in any one of the above categories
 
# are literacy programs in existence or planned. If so, what are the details of the languages/materials used and what kinds of success and who is it reaching
 
'''E. Educational resources'''
 
# what trained personnel are available for development
 
# what is the potential for additional trainees
 
# how can teachers be remunerated
 
# what local resources are available
 
'''F. Literature preferences'''
 
# what is the interest in reading the national/local/other language
 
# Books
 
## who owns them
 
## what languages are they in
 
## what kinds of books are they
 
## how much did they cost
 
# Media
 
## how many people have some form of communication media
 
## what do they like to listen to/watch
 
## what languages are the broadcasts in
 
'''G. Motivation'''
 
# what motivations are there for material or particular forms of literacy
 
# what communication forms do the people use/desire to use
 
# what particular groups of the community desire literacy
 
# what are their reasons for doing so
 
# who are the influential people in the language group
 
'''H. Traditional education'''
 
# what skills/topics are consciously taught
 
# what skills/topics are taugt by verbal explanation
 
# who is taught and at what age
 
## would younger ever teach older
 
## are there any social barriers for adults teaching adults of the opposite sex
 
# who teaches different topics/skills
 
# what is the period of instruction
 
# how is the teaching/learning done - what is deemed successful
 
# are there any rewards for the educator
 
# how is motivation to learn inspired
 
# when do parents start to talk to their children and how
 
'''I. Mother tongue literature'''
 
# describe what materials have already been produced in the mother tongue (title, author, date, producer, motivation, distributor, number of copies available, popularity, revisions needed or done)
 
# who is already producing materials in this language
 
# what titles are planned
 
# what titles do the local community desire
 
'''J. Mother tongue writers'''
 
# who are the creative writers in the community
 
# who could be trained as writers
 
'''K. Production'''
 
# what are the local means of production if any
 
# are there any steps of production that local people could do or be trained/equipped to do
 
# what provisions are there for revisions or reprints of popular materials
 
'''L. Promotion'''
 
# how can literature be promoted
 
'''M. Distribution'''
 
# how can new literature be distributed
 
# what happens to money from sales
 
# is there a workable system
 
# how can the system be improved
 
 
 
===Notes===
 
"It is very important to remember which language is in focus when talking about attitudes toward education."<ref>ibid. p57</ref>
 
"It is highly likely that there will be some difference between attitudes to adult education and that for children."<ref>ibid. p58</ref>
 
"Politics often override other factors. Where a group is needing more prestige, sometimes devlelopment of a local language in written form... accomplishes this. It has been reported that in the Pacific islands [language development] is welcome in many language groups not because people really want to read... but because of the prestige it brings to the group."<ref>ibid. p58</ref>
 
"In the evaluation of the Southern Sudan Bilingual Education Program, it was foudn taht although parents said that they valued weducation and they wanted schools, they did not send their children to school regularly and were not concerned at high absenteeism throughout the semester."<ref>ibid. p60</ref>
 
"The level of education in the area may give us a clue to the level of bilingualism that can be expected among the educated. It will also be an indicator of the educational background we might expect from co-translators and literacy co-workers in the project."<ref>ibid. p60</ref>
 
 
 
==9. Religion==
 
# what other agencies have been at work in the area and what programs have they run
 
# what religious influences have their been in the community and what is predominant now
 
# what are the attitudes of the religous leaders towards development
 
'''A. Actual religious situation'''
 
# what is the traditional religion
 
# what percentage of the population follows each religion in the community
 
# what percentage of the population maintain traditional and new beliefs
 
# what are the places of worship
 
# how have traditional religions been influenced by present/past development
 
# what religious ceremonies or activities can be considered in planning programmes
 
# what religious groups are represented officially among the population
 
# what percentage of the people are official adherents to a particular religion
 
# what languages are used for each religious event
 
# who are the important religious authorities and what are their views of development
 
# how are religious leaders appointed and trained
 
# what cooperation is there between religious leaders
 
 
 
===Notes===
 
"What people believe is at the center of their world view and has some effect on all other aspects of their life."<ref>ibid. p68</ref>
 
"Often there will be only a portion of the society that will thoroughly embrace the new religion, while many others will maintain their traditional beliefs and customs others will syncretize the new with the old, so that in form they are Christians or Muslims, but in fact they are still continuing to follow their traditional beleifs."<ref>ibid. p68</ref>
 
 
 
==References==
 
<references />
 

Latest revision as of 15:43, 18 October 2011

Data Collection Tools
Tools.png
Interviews
Observation
Questionnaires
Recorded Text Testing
Sentence Repetition Testing
Word Lists
Participatory Methods
Matched-Guise
  • The Max Planck Institute's Dept. of Linguistics has a long list of different questionnaire types available here
  • Bendor-Samuel, Bendor-Samuel & Jackson have a large number of suggestions of Questionnaire Topics

Background

In western culture, questionnaires are often self-administered, but in pre-literate societies, this is impossible to carry out. Thus, what we often refer to in language survey as a questionnaire is similar in many ways to what social science calls an interview. Often though, in our contexts, one-on-one interviews are difficult to carry out as private locations to interview people may be hard to come by. In addition, it may not be socially acceptable for one person to speak on behalf of the entire community, nor may it be appropriate for a stranger to be in a room with a single member of the community, particularly if the participant is female.

We should therefore be aware of the social constraints that affect the administration of questionnaires in our particular context. The following guide is therefore simply an ideal and you may have to adapt it for your situation.

Designing a questionnaire

  1. Carry out thorough background research into your topic area. Through this, isolate 'holes' in your data or areas that you will need to collect data for.
  2. Reduce each of these holes to a variable. For example, imagine that there is a language project planned for a particular town and you want to know if people from the surrounding villages will collaborate on this project if this town is the venue. Through your research, you discover that there are regular buses running to the villages the town. However, there are a number of holes in your data:
    1. Do the people travel to the town? If not, why not?
    2. Are there any communities that are not on bus routes? How might they travel?
    3. Would there be any seasonal reasons why people might not travel? E.g. festivals, heavy rains
    4. How reliable are the buses?
    5. If people attend a workshop, what time must they finish to be sure of getting a bus home?
  1. each of these can be reduced to a variable that you are looking to identify e.g.
  2. time of last bus
  3. weather


  • It is possible for the surveyor to greatly influence the responses through the way they administer the questionnaire.
  • The length of the questionnaire will directly affect the amount of time it takes to administer and therefore the potential quality of the data collected, particularly in the latter stages of the process. However, if the surveyor is able to use the length of the questionnaire to develop rapport, latter questions may be able to go to a greater depth as this rapport strengthens the relationship.
  • Participants may find the process of their answers being recorded threatening, particularly if their personal details are noted.
  • Questionnaires must consider the educational and social background of the participants. If questions are too challenging, participants may need clarification and then the influence of the surveyor increases considerably.
  • Questions aimed at collecting factual data can be much easier to verify than those which collect data about opinions, attitudes and beliefs.
  • Open ended, multiple choice and closed questions are all different and which you choose when you design your questionnaire will affect the kind of data you end up with.


How to Administer a Questionnaire

Sample Questionnaires

Observation Schedule