Difference between revisions of "Administer Text Test Set"
From SurveyWiki
Jump to navigationJump to search (Added first part of page (see discussion for next steps)) |
m (Number formatting) |
||
| (2 intermediate revisions by the same user not shown) | |||
| Line 3: | Line 3: | ||
The administration of the final recorded text tests differs from that of the pilot tests mainly in the sampling procedure. The process also becomes more complicated and fatiguing when there is more than one test given. When you familiarize yourself with the steps in this process and practice them, you will be better prepared to administer an RTT properly and prevent or reduce errors. | The administration of the final recorded text tests differs from that of the pilot tests mainly in the sampling procedure. The process also becomes more complicated and fatiguing when there is more than one test given. When you familiarize yourself with the steps in this process and practice them, you will be better prepared to administer an RTT properly and prevent or reduce errors. | ||
| − | Rotate Texts | + | First, follow these [[Before Testing Participants|suggestions]] to prepare for testing participants. |
| − | If a test subject has to listen to several tests, he or she may get tired toward the end and not listen as closely. Rotating the texts equalizes the effect fatigue has on the scores. Sometimes it is not possible or appropriate to give the test in private, and you must do it in a public place. Rotation also prevents bystanders from memorizing the answers that they think they should use, because they will be listening to a different test at that point. | + | |
| + | ==How to Administer a Recorded Text Test== | ||
| + | |||
| + | To use this procedural guide, you will need to have the complete list of questions and answers for the test written out, with the track numbers corresponding to each question's location written beside the question. | ||
| + | |||
| + | #Follow the procedural guide for translating and recording the introduction text. Record the introduction text in the speech variety of the test site on the same MiniDisc (disc) as the hometown text for that variety. Note (in your data management notebook) the track number assigned to the introduction text. Only one track is needed for this text. | ||
| + | #Find a helper who can translate your instructions to the test subjects from the LWC into the local language. Explain the steps involved in test administration so that the translator understands what you will be doing. | ||
| + | #Ask for help in finding potential test subjects. | ||
| + | #When a test subject arrives, sit him or her down in a comfortable setting and briefly explain what the test is like. You may need to explain how the voices were recorded and that they can be heard through the headphones. | ||
| + | #Double check that he or she meets the basic qualifications needed to participate in this test. | ||
| + | #Explain that the first speech he or she will hear is an announcement. | ||
| + | #Play the introduction text and pause at the end of the text. | ||
| + | #Check the introduction by having the first few test subjects explain it in their own words. If they don't understand it, then you need to write, record, or translate the introduction text again. | ||
| + | #Cue the MD player to the beginning of the test text and put the list of questions and answers in front of you so that you can follow along. If you set your MD player's counter to count down the time remaining in each track, it will help you know when to pause the test. | ||
| + | #Play the first section of text and the first question track and then pause the MD player. | ||
| + | #If the test subject does not answer automatically after hearing the question, then ask him or her to answer the question. If the test subject seems unable to answer the question, you may play the question track again. Remember – do not repeat the text before the question! | ||
| + | #If he or she is still unable to answer the question, mark the score sheet appropriately and continue the test. | ||
| + | #If a test subject is missing nearly every question or is not answering them, it may be that he or she is having a hard time with the test methodology itself. Graciously dismiss him while thanking him for his time, and then call the next participant. | ||
| + | #If the test subject answers the question correctly, write the appropriate score on the score sheet and continue the test. | ||
| + | #Play the next text segment and question, and then pause the MD player. | ||
| + | #Repeat steps 4 - 15 until the entire text is finished. Repeat the process for each of the additional subjects required for the test. | ||
| + | |||
| + | ==Rotate Texts== | ||
| + | If a test subject has to listen to several tests, he or she may get tired toward the end and not listen as closely. Rotating the texts equalizes the effect fatigue has on the scores. Sometimes it is not possible or appropriate to give the test in private, and you must do it in a public place. Rotation also prevents bystanders from memorizing the answers that they think they should use, because they will be listening to a different test at that point. Click [[Media:Rotate.pdf|here]] for more details on rotating texts. | ||
[[Category:Recorded Text Testing]] | [[Category:Recorded Text Testing]] | ||
| − | |||
Latest revision as of 07:11, 19 April 2011
The administration of the final recorded text tests differs from that of the pilot tests mainly in the sampling procedure. The process also becomes more complicated and fatiguing when there is more than one test given. When you familiarize yourself with the steps in this process and practice them, you will be better prepared to administer an RTT properly and prevent or reduce errors.
First, follow these suggestions to prepare for testing participants.
How to Administer a Recorded Text Test
To use this procedural guide, you will need to have the complete list of questions and answers for the test written out, with the track numbers corresponding to each question's location written beside the question.
- Follow the procedural guide for translating and recording the introduction text. Record the introduction text in the speech variety of the test site on the same MiniDisc (disc) as the hometown text for that variety. Note (in your data management notebook) the track number assigned to the introduction text. Only one track is needed for this text.
- Find a helper who can translate your instructions to the test subjects from the LWC into the local language. Explain the steps involved in test administration so that the translator understands what you will be doing.
- Ask for help in finding potential test subjects.
- When a test subject arrives, sit him or her down in a comfortable setting and briefly explain what the test is like. You may need to explain how the voices were recorded and that they can be heard through the headphones.
- Double check that he or she meets the basic qualifications needed to participate in this test.
- Explain that the first speech he or she will hear is an announcement.
- Play the introduction text and pause at the end of the text.
- Check the introduction by having the first few test subjects explain it in their own words. If they don't understand it, then you need to write, record, or translate the introduction text again.
- Cue the MD player to the beginning of the test text and put the list of questions and answers in front of you so that you can follow along. If you set your MD player's counter to count down the time remaining in each track, it will help you know when to pause the test.
- Play the first section of text and the first question track and then pause the MD player.
- If the test subject does not answer automatically after hearing the question, then ask him or her to answer the question. If the test subject seems unable to answer the question, you may play the question track again. Remember – do not repeat the text before the question!
- If he or she is still unable to answer the question, mark the score sheet appropriately and continue the test.
- If a test subject is missing nearly every question or is not answering them, it may be that he or she is having a hard time with the test methodology itself. Graciously dismiss him while thanking him for his time, and then call the next participant.
- If the test subject answers the question correctly, write the appropriate score on the score sheet and continue the test.
- Play the next text segment and question, and then pause the MD player.
- Repeat steps 4 - 15 until the entire text is finished. Repeat the process for each of the additional subjects required for the test.
Rotate Texts
If a test subject has to listen to several tests, he or she may get tired toward the end and not listen as closely. Rotating the texts equalizes the effect fatigue has on the scores. Sometimes it is not possible or appropriate to give the test in private, and you must do it in a public place. Rotation also prevents bystanders from memorizing the answers that they think they should use, because they will be listening to a different test at that point. Click here for more details on rotating texts.
