Что такое findslide.org?

FindSlide.org - это сайт презентаций, докладов, шаблонов в формате PowerPoint.


Для правообладателей

Обратная связь

Email: Нажмите что бы посмотреть 

Яндекс.Метрика

Презентация на тему Tems – The Building Blocks оf Tests

Содержание

THIS LECTURE OFFERS: partial listing of the options that are available in LT from which you can choose when you plan your tests advantages and disadvantages and points to consider when choosing these options MCQs,
LECTURE 3: ITEMS – THE BUILDING BLOCKS OF TESTSAssessment and International Exams in TEFL THIS LECTURE OFFERS:  partial listing of the options that are available TASK FORMAT What a test task “looks like”, what sort of input TEST ITEMSDeletion- based items CONSTRUCTED RESPONSE (SUPPLY) ITEMSLimited response LIMITED RESPONSE TASKS Short-answer questions, fill-in-the-blank , sentence writing or combination tasks, LIMITED RESPONSE TASKS SHORT ANSWER ITEMLook at the story. You can use one, two or WORD FORMATIONUse the word in capitals at the end of the line ERROR DETECTIONIn each sentence there is either a spelling or punctuation error. KEY WORD SENTENCE TRANSFORMATIONComplete the second sentence so that it has a INFORMATION TRANSFER DELETION-BASED TASKS: CLOZE TESTS Fixed Deletion Cloze (n = 7)Studying black bearsAfter RATIONAL DELETION CLOZEAfter years studying North America’s black bears in the (0) TASK FORMAT?You should spend about 40 minutes on this task. Write about CONSTRUCTED RESPONSE (SUPPLY) ITEMSExtended response EXTENDED RESPONSEYou should spend about 40 minutes on this task. Write about OTHER EXTENDED RESPONSE TASKS Written: recall tasks, written summaries, essays and compositions, SELECTED-RESPONSE ITEMS TRUE / FALSE / NOT GIVEN TFNs: True/False, yes/no, correct/incorrect, right/wrong, or TRUE / FALSE / NOT GIVEN Write items that test meaning rather Chilies originate in South America and have been eaten for at least MATCHING Fairly easy to construct but may be a matter of logic MULTIPLE CHOICE QUESTIONS MULTIPLE CHOICE QUESTIONSAdvantages Objective: Ease of scoring Most commonly used format: known COMMON ITEM PROBLEMS Cueing 3 for 1 Split Impurity Subsuming Apples and CUEING within an item or within the testWhen you write “for deposit 3 FOR 1 SPLIT 3 distractors are parallel; the 4th is not IMPURITY Items that test more than one thing I never knew ______________.a. SUBSUMINGJohn: We need to buy some new office furniture.Mike: Ok, I’ll call APPLES AND ORANGES Response options have no relation to one another or UNPARALLELED OPTIONS Response options are not parallel in length grammarHow do most STEREOTYPES Test materials should avoid language that fosters stereotypes. Latifa went downtown INFLAMMATORY TONE Material that may have a negative emotional impact on Ss INSENSITIVITY Items should not be shocking or upsetting to test takers. Four DOUBLE KEYS More than one response option is keyable.I apologize for …. NO KEY Care should be taken to include a correct answer in IMPLAUSIBILITY Ss can improve ‘monkey score’ by eliminating absurd or giveaway distractors OUTSIDE/BACKGROUND KNOWLEDGE Ss are able to answer the question based on outside TRICKINESS Focus on points that are notoriously confusing even for native speakers. INAPPROPRIATE TERMINOLOGY Avoid politically incorrect terminology Crippled children can study a variety MULTIPLE CHOICE QUESTIONS (MCQS)Question should be clearly in stemFour options optimal, one Parallel in length The most general cause of low individual incomes Move recurring information in response options to the stem.In national elections CONCLUSIONS Teachers should be aware of the implications for English language learners
Слайды презентации

Слайд 2 THIS LECTURE OFFERS:
partial listing of the options

THIS LECTURE OFFERS: partial listing of the options that are available

that are available in LT from which you can

choose when you plan your tests
advantages and disadvantages and points to consider when choosing these options
MCQs, and possible problems with them

Слайд 3 TASK FORMAT
What a test task “looks like”,

TASK FORMAT What a test task “looks like”, what sort of

what sort of input test takers must produce
Bachman:

test method
Bachman and Palmer: task type
Brown and Hudson: item format
Famularo, Shin: response format
Alderson: test technique
Coombe: test item

Слайд 4 TEST ITEMS
Deletion- based items

TEST ITEMSDeletion- based items

Слайд 5 CONSTRUCTED RESPONSE (SUPPLY) ITEMS
Limited response

CONSTRUCTED RESPONSE (SUPPLY) ITEMSLimited response

Слайд 6 LIMITED RESPONSE TASKS
Short-answer questions, fill-in-the-blank , sentence

LIMITED RESPONSE TASKS Short-answer questions, fill-in-the-blank , sentence writing or combination

writing or combination tasks, open-the brackets, an incomplete graphic

organizer, an incomplete outline
Can be passage-based or independent
Assess a variety of language skills and subskills
Require written response, ranging in length from 1 word to max. 1 sentence

Слайд 7 LIMITED RESPONSE TASKS

LIMITED RESPONSE TASKS

Слайд 8 SHORT ANSWER ITEM
Look at the story. You can

SHORT ANSWER ITEMLook at the story. You can use one, two

use one, two or three words for your answers.


Last week, Vicky went to the city center by bus. She met her friend Kate and they went to the cinema. …..
How did Vicky get to the city center last week?
…………………………………………………..

Слайд 9 WORD FORMATION
Use the word in capitals at the

WORD FORMATIONUse the word in capitals at the end of the

end of the line to form a word that

fits the sentence.

The results of the scientist’s work have …… significance. GLOBE
People made some ………….remarks about my performance. COMPLIMENT

Слайд 10 ERROR DETECTION
In each sentence there is either a

ERROR DETECTIONIn each sentence there is either a spelling or punctuation

spelling or punctuation error. Write the correctly spelled word

or show the correct punctuation on your answer sheet.

If we look at wood through a microscope we can see its made up of elongated cells.


Слайд 11 KEY WORD SENTENCE TRANSFORMATION
Complete the second sentence so

KEY WORD SENTENCE TRANSFORMATIONComplete the second sentence so that it has

that it has a similar meaning to the first

sentence. Do not change the word given. You must use between two and five words, including the word given.
Could you please turn off your mobile phone?
MIND
Would ………………………………………. your mobile phone off?


Слайд 12 INFORMATION TRANSFER

INFORMATION TRANSFER

Слайд 13 DELETION-BASED TASKS: CLOZE TESTS
Fixed Deletion Cloze (n

DELETION-BASED TASKS: CLOZE TESTS Fixed Deletion Cloze (n = 7)Studying black

= 7)
Studying black bears
After years studying North America’s black

bears in the (0) …….. way, wildlife biologist Luke Robertson felt no closer to understanding the creatures. He realised that he had to (1) …….. their trust. Abandoning scientific detachment, he (2) …….. the daring step of forming relationships (3) …….. the animals, bringing them food to (4) …….. their acceptance. The insight this has (5) …….. him into their behaviour has allowed (6) …….. to dispel certain myths about bears.

Слайд 14 RATIONAL DELETION CLOZE
After years studying North America’s black

RATIONAL DELETION CLOZEAfter years studying North America’s black bears in the

bears in the (0) …….. way, wildlife biologist Luke

Robertson felt no closer to understanding the creatures. He realised that he had to (1) …….. their trust. Abandoning scientific detachment, he took the daring step of forming relationships with the animals, bringing them food to gain their acceptance.
The (2) …….. this has given him into their behaviour has allowed him to dispel certain myths about bears. (3) …….. to popular belief, he contends that bears do not (4) …….. as much for fruit as previously supposed. He also (5) …….. claims that they are ferocious. He says that people should not be (6) …….. by behaviour such as swatting paws on the ground, as this is a defensive, rather than an aggressive, act.

Слайд 15 TASK FORMAT?
You should spend about 40 minutes on

TASK FORMAT?You should spend about 40 minutes on this task. Write

this task. Write about the following topic:
Some people believe

that children are given too much free time. They feel that this time should be used to do more school work.
How do you think children should spend their free time?
Give reasons for your answer and include any relevant examples from your own knowledge or experience.
Write at least 250 words.

Слайд 16 CONSTRUCTED RESPONSE (SUPPLY) ITEMS
Extended response

CONSTRUCTED RESPONSE (SUPPLY) ITEMSExtended response

Слайд 17 EXTENDED RESPONSE
You should spend about 40 minutes on

EXTENDED RESPONSEYou should spend about 40 minutes on this task. Write

this task. Write about the following topic:

Some people believe

that children are given too much free time. They feel that this time should be used to do more school work.
How do you think children should spend their free time?

Give reasons for your answer and include any relevant examples from your own knowledge or experience.
Write at least 250 words.

Слайд 18 OTHER EXTENDED RESPONSE TASKS
Written: recall tasks, written

OTHER EXTENDED RESPONSE TASKS Written: recall tasks, written summaries, essays and

summaries, essays and compositions, full size research papers.
Spoken:

short or lengthy monologues on a given topic, a speech, a presentation, group oral interview, roleplay,

Слайд 19 SELECTED-RESPONSE ITEMS

SELECTED-RESPONSE ITEMS

Слайд 20 TRUE / FALSE / NOT GIVEN
TFNs: True/False,

TRUE / FALSE / NOT GIVEN TFNs: True/False, yes/no, correct/incorrect, right/wrong,

yes/no, correct/incorrect, right/wrong, or fact/opinion.
Advantages?? Disadvantages??
Allow for testing

large amounts of content in lesser time
Ease of scoring (objective items)

They are easy! ! It is difficult to discriminate btw Sts who know the material and students who do not
If NG option not included, 50% guessing factor
To increase reliability, must be a sufficient amount on the test

Слайд 21 TRUE / FALSE / NOT GIVEN
Write items

TRUE / FALSE / NOT GIVEN Write items that test meaning

that test meaning rather than trivial detail.
Qs should

be at lower level of language difficulty than the text
Consider the effects of background knowledge!
Qs should appear in same order as text
Paraphrase questions, avoid verbatim matching
Avoid ‘absoluteness’ cues, answer patterns
Rather have Sts circle TFNs, than write letters


Слайд 22 Chilies originate in South America and have been

Chilies originate in South America and have been eaten for at

eaten for at least 9,500 years.
Chilies come from South

America.
People began eating Chilies in the last few centuries.
South Americans were the first people to start eating Chilies.
South Americans are the only nation who have a special loving for Chilies.


Слайд 23 MATCHING
Fairly easy to construct but may be

MATCHING Fairly easy to construct but may be a matter of

a matter of logic and elimination
Include more options

than blanks to reduce the guessing factor
Can take many forms and formats:
Connect a list of words to list of pictures
Connect synonyms from two word lists
Select a word from a word bank
Passage-based: multiple-matching

http://www.flo-joe.co.uk/cae/students/tests/

Слайд 24 MULTIPLE CHOICE QUESTIONS

MULTIPLE CHOICE QUESTIONS

Слайд 25 MULTIPLE CHOICE QUESTIONS
Advantages
Objective: Ease of scoring
Most

MULTIPLE CHOICE QUESTIONSAdvantages Objective: Ease of scoring Most commonly used format:

commonly used format: known to teachers and students at

various levels
No skill contamination
Cost-effective and practical

Disadvantages

Lack authenticity, cannot be used to test language as communication
Very often aimed only at recall and recognition
Guessing factor is strong!
Challenging and time consuming to create


Слайд 26 COMMON ITEM PROBLEMS
Cueing
3 for 1 Split

COMMON ITEM PROBLEMS Cueing 3 for 1 Split Impurity Subsuming Apples

Impurity
Subsuming
Apples and Oranges
Unparalleled options
Gender representation

Stereotypes
Inflammatory tone

Double keys
No key
Implausibility
Outside or Background knowledge
Trickiness
Insensitivity
Inappropriate terminology



Слайд 27 CUEING
within an item or within the test
When

CUEING within an item or within the testWhen you write “for

you write “for deposit only” on a check, you

are probably going to _______.
a. cash a check
b. deposit money
c. transfer funds
d. open an account

Слайд 28 3 FOR 1 SPLIT
3 distractors are parallel;

3 FOR 1 SPLIT 3 distractors are parallel; the 4th is

the 4th is not (a.k.a. “odd man out”)

The hotel

_______ an ad in the newspaper to recruit new employees.
a. placing
b. placed
c. to place
d. placement

Слайд 29 IMPURITY
Items that test more than one thing

IMPURITY Items that test more than one thing I never knew

I never knew ______________.
a. had the boys gone
b.

the boys have gone
c. have the boys gone
d. the boys had gone

Слайд 30 SUBSUMING
John: We need to buy some new office

SUBSUMINGJohn: We need to buy some new office furniture.Mike: Ok, I’ll

furniture.
Mike: Ok, I’ll call the supply company.
John: Just don’t

get the metal ones, please!

What will Mike order?
a. metal desks
b. comfortable chairs
c. office furniture

Слайд 31 APPLES AND ORANGES
Response options have no relation

APPLES AND ORANGES Response options have no relation to one another

to one another or are 2 for 2 split

Nowadays people use mobile phones ______________.
a. frequently
b. seldom
c. in their cars
d. for emergency purposes

Слайд 32 UNPARALLELED OPTIONS
Response options are not parallel in

UNPARALLELED OPTIONS Response options are not parallel in length grammarHow do

length
grammar
How do most Russians go to work?
a.

By bus.
b. Go by taxi.
c. Most of them drive.
d. Walk.

Слайд 33 STEREOTYPES
Test materials should avoid language that fosters

STEREOTYPES Test materials should avoid language that fosters stereotypes. Latifa went

stereotypes.
Latifa went downtown ____ pick up some soul

food.
so
to
for
---

Слайд 34 INFLAMMATORY TONE
Material that may have a negative

INFLAMMATORY TONE Material that may have a negative emotional impact on

emotional impact on Ss should be avoided.
_______ many American

soldiers in the Arabian Gulf right now.
There are
There is
There were
There have been

Слайд 35 INSENSITIVITY
Items should not be shocking or upsetting

INSENSITIVITY Items should not be shocking or upsetting to test takers.

to test takers.
Four people ______ in three serious

car accidents on Sheikh Zayed Road yesterday.
were killed
killed
are killed
to kill

Слайд 36 DOUBLE KEYS
More than one response option is

DOUBLE KEYS More than one response option is keyable.I apologize for

keyable.

I apologize for …. before.
Not writing
Not write
Not having written
Not

to be writing

Слайд 37 NO KEY
Care should be taken to include

NO KEY Care should be taken to include a correct answer

a correct answer in response options.
This is the

restaurant _____ I told you about yesterday.
what
why
where
how

Слайд 38 IMPLAUSIBILITY
Ss can improve ‘monkey score’ by eliminating

IMPLAUSIBILITY Ss can improve ‘monkey score’ by eliminating absurd or giveaway

absurd or giveaway distractors

The Olympics were held in

______ in 2004.
a. Athens
b. Beijing
c. Seoul
d. Disneyland

Слайд 39 OUTSIDE/BACKGROUND KNOWLEDGE
Ss are able to answer the

OUTSIDE/BACKGROUND KNOWLEDGE Ss are able to answer the question based on

question based on outside or background knowledge.
The weather

in Siberia is _____ hot and sunny.
a. often
b. never
c. sometimes
d. rarely

Слайд 40 TRICKINESS
Focus on points that are notoriously confusing

TRICKINESS Focus on points that are notoriously confusing even for native

even for native speakers.
Smoking has a bad________ on

health.
a. effect
b. affect
c. affliction
d. effectiveness



Слайд 41 INAPPROPRIATE TERMINOLOGY
Avoid politically incorrect terminology
Crippled children

INAPPROPRIATE TERMINOLOGY Avoid politically incorrect terminology Crippled children can study a

can study a variety of different _____ at the

new school.
teachers
students
subjects
methods



Слайд 42 MULTIPLE CHOICE QUESTIONS (MCQS)
Question should be clearly in

MULTIPLE CHOICE QUESTIONS (MCQS)Question should be clearly in stemFour options optimal,

stem
Four options optimal, one must be unambiguous answer.
Others

= distractors which attract Ss
All response options are parallel (same length, difficulty level)
Avoid the longest answer is the correct one – rule-of-thumb
Avoid: “all of the above”, never, always, absurd or giveaway distractors, extraneous cues, items that presuppose correct answer to previous item.
Avoid patterns: AAABBBCCCAAABBBCCC


Слайд 43 Parallel in length

The most general

Parallel in length The most general cause of low individual

cause of low individual incomes in the United States

is:
lack of valuable productive services to sell.
unwillingness to work.
automation.
inflation.


Слайд 44 Move recurring information in response options to

Move recurring information in response options to the stem.In national

the stem.
In national elections in the United States the

President is officially:
chosen by the people.
chosen by members of Congress.
chosen by the House of Representatives.
chosen by the Electoral College."
If the same words appear in all response options, take these words out of the response options and put them in the stem.


  • Имя файла: tems-–-the-building-blocks-of-tests.pptx
  • Количество просмотров: 103
  • Количество скачиваний: 0