Chapter 8: TEST DEVELOPMENT

An early stage of the test development process wherein the idea for a particular test or test revision is first conceived.

A method of evaluation and a way of deriving meaning from test scores by evaluating an individual test taker’s score and comparing it to scores of a group of test takers on the same test.

A method of evaluation and a way of deriving meaning from test scores by evaluating an individual’s score with referenced to set standard (or criterion).

The preliminary research surrounding the creation of a prototype test; a general objective of it is determine how best to measure, gauge, assess, or evaluate the targeted construct(s). Also referred to as pilot study and pilot research

A stage in the process of test development that entails writing test items (or rewriting or otherwise revising existing items), as well as formatting items, setting scoring rules, and otherwise designing and building a test.

As the process of setting rules for assigning numbers in measurement. Is the process by which a measuring device is designed and calibrated and by which numbers (or other indices) – scale values – are assigned to different amounts of the trait, attribute, or characteristics being measured.

Defined as a grouping of words, statements, or symbols on which judgements of the strength of a particular trait, attitude, or emotion are indicated by the test taker. Can be used to record judgements of oneself, others, experiences, or objects and they can take several forms.

The ratings that the test takers makes for each of the 30 test items are added together to obtain a final score. Scores range from a low of 30 (if the test taker indicates that all 30 behaviors are never justified) to high of 300 (if the test taker taker indicates that all 30 situations are always justified). Because the final test score is obtained by summing the rating across all the items. Each item presents the test taker with five alternative responses (sometimes seven), usually on an agree-disagree or approve-disapprove continuum

Test takers are presented with pairs of stimuli (two photographs, two objects, two statements), which they are asked to compare. They must select one of the stimuli according to some rule; for example, the rule that they find one stimulus more appealing than the other.

One method of developing ordinal scales through the use of sorting task that entails judging of stimulus in comparison with every other stimulus on the test.

Stimulus are placed into one of two or more alternative categories that differ quantitatively with respect to some continuum.

A scale wherein items range sequentially from weaker to stronger expressions of the attitude or belief being measured.

An item-analysis procedure and approach to test development that involves a graphic mapping of a test taker’s responses.

Is the reservoir or well from which items will or will not be drawn for the final version of the test.

Variables such as the form, plan, structure, arrangement, and layout of individual test items.

Require test takers to select a response from a set of alternative responses.

Require test takers to supply or to create the correct answer, not merely to select it.

Multiple-choice item that contains only two possible responses.

The test taker is presented with two columns: premises on the left and responses on the right.

Requires the examinees to provide a word or phrase that completes a sentence. Should be worded so that the correct answer is specific.

A test item that requires the test taker to respond to a question by writing a composition, typically one that demonstrates recall of facts, understanding, analysis, and/ or interpretation.

A collection of questions to be used in the construction of tests.

In computerized adaptive testing, the individualized presentation of test items drawn from an item bank based on the test taker’s previous responses.

The diminished utility of an assessment tool for distinguishing test takers at the low end of the ability, trait, or other attribute being measured.

The diminished utility of an assessment tool for distinguishing test takers at the high end of the ability, trait, or other attribute being measured.

A method of scoring whereby points or scores accumulated on individual items or subsets are tallied and then, the higher the total sum, the higher the individual is presumed to be on the ability, trait, or other characteristics being measured.

A method of evaluation in which test responses earn credit toward placement in a particular class or category with other test takers. Sometimes a test takers must meet a set number of responses corresponding to a particular criterion in order to be placed in a specific category or class.

An approach to test scoring and interpretation wherein the test taker’s responses and the presumed strength of a measured trait are interpreted relative to the measured strength of other traits for the test taker.

A stage in the process of test development that entails administering a preliminary version of a test to a representative sample of test takers under conditions that simulate the conditions under which the final version of the test will be administered.

Analyses test scores and responses to individual items.