Preparation
This assessment is a culmination of the previous assessments you have completed during this course. In this assessment, you will synthesize your previous research as well as conduct research on the final element of the Code, Element 9. Element 9 states that a test user, “evaluate(s) the available evidence on the performance of test takers of diverse subgroups . . . determine(s) to the extent feasible which performance differences may have been caused by factors unrelated to the skills being assessed.” Together, the previous assessments and this current one involving Element 9 will provide you with the data, research, and literature reviews across all nine elements of the Code to assist your decision-making process about the appropriate selection of a test.
For this assessment, you will:
Locate reviews or research related to how Element 9 applies to your selected test. If the research or reviews do not address this element in any way, then you will need to cite the references you reviewed and note what they were lacking in addressing this element, drawing appropriate conclusions for when a test is lacking such evidence.
Synthesize all of the data and information you gathered on your selected test throughout the course and identify highlights, both positive and negative, both advantages and disadvantages, according to all nine elements of the Code.
Evaluate your selected test based on these data and draw a conclusion as to whether it is a test that you would select, recommend, or even defend, if necessary, in practice.
Note: You should not merely copy and paste your earlier assessments for the final report. Instead you will be synthesizing the research you completed for each element into a summary of that element that you will offer in support of your final evaluation. (For example, note that the technical quality element (that is, Element 5) will be only a synthesis and evaluation, not a repeat of previous analysis work.)
Review all of your evaluations for each element, recommended improvements to the test, and write an overall evaluation and determination about the use of your selected test.
Instructions
Use the Assessment 4 Template: Final Analysis of Selected Test, linked in the Required Resources, to complete the assignment.
Use the following structure in your assessment:
Title Page
The Code of Fair Testing Practices in Education
Identify the strengths or weaknesses for each element, and determine if the information about that element supports (or opposes) the use of your selected test in the field and population to be served.
Analyze the test against each element.
Element 1. Purpose: Define the purpose for testing, the content, and skills tested.
Element 2. Appropriateness: Evaluate appropriateness of test content, skills tested, and content covered.
Element 3. Materials: Evaluate materials for which clear, accurate, and complete information is provided.
Element 4. Training: Test users have appropriate knowledge, skills, and training.
Element 5. Technical Quality.
Synthesis of evidence of reliability.
Synthesis of evidence of validity.
Element 6. Test Items and Format: Evaluate test items, test format, directions, manuals, and scores.
Element 7. Test Procedures and Materials: Evaluate test procedures and materials to ensure that potentially offensive content or language is avoided.
Element 8. Modifications and Accommodations: Evaluate if tests provide appropriately modified forms or procedures for test takers with disabilities.
Element 9. Group Differences: Evaluate evidence on performance of test takers of diverse subgroups.
Recommendations
Include overall recommendations to use the selected test in the field and with populations to be served.
Identify the setting and its population.
Identify the test and the intended population for the test.
Identify the greatest strengths you discovered and determined in its use, if recommending the use of the selected test. Additionally, identify any limitations or concerns that may still exist with its use regardless of the recommendation. Are there still concerns for the test in certain situations?
Identify the greatest weaknesses you discovered and determined in its use, if not recommending the use of the selected test. Additionally, identify any strengths that may still exist with its use regardless of the opposition. Are there still uses for the test within set parameters?
References
A minimum of nine references are required for this assessment, of which at least five must be of peer-reviewed journal articles. These may include journal articles, literature reviews, MMY reviews, and publisher websites. At least five of the nine references must be from professional journals. It is likely and appropriate that many of these references and citations were included in one or more of your previous assessments. Alternatively, you may want to supplement your paper with current, peer-reviewed journal articles you located after completing an earlier assessment. Such inclusions would also be acceptable.
Additional Requirements
Your assessment should meet the following requirements:
Written communication: Write clearly and logically, with correct use of spelling, grammar, punctuation, mechanics, and APA format and style.
APA format: Follow current APA format and style throughout the assessment.
Font and font size: Times New Roman, 12 point.
Reference
Joint Committee on Testing Practices. (2004). Code of fair testing practices in education. Retrieved from http://www.apa.org/science/programs/testing/fair-testing.pdf
