Using, Writing & Evaluating |
|
Figure 1. |
PAGE 74
|
Development and Selection During the development and selection stage, educators make specific decisions regarding the assessment instruments and other procedures they will use to assess students. Those decisions may have a major impact on whether the assessment is ethical and fair. (Principles of ethical and fair assessment practices are in bold print.) |
|
Assessment procedures are sufficiently aligned with content. Assessment procedures do not provide valid information if they are not aligned with the content to be assessed. The assessment should be aligned with learning outcomes or instruction, depending on whether the results will be used to evaluate student attainment of the outcomes or the effectiveness of instruction. Alignment also means that the assessment is as comprehensive as and probes the range and depth of thinking skills represented in the outcomes or instruction. Assessment procedures are valid, reliable, and fair. Validity, reliability, and absence of bias are essential to ethical and fair assessment practices. |
Validity refers to the extent to which information is appropriate for the purposes for which it is used. During this stage, educators should attempt to identify instruments or procedures which will produce the information needed for the intended uses. Educators should also consider other anticipated uses and decide whether to select assessment procedures that will be appropriate for those uses or to issue statements later about their inappropriateness. Reliability is concerned about the consistency or stability of information. Interrater agreement is also necessary for reliability. Assessment procedures which are fair do not discriminate against members of various racial, ethnic, gender or other groups or against students with disabilities. |
|
Preparation for Assessment Assessment preparation activities are unethical or unfair if they involve directly teaching specific concepts simply because those concepts will be included in an assessment procedure, unless that procedure is part of an instructional cycle and was specifically designed to assess a limited body of content. Preparation activities may also be unfair if they give some students an advantage over others to whom they will be compared, such as students in a publisher's norming sample. (Principles of ethical and fair assessment practices are in bold print.) |
|
The preparation helps students better demonstrate what they know. The intent of assessment preparation should be to help make sure that a test does not interfere with studentsâ demonstration of their knowledge because, for example, students do not know how to interpret or respond to assessment questions. |
The preparation avoids teaching specific concepts that will be tested. Aligning instruction to assessment to ensure that major concepts are taught is good educational practice. However, teaching actual test items or assessment tasks is unethical. Teaching specific concepts simply because they will be assessed is also unethical. |
PAGE 75
|
Assessment Administration Unethical and unfair assessment practices that occur during the administration stage usually involve giving some students advantages over others by, for example, giving them more time to complete the assessment, assisting them during testing, or excluding some students from the assessment in order to raise the average scores for schools or other groups of students. (Principles of ethical and fair assessment practices are in bold print.) |
|
The assessment is administered uniformly. Comparisons of students' test scores to one another, to a statewide sample, or to a publisher's norming sample are not warranted unless all students take the test under generally uniform conditions. |
All students are included in the assessment system. Excluding some students from an assessment may be unethical or unfair. In Illinois, it may also be illegal. All students shall be included in state assessment. Students excluded due to provisions in IEPs or participation in bilingual programs shall be assessed using alternative procedures. Also, all students must be accounted for in data used in the Illinois Public School Accreditation System. |
|
Processing of Assessments Unethical and unfair assessment practices may occur after assessments are administered but before the results are interpreted and used. Such practices include obtaining and using copies of assessment procedures, changing answer documents, failing to use uniform scoring procedures, and not verifying that assessment data are accurate. (Principles of ethical and fair assessment practices are in bold print.) |
|
Assessment security is protected. All professional persons have a responsibility to protect the security of assessment procedures. Large-scale tests, such as Illinois Goal Assessment Program (IGAP) and commercial tests, often assess extensive content areas with a limited number of items or exercises. It is essential that students are taught the larger body of content rather than the more restricted items or exercises. Therefore, it is unethical to make or keep copies of such tests or to use them in any way prior to their administration. Answer documents are treated ethically. Students' answers to assessment items or tasks should not be altered. It is unethical to mark, erase, or change responses to alter a score. However, it is acceptable to make sure that students |
have accurately completed the identification information on answer sheets. Assessment procedures are scored uniformly. Uniformity is generally not problematic when tests are scored by machine. However, when they are not, educators should ensure that all tests are scored using the same criteria and procedures in the same manner. Studentsâ scores should vary only because their responses were different, not because different raters assigned divergent scores to equivalent responses. Data are verified. Assessment results should always be reviewed to ensure that they are accurate before they are used for any purpose. |
PAGE 76
|
Use of Assessment Results Unethical and unfair assessment practices may also involve misinterpreting or misusing assessment results. The misuses include using the data for purposes other than those for which they were collected, violating the confidentiality of individual students and teachers, and reporting results misleadingly. (Principles of ethical and fair assessment practices are in bold print.) |
|
Assessment results are interpreted appropriately. Misinterpretations of assessment results easily lead to unethical and unfair assessment practices. Interpretations should be based on thorough understandings of what was assessed, how it was assessed, how the scores were derived, and what the scores mean. To help guard against misinterpretation, interpretation manuals should be available to all assessment users. Assessments are used only for the intended puposes. Assessments are selected or developed for specific purposes. Validity is examined for those purposes. People frequently invent new interpretations or uses of assessment results, but it is unethical to announce findings or make decisions affecting persons or schools without validating such interpretations or uses. The confidentiality of individual students and teachers is respected. State and federal laws protect the confidentiality of individual students. Illinois legislation rules that individual students' scores shall not be entered on permanent records. They shall not be released without written permission from parents. Assessment results should not be presented in a manner which allows them to be associated with individual teachers. Failure to protect the confidentiality of individual students and teachers is unethical and unfair. Further more, releasing the results for individual students may be illegal. |
Reports are accurate, clear, and comprehensive. Assessment reports should present results ethically and fairly. Also, they should encourage readers to do the same when they communicate the results to others. Reports should be technically accurate. They should present the data clearly to enable audience members to understand what the data mean and how they should be interpreted. Furthermore, reports should present results comprehensively so that readers' perceptions are constructed from a variety of data rather than a narrow set of test scores. Assessment results are used to further examine validity. Because validity resides in the interpretation and use of assessment results, educators should continue to examine issues of validity after data are released. The examination should include both anticipated and unanticipated uses of test data. Questions should focus on whether assessment information is appropriate for each use. If not, it may be necessary to adjust assessment plans (e.g., adopt new tests or tasks), provide additional guidelines about interpretation and use, or more carefully monitor and control interpretation and use. |
PAGE 77
| Using,
Writing & Evaluating |
|