4 Assignment 3: Formative Evaluation Plan by Your Name Goes Here IDT

4

Assignment 3: Formative Evaluation Plan

by

Your Name Goes Here

IDT 8001 CRN XXXXXX
Instructional Design

Nova Southeastern University

Month day, Year

Formative Evaluation Plan

In order to evaluate your instructional materials, you need to develop a set of data collection instruments, protocols, and write a formative evaluation plan. It will be necessary for you to interact and schedule meetings with one or more subject matter experts (SME), or specialist, and with representatives of the target population of learners. You may also wish to contact another instructional designer expert to act as evaluator.

This document presents the outline that you are to follow for the evaluation plan. Use the headings to guide you as you write the plan. In the plan you will explain what you are evaluating and how you will do it. This is not to be a 20-page paper, but make sure your explanation is clear enough that someone else to understand what you are planning on doing.

Examples of interview questions and questionnaire are provided in the Appendices. Please, do not copy—you are expected to create your own instruments. Use your textbook for examples of the questions that you need to ask based on your design.

After you conduct the actual formative evaluation, you will report the findings as a part of the final report. You will follow the same outline for the final report and include two other sections: Results, and Discussion and Recommendations. The writing of the final report would change from future to past tense where needed.

Use this section as the introduction to the document to indicate the reader what this document is about—its purpose. Indicate the sections that follow (i.e., the content). Do not refer to this, or any report, as an “assignment” or a “requirement for the class.” Place yourself in the role of the instructional designer—not a student. For this, and all assignments, make sure you cover the grading criteria and requirements in the syllabus.

Overview

In this section, introduce the evaluation plan. Include the type and purpose of the evaluation—remember you will conduct a one-to-one formative evaluation that includes specialist reviews, as opposed to a small group or field trial. Provide an overview of lesson materials (i.e., instructional goal, audience, format, and context where instruction is to be delivered), explain the sections/content of the report.

Design Plan

In this section, provide an overall description of your general formative evaluation plan. Provide an overall description of your general formative evaluation plan. Remember you will conduct a one-to-one formative evaluation (which includes specialist reviews). This is as opposed to a small group, or field trial. Review the text if you need to re-familiarize yourself with the distinctions among these. Indicate the following information for each evaluation phase (expert evaluation and learner evaluation): name of evaluator, date that the evaluation will take place, instructional target(s) of the evaluation (i.e., Goals & Objectives, Assessments, and/or Instructional Strategies), and name of specific instruments that will be employed to collect data (e.g., questionnaires, interview questions/protocols, and/or observation forms). You can use a table as the one in Appendix A.

Subjects

In this section, describe the subject experts and learners who will participate as evaluators of your materials. Include at least three subject learners, each with different skill levels (e.g., novice, intermediate, and advanced), a SME and another expert (perhaps an instructional designer). Describe the target population and how each subject learner relates to the target population. For all evaluators—experts and learners— give their names and roles; describe the skills, knowledge, and experience. This is not an anonymous activity with random selection because you as the designer will know whom you are meeting with. The designer should be able to select the learner based on how well they represent the target population, their prior skill level, and ability to learn.

Instruments

List and describe each instrument in this section. Refer to the actual instrument in the Appendices. Description of each instrument should include specific purpose and number and types of items, purpose of the interview, etc. The Appendix is where you will present the actual instrument and questions.

Procedures

In this section you are to briefly describe the procedures that you will employ to conduct the formative evaluation. Describe in step-by-step fashion the activities that you will carry out. Expand on the actual evaluation procedures (protocols) in the Appendices. See Chapter 11 Job Aid for details and examples of procedures and activities for conducting a one-to-one formative evaluation.

APPENDIX A
EXAMPLE OVERALL PLAN

Phase

Evaluator

Date

Target

Instruments

Expert Reviews

Design expert name

August 3, 2018

Goals & Objectives,

Assessment

Instructional Strategy.

Questionnaire

Interview questions

Subject matter expert name

August 7, 2018

Goals & Objectives

Assessment

Interview questions

One-to-One Evaluations

Student (High Achievement) Name

August 7, 2018

Course Content

Assessments

Observation forms & interview questions /protocol

Student (Middle Achievement) Name

August 9, 2018

Course Content

Assessments

Observation forms & interview questions /protocol

Student (Low Achievement) Name

August 9, 2018

Course Content

Assessments

Observation forms & interview questions /protocol

APPENDIX B

EXAMPPLE INTERVIEW QUESTIONS

PLEASE DO NOT COPY.
YOU NEED TO CREATE YOUR OWN INSTRUMENTS. SEE THE TEXTBOOK FOR EXAMPLES.

Thank you for agreeing to be a part of this study. Your identity and responses to these and other assessments will be kept confidential and reference to you will be coded information.

Questions:

1. Do the handouts and other associated materials identify the appropriate skills?

2. Were the graphics that appeared in the materials appropriate?

3. Were the objectives appropriate for this type of instruction? If not, what is missing or what should be changed?

4. Were the materials clustered and sequenced appropriately?

5. Were the performance criteria appropriate for your needs? If not, why?

6. Did the instructional materials content cover what you expected?

7. Please indicate any other comments, questions or recommendations.

APPENDIX C

EXAMPLE OF QUESTIONNAIRE

PLEASE DO NOT COPY.
YOU NEED TO CREATE YOUR OWN INSTRUMENTS. SEE THE TEXTBOOK FOR EXAMPLES.

N/A = Not applicable

1 = Strongly disagree

2 = Disagree

3 = Neither agree/disagree

4 = Agree

5 = Strongly agree

N/A = Not applicable

1 = Strongly disagree

2 = Disagree

3 = Neither agree/disagree

4 = Agree

5 = Strongly agree

Thank you for agreeing to be a part of this study. Your identity and responses to these and other assessments will be kept confidential and reference to you will be coded information.

Instructions: Please circle your rating regarding each aspect of the interactive multimedia package.

1. The objectives were clear N/A 1 2 3 4 5

2. The materials stimulated my learning N/A 1 2 3 4 5

3. I was given sufficient practice and feedback N/A 1 2 3 4 5

4. The content of this course was appropriate N/A 1 2 3 4 5

5. The instructions were easy to follow N/A 1 2 3 4 5

6. This instruction was visually appealing N/A 1 2 3 4 5

7. The layout was appropriate N/A 1 2 3 4 5

8. The layout was professional N/A 1 2 3 4 5

9. I felt my attention was focused on the materials N/A 1 2 3 4 5

10. I was satisfied with the content N/A 1 2 3 4 5

11. The content was relevant to my job N/A 1 2 3 4 5

12. I was confident I could complete the materials N/A 1 2 3 4 5

Comments regarding the instructional materials: