Evaluate

Last updated:January 27, 2006 8:05 PM

Home | Analysis | Design | Develop | Implement | Evaluate

There are two forms of evaluation you need to do: formative and summative.

Formative Evaluation Plan

Create a Formative Evaluation Plan that describes how you would verify that the instructional approach is likely to succeed before it is actually delivered to the learner. Include when such steps would take place in the process and why.

 Since "How To Make Sara Moulton's Vinaigrette" is a prototype of what would be a complex Web site with a good number of similar lessons included, it is crucial to get feedback on the prototype as soon as possible.  The following plan is suggested:

Evaluation Phase	Time Frame	Evaluators	Evaluation Procedure
Design Reviews: Goal Review	Immediately after design plan is complete in order to make initial modifications	Good Foods representatives from management and marketing staffs	Examine goals to determine if they meet instructional goals and needs.
Design Reviews: Environment and Learner Analysis Review	Immediately after design plan is complete in order to make initial modifications	Good Foods representatives from management and marketing staffs	Examine analysis to determine if it accurately reflects the target audience.
Design Reviews: Task Analysis Review	Immediately after design plan is complete in order to make initial modifications	Good Foods representatives from editorial staff (content experts) Another instructional designer Cooking instructor from culinary school	Examine analysis to determine if entry level skills and objectives are realistic.
Design Reviews: Assessment Specifications Review	Immediately after design plan is complete in order to make initial modifications	Good Foods representatives from editorial staff Another instructional designer Cooking instructor from culinary school	Examine assessment plans to determine if assessments and mastery levels are adequate.
Expert Reviews:	Immediately after design reviews are complete and  initial changes are made, in order to make any content changes necessary before presenting to the learners	Good Foods representatives from editorial staff Another instructional designer Cooking instructor from culinary school	Examine content for accuracy, currency, appropriateness to  target learners, consistency with current instructional practice and theories.
Learner Validation: One-to-one evaluation	Immediately after expert reviews have come in and any modifications are made, in order to make any changes to any aspect of instruction before going in to field trials.	Members of target audience	One-to-one evaluation during which the learner: completes the lesson in the test kitchen, while thinking aloud. is videotaped. completes the assessment materials (test and survey).
Learner Validation: Field Trial	Immediately after the one-to-one evaluation is complete and modifications are made, in order to make any modifications before going to general dissemination of instruction	Members of target audience	Post the lesson on the current Good Foods Web site and offer a free Good Foods apron to the first 100 people who complete the lesson and electronically submit an assessment survey.

Summative Evaluation (Kirkpatrick Level 1)

Create a Summative Evaluation including the questions you would use (Kirkpatrick Level 1) that verifies that the materials and learning experience have met expectations.

 Summative evaluations normally take place 1 year after the instructional program is in place.  However, since this lesson is a prototype of what is to come, it is recommended that the summative evaluation occur in two stages.  The first stage would occur as part of the field trial assessment and would give Good Foods the data needed to determine whether to accept the prototype and build additional lessons.  The second stage would occur a year after the full Web-site becomes operational.