Skip navigation.

Weekly Schedule (Outline Mode)

 

Phase 1 Phase 2 Phase 3 Phase 4
Week
Topics/Agenda

Phase 1: Frameworks and approaches (that guide evaluation)  

Week 1: Mon, Aug 28 (5:15 pm)

Log into Blackboard--and then our course site. Choose Communication and then Live Classrooms from the navigation bar. You'll see our session listed.

Introductions 

How the 791 sequence connects to the rest of the EDTEC program

Website and Bb review; HorizonWimba vs. Breeze

Evaluation fundamentals--and how evaluation helps organization meet business needs

Thinking like an investigator

Evaluator "conduct"; characteristics of the "successful' evaluator

Week 2: Mon, Sept 4 (5:15 pm)

RealWorld evaluation and the contexts it addresses 

The seven steps of the RealWorld approach

Week 3: Mon, Sept 11

Determining the "right" time for evaluation; engaging stakeholders in the process

Evaluation approaches---and the "how" that drives decisions about underlying theories, methods, and strategies

Familiarizing yourself with the evaluation literature; a first look at writing an evaluation plan

Servng on an Expert Panel: the task, the logistics

NOTE: Sept 18 is the LAST day to drop or add classes/no exceptions!

 

Phase 2: The evaluator's toolkit (preparing for data gathering)

Week 4: Mon, Sept 18

Strategy 1: review of existing materials (extant data)
  • Conducting a content analysis
  • Using rubrics and checklists
  • Applying principles of sampling to content analysis
  • Aligning content analysis with RealWorld evaluation and other frameworks

NOTE: Sept 18 is the LAST day to drop or add classes/no exceptions!

Week 5: Mon, Sept 25

Strategy 2: surveys (online, print-based)
  • Examples to browse
  • Practice with item writing
  • Applying principles of sampling to survey research
  • Aligning surveys with RealWorld evaluation and other frameworks

Overview of the class project

 

Week 6: Mon, Oct 2

Strategy 2 (cont'd): surveys (online, print-based)
  • Survey administration--does the medium matter?
  • Survey data: analysis, interpretation, reporting
  • Data triangulation

The article critique (template to use; ECR readings from which to choose)

 

Week 7: Mon, Oct 9

Strategy 3: tests
  • Searching for tests online; orientation to the Buros website and Buros print resources
  • Tests: types and kinds
  • Practice with item writing
  • Issues with validity and reliability; analysis challenges
  • Applying principles of sampling to tests
  • Aligning tests with RealWorld evaluation and other frameworks

Download a copy of the client letter for Spring 2007

Week 8: Mon, Oct 16

Strategy 4: interviews and focus groups
  • Practice with protocol development
  • Software solutions
  • Applying principles of sampling to qualitative data gathering
  • Aligning interviews/focus groups with RealWorld evaluation and other frameworks
  • Analysis challenges
  • A first look at the qualitative/quantitative "debate" ... and triangulation

Expert Panel 1 presents this week; download their slides and activity!

DUE: Literature review (class project); download the criteria for scoring your papers

Discuss parameters of data gathering for the class project (tools, logistics, analysis techniques, etc.)

 

Week 9: Mon, Oct 23

Strategy 5: observations
  • Practice with protocol development
  • Automatiing data collection with PDAs and other handhelds
  • Applying principles of sampling to observations
  • Aligning observations with RealWorld evaluation and other frameworks
  • Challenges of data analysis

Expert Panel 2 presents this week; download their slides and activity!

Quiz preparation

 

Phase 3: Evaluation objects (moving from theory to practice)

Week 10:
Mon, Nov 6

Some thoughts about action planning (Strategy 6?)

Quiz available online from Thurs, Nov 9 (6 a.m.) to Sun, Nov 12 (6 pm)

Preparation for client presentations (see the selection form we'll be using)

Expert Panel 3 presents this week; download their slides and activity!

 

Week 11: Mon, Nov 13

Usability (settings and contexts)
  • academia (online courses -- or entire programs of stud)y
  • webisites generally (recognizing that fall into genre or types)
  • instructional programs or other "training" (including products that "stand alone"
  • usability centers
  • branding

Writing an evaluation plan -- exploring the matrices

DUE: Data analysis

 

Phase 4: Data analysis and interpretation -- review of the basics

Week 12:
Mon, Nov 27
Week 13: Mon, Dec 4

Data analysis -- taking the plunge

Quantitative analyses

  • Statistical terminololgy (the basics; the essentials)
  • Distinguishing between descriptive and inferential statistics
  • Parametric v. nonparametric measures

DUE: Article critique due

Week 14: Mon, Dec 11

More on data analysis ... techniques specific to qualitative methods

Putting an interpretative spin on results/findings; generalizing (myths and realities)

Reporting to clients; a final look at the evaluation plan

Transitioniing to 791BC

Launching your OWN studies -- and "play data" for you to explore during the Winter Break

*Due (Dec 14): project report

 

   

Your browser does not support web standards, including Cascading Style Sheets (CSS). This site (and many others) will look better if you upgrade your browser. We recommend Mozilla - it's free, standards-compliant, and fast.