Evaluation in Distance Education and E-Learning: The Unfolding Model (Paperback)

l. Why Do We Need a New Approach to Evaluation in Distance Education and E-Learning?

Distance Education versus E-Learning

The Rapid Expansion of Distance Education and E-Learning

What Is Evaluation?

Why Do We Need a Professional Approach to Evaluation?

What Does a Professional Approach to Evaluation Look Like?

Responding to the Call for a Professional Evaluation Approach: The Unfolding Model

Conclusions: Our Approach to Evaluation

2. The Theory and Practice of Program Evaluation

Why Are Program Evaluation Models Important?

Classification Frameworks for Program Evaluation Models

Alkin and Christie's Evaluation Tree: The Roots and Branches

Where Do We Diverge from Alkin and Christie?

Conclusions

3. Evaluation Theory and Practice in Distance Education and E-Learning

Evaluation Theory

Models with Scientific Evidence in the Foreground

Models Based on Evidence, Values, and Consequences

Models Based on Messick's (1989) Framework

A Summary of Evaluation Models in Distance Education

Evaluation Studies

Evaluation Practice

Do Unintended Consequences Emerge in Authentic Evaluation Studies?

Conclusions

4. Messick's Framework: What Do Evaluators Need to Know?

The Overlap between Test Validity and Program Evaluation

Messick's Contributions

Messick's Framework

The Overlap among the Four Facets

The Controversy over Unintended Consequences

Implications for Evaluation

Conclusions

5. Getting Started

Planning the Evaluation Study

The Ethics Review Process

The Political Context of Evaluation

Using the Unfolding Model as a “Road Map”

Mixed Methods: Blending Quantitative and Qualitative Data

What Is Essential to Our Approach?

Tailoring the Unfolding Model to Your Needs

Conclusions

6. The Unfolding Model: Scientific Evidence

Definition of “Scientific Evidence”

Scientific Evidence

How to Write Good Survey Questions

Using the Unfolding Model to Write Survey and Interview Questions

Administering Surveys

Analyzing Survey Data

Qualitative Data: Interviews, Focus Groups, and Online Ethnographies

Qualitative Data Analysis

Outcomes

The Evaluation of Environmental Quality

Relevance

Cost–Benefit Analysis

Bringing It All Together: Mixed Methods

Conclusions

7. The Unfolding Model: Values and Consequences

Underlying Values

How to Identify the Values Underlying Your Course

Course Goals and Objectives

Writing Survey/Interview Questions about Underlying Values

Analyzing Data on Underlying Values

Unintended Consequences

How Can You Identify Unintended Consequences?

Writing Survey/Interview Questions about Unintended Consequences

Analyzing Data on Unintended Consequences

How to Enhance the Validity of Your Findings

Recommendations for Course Improvement

Writing the Evaluation Report

Conclusions

8. Findings from Two Authentic Case Studies

Methods and Procedures for Both Studies

Distance Learning: Computing Science 200 (CPSC 200)

E-Learning: Professional Writing 110 (PWRIT 110)

Conclusions

9. Bringing It All Together

Using Messick's Framework to Evaluate Distance and E-Learning Courses

Using the Unfolding Model to Evaluate Your Courses

Conducting Your Evaluation Study

What Have We Learned from Two Case Studies?

E-Learning and Beyond: Is the Unfolding Model the Last Word?

The Future of Distance Education and E-Learning

The Future of the Unfolding Model

Conclusions

Appendix A. Summary of the 1994 Program Evaluation Standards

Appendix B. Glossary