Program Logic for the Twenty First Century: A Definitive Guide

By Jackson de Carvalho

Learn how to develop effective, efficient and evaluable programs by following the sample framework provided by Program Logic For The Twenty First Century: A Definitive Guide. The prevailing thought of most program evaluators is that project design should follow a logical framework including relevant indicators, which facilitate the evaluation process to enable program corrections and ensure success. Program Logic For The Twenty First Century: A Definitive Guide, therefore, serves as a comprehensive and easy to follow road map to maximize:
Participation of stakeholders
Reduction of programmatic costs
Achievement of desired outcomes
Program Logic For The Twenty First Century: A Definitive Guide, depicts the pathway to a successful development and implementation of program logic.

• Language: English
• Publisher: Xlibris US
• Release date: Jul 3, 2013
• ISBN: 9781483640549

Jackson de Carvalho

Dr. Jackson de Carvalho, a faculty member of Prairie View A&M University, has a solid experience providing program design, evaluation, strategic planning, and comprehensive grant writing services. Dr. de Carvalho holds two PhDs and a master's degree in the areas of program development, management and evaluation. Dr. de Carvalho is fluent in five languages and has the multicultural sensitivity and capacity to engage organizations to find ways to improve the quality of their services, maintain efficient operations and increase positive outcomes.

Book preview

PROGRAM LOGIC

FOR THE TWENTY FIRST CENTURY

A DEFINITIVE GUIDE

It is easier to arrive when you know

where you’re going and how to get there.

JACKSON DE CARVALHO, PH.D

TABLE OF CONTENTS

ACKNOWLEDGEMENTS

BRIEF OVERVIEW OF CHAPTERS

PREFACE

CHAPTER I

Figure 1: United Way Generalized Model for Program Development

Definition of Key Terms

CHAPTER II

A Brief History of Logic Model Program Framework

A Brief Historical Overview of Program Theory

Figure 2: Chen and Rossi’s Generalized Model for Program Development and Evaluation

Figure 3: Early logic model diagram

Table 1: Theory Approach Logic Model

Outcomes Approach Logic Model

Table 2: Outcomes Approach Logic Model

Activities Approach Logic Model

Table 3: Activities Approach Logic Model

Advantages of Using Logic Models

CHAPTER III

Stakeholder Involvement

Broad Definition of stakeholders.

Narrow Definitions of Stakeholders.

Primary and Secondary Stakeholders.

History of the Stakeholder Concept

Typical Key Stakeholders of a Program

Figure 4: Who are the Stakeholders

Table 4: Identifying Key Stakeholders

Table 5: What Matters to Stakeholders

The Firms Mission Statement and Stakeholders Interests

CHAPTER IV

Evaluation

Benefits of program evaluation

Brief Historical Overview of Evaluation

Evaluation types

Planning Evaluation

Formative Evaluation

Summative evaluations

Predictive Evaluation

Figure 5: Predictive Evaluation Points

Table 6: A Taxonomy of Major Evaluation Types

Figure 6: The CAI Design Model (Hannafin and Peck Design Model)

Figure 7: The Dick and Carey System Approach Model

Table 7: Pre-service and in-service teachers’ responses to hearing the word evaluation

Using Structural Equation Modeling for Program Evaluation

Structural Equation Evaluation Questions

Establishment of Evaluation Plan

Table 8: Evaluation Plan

Figure 8: The Evaluation System Approach Model

Table 9: Checklist for Feasibility and Quality of Evaluation Plan

CHAPTER V

Gathering Archival Data and Organizing Information

Program modeling decisions

Table 10: Checklist for Evaluation Plan

Welcome and Introductions

Stakeholder’s role clarification

Brief Background on program models

Group boundaries and expectations

Begin Developing the Program Logic Model

1. PROGRAM

2. SITUATION AND RATIONAL

Table 11: Competitors and Theirs Strengths.

3. INPUTS

Figure 9: Organizational Chart

Table 12: Program Costs.

Table 13: Program Revenue.

Table 14: Program Expenses.

Table 15: Readiness For Program Development and Implementation.

4. ACTIVITIES

5. OUTPUTS

6. OUTCOMES

Table 16: Readiness For Program Design

7. REFERENCES

Appendix A

Figure 10: Logic Model (example)

Example of a Logic Model & Narrative

Appendix B

Table 17: Work Plan Matrix.

Table 18: Complete Work Plan Matrix

10. Appendix C

10.1 Client Story

ACKNOWLEDGEMENTS

Although this book outlines the culmination of twenty years of program development experience it could not be completed without the expertise of many other professionals. I cannot individually thank all those who helped in the preparation of this publication that list would be long, and they already know our deep gratitude. I am extremely grateful for the many hours and great diversity of ideas contributed by these individuals. The author would like to both acknowledge and thank the many program designers, teachers, and evaluators who assisted in the development of this publication by sharing their experiences, expertise, and resource materials.

BRIEF OVERVIEW OF CHAPTERS

CHAPTER I - explains logic model as a program framework, describes the historical framework of logic models and make suggestions of how and when to use it. In addition, this chapter defines a few key terms and concepts used throughout the document.

CHAPTER II- describes a brief history of logic model program framework while exposing the reader to some of the first logical models based on theoretical framework to pave the way to data driven program development. Additionally, this chapter includes a brief historical overview of program theory for the purpose of elucidating the role of theories in the development of programs.

CHAPTER III - focuses on the clarification of the stakeholder concept including a discussion on the history, categories and identification of key stakeholders for a program. This chapter also includes worksheets to facilitate the identification and recruitment of stakeholders.

CHAPTER IV - reviews and describes the program evaluation process within the parameters of logic model. There is an exercise at the end of this chapter that organizations can use to assess the extent to which they have incorporated the logic model guiding principles and elements into their programs.

CHAPTER V - This chapter describes a program development step-by-step process following the logic model guiding principles and elements. Diagrams of actual projects illustrate the integration of Logic Model components at each stage of project development and demonstrate the link between key elements of a program-integrated approach and project actions.

PREFACE

The increasing scarcity of global resources is forcing organizations to demonstrate greater effectiveness and efficiency of their program activities by conducting outcome-oriented evaluation of projects. The prevailing thought of most program evaluators is that when projects are designed within a logical framework targeting the inclusion of outcome measures it will facilitate the evaluation process and insures ultimate success. Logic model framework will accomplish this by forcing program designers to include evaluable measures to allow decision makers to notice potential problems sooner. As stated in the Kellogg Foundation (2004): As you implement your program, outcome measures enhance program success by assessing your progress from the beginning and all along the way. That makes it possible to notice problems early on. The elements (Outputs, Outcomes, and Impact) that comprise your intended results give you an outline of what is most important to monitor and gauge to determine the effectiveness of your program. You can correct and revise based on your interpretation of the collected data (p. 16).

Subsequently, this guide was developed to provide practical assistance to organizations to engage in this process. In the pages of this guide, we hope to give staff of nonprofits and community members alike sufficient orientation to the underlying principles of logic modeling to use this tool to enhance their program planning, implementation, and dissemination activities.

This workbook was developed for the purpose of elucidating what is fast becoming the most popular framework for program design and evaluation and to serve as a comprehensive guide in the do-it-yourself program development approach. It describes the steps necessary for you to create logic models and Evaluation Matrix for your own programs. This process may take anywhere from a few hours to several days, depending on the complexity of the program being developed. At any rate, we hope this workbook represents a simple and practical tutorials and that you may use it in the way that works best for you:

As a stand-alone guide in the design of logic models for program and grant development

As a basic resource for program evaluation

As a supplement to a logic model training

Feedback on this workbook and suggestions for strengthening it are welcome, and should be addressed to: Dr. Jackson de Carvalho, Ph.D.: [e-mail]

CHAPTER I

A logic model is a commonly-used tool often expressed in the form of diagrams or visual schematics that has the power to communicate the goals of a project clearly and comprehensibly in a single framework or matrix. According to Greenfield, Williams and Eiseman (2006), "A logic model typically offers a simplified visual representation of the