"Providing support and training to help those living with dementia"


Program Development and Evaluation

Programs are a non-profit organization’s mission in action. Through programs, you reach out to those in need of your services. Strong programs are tied to the organization’s strategic plan and they follow a logic model anchored with outcomes and measures. Program evaluation is the cornerstone of continuous improvement and necessary for acquiring and sustaining funding.

Contact us if your organization needs assistance in developing new programs or expanding and improving existing programs. Advantage Consulting Services provides training for staff and volunteers so that you can conduct effective program evaluations. We can also do your program evaluations for you, or help you design surveys and questionnaires, pre-and post-testing, facilitate focus groups, and compile evaluation reports you can share with funders and donors.

6 Cornerstones for Solid Program Planning

With these cornerstones in place, the non-profit is assured of a program plan that has a strong foundation and can survive multiple changes as the program develops.

Program Planning Should Tie in With Strategic Planning

Depending on the nature of the organization, strategic planning typically includes review of the organization's vision, mission, values, overall issues and goals (each of which often becomes a program) and strategies to reach the goals (strategies to reach the goals often are the roadmap for how the program meets its own goals). Because the program planning must be tied to the nature of the organization's mission, the program planning should be closely tied with the organization strategic planning as well. Typically, at a point right after the strategic planning process has identified strategic goals and issues, a team of planners can draft a framework for how goals can be met. This framework is often the roadmap for a new program. (For more information about strategic planning, see Strategic Planning.)

Involve the Board

A major responsibility of boards is to set strategic direction for non-profits. The non-profit's board should be highly involved in authorizing and guiding initial direction for programs. Therefore, boards should be involved in strategic planning of programs. (Admittedly, many experienced executive directors might argue that they actually drive the board to conduct strategic planning. Many experienced practitioners believe that ultimately, it's the working relationship of the board and executive director that determines the success of a non-profit.)

Conduct Program Planning as a Team

The chief executive, key planners on the board, relevant middle managers and major clients should be involved in program planning. "Relevant middle managers" are those who lead programs or other departments that will integrate or coordinate with the new program being planned. Often, initial plans for a program are suggested to the board by the chief executive and sometimes the program managers. Program planning is often initiated as part of the organization's overall strategic planning process and so is conducted by the strategic planning team, which should be comprised of board, the chief executive, staff and key clients, as much as possible.

Program Planning Should Involve Potential Clients as Much as Possible

One can embark on a wonderful program planning process with all the right parts, but if key clients aren't involved to provide perspectives from the program user's point of view, the organization may build a beautiful ladder -- on the wrong roof. Involve clients in initial ideas about a program, discuss your perceived unmet need among those clients, ask how they would like the need to be met. You might run a final draft of your program plan past a couple of key clients. This involvement of clients is a critical aspect of the marketing process as well, because the clients are key to the program's successful implementation and use.

Don't Worry About Developing a Perfect Program Plan

If the organization involves the right people, and if everyone participates wholeheartedly and reflects on their experiences, then the organization will develop the "perfect" plan. The organization remains the only real "expert" on their own planning. Outside consultants and facilitators can be brought in, but each planning decision is ultimately up to the organization members. The "perfect" program plan will meet the nature and needs of the organization.

8 Guidelines to Keep Program Planning on Track

Planning is taking one's best shot at working up a "tree" of decisions that must be made at some time, and the earlier the better, to propose developing a program. Your plan doesn't have to be perfect and, like any plan, it isn't a rule. Rather, it's a set of guidelines that serve as reference for the future. You can change your plans -- just know why and be able to explain (e.g., to your board and funder) why you changed the plans. This planning effort is almost always more than non-profit personnel want to undertake, but is almost always less than they fear. Regardless, this planning effort is required if the non-profit plans to pursue funding in the form of grants.

The following guidelines will help ensure the program planning process points in the right direction and will help ensure the resulting program is run effectively and efficiently.

Focus on Outcomes

Outcomes are benefits to clients from participation in the program. Outcomes are usually in terms of enhanced learning (knowledge, perceptions/attitudes or skills) or conditions, e.g., increased literacy, self-reliance, etc. Outcomes are often confused with program outputs or units of services, e.g., the number of clients who went through a program. (For more information about outcomes, see Program Evaluation.)

Examine Your Intended Outcomes - Conduct Some Basic Marketing

We've noted that the intended outcomes are the guiding light for a system. Therefore, it's critical to verify that these planned outcomes are indeed useful to someone in your community. Many people mistakenly believe that marketing is selling a product or idea -- selling is only part of marketing. Sound marketing includes researching a market to identify its needs or to assess if an idea you already have is really needed by that market. (A market is a group of people or organizations that may buy or need your program services). Basically, you're verifying there's a group of clients who are interested in, or even better, really need your planned service or product. Marketing also includes working with clients to identify how they prefer to have the service delivered. Marketing gives a strong impression of how much they're willing to pay for this service -- or what to set the price at for the service.

Non-profits typically don't place the same high priority on setting prices that for-profits do. However, funders won't support a program indefinitely. The non-profit is always wise to explore what revenue can be generated from a service to offset its operating costs. Non-profits that relied on federal funding would be wise to plan programs that recover costs through the use of fees because the federal government is substantially reducing its contributions to non-profits.

Coordinate the New Program with Other Current Programs So often, in the excitement of the birth of a new program, we ignore precious resources that already exist. The new program is but part of an overall organization, an overall system. Pay particular attention to how the new program will coordinate with other programs in the organization. What inputs are needed from other managers and other programs? What ongoing feedback is needed among members of the new program and other programs? How can the new program benefit other programs?

Explore if Client Services Can Be Delivered More Effectively via Collaboration

Successful collaboration brings two or more organizations together to work in synergy, in an effort that is "more than the sum of its parts." That is, if both organizations worked apart, both would serve clients and produce some benefits -- but not as many and as well as if both organizations worked together. In working together, there's an economy of scale, or sharing of resources, that lowers costs and focuses more resources on serving clients.

An increasing number of funders are requiring evidence of collaboration planning from non-profits applying for funding. Many non-profit leaders naturally struggle with the notion of collaboration, of sharing resources and control with other organizations. Collaboration can be quite frustrating for non-profit leaders. This dilemma invites leaders to carefully consider whom it is that they really want to serve. If collaboration will better serve clients (and it usually will) and better serving clients is the overall goal, then collaboration should be attempted.

Plan Key Indicators of Program Success

These planned indicators will help you establish whether the program is successful or not, and will help you avoid doing a program for the sake of a program. Consider planning indicators associated with intended outcomes, e.g., "increased self-reliance (an outcome) for 70% of adult, African American women living in the inner city of Minneapolis as evidenced by the following measures (indicators) ...". An outcomes-based evaluation will help you ascertain if you've reached this indicator or not. You can also resort to indicators in terms of outputs (tangible results), e.g., amount of clients served, money made, milestones accomplished, measures of satisfaction among clients per questionnaires, etc. (Note that many evaluators will assert that measuring outputs is not a valid determination of whether outcomes have been reached or not.)

If you struggle with identifying key indicators of success, then imagine the program operating in a highly successful manner at some time in the future. Then describe what features of the program indicate that the program is successful.

Include Short-Range Focus in a Long-Range Plan

Getting the program off on the right foot includes not falling over your own feet because you were looking far off into the distance. Many non-profit strategic plans are usually three years in scope, with particular planning focus on the first year of the three years. Follow this format for the program planning as well. Don't worry about exhaustive detail even in the first year of the plan. Plans are guidelines, not rules. Plans can be changed -- but understand why you changed them.

Learn by "Testing the Waters"

Consider planning a six-month or one-year pilot effort. The pilot will be a sort of mini-program that will reflect many of the aspects of a full-blown program. However, planning and operations regarding the pilot will include numerous reviews and assessments from which to learn from experiences around the pilot program. This learning will go into planning for the full-blown program. Note that funders are often highly cooperative in funding pilots as an approach to research or verify the non-profit's proposed plans.

Plan Program Reviews

Program reviews are regular examinations of the program's activities to assess how the program is doing. A program review team should probably include the chief executive, the head of the new program and one or two other program directors, particularly those from programs that closely coordinate with the new program. A board planner should be involved, if possible. Examine if the program seems to be following the original plan. If it's not, the deviation is not as important as understanding why and assessing if the deviation was necessary. Take a look at the key indicators as noted in the plan. What is the progress toward the key indicators? What major problems exist and what is needed to address them? How are the actual costs comparing to the planned costs? Are any actions needed to avoid financial problems? What would you do differently about the program if you could do anything? What limitations are holding you back from what you would ideally do if you could? What are you learning from the program implementation so far?

Program Evaluation

Programs should be evaluated on a yearly basis to discern if the programs are reaching their goals, achieving their outcomes and if they are doing so in an efficient manner. Small non-profits seldom have the resources to conduct evaluations of a program's goals, outcomes and process. However, they can think about where they have the most concerns about a program and then gear an evaluation to look at that aspect of the program.

Program evaluation holds numerous advantages. It can verify or increase the impact (or outcomes) on constituents. It can fine tune delivery of program services, which, in turn, saves costs and time. Evaluations often provide wonderful client testimonials that can be used for public relations and credibility when applying for funding. In fact, evaluations are often used by program planners to ensure that the program is indeed carrying out the original process planned for the program in the first place. Often, non-profit leaders develop a program plan which ends up changing dramatically over time as program staff are overcome by events. Program processes can naturally deviate from the original plan because program plans were flawed in the first place, the program's environment changed a great deal or program staff simply found a much better way to deliver services to clients.



© Advantage Consulting Services, LLC doug@advantageconsultingservices.org