Warning: Table './mcsorg_drupal/sessions' is marked as crashed and should be repaired query: SELECT u.*, s.* FROM users u INNER JOIN sessions s ON u.uid = s.uid WHERE s.sid = '92011e23db08a12dd30d904571d23374' in /home/mcsorg/public_html/includes/database.mysql.inc on line 172

Warning: session_start() [function.session-start]: Cannot send session cache limiter - headers already sent (output started at /home/mcsorg/public_html/includes/database.mysql.inc:172) in /home/mcsorg/public_html/includes/bootstrap.inc on line 860

Warning: Cannot modify header information - headers already sent by (output started at /home/mcsorg/public_html/includes/database.mysql.inc:172) in /home/mcsorg/public_html/includes/bootstrap.inc on line 531

Warning: Cannot modify header information - headers already sent by (output started at /home/mcsorg/public_html/includes/database.mysql.inc:172) in /home/mcsorg/public_html/includes/bootstrap.inc on line 532

Warning: Cannot modify header information - headers already sent by (output started at /home/mcsorg/public_html/includes/database.mysql.inc:172) in /home/mcsorg/public_html/includes/bootstrap.inc on line 533

Warning: Cannot modify header information - headers already sent by (output started at /home/mcsorg/public_html/includes/database.mysql.inc:172) in /home/mcsorg/public_html/includes/bootstrap.inc on line 534
How to Rate Program Effectiveness | Management Consulting Services

How to Rate Program Effectiveness

warning: Cannot modify header information - headers already sent by (output started at /home/mcsorg/public_html/includes/database.mysql.inc:172) in /home/mcsorg/public_html/includes/common.inc on line 141.
Jan Beaven's picture

Are our programs having the Impact we want?  Do program Finances justify a program’s viability?  How can we identify strengths and weaknesses?

Executive Directors are striving to cope with shrinking budgets.  If programs must be cut or curtailed, what approach helps with decision making?  Management Consulting Services (MCS) has developed a process and tools for program analysis.   Executive Directors, and their Boards, have found the MCS approach to be helpful.

Step 1.  Develop Program Assessment Criteria

The process begins with definition of the criteria to be used in evaluating programs.  Recently, an MCS client agreed to the following criteria for its programs:

  • Mission fit – How well does the program fit with mission and vision?
  • Impact – What are the benefits to various constituencies?
  • Constituency outcomes – What are they and how are they measured?
    • Qualitative evaluation
    • Quantitative measurement, to extent available
  • Revenue analysis – What are the current and projected revenues?
  • Cost analysis – What are the expenses, inclusive of staff time and overhead?
  • Competitive position – Who else delivers the program? How does our program compare?  Are other programs substantially better?


Step 2. The Program Analysis Grid

With the program criteria determined, MCS created a Program Analysis Grid.   A sample grid for an organization with 9 programs appears below in Decision Tool 1:

The Program Analysis Grid

An organization with this program profile might conclude that Programs F, G, and H are low on organizational impact and on financial contribution.

Step 3.  The Program Matrix

Next, the organization, looking for strong programs with both high impact and adequate financial support, takes the analysis a step further.  Programs are arranged in a program matrix based on their ranking along these lines.  Impact is inclusive of the rankings for mission fit, quality, measurable impact, and competitive position.  Financial contribution is a combination of revenue and expense, along with future expectations of revenue.

In the Program Matrix below, notice that the Quadrant 1 in the matrix is high on both impact and financial viability.  Quadrant 2 is high on mission and mission, but has a lower financial ranking.  With adequate funding, these programs could be very effective.  Quadrant 3 is lower on impact, but financial support is available.  Quadrant 4 is the weakest position, low on impact and low on finance.  These are the programs the organization may divest.  Alternatives would be to knowingly support a financially weak program because it is the “soul” of the agency’s mission or to significantly restructure costs.

The Program Matrix