LTSS Roadmap - Step 7: Evaluation

Once your community has developed a new LTSS program or modified an existing LTSS program, it is important to thoughtfully consider the results of your efforts. The process of evaluation helps you identify successes and areas in need of change.

The purpose of evaluation is to describe the implementation process and measure progress toward reaching LTSS goals and objectives. In particular, you should seek to measure change.

Basic Questions an Evaluation Should Answer

• How do current outcomes compare to baseline results?
• Has the program achieved intermediate objectives?
• Has the program achieved its stated goal?
• Is the program sustainable?
  • Have the factors driving program cost (e.g., wages, rent, equipment) changed?
  • Is the program generating enough revenue to cover the operating costs?
  • Do evaluation results present ideas for growth or maintenance of services over time?

Key Elements in Evaluating LTSS

• Performance metrics: finding measurable, comparative results
  • Recall which performance metrics you identified during your planning
  • Determine what is happening compared to what was planned
  • Measure and compare preprogram and post-program implementation results on key indicators, including level of satisfaction and collaboration between partners
  • Assess changes at set time intervals (e.g., monthly, quarterly, or yearly)
  • Compare health status of those who are receiving one program or service to those who are receiving another
  • Examples of performance measures:
  • (PDF)
    Example Metric: Comparing Program Participation Over Time 
  • (PDF)
    Example Metric: Changes in Service Delivery Over Time
  • Measurable objectives
    • Did you achieve your stated objectives? If not, is LTSS performance moving in the right direction, according to your performance metrics?
  • What are the lessons learned from both met and unmet objectives?
    • How can you leverage successes and learn from mistakes in the future?
    • What modifications do you need to put into place to realize your community’s LTSS objectives?
  • Effectiveness
    • What was the impact of the program on selected indicators?
    • Were desired outcomes achieved?
  • Efficiency
    • Identify the relationship between resource utilization and LTSS outcomes
• Develop a logic model:
  
  (PDF)
  
  Example Logic Model
  • Definition:
    • A logic model provides a picture of what you plan to do and the results you hope to see
  • What it does: Looks at what you have (resources), what activities you are going to conduct, targets for the activities (outputs), and short- and long-term outcomes from program
  • Purpose
    • Provides a structure for your evaluation

Evaluation is a Continuous Process

After evaluating your community’s newly established or modified LTSS program, use these results for program improvement efforts. Similarly, continue to measure and assess LTSS needs in your community. Since your community is constantly changing and evolving, whether in demographic composition or health status, your LTSS program should routinely and systematically assess if the services provided by the program reflect community needs. This approach supports and ensures continuous program improvement. Most importantly, it help your community achieve its goal of providing your elders with access to high quality, culturally appropriate LTSS.