The Holy Grail: Capturing Elusive Level 3 Evaluation Data


founder and CEO, Phillips Associates
Webinar Recording Details
  • Category
  • Date and Time
    Wed, Jan 11, 2023 at 12PM Pacific / 3PM Eastern
  • Duration
    1 Hour
  • Cost
    $0 (Free)
  • Want Access?
    Register to view the recording.


Are you one of the many L&D professionals who would like to conduct Level 3 evaluations, but don’t? You’re not alone.

According to a recent ATD research study, only 54% of organizations evaluate some learning programs at Level 3 of the five-level evaluation model. To establish real credibility and prove value, you need to measure whether or not participants applied what they learned in a training program back on the job (Level 3 evaluation). Unfortunately, measuring on-the-job behavior change is not something many L&D professionals know much about nor often do. Also, some L&D professionals who are conducting Level 3s have fallen behind recent advances made in evaluation and survey design methodology. Consequently, they likely are collecting data that is either misleading or invalid. 

In this informative, highly engaging session you will learn practical tips and guidelines on how to create Level 3 participant surveys that measure job behavior change. Particular emphasis is given to three crucial areas of survey design: the content of the survey items, formatting of the survey, and the measurement scale used. 

After attending this session, you will be able to:
  • Use facts from a recent Association for Talent Development (ATD) research study to benchmark an organization’s use of Level 3 evaluations
  • Avoid the common mistakes made by many L&D professionals when creating Level 3 evaluation surveys that result in the collection of misleading or invalid data
  • Use twelve tips and best practices for creating valid, scientifically sound Level 3 evaluations

About Ken Phillips, CPTD

Ken delivers all programs and workshops in his signature style: professional, engaging, and approachable. Ken is the founder and CEO of Phillips Associates and the creator and chief architect of the Predictive Learning Analytics™ (PLA) learning evaluation methodology. He has more than 30 years of experience designing learning instruments and assessments. Ken also is the author of more than a dozen published learning instruments. Ken regularly speaks to Association for Talent Development (ATD) groups, university classes, and corporate L&D groups. Since 2008, he has spoken at the annual ATD International Conference and Expo on topics related to measurement and evaluation of learning.

Panel newest members
Digital Sponsors