This book shows the importance of tackling this issue and the variety of ways in which evaluators can address this critical step. The techniques are presented beginning with the most credible, rigorous approaches and moving to the more subjective approaches. The weakest technique (which is using estimates) is made as credible as possible. Consequently, almost 20% of the book is devoted to using estimates, including clear and proven steps for increasing the reliability and validity of the estimation process. Coverage includes: Importance of Isolating the Effects of the Process/Solution Preliminary Issues First Steps Using Control Group Arrangements Using Trend Line Analysis The General Case: Forecasting Expert Estimation Adjustments Credibility Issues
Book Details:
- Author: Jack J. Phillips
- ISBN: 9780787987190
- Year Published: 2008
- Pages: 160
- BISAC: BUS066000, BUSINESS & ECONOMICS/Training
About the Book and Topic:
This book shows the importance of tackling this issue and the variety of ways in which evaluators can address this critical step. The techniques are presented beginning with the most credible, rigorous approaches and moving to the more subjective approaches. The weakest technique (which is using estimates) is made as credible as possible. Consequently, almost 20% of the book is devoted to using estimates, including clear and proven steps for increasing the reliability and validity of the estimation process. Coverage includes: Importance of Isolating the Effects of the Process/Solution Preliminary Issues First Steps Using Control Group Arrangements Using Trend Line Analysis The General Case: Forecasting Expert Estimation Adjustments Credibility Issues
When a program, project, or initiative is planned and implemented and influences a particular business measure, other influences are inevitably driving the same measure. This step in the ROI Methodology isolates the effect of a solution on the business data, separating it from other factors or influences. Essentially, this step is the No. 1 credibility issue. Without it, there is no linkage to a business impact. The concept of evidence versus proof explains this issue. Collecting data at the different levels provides evidence that a particular program is adding value. Isolating the effects of the program on the impact data provides the proof that it is adding business value.
Addresses Most Critical Challenge in ROI: This topic is the most critical challenge in ROI evaluation. Without tackling this issue, an impact study will not be credible, even to be point of being invalid. It is an essential step in any type of impact and ROI analysis as well as any major program evaluation study. Fills a Key Void. This book fills an important void in the literature from all perspectivesthe practitioners who must have a credible analysis; researchers who must have alternatives to more sophisticated processes; and executives who are aware of the many influences at play and need some understanding about how this particular program has helped the business. Credible Techniques. To bring credibility to a project, isolating the effects of the program on business data must be addressed. The reality of the workplace is that the most credible techniques will not usually apply or will not work effectively in the organizational setting. Consequently, more subjective approaches must be taken. Researchers and practitioners alike need assurances of the validity and reliability of these processes. First of its Kind. What makes this book unique is its focus on using expert estimations for isolating the effects of a program or solution. When estimates are taken, the results are adjusted for the error of the estimate. Although more credible processes are always recommended and estimates are to be used only as a last scenario, most projects will use this method. This book provides more detail on this technique, including more supporting research and validation than is in print anywhere. ROI Institute Connection. The leaders in measurement and ROI research, pedagogy, tools, case studies, and programs, the ROI Institute has delivered workshops to more than 25,000 training professionals — offered in almost every major international city. Routine offerings of one- and two-day workshops sponsored by ASTD and other organizations and are offered about 40 times per year by the Institute. The Series will be an indispensable tool to support ROI Institute workshops, certification programs, and as handouts on particular topics and aggressively marketed and promoted by the Institute.
About the Author
Dr. Jack J. Phillips is chairman of the ROI Institute. A world-renowned expert on measurement and evaluation, Phillips provides consulting services for Fortune 500 companies and workshops for major conference providers throughout the world. Phillips is also the author or editor of more than 30 books and more than 100 articles. His expertise in measurement and evaluation is based on more than 27 years of corporate experience in five industries. Phillips has served as training and development manager at two Fortune 500 firms, senior HR officer at two firms, president of a regional federal savings bank, and management professor at a major state university. The ROI Institute, Inc. is a benchmarking, research, information sharing organization that provides consulting services, workshops, and certification in the ROI methodology. Widely considered leading authorities on evaluation and measurement of learning and development in organizations, the Institute annually conducts workshops and offers certifications for thousands of practitioners through a variety of strategic partners, including ASTD, Bloom, Knowledge Advisors, Meeting Professionals International, SAP Education, University Alliance, Worldwide Association of Business Coaches, and more than 25 international partners. The Institutes main office is in Chelsea, AL.