ROI and Metrics in eLearning

Tony Karrer

I'm working on an article around the use of ROI and metrics in eLearning. This level of evaluation will increase the visibility of learning and development efforts, because successful implementation of Level 3 evaluation Internet Time Blog: ROI is toast. ROI is toast. Support - ROI Calculator Training & Support Return on Investment Calculator Investing in Learning: Consider Value, Not Just ROI ROI, or return on investment, is king in today's business world.

Not Your Father’s ROI

Jay Cross

Productivity in a Networked era: Not Your Father’s ROI. Networked organizations are reaping rewards for connecting people, know-how and ideas at an ever-faster pace. But like Pontiacs and Oldsmobiles, old-school ROI’s day in the sun is waning. Traditional ROI.

ROI 61

Trending Sources

Relevance Trumps ROI

Jay Cross

A focus on formal school or executive education-type learning involving tests, for example, may not provide valuable metrics anyway, Cross said, because grades or test results in school are unrelated to anything outside of school.

ROI 39

UX Metrics for Noobs and Skeptics: An Interview With Richard Dalton

Adaptive Path

And yet, without understanding the quantifiable effects, it’s very difficult to know or show what impact user experience is having in an organization. So I guess it’s time for me to learn more about UX metrics. MX: Managing Experience Management ROI/Business ValueThey say, if it moves measure it. I’ve been finding myself thinking a lot about how to measure UX lately — mainly to realize that I halfway don’t believe it’s possible.

ROI 52

Measure what’s important

Jay Cross

Most business managers recognize that they’re managing a living organization, not a balance sheet, but many managers of L&D are still in a fog. Because they’ve learned a narrow view of Return on Investment, namely ROI as seen through the eyes of a bank loan officer.

High time for ROI

Jay Cross

Scouts live by metrics. Following a keynote by Ed Cohen, former CLO at Booz and now head of Satyam Computer Services’ School of Leadership, we launched into a ThinkTank session chaired by Cedric Coco of Lowe’s with observations from Kent Barnett (Knowledge Advisors), Michael Echols (Bellevue University’s Human Capital Lab), and Patti Phillips (of The ROI Institute). Issue: What are the biggest mistakes in installing HR metrics? ROI is the answer.


Jay’s new book on learning metrics

Jay Cross's Informal Learning

This takes more than jargon and metrics. If you can do that, convincing your organization shouldn’t be a problem. ROI, just ask yourself “What would Andrew. The false precision of ROI comes from looking. New book: What Would Andrew Do? by Jay Cross & friends.

How to Replace Top-Down Training with Collaborative Learning (4)

Jay Cross

Is your organization ready? Where does your organization fit on the progression from Hierarchical Organization to Collaborative Organization? If you checked fewer than five ”yes” boxes, your organization is trailing the mainstream. Fourth post in a series.

What is stopping companies from measuring learning: Skillsets, datasets, toolsets or mindsets?


In short, learning and development organizations and departments are suffering from an analytics crisis. L&D is no different—except to the extent that professionals must work even harder to demonstrate impactful training outcomes and ROI. "In

Why Your Nonprofit Should Invest in Video As Part Its Communications Strategy

Beth Kanter

And when video is paired with a continuous strategy and clear metrics for success, there is overwhelming evidence showing that it is a crucial, important investment for nonprofits. Finding the ROI. Photo Credit: Tristan Hanson.

Video 57

Playtime is Over: Reflecting on 2015’s Service Experience Conference

Adaptive Path

The third-annual conference took place November 16-17 in San Francisco, bringing together various industries and organizations to address how we design and deliver great service experiences that create value for both people and organizations.

January 2014Nonprofit Blog Carnival: Measurement and Learning

Beth Kanter

The art part is how you articulate your organization’s measure of success and formulate strategies to realize that success. The science part of the equation starts with a solid methodology and tools. Pick Metrics. Photo by Notemily.

Dear C-Suite: We Don’t Do Training Anymore

Dan Pontefract

It’s time to help the C-Suite – aside from Peter Aceto and other learning savvy and employee engagement focused C-Suite leaders – to appreciate and understand that organizations don’t do training anymore.

My top 10 favourite resources from February

Jane Hart

” 4 - Relevance trumps ROI , Jay Cross, 15 February 2012. And what can you do to speed not only adoption, but the adoption of productive practices in your organization? In February I added links to over 100 resources in my 2012 Reading List , but these are my 10 favourite.

Annual M&R Benchmarks Study Released

Beth Kanter

For the past 11 years, this study has gathered comparative metrics from nonprofits on email, social media, social advertising, fundraising, and web engagement.

Data Nerd Alert: Donors Who Give Through Multiple Channels Give the Most

Beth Kanter

With the study’s findings, we can now more confidently say that nonprofits need to adapt to in the way they both engage externally with their supporters as well as organize their efforts internally. How is your organization optimizing integrated marketing to enhance the donor experience?

Data 28

Edge Perspectives with John Hagel: Community 2.0

John Hagel

This is especially a problem for large companies seeking to organize virtual communities. What are relevant operational metrics? To make it easy, I keep the same acronyms – ROA, ROI and ROS - but just attach different meanings. Besides, ROS has better symmetry with ROA and ROI.

ROI 74

Pushing back

Clark Quinn

You can help them here, doing some business consulting on ROI for them. This may be the path that starts getting your contribution to the organization to start being strategic. You’ll have to start being about more than efficiency metrics (cost/seat/hour; “may as well weigh ’em”) and about how you’re actually impacting the business.

Intangibles matter

Jay Cross

Cross then goes on to make the point about the way outcomes are measured; “First, the metrics that people have been using for the past 30 years— using accounting measures—are totally ridiculous. The ROI stuff is totally bogus and organizations shouldn’t waste their time on it. Tags: Metrics of organizational learning Leadership, Intangibles, and Talent Review.

Decisions, decisions. Business decisions.

Jay Cross

Jay Cross examines decision making on learning at work, and gives the lie to some myths about the use of business metrics. They want their organizations to give them the dots but they want to connect the dots for themselves. need to shrink cycle times throughout our organization.

Working Smarter eFieldbook $12

Jay Cross

The accelerating rate of change in business forces everyone in every organization to make a choice: learn while you work or become obsolete. It’s not a separate function so much as another way of looking at how we organize work. It’s an organization’s learning ecosystem.

eBook 39

My Conversation With Eric Ries on the benefits of Lean Start Up Principles for Nonprofits

Beth Kanter

It is common for entrepreneurs to dodge accountability because being driven by the metrics suggested by the funder can get in the way of success. Funders that ask for ROI to soon create a bad dynamic for innovation.

Open Business – The Narrative vs. The Ruthless Measurement

Luis Suarez

Oh, metrics, what would we do without you in the business world, right? “ As an organization grows and industrializes, it’s tempting to simplify things for the troops. In most organizations, the thing you measure is the thing that will improve. Social Analytics.

Interview with Margret Schmidt, VP of User Experience Design and Research at TiVo (Part 3)

Adaptive Path

Once the redesign was complete, we immediately jumped into the metrics to figure out what needed to be tweaked, and then launched further updates to the home page, “What is TiVo?&# , and “Shop&# based on what what was working, and what wasn’t. This ongoing work is done internally, with user experience as a service organization working for marketing, product management, or customer support (depending on the site section). Part 1 of this interview.

Convert ILT to eLearning - Estimating

Tony Karrer

How will the finished product be implemented within the organization? Does the organization use a learning management system (LMS)? I received an inquiry from a reader and I'm hoping that people can chime in on their thoughts. It relates to my post about eLearning Costs , which bases cost estimates on seat time of the eLearning course. So, the basic question is: We current provide a two day (16 hour) classroom training course for our employees.

CLO Symposium

Jay Cross

“Nobody cares about internal metrics.” “Finance destroys organizations. What was Columbus’s ROI?”

ROI 19

What Are the Chances of Pragmatic Pathways for Social Business?

Luis Suarez

However, these social technologies can’t just be simply inserted in today’s organizations. What key role do they play in the whole power, political, bullying dynamic within organizations?

Edge Perspectives with John Hagel: Wasting Talent

John Hagel

The need for new performance metrics We all know about the growing power of customers, and I have written here about two new forms of performance measurement that will be required to respond to this growing power – return on attention (ROA) and return on information (ROI).

Social Media Planning and Evaluation for NGOs | Full Circle Associates

Nancy White

As people responsible for getting things done in your organization, you know the value of having a clear strategy and a way of evaluating if your strategy is working. Organizations working with limited bandwidth want to block applications to prioritize internet use.


Harold Jarche

Or, more likely, it accrues to other organizations or networks who HAVE figured out how to trust each other. And a post on measuring ROI for soft skills training [because we don't trust workers] and the perversion of individual measurement: Most soft skills deal with our relationships to others. The drive to individually behavioralize, then metricize, has the effect of killing relationships—an ironic outcome for relationship-targeting training.


Edge Perspectives with John Hagel: Mastering New Marketing Practices

John Hagel

Redefine marketing strategy These shifts have broad implications in terms of marketing strategy, branding and marketing performance metrics. We’ll also see a new form of ROI measure – Return On Information, again from both a customer and vendor perspective.

Why Your Nonprofit Should Be A Big Listener

Beth Kanter

Listening to that is very different than just plugging your organization’s name and the most common misspellings into one of these tools and watching the graphs move. 5 Big Listening Helps You Identify Which Angle of Your Issue Has the Best ROI.

ROI 20

Businesses must assess the quality of learning

Jay Cross's Informal Learning

On the organization’s income statement, however, the good, the bad, and the ugly learning experiences all look the same: they are costs. The hand-wringing discussions about the ROI of learning rarely lay out the range of R’s you can achieve with different levels of I.


Financial Investment

Tony Karrer

Should learning organizations make a financial investment in new forms of learning? I would love to have a discussion with him because I think he's missing the point about the importance of metalearning and metacognition and their implications on learning organizations.


State of Assessment by E-Learning Developers

Tony Karrer

11% said they did NO evaluation 26% said they did Level 1 smile sheets 48% said they measured Level 2 learning 15% said they measured Level 3 on-the-job performance 0% said they measured Level 4 business results (or ROI) His discussion further points out that doing Level 2 assessment immediately at the end of training (i.e., Will Thalheimer posted a must-read Assessment Mistakes by E-Learning Developers which I think is mistitled. It should be the "State of Assessment."

Connectivism & Connected Knowledge

Jay Cross

People self-organized in their prefered spaces.


Social Media Planning and Evaluation for NGOs

Nancy White

As people responsible for getting things done in your organization, you know the value of having a clear strategy and a way of evaluating if your strategy is working. Organizations working with limited bandwidth want to block applications to prioritize internet use.


Time Is Money

Jay Cross's Informal Learning

The sooner workers are productive, the larger their contribution to the organization. This makes time-to-performance, the amount of time required to begin performing at target levels, a vital metric. Time-to-performance is a metric a business executive can understand and believe in.

Formalizing and Investing in Informal Learning

Tony Karrer

I just saw a post by David Wilson - Real metrics on Informal Learning that asks about a subject that we would all like to know. This is a fascinating subject for me, because it leads us straight into The Paradox of Informal Learning (Form of Informal?) - which is basically that once you put form and structure to informal learning and try to support it in an organization, it becomes more formal.

Let's just call it what it's a brand name.not learning

Mark Oehlert

Well describe the ROI of learning. I can describe metrics related to an individual''s or an organization''s performance though. I can tell you if that performance changes after contact with a training product or after the deployment of a performance support system - if I have access to establish a baseline and collect the metrics afterwards. mLearning. sLearning. The venerable and ancient eLearning.