Expert insights. Personalized for you.
It turns out that in the era of big data, we’re about to run out of metric system: Yotta- , signifying 10^24, is the only metrix prefix left on the list. I recently came across two very different pieces of evidence showing how big a deal big data is. The first is the great thirst mainstream organizations have for analytic talent. A friend who works at PWC called me up a little while ago to ask if I knew of any data jocks who were looking for work. MORE
So I guess it’s time for me to learn more about UX metrics. They say, if it moves measure it. I’ve been finding myself thinking a lot about how to measure UX lately — mainly to realize that I halfway don’t believe it’s possible. My gripe is that even if you can regularly track and look at numbers (itself no small feat), it’s hard to know what they mean exactly. MORE
I’ve been reading Social Media Metrics Secrets by John Lovett who is a senior partner at Web Analytics Demystified where Eric T. I’ve referred several Packard grantees who have used John Lovett’s social analytics framework to help them think through social media metrics. I sent a tweet to John asking if there was a blank copy and he sent me a blank one with permission to hack and share. How are you curating your organization’s social media metrics? MORE
Methods and Metrics for Assessing Civic Tech, Guest post by Anne Whatley, Network Impact. In addition to tracking app deployments, Code for America has developed metrics that help them understand their impact on the governments they work with, the communities they engage, and the larger civic technology ecosystem. MORE
" When I asked what the "warning signs" he looked for during store visits, signs that management was slipping, he offered two metrics (which he said could be applied to many others retail settings too): 1. Yesterday, we had the CEO of a large retail chain as a visitor in the Stanford class we Huggy Rao and I are teaching on scaling-up excellence. I will refrain from using his name as this a class, not a speech to the public. MORE
stevenberlinjohnson.com « The Battle Of The Books | Main | » "We have for years allowed ourselves to be held hostage to one metric only," says Jay R. Smith, chairman of the Newspaper Association of America (NAA) and president of Cox Newspapers Inc. Newspapers have for the last couple of years been finding whole new pockets of audiences for which they get no credit." MORE
Those in the quantitative data/metrics/benchmarking camp argue against the legitimacy of the notion of “informal” learning. Informal Learning Meta-Learning Metrics of organizational learning Web 2.0Learning Solutions Magazine. Working Smarter: Informal Learning in the Cloud by Jay Cross and Friends. By Jane Bozarth. March 30, 2010. One of the things I like best about Twitter is the collegial, friendly fire-ish banter among L & D professionals. MORE
I'm working on an article around the use of ROI and metrics in eLearning. BPM and workflow technologies have been able to achieve significant gains in productivity Metrics Recently, functional managers have begun using eLearning to meet business objectives. This is where w Return on Investment in Training - Learnativity.com The problem is that nobody is quite sure what the appropriate metrics are for measuring ROI for learning. MORE
Community Metrics of organizational learning Working SmarterFourth post in a series. In case you missed them, here are the first , second , and third posts. Is your organization ready? How ready are you to tackle Big L Learning? Where does your organization fit on the progression from Hierarchical Organization to Collaborative Organization? You can take this survey online. We’ll report the aggregate results in a couple of weeks. MORE
The other is about using data to make decisions, but for the start up audience. They have some ideas in common – including finding the “One Metric that Matters.” My favorite snippet in the book is “The One Metric That Matters” which encourages an to focus on that one key important metric that determines success. When you know what the right question is, you’ll know what metric to track in order to answer that question. MORE
Marino Morino, who wrote “ Leap of Reason: Managing to Outcomes in an Era of Scarcity ” pointed me to this recent report, “ Transactions, Transformations, Translations: Metrics That Matter for Building, Scaling and Funding Social Movements ” by Manual Pastor, Jennifer Ito, and Rachel Rosner with the USC Program for Environmental and Regional Equity and funded by the Ford Foundation. Anyone out there using metrics to measure movements? MORE
Mari Smith pointed to this blog post from All Facebook explaining the metric and how it has been implemented in apps. The people talking about this metric tallies: Liking a page; Posting to a page’s wall; Liking, commenting, or sharing a page’s status update, photo, video, or other content; Answering a question posted by a page; RSVPing to an event hosted by the page; Mentioning the page (users must formally tag the page); Tagging a page in a photo; Liking or sharing a check-in deal, and. MORE
Beth Kanter shares her presentation on Mapping metrics to strategy (with slide show) focused on non-profits using social media: The session will share an overview of why the sequence listen, learn, and adapt is critical to implementing a successful social media strategy. We’ll examine what can and can’t be quantified as well as various metrics and analytics tools. MORE
ROI – Flaws in the Metrics System. Tags: General Informal Learning Metrics Social After a lengthy hibernation, Learning Light ’s eLearning Centre rides again! From a press release yesterday: Learning Light has now launched the new look and feel e-learning centre. Check it out for news, views, jobs, reports, research papers and supplier directory. The e-Learning Centre is a free information resource for learning and development professionals and e-learning developers. MORE
Metrics of organizational learning Psychology Well-beingCLO , October 2012. When I was 5 years old my mother always told me that happiness was the key to life. When I went to school, they asked me what I wanted to be when I grew up. I wrote down ‘happy.’ They told me I didn’t understand the assignment, and I told them they didn’t understand life.” John Lennon. Humans are driven by their emotions. We make most decisions subconsciously, in the emotional brain. MORE
As I explained about social media metrics, but applies here too, you should be iterating until you achieve the metrics you’ve set. Which requires, of course, that you set metrics about what your solution should achieve. MORE
Focus on the metrics and your vision is limited. The post The myopia of metrics appeared first on Cognitive Edge. I still have affectionate memories of my slide rule. We learnt how to use them around 14 or so and while they took away the mechanical aspects of computation you still had to have a sense of scale – the power of ten you had to work out in your head. MORE
“In Strategic Doing, metrics play a different role. We use metrics to facilitate learning. Metrics provide a convenient tool to accelerate our learning. Tweet Comparing Strategic Planning and Strategic Doing. Whereas strategic planning is a deductive process of thought and action, Strategic Doing using inductive reasoning. We learn as we do. With them, we figure out what works. Without them, we would be lost. MORE
” The discipline of measurement help you analyze what lies beneath those numbers, and uses that insight to improve your practices. You set objectives, create and implement strategy, identify key metrics, make changes based on your research, then gather new data, then make more changes, then gather more data, and on and on. Measurement of your processes and results—where you spend your time and money and what you get out of it—helps you make better decisions. MORE
MetricsRecognition of Non-formal and Informal Learning. Fifteen years ago, “the OECD education ministers agreed to develop strategies for ‘lifelong learning for all’ &# They still don’t have it right. Who are these guys? MORE
One of the many topics discussed was the use of social media to track metrics and correlate these with organizational success metrics. A range of other very specific insights were generated from the analysis, and these metrics are now tracked on an ongoing basis. This week I was MC for the AHRI HR Technology conference , and ran one of the workshops on the following day, on Creating Results Using Social Media. MORE
I found this wonderful infographic that takes you through the process of setting goals, making them measurable, picking your metrics, and making decisions based on your data. This is a general rule of thumb that you should test and adapt for your audience. Watch for signs in your metrics that you’re posting too frequently. The most important practice is the sense-making of comparing my content to metrics and getting ideas of what to test next. MORE
I’ve been facilitating a peer learning group with Packard Foundation grantees during the past year with a goal of improving measurement practice for social media and based on my book, “ Measuring the Networked Nonprofit.” ” Each organization is working on an action learning project that is a small, doable measurement project that applies the frameworks and steps in the book. MORE
Just Jay Metrics of organizational learning In the last twenty years of the twentieth century, investors shifted from Industrial Age thinking to Knowledge Era thinking. The shift changed how owners value businesses. The change is fundamental to optimizing return on investment, but sadly many L&D managers are mired in mid-twentieth century thinking. In the Industrial Age, tangible assets produced wealth, so investors put their money on plant and equipment. MORE
There’s no cookie-cutter formula for applying metrics, but there is an underlying process. The Metrics Cycle. There’s no cookie-cutter formula for applying metrics, but there is an underlying process. Generally, you’ll follow these five steps to identify, agree upon, assess and use metrics. The only valid metrics for corporate learning are business metrics. Once you’ve settled on the project and its metrics, get it in writing. CLO magazine. MORE
Jay Cross examines decision making on learning at work, and gives the lie to some myths about the use of business metrics. Common measures are gain in market share, increased revenue, customer satisfaction, and other business metrics. All learning, informal or formal and anything inbetween, should be evaluated with the same metric: whether people who participate in it are doing the job. Tags: Metrics of organizational learning MORE
Like others, I have been seduced by the “what X are you” quizzes on FaceBook. I certainly understand why they’re compelling, but I’ve begun to worry about just why they’re so prevalent. And I’m a wee bit concerned. People like to know things about themselves. MORE
LMS learners waste up to 40 percent of their time due to "frustrating experiences" with online courses, per eLearning Industry. 1 This statistic indicates that many eLearning courses aren’t as effective as they should be, but measuring the effectiveness of each course exactly can be a complex process. eLearning LMS LMS Reporting MORE
That’s why Return on Intangibles is the most important metric in the CLO’s toolkit. Management Innovation Metrics of organizational learning Profit This article appears in the October 2013 issue of Chief Learning Officer. Understanding learning’s value depends on measuring what can’t be touched. . In his marvelous book Intellectual Capital , Tom Stewart asked, “ What’s new? MORE
I continue to get asked about social learning metrics. Until we get around to a whitepaper or something on metrics, here’re some thoughts: Frankly, the problem with Kirkpatrick (sort of like with LMS’ and ADDIE, *drink*) is not in the concept, but in the execution. Frankly, even activity is a metric. Metrics for informal learning aren’t rocket science, but instead mapping of best principles into specific contexts. MORE
Facebook Rolls Out New Metric: People Talking About. Last night Facebook announced some changes to Insights , the analytics program that we use for tracking Facebook pages, that includes a new metric, “People Talking About.” “People Talking About This” will be the new Facebook metric, both for page owners and Facebook users. Facebook Changes: A Complete Guide – by Mari Smith. View more presentations from Mari Smith. MORE
But only one metric mattered: registrations. But by focusing on the only real metric, it is obvious that the audience for this workshop is not there. Ignoring vanity metrics will free my mind. They deserve my time more than the vanity metrics that may stroke my ego. While your mileage may vary, I would suggest that most freelancers and small businesses could benefit from ignoring vanity metrics. About a year ago I deleted Google Analytics from this website. MORE
Cross then goes on to make the point about the way outcomes are measured; “First, the metrics that people have been using for the past 30 years— using accounting measures—are totally ridiculous. Tags: Metrics of organizational learning Leadership, Intangibles, and Talent Review. MORE
Tags: Making sound decisions Metrics of organizational learning MORE
Tags: Making sound decisions Management Innovation Metrics of organizational learning MORE
Those services can help retail companies improve key metrics like: Online Training LMS Retail TrainingRetail employees help generate a large portion of a business’ revenue by helping shoppers find what they need, suggesting additional purchases, and providing exceptional customer service. MORE
This takes more than jargon and metrics. New book: What Would Andrew Do? by Jay Cross & friends. How to sell senior management on the value of learning. Preview and Table of Contents. 189 pages, $19.99 hard copy or download , $14.99 read-only. Blurb : Chief Learning Officers and training directors are struggling to convince executives they are making a difference. To be successful, they must think and act like business people. MORE
Evidence-Based Management in Action » A Rough But Intriguing Metric for School Assessing a School Principal. What do you think of this metric? Listed below are links to weblogs that reference A Rough But Intriguing Metric for School Assessing a School Principal : Comments. I am a teacher, among other things, and say can that yes that metric works- to a point. Agree it is an imperfect but potentially useful metric. Bob Sutton. MORE
Metrics Related Topics Dave Snowden
JULY 31, 2018
Focus on the metrics and your vision is limited. The post The myopia of metrics appeared first on Cognitive Edge. I still have affectionate memories of my slide rule. We learnt how to use them around 14 or so and while they took away the mechanical aspects of computation you still had to have a sense of scale – the power of ten you had to work out in your head.
Clark Quinn
JUNE 4, 2014
Like others, I have been seduced by the “what X are you” quizzes on FaceBook. I certainly understand why they’re compelling, but I’ve begun to worry about just why they’re so prevalent. And I’m a wee bit concerned. People like to know things about themselves.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Harold Jarche
FEBRUARY 28, 2018
But only one metric mattered: registrations. But by focusing on the only real metric, it is obvious that the audience for this workshop is not there. Ignoring vanity metrics will free my mind. They deserve my time more than the vanity metrics that may stroke my ego. While your mileage may vary, I would suggest that most freelancers and small businesses could benefit from ignoring vanity metrics. About a year ago I deleted Google Analytics from this website.
Clark Quinn
FEBRUARY 1, 2011
I continue to get asked about social learning metrics. Until we get around to a whitepaper or something on metrics, here’re some thoughts: Frankly, the problem with Kirkpatrick (sort of like with LMS’ and ADDIE, *drink*) is not in the concept, but in the execution. Frankly, even activity is a metric. Metrics for informal learning aren’t rocket science, but instead mapping of best principles into specific contexts.
Andy McAfee
OCTOBER 31, 2012
It turns out that in the era of big data, we’re about to run out of metric system: Yotta- , signifying 10^24, is the only metrix prefix left on the list. I recently came across two very different pieces of evidence showing how big a deal big data is. The first is the great thirst mainstream organizations have for analytic talent. A friend who works at PWC called me up a little while ago to ask if I knew of any data jocks who were looking for work.
TOPYX LMS
JUNE 25, 2019
Those services can help retail companies improve key metrics like: Online Training LMS Retail TrainingRetail employees help generate a large portion of a business’ revenue by helping shoppers find what they need, suggesting additional purchases, and providing exceptional customer service.
Harold Jarche
MAY 11, 2009
Beth Kanter shares her presentation on Mapping metrics to strategy (with slide show) focused on non-profits using social media: The session will share an overview of why the sequence listen, learn, and adapt is critical to implementing a successful social media strategy. We’ll examine what can and can’t be quantified as well as various metrics and analytics tools.
Trends in the Living Networks
OCTOBER 14, 2011
One of the many topics discussed was the use of social media to track metrics and correlate these with organizational success metrics. A range of other very specific insights were generated from the analysis, and these metrics are now tracked on an ongoing basis. This week I was MC for the AHRI HR Technology conference , and ran one of the workshops on the following day, on Creating Results Using Social Media.
Beth Kanter
MAY 27, 2015
Methods and Metrics for Assessing Civic Tech, Guest post by Anne Whatley, Network Impact. In addition to tracking app deployments, Code for America has developed metrics that help them understand their impact on the governments they work with, the communities they engage, and the larger civic technology ecosystem.
Jay Cross's Informal Learning
MAY 25, 2009
This takes more than jargon and metrics. New book: What Would Andrew Do? by Jay Cross & friends. How to sell senior management on the value of learning. Preview and Table of Contents. 189 pages, $19.99 hard copy or download , $14.99 read-only. Blurb : Chief Learning Officers and training directors are struggling to convince executives they are making a difference. To be successful, they must think and act like business people.
Tony Karrer
OCTOBER 16, 2007
I'm working on an article around the use of ROI and metrics in eLearning. BPM and workflow technologies have been able to achieve significant gains in productivity Metrics Recently, functional managers have begun using eLearning to meet business objectives. This is where w Return on Investment in Training - Learnativity.com The problem is that nobody is quite sure what the appropriate metrics are for measuring ROI for learning.
Beth Kanter
JANUARY 9, 2012
Marino Morino, who wrote “ Leap of Reason: Managing to Outcomes in an Era of Scarcity ” pointed me to this recent report, “ Transactions, Transformations, Translations: Metrics That Matter for Building, Scaling and Funding Social Movements ” by Manual Pastor, Jennifer Ito, and Rachel Rosner with the USC Program for Environmental and Regional Equity and funded by the Ford Foundation. Anyone out there using metrics to measure movements?
Beth Kanter
NOVEMBER 8, 2011
I’ve been reading Social Media Metrics Secrets by John Lovett who is a senior partner at Web Analytics Demystified where Eric T. I’ve referred several Packard grantees who have used John Lovett’s social analytics framework to help them think through social media metrics. I sent a tweet to John asking if there was a blank copy and he sent me a blank one with permission to hack and share. How are you curating your organization’s social media metrics?
Adaptive Path
FEBRUARY 16, 2011
So I guess it’s time for me to learn more about UX metrics. They say, if it moves measure it. I’ve been finding myself thinking a lot about how to measure UX lately — mainly to realize that I halfway don’t believe it’s possible. My gripe is that even if you can regularly track and look at numbers (itself no small feat), it’s hard to know what they mean exactly.
Bob Sutton
FEBRUARY 22, 2012
" When I asked what the "warning signs" he looked for during store visits, signs that management was slipping, he offered two metrics (which he said could be applied to many others retail settings too): 1. Yesterday, we had the CEO of a large retail chain as a visitor in the Stanford class we Huggy Rao and I are teaching on scaling-up excellence. I will refrain from using his name as this a class, not a speech to the public.
Beth Kanter
MARCH 5, 2013
The other is about using data to make decisions, but for the start up audience. They have some ideas in common – including finding the “One Metric that Matters.” My favorite snippet in the book is “The One Metric That Matters” which encourages an to focus on that one key important metric that determines success. When you know what the right question is, you’ll know what metric to track in order to answer that question.
Beth Kanter
MAY 31, 2013
I’ve been facilitating a peer learning group with Packard Foundation grantees during the past year with a goal of improving measurement practice for social media and based on my book, “ Measuring the Networked Nonprofit.” ” Each organization is working on an action learning project that is a small, doable measurement project that applies the frameworks and steps in the book.
Beth Kanter
OCTOBER 5, 2011
Mari Smith pointed to this blog post from All Facebook explaining the metric and how it has been implemented in apps. The people talking about this metric tallies: Liking a page; Posting to a page’s wall; Liking, commenting, or sharing a page’s status update, photo, video, or other content; Answering a question posted by a page; RSVPing to an event hosted by the page; Mentioning the page (users must formally tag the page); Tagging a page in a photo; Liking or sharing a check-in deal, and.
Beth Kanter
OCTOBER 3, 2011
Facebook Rolls Out New Metric: People Talking About. Last night Facebook announced some changes to Insights , the analytics program that we use for tracking Facebook pages, that includes a new metric, “People Talking About.” “People Talking About This” will be the new Facebook metric, both for page owners and Facebook users. Facebook Changes: A Complete Guide – by Mari Smith. View more presentations from Mari Smith.
Beth Kanter
OCTOBER 11, 2011
” The discipline of measurement help you analyze what lies beneath those numbers, and uses that insight to improve your practices. You set objectives, create and implement strategy, identify key metrics, make changes based on your research, then gather new data, then make more changes, then gather more data, and on and on. Measurement of your processes and results—where you spend your time and money and what you get out of it—helps you make better decisions.
Jay Cross
OCTOBER 6, 2013
That’s why Return on Intangibles is the most important metric in the CLO’s toolkit. Management Innovation Metrics of organizational learning Profit This article appears in the October 2013 issue of Chief Learning Officer. Understanding learning’s value depends on measuring what can’t be touched. . In his marvelous book Intellectual Capital , Tom Stewart asked, “ What’s new?
Beth Kanter
FEBRUARY 16, 2012
I found this wonderful infographic that takes you through the process of setting goals, making them measurable, picking your metrics, and making decisions based on your data. This is a general rule of thumb that you should test and adapt for your audience. Watch for signs in your metrics that you’re posting too frequently. The most important practice is the sense-making of comparing my content to metrics and getting ideas of what to test next.
Jay Cross
JUNE 10, 2013
Just Jay Metrics of organizational learning In the last twenty years of the twentieth century, investors shifted from Industrial Age thinking to Knowledge Era thinking. The shift changed how owners value businesses. The change is fundamental to optimizing return on investment, but sadly many L&D managers are mired in mid-twentieth century thinking. In the Industrial Age, tangible assets produced wealth, so investors put their money on plant and equipment.
Jay Cross
SEPTEMBER 6, 2012
Community Metrics of organizational learning Working SmarterFourth post in a series. In case you missed them, here are the first , second , and third posts. Is your organization ready? How ready are you to tackle Big L Learning? Where does your organization fit on the progression from Hierarchical Organization to Collaborative Organization? You can take this survey online. We’ll report the aggregate results in a couple of weeks.
Jay Cross's Informal Learning
JANUARY 2, 2011
MetricsRecognition of Non-formal and Informal Learning. Fifteen years ago, “the OECD education ministers agreed to develop strategies for ‘lifelong learning for all’ &# They still don’t have it right. Who are these guys?
Jay Cross
JULY 17, 2010
There’s no cookie-cutter formula for applying metrics, but there is an underlying process. The Metrics Cycle. There’s no cookie-cutter formula for applying metrics, but there is an underlying process. Generally, you’ll follow these five steps to identify, agree upon, assess and use metrics. The only valid metrics for corporate learning are business metrics. Once you’ve settled on the project and its metrics, get it in writing. CLO magazine.
Jay Cross's Informal Learning
MARCH 27, 2010
ROI – Flaws in the Metrics System. Tags: General Informal Learning Metrics Social After a lengthy hibernation, Learning Light ’s eLearning Centre rides again! From a press release yesterday: Learning Light has now launched the new look and feel e-learning centre. Check it out for news, views, jobs, reports, research papers and supplier directory. The e-Learning Centre is a free information resource for learning and development professionals and e-learning developers.
Jay Cross
SEPTEMBER 16, 2012
Metrics of organizational learning Psychology Well-beingCLO , October 2012. When I was 5 years old my mother always told me that happiness was the key to life. When I went to school, they asked me what I wanted to be when I grew up. I wrote down ‘happy.’ They told me I didn’t understand the assignment, and I told them they didn’t understand life.” John Lennon. Humans are driven by their emotions. We make most decisions subconsciously, in the emotional brain.
Bob Sutton
JUNE 21, 2011
Evidence-Based Management in Action » A Rough But Intriguing Metric for School Assessing a School Principal. What do you think of this metric? Listed below are links to weblogs that reference A Rough But Intriguing Metric for School Assessing a School Principal : Comments. I am a teacher, among other things, and say can that yes that metric works- to a point. Agree it is an imperfect but potentially useful metric. Bob Sutton.
Jay Cross
FEBRUARY 2, 2010
Tags: Making sound decisions Metrics of organizational learning
Jay Cross
JANUARY 19, 2010
Cross then goes on to make the point about the way outcomes are measured; “First, the metrics that people have been using for the past 30 years— using accounting measures—are totally ridiculous. Tags: Metrics of organizational learning Leadership, Intangibles, and Talent Review.
Jay Cross
MARCH 14, 2010
Jay Cross examines decision making on learning at work, and gives the lie to some myths about the use of business metrics. Common measures are gain in market share, increased revenue, customer satisfaction, and other business metrics. All learning, informal or formal and anything inbetween, should be evaluated with the same metric: whether people who participate in it are doing the job. Tags: Metrics of organizational learning
Jay Cross
NOVEMBER 7, 2009
Tags: Metrics of improving organizational learning
Jay Cross
MARCH 30, 2010
Those in the quantitative data/metrics/benchmarking camp argue against the legitimacy of the notion of “informal” learning. Informal Learning Meta-Learning Metrics of organizational learning Web 2.0Learning Solutions Magazine. Working Smarter: Informal Learning in the Cloud by Jay Cross and Friends. By Jane Bozarth. March 30, 2010. One of the things I like best about Twitter is the collegial, friendly fire-ish banter among L & D professionals.
Jay Cross
FEBRUARY 19, 2010
Tags: Metrics of organizational learning The process of Innovation
Jay Cross
JUNE 12, 2010
Tags: Increasing profitability Making sound decisions Management Innovation Metrics of organizational learning
Jay Cross
JANUARY 11, 2010
Tags: Making sound decisions Management Innovation Metrics of organizational learning
Clark Quinn
SEPTEMBER 7, 2021
As I explained about social media metrics, but applies here too, you should be iterating until you achieve the metrics you’ve set. Which requires, of course, that you set metrics about what your solution should achieve.
Steven Berlin Johnson
NOVEMBER 30, 2005
stevenberlinjohnson.com « The Battle Of The Books | Main | » "We have for years allowed ourselves to be held hostage to one metric only," says Jay R. Smith, chairman of the Newspaper Association of America (NAA) and president of Cox Newspapers Inc. Newspapers have for the last couple of years been finding whole new pockets of audiences for which they get no credit."
Harold Jarche
FEBRUARY 19, 2012
“In Strategic Doing, metrics play a different role. We use metrics to facilitate learning. Metrics provide a convenient tool to accelerate our learning. Tweet Comparing Strategic Planning and Strategic Doing. Whereas strategic planning is a deductive process of thought and action, Strategic Doing using inductive reasoning. We learn as we do. With them, we figure out what works. Without them, we would be lost.
219 
Let's personalize your content