Metrics and Knowledge Management

April 24, 2007

This article has been moved here…..

For the longest time ( well, since a couple of weeks ago ) , i’ve been trying to come to grips with how Knowledge Management in theory differs so much from actual practice in corporates.

My previous posts on corporate KM and ROI on KM are an indication of my thoughts on this subject. As those of you who practice KM in the corporate world know, the success of any initiative is determined by its ROI.

The problem of addressing ROI is one which we face on a daily basis. The question they all ask “How do you determine , in numbers , the effect of a KM program?”.

The basis of any analysis is numbers, and the process of collecting “meaningful” numbers, metrics. So, how do you gather metrics on Knowledge Management initiatives? and by that i dont mean how many hits you get on your portal or which document was used the most. These numbers do not mean anything unless put in meaningful context.

While metrics are important there isnt any definite way to capture the benefits of KM. Due to the variable nature of Knowledge a standardized metrics capture process would not give a clear picture of the benefits of knowledge transfer and its re-use.

Now while metrics in KM is a very vague subject, trying to quantify knowledge transfer in a large organization where just getting knowledge to flow is such a challenge, seems an impossible task.

Though at the end of the day its a numbers game, and without metrics backing knowledge management initiatives in the corporate arena, management buy-in seems bleak.

So, for those of you out there who have managed to implement, successfully or otherwise, a KM metrics methodology please feel free to leave comments.


ROI for Knowledge Management, Continued…..

March 27, 2007

This article has been moved here…..

Since i launched this blog a little over a month ago i have recieved a considerable number of responses. While a few of my readers do take the time to leave a comment against a post. There are a large number that send their comments via mail.

I have chosen to put a few of these in my blog as i would hate for my other readers to miss out on this information ( the post was way too large to have it sitting idle in my comments section ) .

Joseph M. Firestone who is the CEO of KMCI sent me one such mail which contains some information regarding the topic of ROI for knowledge management.

The ROI issue in KM is one that surfaces fairly frequently. I think the issue is part of the larger problem of developing good metrics for knowledge processing and KM activities and direct outcomes, But it’s also closely related to the problem of modeling KM impact on other activities and outcomes in the enterprise that it effects indirectly.

If I recall correctly, there was a recent discussion of KM and ROI in the actkm list serv group which you may have seen earlier. It was a pretty good interchange and covered many of the main issues surrounding the subject. I’ve written a few things either on KM and ROI or closely related to it. One piece is here:

http://kmci. org/media/ KMBenefitEstimat ionrev1.PDF

A second is downloadable from the Cutter Consortium site. Go here first:

http://www.adaptive metricscenter. com/media/ BSCdevelopmentsa ndchallenges. pdf

Then here:

http://www.cutter. com/offers/ adaptivescore. html

and download the adaptive scorecard report using their promotion code.

In addition, I’ve also developed a Software Template using Expert Choice providing a very detailed hierarchical ontology identifying descriptors and metrics relating to knowledge and KM processes and knowledge outcomes. The measurement models themselves can be developed using this ontology, along with the measurement methodology (The Analytic Hierarchy Process) associated with Expert Choice. The template is called the Open Enterprise Template because it provides a framework for measuring progress towards the Open Enterprise (See http://www.dkms. com/papers/ openenterpriseex cerptnumb1final. pdf) for more on the Open Enterprise.

Finally, I’ll point out that the issue of ROI is also not a straightforward one because of the issue of monetary ROI versus ROI in terms of values. We know that the relationship between money and value is a non-linear one so that, in general, a person’s first $1,000 units of currency are worth far more than the same person’s last $1,000 units when that person has become a billionaire (at least relative to the person). The fact that the relationship is non-linear raises the issue of value interpretation of improvements in monetary assests resulting from business activities including KM. The paper I’ve mentioned above discusses the value interpretation question and the Open Enterprise Template combined with the AHP methodology provides a way of handling it. The paper also contends that measurement techniques are needed that will allow comparison of monetary and non-monetary values on the same measurement scale.The adaptive scorecard paper puts the possibility of value interpretation
into both KM and Balanced Scorecard contexts

Please feel to comment on any of the other posts as well to enable further discussions on the subject.

ROI for Knowledge Management

March 26, 2007

This article has been moved here…..

As with every business venture , unless there is a solid case built on the ROI chances are the initiative wouldn’t get the backing of the executive team. It’s a numbers game, and without a clear indication of some benefit, in terms of a dollar figure, it get more and more difficult to justify the costs.

Now the reason i started up this post is to get an idea of how companies , if at all, calculate the ROI on a knowledge management initiative. Based on my experience, figuring out where the knowledge is and getting it to flow is tough enough, adding a number value to it seems next to impossible . Sure , there have been methods where people have attempted to calculate it. But the question of a methodology robust enough to calculate the ROI of a KM intiative doesn’t seem to be here as yet, then again i could be wrong.

So, if any of you have managed to implement an accurate ROI calculation in a KM environment i’d love to hear about it. Do leave a comment , against this post so other people can get involved in this discussion.