Wednesday, October 29, 2008

Data Quality - A Case of Common Courtesy and Consideration

The term "data" often conjures up images of computer rooms and technicians. Although data are the building blocks for information, knowledge, wisdom, and enlightenment, they have become common elements of our everyday lives. Technology accelerated the creation and consumption of information, moving us squarely into the Information Age. Clearly, when the quality of data and information isn't adequate, our everyday lives can be adversely impacted. So, what does all this have to do with common courtesy?

What happens when someone doesn't put the lid down tightly on the garbage can? The next person to take out the garbage can be faced with a huge mess to clean up. What about when someone fails to replenish the paper towels when they run out? It may be that the next person who has to immediately address a major spill won't have the paper towels to do the job. Those scenarios are pretty common and the recipient of the garbage mess or the lack of paper towels is likely thinking, "if only so-and-so had...".

The idea is that if the people not putting the lid on tight or using up the last of the paper towels had been thinking about, aware of, or cared about what people's experiences would be like who would inherit their mess or lack of paper towels, there wouldn't be a mess and the roll of paper towels would be there for the next calamity. Common courtesy suggests that people consider others who come after them and ensure those people are set up to succeed. That kind of consideration requires understanding what the needs of others are and doing things to ensure those needs are met.

Data quality is no different. True data quality improvement comes from behavior changes in people. Technology plays a part, for sure, but if people begin to understand who uses the data they create and how to create the data in a way that sets the next people up for success, the overall state of data will improve...simply because people change the way they think about data and about others who use it.

Do you know who uses the data you create and are you doing what's necessary to set those people up for success?

2 comments:

C said...

I agree with you

Data Quality is so important with new technologies and our new need of information.

The job is very interesting to discover error of data and to analyse a solution thanks IT dpt.

Do you use specials softs ?

Eric Salzer said...

Software tools have evolved much in the data quality management space and are sophisticated enough to allow talented analysts to inspect, profile, and monitor data quality. I'm currently surrounded with very effective SQL people who can do this work at a fundamental level. So, well-crafted queries with strong data analysis are the tools I use.

I've found that there are two approaches to addressing data quality in organizations. One is to take an IT outward approach. That is, concentrate studies of data in databases using powerful tools and talented people. This yields a long list of quality issues.

An alternative approach is to look at data quality from the outside in (e.g., from the customer's view - whether or not the customer is external or internal). This is the method I prefer because it focuses quality improvement on the data that is consumed which is usually the data that is most important.