The future of data quality work

Up until this point, this book has been based entirely on my experience across the various organizations I have worked with. This final section is different. It is my conjecture and theory about how working in data quality will change over the next 10 years.

Over the last year, we have seen much wider public recognition of the potential of artificial intelligence (AI)-driven large language models (LLMs), such as OpenAI’s Chat-GPT. When combined with major ongoing growth in the perceived importance of data in organizations, there will be a significant shift in how we do data quality work in the future.

This section outlines the key trends I expect to see, and what we as data quality professionals need to do to be prepared.

LLMs

LLMs are a capability driven by AI. They have been trained by being exposed to large quantities of publicly available information via the internet. This training and access to information allows them to respond...