Big Data, Big Headache?
The U.S. Department of Veterans Affairs (VA) had a big problem with big data.
Just ask Dat Tran, deputy assistant secretary for data governance and analysis at the VA, and the keynote speaker at the Massachusetts Institute of Technology's seventh annual Information Quality Symposium, taking place this week in Cambridge, Mass. As the second-biggest federal agency in the country, the VA has a lot of data -- over 11 petabytes of it, to be exact. But the problem, according to Tran, was the quality of that data. There were repetitive data entries, a lack of interoperability between systems and no "authoritative source" when it came to customer records.
But Tran and his team recently set out to change all that, launching a massive data quality initiative across the VA. Here, according to Tran, are the department's top lessons learned along the way.