' In the commercial world, 50% have made the change to data lakes or data warehouses are cloud-oriented; while in the federal government it has only been 10%' Brian Boxman, Talend Click To Tweet
Brian Boxman, VP Sales Mid Atlantic and Public Sector, Talend is the guest in the studio today with John Gilroy as moderator. Talkin’ data lakes and data warehouses. He addresses one of the most obvious topics: how to mange the flood of data every federal agency is encountering
Talend helps large organizations collect, transform, cleanse, and move large data sets. During the interview Brian details the differences between data lakes and data warehouses. He suggests that a data lake handles data in a relational manner; a data lake uses a flat file method. For some people, they may think this is borderline “academic,” but it isn’t.
It is probably the most practical differentiation if your agency wants to step into the world of artificial intelligence. Artificial intelligence likes the flexibility of data in a relational storage system. This way, it is unencumbered, and data can be sifted and sorted easier than in a relational database. During the interview, Brian mentions that many people who are interested in AI should examine how the the data they use is stored.
Brian explains that, in order to interoperate at scale, one must understand metadata. Talend has the capability to work with major cloud vendors like Amazon Web Services and Azure. This is important because, in November of 2019, the Office of Management and Budget announced the formation of a Data Council. The idea is to give federal information technology professionals the tools, processes, and capabilities to leverage data as a strategic asset.