Despite massive growth in data analytics demand globally, new research shows that there is still much work to be done for organizations to get the most of their data assets and infrastructures, particularly when it comes to data discovery and cataloging.
A new study from data science and analytics firm Alteryx reveals that data professionals are wasting half of their time each week finding, protecting, or preparing data—costing organizations big money.
“It is evident that many professionals are not aware of what resources are available within data assets like data lakes, how to access the data, where it came from, or how to glean trusted insights,” said Langley Eide, chief strategy officer at Alteryx, in a news release. “Unless organizations make changes to their infrastructure now, and close the gaps on data discovery, integrity and cataloging, processes will only become more inefficient as data volume and variety continues to grow.”
Data professionals are spending more time governing, searching and preparing data than they are on extracting business value. Among the findings:
- Data professionals spend 60 percent of their time getting to insight, but just 27 percent of that time is spent on actual analysis. Instead, 37 percent of that “getting to insight” time is spent searching for data and 36 percent of that time is spent preparing data.
- These data workers waste 30 percent of their time—on average 14 hours per week—because they cannot find, protect or prepare data. They waste another 20 percent of their time—10 hours per week—building information assets that already exist. In total, they lose 50 percent of their time every week on unsuccessful activities or repeating efforts.
- Even though data discovery and integrity is important for business, 30 to 50 percent of organizations say they are not where they want to be.
- The inefficiencies of data intelligence and knowledge is costing U.S. organizations $1.7M per year for every 100 employees, and European organizations €1.1M per year for every 100 employees.
“Data discovery is important to all aspects of business, from operations efficiency to compliance to risk reduction, revenue growth, and beyond,” said Stewart Bond, director of data integration and integrity software research at IDC, which conducted the research, in the release. “Knowledge of how, where and why data is used, by whom, and what information already exists will help data professionals refrain from repeating efforts, increase personal productivity and free-up time for more advanced analytics.”
Download the full IDC InfoBrief here.
The IDC InfoBrief: The State of Data Discovery and Cataloging, commissioned by Alteryx, is based on a comprehensive survey of 400-plus individuals performing data functions across North America and Europe.
