Data and analytics technology will help to accelerate renewal, drive innovation and rebuild society over the next three to five years. Savvy digital business leaders will leverage their ongoing IT investment that enables recovery and reinvention.
Gartner has identified the key data and analytics trends that can help forward-looking CIOs and CTOs navigate their essential digital transformation and prepare for a post-pandemic marketplace.
"To innovate their way beyond a post-COVID-19 world, data and analytics leaders require an ever-increasing velocity and scale of analysis in terms of processing and access to succeed in the face of unprecedented market shifts," said Rita Sallam, vice president at Gartner.
Business leaders should examine the following trends to accelerate adoption:
Smarter, Faster, More Responsible AI
By the end of 2024, 75 percent of organizations will shift from piloting to operationalizing artificial intelligence (AI), driving a five times increase in streaming data and analytics infrastructures.
During the pandemic, machine learning (ML), optimization and natural language processing (NLP) are providing vital insights and predictions about the spread of the virus and the effectiveness and impact of counter-measures.
Other AI techniques -- such as reinforcement learning and distributed learning -- are creating more adaptable and flexible systems to handle complex business situations. For example, agent-based systems that model and simulate complex systems.
The Decline of the Dashboard
Dynamic data stories with more automated and consumerized experiences will replace visual, point-and-click authoring and exploration. As a result, the amount of time IT users spend utilizing predefined dashboards will decline.
The shift to dynamic data stories that leverage for example augmented analytics or NLP, means that the most relevant insights will stream to each user based on their context, role, or use.
The Rise of Decision Intelligence
By 2023, more than 33 percent of large organizations will have analysts practicing decision intelligence, including decision modeling. Decision intelligence brings together several disciplines, including decision management and decision support.
It provides a framework to help data and analytics leaders design, model, align, execute, monitor or tune decision models and processes in the context of business outcomes and behavior.
Exploring X Analytics
Gartner coined the term “X analytics” to be an umbrella term, where X is the data variable for a range of different structured and unstructured content such as text analytics, video analytics, audio analytics, etc.
AI has been critical in combing through thousands of research papers, news sources, social media posts and clinical trial data to help medical and public health experts predict the pandemic spread, capacity-plan, find new treatments and identify vulnerable populations.
X analytics combined with AI and other techniques such as graph analytics will play a key role in identifying, predicting and planning for natural disasters and other crises in the future.
Augmented Data Management
Augmented data management uses ML and AI techniques to optimize and improve operations. It also converts metadata from being used in auditing, lineage and reporting to powering dynamic systems.
Augmented data management products can examine large samples of operational data, including actual queries, performance data and schemas.
Using the existing usage and workload data, an augmented engine can tune operations and optimize configuration, security and performance.
Public Cloud Enables Innovation
By 2022, public cloud services will be essential for 90 percent of data and analytics innovation. As data and analytics moves to the cloud, data and analytics leaders still struggle to align the right services to the right use cases, which leads to unnecessary increased governance and integration overhead.
The question for data and analytics is moving from how much a given service costs to how it can meet the workload’s performance requirements beyond the list price. Data and analytics leaders need to prioritize workloads that can exploit cloud computing capabilities and focus on cost optimization when moving to a public cloud.
Data and Analytics Worlds Collide
Data and analytics capabilities have traditionally been considered distinct entities and managed accordingly. Vendors offering end-to-end workflows enabled by augmented analytics blur the distinction between the two markets.
The collision of data and analytics will increase interaction and collaboration between historically separate data and analytics roles. This impacts the technologies and capabilities provided, plus the people and processes that support and use them.
The spectrum of roles will extend from traditional data and analytics admins to information explorers and citizen developers.
More Data Marketplaces and Exchanges
By 2022, 35 percent of large organizations will be either sellers or buyers of data via formal online data marketplaces -- that's up from 25 percent in 2020. Data marketplaces and exchanges provide single platforms to consolidate third-party data offerings and reduce costs for third-party data.
Blockchain in Data and Analytics
Blockchain technologies address two challenges in data and analytics. First, blockchain provides the full lineage of assets and transactions. Second, blockchain provides transparency for complex networks of participants.
Outside of limited bitcoin and smart contract use cases, ledger database management systems (DBMSs) will provide a better option for single-enterprise auditing of data sources. By 2021, Gartner estimates that most allowed blockchain uses will be replaced by ledger DBMS products.
How Relationships Form the Foundation of Data and Analytics Value
By 2023, graph technologies will facilitate rapid contextualization for decision making in 30 percent of organizations worldwide. Graph analytics is a set of analytic techniques that allows for the exploration of relationships between entities of interest such as organizations, people and transactions.
According to the Gartner assessment, it helps IT leaders find unknown relationships in data, and review data not easily analyzed with traditional analytics solutions.
Gartner has identified the key data and analytics trends that can help forward-looking CIOs and CTOs navigate their essential digital transformation and prepare for a post-pandemic marketplace.
"To innovate their way beyond a post-COVID-19 world, data and analytics leaders require an ever-increasing velocity and scale of analysis in terms of processing and access to succeed in the face of unprecedented market shifts," said Rita Sallam, vice president at Gartner.
Business leaders should examine the following trends to accelerate adoption:
Smarter, Faster, More Responsible AI
By the end of 2024, 75 percent of organizations will shift from piloting to operationalizing artificial intelligence (AI), driving a five times increase in streaming data and analytics infrastructures.
During the pandemic, machine learning (ML), optimization and natural language processing (NLP) are providing vital insights and predictions about the spread of the virus and the effectiveness and impact of counter-measures.
Other AI techniques -- such as reinforcement learning and distributed learning -- are creating more adaptable and flexible systems to handle complex business situations. For example, agent-based systems that model and simulate complex systems.
The Decline of the Dashboard
Dynamic data stories with more automated and consumerized experiences will replace visual, point-and-click authoring and exploration. As a result, the amount of time IT users spend utilizing predefined dashboards will decline.
The shift to dynamic data stories that leverage for example augmented analytics or NLP, means that the most relevant insights will stream to each user based on their context, role, or use.
The Rise of Decision Intelligence
By 2023, more than 33 percent of large organizations will have analysts practicing decision intelligence, including decision modeling. Decision intelligence brings together several disciplines, including decision management and decision support.
It provides a framework to help data and analytics leaders design, model, align, execute, monitor or tune decision models and processes in the context of business outcomes and behavior.
Exploring X Analytics
Gartner coined the term “X analytics” to be an umbrella term, where X is the data variable for a range of different structured and unstructured content such as text analytics, video analytics, audio analytics, etc.
AI has been critical in combing through thousands of research papers, news sources, social media posts and clinical trial data to help medical and public health experts predict the pandemic spread, capacity-plan, find new treatments and identify vulnerable populations.
X analytics combined with AI and other techniques such as graph analytics will play a key role in identifying, predicting and planning for natural disasters and other crises in the future.
Augmented Data Management
Augmented data management uses ML and AI techniques to optimize and improve operations. It also converts metadata from being used in auditing, lineage and reporting to powering dynamic systems.
Augmented data management products can examine large samples of operational data, including actual queries, performance data and schemas.
Using the existing usage and workload data, an augmented engine can tune operations and optimize configuration, security and performance.
Public Cloud Enables Innovation
By 2022, public cloud services will be essential for 90 percent of data and analytics innovation. As data and analytics moves to the cloud, data and analytics leaders still struggle to align the right services to the right use cases, which leads to unnecessary increased governance and integration overhead.
The question for data and analytics is moving from how much a given service costs to how it can meet the workload’s performance requirements beyond the list price. Data and analytics leaders need to prioritize workloads that can exploit cloud computing capabilities and focus on cost optimization when moving to a public cloud.
Data and Analytics Worlds Collide
Data and analytics capabilities have traditionally been considered distinct entities and managed accordingly. Vendors offering end-to-end workflows enabled by augmented analytics blur the distinction between the two markets.
The collision of data and analytics will increase interaction and collaboration between historically separate data and analytics roles. This impacts the technologies and capabilities provided, plus the people and processes that support and use them.
The spectrum of roles will extend from traditional data and analytics admins to information explorers and citizen developers.
More Data Marketplaces and Exchanges
By 2022, 35 percent of large organizations will be either sellers or buyers of data via formal online data marketplaces -- that's up from 25 percent in 2020. Data marketplaces and exchanges provide single platforms to consolidate third-party data offerings and reduce costs for third-party data.
Blockchain in Data and Analytics
Blockchain technologies address two challenges in data and analytics. First, blockchain provides the full lineage of assets and transactions. Second, blockchain provides transparency for complex networks of participants.
Outside of limited bitcoin and smart contract use cases, ledger database management systems (DBMSs) will provide a better option for single-enterprise auditing of data sources. By 2021, Gartner estimates that most allowed blockchain uses will be replaced by ledger DBMS products.
How Relationships Form the Foundation of Data and Analytics Value
By 2023, graph technologies will facilitate rapid contextualization for decision making in 30 percent of organizations worldwide. Graph analytics is a set of analytic techniques that allows for the exploration of relationships between entities of interest such as organizations, people and transactions.
According to the Gartner assessment, it helps IT leaders find unknown relationships in data, and review data not easily analyzed with traditional analytics solutions.