Skip to main content

Exploring the Big Data Challenges and Opportunities

The need for Big Data solutions is becoming a reality for more companies. The market hype around big data is ending, signifying a long-term adoption trend that will expose many software application opportunities in the coming year.

As the broader big data and analytics (BDA) products and services market approaches $100 billion in revenues, software vendors are faced with the need to address an increasingly fragmented enterprise buyer population.

A new worldwide market study provides valuable insight into developer opinions about big data technologies, current database and analytics solutions, and the buyer motivations behind product and service choices.

Data quality and growing volume are the primary problems affecting software developers while exploring the evolving concept of big data, according to findings from the latest survey by Evans Data Corp.

This comprehensive market study measured and analyzed the IT buyer and business decision maker attitudes and perceptions, as well as the current and planned activities of developers involved with big data projects.

The ripple effect influenced by data quality, which can cause problems in the processing phase and cost millions of dollars in lost revenue annually, was cited as the top problem by 21 percent of the respondent developers who were surveyed.

Fourteen percent cited the volume of data being processed as a concern, and another 12 percent said their chief concern was more about the ongoing challenges of data storage.

Moreover, the inability to gain insight from big data was also cited, though all options had a low response set -- indicating that no single hurdle is to blame for big data project difficulties.

"Confidence in the veracity, precision, and comprehensiveness of the contents of an organization's data lake enables the kinds of complex exploratory analytics that can identify and deconstruct real-world trends as they emerge," said Charles Mander, analyst at Evans Data.

As such, Mander believes that the ability to capture and process big data in real-time can transform an organization's approach to strategic intelligence, adding tremendous value to data points that are already being generated in the course of normal business activity.

Evans annual survey covers topics such as the key drivers, barriers and risks for big data, machine and deep learning, real-time event processing, advanced analytics tools and related services.

It also covers big data applications relative to the Internet of Things (IoT), data visualization and graphic modeling tool use, cloud computing, Hadoop and testing requirements.

Popular posts from this blog

Artificial Intelligence Growth at an Inflection Point

Business technology investment no longer follows a predictable path to growth. The global venture capital (VC) investment in artificial intelligence (AI) was close to its peak in 2021 reaching $22.3 billion, according to the latest worldwide market study by ABI Research. This is just $400 million shy of the historical high of $22.7 billion recorded in 2019. Compared to the $15 billion recorded in 2020, the market made a remarkable recovery, with a 48.5 percent year-on-year growth. Will the future AI marketplace return to stable growth, or will it remain volatile? Artificial Intelligence Market Development "COVID-19 greatly accelerated the speed of digital transformation within the enterprise. Businesses are looking for solutions to work processes automation, customer care, due diligence, transcription and translation, and sales and marketing enablement tools," said Lian Jye Su, research director at ABI Research . At the same time, COVID-19 led to the Great Resignation of 2021

How a Digital-First CEO Leads Transformation

Some leaders reject the notion that "wait and see" is the best response to disruptive change. Savvy senior executives are already driving digital business transformation throughout their organization in an effort to gain a bold strategic advantage. According to the latest market study by International Data Corp (IDC), Digital-First CEOs plan to drive at least half of their income from digital business products, services, and experiences by 2027 -- that's ahead of the market average of 39 percent. Driven by their response to the COVID-19 pandemic, these business leaders have changed how they think about the relationship between business and technology, and how they approach the next digital transformation era -- from scaling digital technology to guiding a viable digital business. Digital Business Market Development IDC defines digital business as value creation based on technology, which entails: 1) Automated customer-facing processes and internal operations; 2) Provision

Digital Solutions for Industrial & Manufacturing Firms

Executive leaders of fast-moving consumer goods (FMCG) are seeking guidance on how to apply new business technology in their manufacturing operations. CIOs and CTOs are tasked with gaining insight into the best solutions for digital transformation. ABI Research evaluated the impact politics, regulation, the economy, supply chain, ESG, and technology are having on FMCG, pharma, producers of steel, chemicals, pulp and paper -- as well as the mining and oil & gas sectors. Digital Transformation Market Development "Our assessment found that the FMCG sector is under pressure from all sides," says Michael Larner, industrial & manufacturing research director at ABI Research . Securing raw materials is challenging considering lockdowns in China and limited grain supplies from Ukraine. Supply shocks are raising input costs, and operating costs are rising with higher energy costs coupled with the pressure to pay higher wages and work sustainably. "We all hoped that with th