Data engineering redefined for the Artificial Intelligence era

A new survey of 400 senior data and technology leaders finds data engineers are becoming central to Artificial Intelligence efforts and broader business success, while facing rising complexity and workloads.

As organizations embed Artificial Intelligence more deeply across operations, data engineers are emerging as pivotal enablers of these initiatives. A survey of 400 senior data and technology executives by MIT Technology Review Insights finds data engineers now play an influential role that extends beyond traditional pipeline management. With Artificial Intelligence success hinging on reliable, well-managed, high-quality data, respondents view data engineers as integral to realizing business value from advanced technologies.

The report highlights a decisive shift in how data engineers spend their time. On average, their daily involvement in Artificial Intelligence projects has nearly doubled in two years, rising from 19 percent in 2023 to 37 percent in 2025. Executives expect this share to climb further to 61 percent within the next two years, underscoring the growing weight of Artificial Intelligence specific tasks relative to core data management. This expansion is occurring alongside heavier job demands. Most respondents, 77 percent, report that data engineering workloads are increasing.

Growing influence also brings mounting challenges. More advanced Artificial Intelligence models are increasing the complexity of data environments, elevating the importance of managing unstructured data and real-time pipelines. Data teams must sustain reliability and speed while scaling to meet new requirements, which compounds operational strain. These dynamics reflect a broader transition in which data engineering responsibilities are broadening to support more sophisticated, real-time Artificial Intelligence use cases.

The strategic importance of data engineers is widely recognized. Seventy two percent of surveyed technology leaders say data engineers are integral to the business, a view that is even stronger in the largest organizations, where Artificial Intelligence maturity is highest. There, 86 percent share this assessment. Support is especially pronounced in financial services and manufacturing. Taken together, the findings indicate that data engineering is being redefined, with elevated expectations, expanding scope, and increasing workload as organizations push to scale Artificial Intelligence across the enterprise.

55

Impact Score

MIT method spots overconfident Artificial Intelligence models

MIT researchers developed a way to detect when large language models are confidently wrong by comparing their answers with outputs from similar models. The combined uncertainty measure outperformed standard techniques across a range of tasks and may help reduce unreliable responses.

MEPs back delay for parts of Artificial Intelligence Act

European Parliament committees have endorsed targeted delays to parts of the Artificial Intelligence Act while adding a proposed ban on certain non-consensual image manipulation tools. The changes aim to give companies clearer deadlines, reduce overlap with other EU rules, and extend support to small mid-cap enterprises.

Publisher alliance seeks leverage over Artificial Intelligence web access

A new publisher coalition is trying to reshape how Artificial Intelligence companies access journalism by combining collective bargaining with tougher technical controls. The effort reflects growing pressure on Artificial Intelligence firms to pay for content used in training, search, and user-facing responses.

Military advantage in the age of algorithmic diffusion

American leadership in Artificial Intelligence research and infrastructure may not translate into lasting military advantage. Rapid diffusion of algorithms is shifting the contest toward compute, talent, and the speed of military adoption.

Artificial Intelligence adoption rises among small businesses

Small businesses are increasingly using Artificial Intelligence and reporting strong gains in efficiency, productivity, and expected revenue. Many still face practical barriers and want more training, resources, and policy support to move from experimentation to full implementation.

Contact Us

Got questions? Use the form to contact us.

Contact Form

Clicking next sends a verification code to your email. After verifying, you can enter your message.