Shutterstock
Analytics engineering emerged alongside probably the most important technological revolution of the previous decade – the rise of cloud computing. Right now, we’re experiencing even a larger transformation, one fueled by the meteoric rise of synthetic intelligence (AI), which is reshaping how analytics engineers strategy knowledge challenges
AI has rapidly turn out to be an integral a part of the each day workflows for 80% of information professionals, up from 30% final yr. It’s additionally altering how knowledge groups work, with 70% of execs now utilizing AI to help with code growth, and 40% reporting that their knowledge groups are rising. Whereas funding in AI instruments is main the best way, knowledge high quality stays a persistent problem, with over 56% of practitioners highlighting it as a key concern.
These insights come from dbt Labs’ 2025 State of Analytics Engineering Report, the third version of their annual publication, which dives into how AI is redefining knowledge groups, the place budgets are being prioritized, and why constructing belief in knowledge is extra vital than ever.
A key discovering of the report is that AI is augmenting, not changing knowledge groups, as many had anticipated it to. As an alternative of changing human experience, AI adoption is altering how individuals work. It’s permitting professionals to spend much less time on redundant duties and focus extra on specialised work. The report highlights that greater than two-thirds (70%) of respondents use AI for analytics growth in some kind.
The rising investments in AI instruments to assist knowledge groups foster a extra constructive notion of their contributions. Because of this, 75% of respondents agree that their organizations extremely worth and belief their knowledge groups.
“AI is disrupting the best way that groups work with organizational knowledge,” stated Mark Porter, CTO of dbt Labs. “As firms enhance AI investments, leaders are prioritizing the groups chargeable for knowledge high quality and governance—the important basis for AI effectiveness.”
“On the identical time, knowledge engineers are turning to AI to automate routine duties, fully altering how knowledge is delivered to the enterprise. Due to this, the strategic position of the information staff continues to develop, with AI because the catalyst. It’s a symbiotic relationship – knowledge professionals make AI higher, and AI makes knowledge groups higher.”
Analytics engineering is rising past tech, with extremely regulated industries like finance (15%) and healthcare (10%) adopting it to handle advanced, compliance-heavy knowledge. Tech stays the most important sector at 34%, although its share has declined by 3% this yr.
In line with dbt Labs, organizations are investing in knowledge once more after a cautious interval. AI instruments are the highest precedence, with 45% planning to spend extra on them within the subsequent yr. Information high quality and observability come subsequent, with 38% specializing in fixing key knowledge challenges.
Supply: Shutterstock
AI instruments lead funding priorities, with 45% of respondents planning to spice up spending on this space over the following yr. Information high quality and observability observe, with 38% aiming to extend funding to deal with pressing knowledge high quality challenges. A number of different experiences have highlighted the pressing want for organizations to deal with knowledge high quality points, and this was a recurring theme all through this yr’s dbt Labs report.
The highest use circumstances for AI embody code growth (70%), adopted by documentation (50%), and answering knowledge questions with SQL technology (22%). The report reveals that knowledge groups are counting on general-purpose LLMs corresponding to OpenAI’s ChatGPT and Gemini.
Nevertheless, as a result of these instruments are usually not tailor-made for particular analytics duties, organizations are more and more adopting specialised GenAI brokers. At present, 25% of respondents are utilizing AI options constructed into their growth tooling
The report’s findings additionally reveal that curiosity in semantic layers, instruments that make knowledge clearer and extra structured, can be rising, with 27% planning to take a position extra on this space. There’s additionally a larger concentrate on empowering nontechnical customers to work with reworked, ruled datasets, which might enhance knowledge effectivity – a key focus for analytics engineering.
There’s a rising push to empower nontechnical customers. Almost 65% of respondents imagine that enabling enterprise stakeholders to create and work with reworked and ruled datasets would considerably enhance organizational knowledge effectivity. Nevertheless, this highlights a core problem in analytics engineering: sustaining knowledge integrity whereas guaranteeing broader accessibility.
dbt Labs CEO Tristan Helpful
On the dbt Cloud Launch Showcase occasion in Might 2024, dbt Labs CEO Tristan Helpful, highlighted the influence of AI for knowledge professionals. He stated, “And whereas this cloud transition remains to be enjoying out, AI goes to be the following huge change in our lives as knowledge professionals. The modifications we’ll see over the approaching years might be simply as dramatic as these we’ve seen play out over the previous decade.”
dbt Labs focuses on analytics engineering and is well-positioned to supply insights into the evolving area. This yr’s report relies on a survey of 459 knowledge professionals, together with particular person contributors (70%) and managers (30%). Among the many particular person contributors, 48% have been analytics engineers, 36% have been knowledge engineers, and 16% have been knowledge analysts.
Later this month, dbt Labs will host the 2025 State of Analytics Engineering Digital Occasion. The occasion’s agenda will embody discussions on the report’s key findings, together with broader methods for constructing efficient knowledge organizations, integrating GenAI, and addressing ongoing business challenges.
