BLOG

Resources and insights

The latest industry news, interviews, technologies, and resources.

AI-Native Analytics
7
min read

Why Every Modern Enterprise Needs AI-Native Analytics

August 15, 2025
August 21, 2025
Data Strategy
7
min read

How SLAs and Monitoring Frameworks Keep Data Reliable

August 21, 2025
August 22, 2025
AI-Native Analytics
4
min read

The Future of Data Is Agentic: Key Insights from Our CDO Magazine Webinar

August 21, 2025
September 9, 2025
AI-Native Analytics
10
min read

Best Practices to Improve Self-Service Analytics Implementation

August 15, 2025
August 21, 2025
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
AI-Native Analytics
4
min read

The Future of Data Is Agentic: Key Insights from Our CDO Magazine Webinar

Matt Turner
August 21, 2025
September 9, 2025
August 21, 2025
September 9, 2025
August 21, 2025
September 9, 2025
AI-Native Analytics
8
min read

Analytics as a Team Sport: Why Data Is Everyone’s Job Now

Matt Turner
August 1, 2025
August 1, 2025
August 1, 2025
August 1, 2025
August 1, 2025
August 1, 2025
Data Strategy
9
min read

12 Must-Have Skills for Data Analysts to Avoid Career Obsolescence

Cody Carmen
July 4, 2025
July 15, 2025
July 4, 2025
July 15, 2025
July 4, 2025
July 15, 2025
AI-Native Analytics
7
min read

Prophecy vs. Databricks Lakeflow Designer

Raj Bains
June 23, 2025
July 29, 2025
June 23, 2025
July 29, 2025
June 23, 2025
July 29, 2025
Events + Announcements
5
min read

Data + AI for everyone: highlights from the 2025 Databricks Summit

Raveena Kapatkar
June 19, 2025
July 15, 2025
June 19, 2025
July 15, 2025
June 19, 2025
July 15, 2025
AI-Native Analytics
7
min read

Agent-Powered Pipeline Development: Designed for Humans, Built for Production

Ravi Uppala
June 17, 2025
August 4, 2025
June 17, 2025
August 4, 2025
June 17, 2025
August 4, 2025
Data Strategy
10
min read

How Data Domains Break the Cycle of Endless Analytics Backlogs

Prophecy Team
June 16, 2025
July 15, 2025
June 16, 2025
July 15, 2025
June 16, 2025
July 15, 2025
Data Strategy
10
min read

From Data Mess to Business Success Through Strategic Data Curation

Matt Turner
June 6, 2025
July 15, 2025
June 6, 2025
July 15, 2025
June 6, 2025
July 15, 2025
Data Strategy
8
min read

How to Stop Playing Data Detective and Build Lineage That Actually Works

Cody Carmen
June 6, 2025
July 15, 2025
June 6, 2025
July 15, 2025
June 6, 2025
July 15, 2025
Events + Announcements
5
min read

Get ready! AI agents, booth chats, and must-see Prophecy events at the 2025 Data + AI Summit

Matt Turner
June 3, 2025
August 4, 2025
June 3, 2025
August 4, 2025
June 3, 2025
August 4, 2025
Events + Announcements
3
min read

Prophecy at Databricks Data + AI Summit 2025

Matt Turner
May 29, 2025
July 15, 2025
May 29, 2025
July 15, 2025
May 29, 2025
July 15, 2025
Data Governance
5
min read

Build It. Govern It. Own It.

Dan Harris, CRO of Cloudaeon
May 20, 2025
July 15, 2025
May 20, 2025
July 15, 2025
May 20, 2025
July 15, 2025
Data Governance
12
min read

Building a Self-Service Data Governance Framework in Databricks With Prophecy

Matt Turner
May 9, 2025
May 15, 2025
May 9, 2025
May 15, 2025
May 9, 2025
May 15, 2025
Data Governance
9
min read

How Modern Self-Service Analytics Tools Are Empowering Non-Technical Users

Matt Turner
April 24, 2025
August 4, 2025
April 24, 2025
August 4, 2025
April 24, 2025
August 4, 2025
Data Strategy
10
min read

Unlock the Full Potential of Data With Data Literacy

Mitesh Shah
April 24, 2025
August 21, 2025
April 24, 2025
August 21, 2025
April 24, 2025
August 21, 2025
Prophecy for Databricks
5
min read

Unlocking Databricks for Data Analysts: Simplify Data Preparation with Prophecy

Mei Long
April 3, 2025
July 15, 2025
April 3, 2025
July 15, 2025
April 3, 2025
July 15, 2025
Events + Announcements
min read

Self-Service Data Preparation Without the Risk

Mitesh Shah
March 27, 2025
July 15, 2025
March 27, 2025
July 15, 2025
March 27, 2025
July 15, 2025
Events + Announcements
5
min read

5 Takeaways from the Gartner Data & Analytics Summit

Matt Turner
March 20, 2025
July 15, 2025
March 20, 2025
July 15, 2025
March 20, 2025
July 15, 2025
Data Strategy
2
min read

The Five Dysfunctions of a Data Team

Lance Walter
March 6, 2025
July 15, 2025
March 6, 2025
July 15, 2025
March 6, 2025
July 15, 2025
Data Engineering
9
min read

Data Pipelines: Optimize and Modernize Your Data Strategy

Mitesh Shah
February 25, 2025
July 15, 2025
February 25, 2025
July 15, 2025
February 25, 2025
July 15, 2025
Data Engineering
5
min read

Survey says… GenAI is reshaping data teams

Matt Turner
February 21, 2025
July 15, 2025
February 21, 2025
July 15, 2025
February 21, 2025
July 15, 2025
Events + Announcements
4
min read

3 Ways to Connect with Prophecy at the Gartner Data & Analytics Summit!

Mitesh Shah
February 18, 2025
July 15, 2025
February 18, 2025
July 15, 2025
February 18, 2025
July 15, 2025
Events + Announcements
5
min read

Prophecy takes in $47M, to scale up and reimagine data integration with AI

Raj Bains
January 15, 2025
July 15, 2025
January 15, 2025
July 15, 2025
January 15, 2025
July 15, 2025
ETL Modernization
5
min read

Five Predictions: Data Integration in 2025

Mitesh Shah
January 2, 2025
July 15, 2025
January 2, 2025
July 15, 2025
January 2, 2025
July 15, 2025
ETL Modernization
5
min read

Gliding into the data wonderland

Matt Turner
December 17, 2024
July 15, 2025
December 17, 2024
July 15, 2025
December 17, 2024
July 15, 2025
Events + Announcements
5
min read

Data Intelligence and AI Copilots at the Databricks World Tour

Matt Turner
October 29, 2024
July 15, 2025
October 29, 2024
July 15, 2025
October 29, 2024
July 15, 2025
Events + Announcements
4
min read

Success With AI Takes Data, Big Data!

Matt Turner
October 2, 2024
July 15, 2025
October 2, 2024
July 15, 2025
October 2, 2024
July 15, 2025
Prophecy for Databricks
5
min read

Load Data into Databricks Delta Lake in 5 Minutes

Shashank Mishra
August 29, 2024
July 15, 2025
August 29, 2024
July 15, 2025
August 29, 2024
July 15, 2025
Events + Announcements
4
min read

Delivering AI and Data Value at CDOIQ 2024

Matt Turner
July 25, 2024
July 15, 2025
July 25, 2024
July 15, 2025
July 25, 2024
July 15, 2025
Prophecy for Databricks
6
min read

Airflow and Databricks: Shorten the Learning Curve with Prophecy

Pooja Singhal
July 24, 2024
July 15, 2025
July 24, 2024
July 15, 2025
July 24, 2024
July 15, 2025
Events + Announcements
6
min read

Databricks Data + AI Summit 2024: AI Shapes a Copilot Future

Raveena Kapatkar
June 20, 2024
July 15, 2025
June 20, 2024
July 15, 2025
June 20, 2024
July 15, 2025
Events + Announcements
3
min read

AI, Copilot and Authors at Databricks Data and AI Summit 2024

Matt Turner
May 30, 2024
July 15, 2025
May 30, 2024
July 15, 2025
May 30, 2024
July 15, 2025
Data Integration Platform
4
min read

The Case for Data Transformation Copilots

Raj Bains and Maciej Szpakowski
May 30, 2024
July 15, 2025
May 30, 2024
July 15, 2025
May 30, 2024
July 15, 2025
Events + Announcements
5
min read

AI, the Texas Rangers, and Aetion at Databricks Data + AI Summit 2024

Matt Turner
May 16, 2024
July 15, 2025
May 16, 2024
July 15, 2025
May 16, 2024
July 15, 2025
Data Integration Platform
3
min read

Data engineers and business data users: end the back-and-forth

Mitesh Shah
May 7, 2024
July 15, 2025
May 7, 2024
July 15, 2025
May 7, 2024
July 15, 2025
Events + Announcements
5
min read

Announcing Prophecy University

Mei Long
April 1, 2024
July 15, 2025
April 1, 2024
July 15, 2025
April 1, 2024
July 15, 2025
Events + Announcements
4
min read

Gartner Data & Analytics Summit 2024 - that’s a wrap!

Ashleigh Blalock
March 20, 2024
July 15, 2025
March 20, 2024
July 15, 2025
March 20, 2024
July 15, 2025
Data Integration Platform
5
min read

Too much data work. Too few data engineers. How to make it scale.

Mitesh Shah
March 7, 2024
July 15, 2025
March 7, 2024
July 15, 2025
March 7, 2024
July 15, 2025
Events + Announcements
5
min read

Johnson & Johnson Takes Center Stage with Prophecy at Gartner Data & Analytics 2024

Mitesh Shah
February 13, 2024
August 4, 2025
February 13, 2024
August 4, 2025
February 13, 2024
August 4, 2025
Events + Announcements
3
min read

Webinar spotlight – The future of data transformation

Mitesh Shah
January 16, 2024
July 15, 2025
January 16, 2024
July 15, 2025
January 16, 2024
July 15, 2025
Events + Announcements
3
min read

Modern Data’s Stuck

George K. Mathew
October 13, 2023
July 15, 2025
October 13, 2023
July 15, 2025
October 13, 2023
July 15, 2025
Events + Announcements
3
min read

Prophecy at Databricks Data+AI World Tour: Empowering Data Democratization #DAIWT

Emily Lewis
October 9, 2023
August 4, 2025
October 9, 2023
August 4, 2025
October 9, 2023
August 4, 2025
Events + Announcements
5
min read

Announcing Prophecy Package Builder and Package Hub: Data engineering, standardized.

Mitesh Shah
September 27, 2023
August 4, 2025
September 27, 2023
August 4, 2025
September 27, 2023
August 4, 2025
Data Integration Platform
5
min read

Prompt engineering vs. fine tuning: Which approach is right for your enterprise generative AI strategy?

Mitesh Shah
September 1, 2023
July 15, 2025
September 1, 2023
July 15, 2025
September 1, 2023
July 15, 2025
Data Integration Platform
3
min read

Enterprise data and the taming of the Generative AI frontier

Kevin Petrie, VP of Research at the Eckerson Group
August 7, 2023
July 15, 2025
August 7, 2023
July 15, 2025
August 7, 2023
July 15, 2025
Data Integration Platform
4
min read

SQL models are easy to deploy and orchestrate with Prophecy

Anya Bida
July 25, 2023
July 15, 2025
July 25, 2023
July 15, 2025
July 25, 2023
July 15, 2025
ETL Modernization
6
min read

Understanding ETL Modernization

Mei Long
July 18, 2023
July 15, 2025
July 18, 2023
July 15, 2025
July 18, 2023
July 15, 2025
Events + Announcements
4
min read

Prophecy and all things Data + AI Summit - that’s a wrap!

Emily Lewis
July 11, 2023
July 15, 2025
July 11, 2023
July 15, 2025
July 11, 2023
July 15, 2025
Data Integration Platform
8
min read

How HealthVerity leverages Prophecy for unmatched data privacy and compliance

Mei Long
June 28, 2023
August 4, 2025
June 28, 2023
August 4, 2025
June 28, 2023
August 4, 2025
Data Integration Platform
9
min read

Introducing the Prophecy Generative AI Platform

Raj Bains and Maciej Szpakowski
June 21, 2023
August 4, 2025
June 21, 2023
August 4, 2025
June 21, 2023
August 4, 2025
Data Integration Platform
5
min read

Introducing Prophecy Data Copilot

Mitesh Shah
June 21, 2023
July 15, 2025
June 21, 2023
July 15, 2025
June 21, 2023
July 15, 2025
Events + Announcements
10
min read

Prophecy at Data + AI Summit

Emily Lewis
June 17, 2023
July 15, 2025
June 17, 2023
July 15, 2025
June 17, 2023
July 15, 2025
Events + Announcements
8
min read

Webinar spotlight — Moneyball: How the Texas Rangers use low-code data engineering and analytics to identify MVPs

Emily Lewis
June 8, 2023
July 15, 2025
June 8, 2023
July 15, 2025
June 8, 2023
July 15, 2025
Data Integration Platform
2
min read

Getting started with low-code

Anya Bida
June 8, 2023
July 15, 2025
June 8, 2023
July 15, 2025
June 8, 2023
July 15, 2025
Data Integration Platform
5
min read

Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 2

Anya Bida
June 8, 2023
August 4, 2025
June 8, 2023
August 4, 2025
June 8, 2023
August 4, 2025
Data Integration Platform
6
min read

Getting started with low-code SQL

Anya Bida
June 5, 2023
July 15, 2025
June 5, 2023
July 15, 2025
June 5, 2023
July 15, 2025
Prophecy for Databricks
3
min read

Data engineering for the data lakehouse: Four guiding principles

Kevin Petrie, VP of Research at the Eckerson Group
June 1, 2023
August 4, 2025
June 1, 2023
August 4, 2025
June 1, 2023
August 4, 2025
ETL Modernization
5
min read

3 ways Prophecy modernizes ETL on Databricks

Maciej Szpakowski
May 29, 2023
July 15, 2025
May 29, 2023
July 15, 2025
May 29, 2023
July 15, 2025
Data Integration Platform
6
min read

How to implement ETL on Apache Spark

Mei Long
May 29, 2023
July 15, 2025
May 29, 2023
July 15, 2025
May 29, 2023
July 15, 2025
ETL Modernization
7
min read

From novice to expert: A blueprint for data analysts to build robust data transformation pipelines without relying on engineering

Mei Long
May 29, 2023
July 15, 2025
May 29, 2023
July 15, 2025
May 29, 2023
July 15, 2025
Events + Announcements
3
min read

Event spotlight: Prophecy at Data + AI Summit

Emily Lewis
May 26, 2023
July 15, 2025
May 26, 2023
July 15, 2025
May 26, 2023
July 15, 2025
Data Integration Platform
5
min read

Hitting data driven home runs: How the Texas Rangers win by harnessing Prophecy in their data mesh architecture

Alexander Booth
May 24, 2023
August 4, 2025
May 24, 2023
August 4, 2025
May 24, 2023
August 4, 2025
Data Integration Platform
11
min read

Empower all business data users with interactive SQL development

Anya Bida
May 10, 2023
August 4, 2025
May 10, 2023
August 4, 2025
May 10, 2023
August 4, 2025
Prophecy for Databricks
15
min read

Prophecy with Delta — making data lakehouses easier

Maciej Szpakowski
April 27, 2023
July 15, 2025
April 27, 2023
July 15, 2025
April 27, 2023
July 15, 2025
Events + Announcements
5
min read

Announcing Prophecy 3.0: low-code SQL transformations

Maciej Szpakowski
April 24, 2023
July 15, 2025
April 24, 2023
July 15, 2025
April 24, 2023
July 15, 2025
Prophecy for Databricks
5
min read

Prophecy: Low-code data engineering on Databricks lakehouses via Partner Connect

Shagun Bains
April 21, 2023
August 4, 2025
April 21, 2023
August 4, 2025
April 21, 2023
August 4, 2025
6
min read

ProphecyHub: Metadata re-invented with Git and GraphQL for data engineering

Raj Bains
April 21, 2023
August 4, 2025
April 21, 2023
August 4, 2025
April 21, 2023
August 4, 2025
6
min read

Spark: Column-level lineage

Raj Bains
April 21, 2023
July 15, 2025
April 21, 2023
July 15, 2025
April 21, 2023
July 15, 2025
3
min read

Spark deserves a better IDE

Raj Bains
April 21, 2023
July 15, 2025
April 21, 2023
July 15, 2025
April 21, 2023
July 15, 2025
5
min read

Introducing Prophecy.io — cloud-native data engineering

Raj Bains
April 21, 2023
July 15, 2025
April 21, 2023
July 15, 2025
April 21, 2023
July 15, 2025
Data Integration Platform
15
min read

PySpark hands-on tutorial using a visual IDE

Anya Bida
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
Data Integration Platform
4
min read

Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 1

Anya Bida
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
ETL Modernization
4
min read

Cloud data engineering on Spark — factors for transitioning to the stack

Raj Bains
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
ETL Modernization
6
min read

Ab Initio to Spark: Modernize your ETL and lower costs

Raj Bains
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
Prophecy for Databricks
10
min read

Deep dive into Prophecy for Databricks

Maciej Szpakowski
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
Data Integration Platform
10
min read

Financial reporting simplified: Working capital forecasting

Anshuman Agrawal
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
Events + Announcements
5
min read

Prophecy raises Series A to industrialize data refining

Raj Bains
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
Data Engineering
3
min read

Data Engineering Battle: Python vs SQL++ vs Visual=Code

Raj Bains
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
Events + Announcements
5
min read

DATA+AI Summit 2021: Poll results and takeaways for low-code products

Prophecy Team
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
Data Integration Platform
6
min read

Be more productive on Spark with low-code

Prophecy Team
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
Data Engineering
3
min read

Prophecy SaaS: Low-code data engineering for your Spark

Prophecy Team
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
Data Engineering
4
min read

ELT is not the disruption — data engineering is!

Raj Bains
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
6
min read

Apache Spark™ vs Snowflake: The cloud data engineering (ETL) debate!

Raj Bains
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
April 9, 2023
August 4, 2025
Events + Announcements
2
min read

Announcing Prophecy's public beta!

Prophecy Team
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
April 9, 2023
July 15, 2025
5
min read

Scala packrat parser combinators for DSLs

Raj Bains
October 11, 2019
May 16, 2024
October 11, 2019
May 16, 2024
October 11, 2019
May 16, 2024
4
min read

Startup superpower: customer discovery machine

Raj Bains
September 5, 2019
April 22, 2023
September 5, 2019
April 22, 2023
September 5, 2019
April 22, 2023
ETL Modernization
4
min read

Weigh Your Options As You Move Off Alteryx

Raj Bains
November 18, 2024
November 18, 2024
November 18, 2024
Data Integration Platform
8
min read

How to build generative AI applications on enterprise data

Mei Long
February 14, 2025
February 14, 2025
February 14, 2025
AI-Native Analytics
Self-service Data Preparation
Data Engineering
Data Governance
Data Strategy
Self Service Data Transformation
ETL Modernization
Data Integration Platform
Prophecy for Databricks
Events + Announcements
Nam cursus vestibulum

Sed diam libero mus pretium elit a morbi. Eget id massa risus.

Start free trial