Our blog

Resources and insights

The latest industry news, interviews, technologies, and resources.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We care about your data in our Privacy Policy.
Data Governance
9
min read

How Modern Self-Service Analytics Tools Are Empowering Non-Technical Users

Discover how self-service analytics tools are empowering non-technical users, enabling data access and insights without coding, streamlining decision-making.
Matt Turner
April 24, 2025
April 24, 2025
April 24, 2025
April 24, 2025
April 24, 2025
April 24, 2025
Data Strategy
10
min read

Breaking Down Silos: 8 Ways to Build Data Literacy Between Technical and Business Teams

Discover 8 effective ways to build data literacy across business and technical teams, breaking down barriers and enhancing collaboration for data-driven success.
Mitesh Shah
April 17, 2025
April 24, 2025
April 17, 2025
April 24, 2025
April 17, 2025
April 24, 2025
Prophecy for Databricks
5
min read

Unlocking Databricks for Data Analysts: Simplify Data Preparation with Prophecy

Prophecy and Databricks are redefining how teams build and manage data pipelines on Databricks SQL.
Mei Long
April 3, 2025
April 3, 2025
April 3, 2025
Events + Announcements
5
min read

5 Takeaways from the Gartner Data & Analytics Summit

Prophecy and data leaders embrace the GenAI moment at Gartner 2025
Matt Turner
March 20, 2025
March 20, 2025
March 20, 2025
March 20, 2025
March 20, 2025
March 20, 2025
Events + Announcements
min read

Self-Service Data Preparation Without the Risk

Prophecy Introduces Fully Governed Data Preparation for Databricks SQL
Mitesh Shah
March 27, 2025
March 27, 2025
March 27, 2025
Data Strategy
2
min read

The Five Dysfunctions of a Data Team

Data teams and analysts are inadvertently siloed into different parts of their organizations. These are the 5 data dysfunctions that breed this situation.
Lance Walter
March 6, 2025
March 6, 2025
March 6, 2025
March 6, 2025
March 6, 2025
March 6, 2025
Data Engineering
9
min read

Data Pipelines: Optimize and Modernize Your Data Strategy

Explore best practices and modern examples in data pipeline strategy. Learn to boost business success with scalable and reliable data solutions.
Mitesh Shah
March 27, 2025
March 27, 2025
March 27, 2025
Data Engineering
5
min read

Survey says… GenAI is reshaping data teams

Our new survey shows that data leaders are embracing GenAI and bracing for new challenges
Matt Turner
February 21, 2025
February 21, 2025
February 21, 2025
Events + Announcements
4
min read

3 Ways to Connect with Prophecy at the Gartner Data & Analytics Summit!

Join the Prophecy team in Orlando to see how genAI is reshaping data teams
Mitesh Shah
February 18, 2025
February 18, 2025
February 18, 2025
Events + Announcements
5
min read

Prophecy takes in $47M, to scale up and reimagine data integration with AI

Raj Bains
January 16, 2025
February 14, 2025
January 16, 2025
February 14, 2025
January 16, 2025
February 14, 2025
ETL modernization
5
min read

Five Predictions: Data Integration in 2025

The clock strikes noon on Shadow IT
Mitesh Shah
January 2, 2025
January 31, 2025
January 2, 2025
January 31, 2025
January 2, 2025
January 31, 2025
ETL modernization
5
min read

Gliding into the data wonderland

Bringing data teams together for the holidays
Matt Turner
December 17, 2024
January 31, 2025
December 17, 2024
January 31, 2025
December 17, 2024
January 31, 2025
Events + Announcements
5
min read

Data Intelligence and AI Copilots at the Databricks World Tour

Accelerating data transformation with AI to deliver insights
Matt Turner
October 31, 2024
January 31, 2025
October 31, 2024
January 31, 2025
October 31, 2024
January 31, 2025
Events + Announcements
4
min read

Success With AI Takes Data, Big Data!

Prophecy team was out in force at one of the data world’s biggest events
Matt Turner
October 2, 2024
January 31, 2025
October 2, 2024
January 31, 2025
October 2, 2024
January 31, 2025
ETL modernization
4
min read

Weigh Your Options As You Move Off Alteryx

Explore alternatives to Alteryx for modern data prep. Explore options and how Prophecy delivers scalability and openness to modernize data preparation.
Raj Bains
November 18, 2024
November 18, 2024
November 18, 2024
Prophecy for Databricks
5
min read

Load Data into Databricks Delta Lake in 5 Minutes

Discover how Prophecy revolutionizes your data operations.
Shashank Mishra
August 29, 2024
August 29, 2024
August 29, 2024
Events + Announcements
4
min read

Delivering AI and Data Value at CDOIQ 2024

Prophecy attended the CDOIQ Symposium last week in Boston.
Matt Turner
July 25, 2024
July 25, 2024
July 25, 2024
Prophecy for Databricks
6
min read

Airflow and Databricks: Shorten the Learning Curve with Prophecy

Maximize productivity without the complexity.
Pooja Singhal
February 14, 2025
February 14, 2025
February 14, 2025
Events + Announcements
6
min read

Databricks Data + AI Summit 2024: AI Shapes a Copilot Future

Databricks held their annual Data+AI Summit in San Francisco last week at Moscone Center.
Raveena Kapatkar
June 20, 2024
June 20, 2024
June 20, 2024
Events + Announcements
3
min read

AI, Copilot and Authors at Databricks Data and AI Summit 2024

Prophecy’s booth will be hopping with book signings, Copilots, and the latest on data and AI
Matt Turner
January 22, 2025
January 22, 2025
January 22, 2025
Data Integration Platform
4
min read

The Case for Data Transformation Copilots

How copilots will change data transformation, and in the process evolve beyond conversational interfaces
Raj Bains and Maciej Szpakowski
June 3, 2024
February 14, 2025
June 3, 2024
February 14, 2025
June 3, 2024
February 14, 2025
Events + Announcements
5
min read

AI, the Texas Rangers, and Aetion at Databricks Data + AI Summit 2024

Prophecy brings championship winning data, critical healthcare data, and AI for data transformation to DAIS 2024
Matt Turner
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
3
min read

Data engineers and business data users: end the back-and-forth

We’ve written before about the challenge of having too few data engineers. There is another problem. 
Mitesh Shah
March 27, 2025
March 27, 2025
March 27, 2025
Events + Announcements
5
min read

Announcing Prophecy University

Inaugural course addresses the growing data engineering skills gap through agile, self-paced training
Mei Long
April 3, 2024
February 14, 2025
April 3, 2024
February 14, 2025
April 3, 2024
February 14, 2025
Events + Announcements
4
min read

Gartner Data & Analytics Summit 2024 - that’s a wrap!

Johnson & Johnson takes center stage with Prophecy
Ashleigh Blalock
March 21, 2024
March 20, 2024
March 21, 2024
March 20, 2024
March 21, 2024
March 20, 2024
Data Integration Platform
5
min read

Too much data work. Too few data engineers. How to make it scale.

Struggling with data transformation? Hiring more data engineers is not the answer. Learn how low-code data transformation unlocks the full potential of your users and your data.
Mitesh Shah
February 14, 2025
February 14, 2025
February 14, 2025
Events + Announcements
5
min read

Johnson & Johnson Takes Center Stage with Prophecy at Gartner Data & Analytics 2024

Join us in Orlando to witness the future of data transformation
Mitesh Shah
February 13, 2024
February 13, 2024
February 13, 2024
Events + Announcements
3
min read

Webinar spotlight – The future of data transformation

Join our webinar and see why self-service is the future of data transformation, through unified visual & code technology
Mitesh Shah
January 16, 2024
January 16, 2024
January 16, 2024
January 16, 2024
January 16, 2024
January 16, 2024
Events + Announcements
3
min read

Modern Data’s Stuck

George K. Mathew
October 18, 2023
February 14, 2025
October 18, 2023
February 14, 2025
October 18, 2023
February 14, 2025
Events + Announcements
3
min read

Prophecy at Databricks Data+AI World Tour: Empowering Data Democratization #DAIWT

Join us in this exciting journey and discover how Prophecy's self-service solutions are revolutionizing the data landscape.
Emily Lewis
September 29, 2023
October 9, 2023
September 29, 2023
October 9, 2023
September 29, 2023
October 9, 2023
Events + Announcements
5
min read

Announcing Prophecy Package Builder and Package Hub: Data engineering, standardized.

With the release of Prophecy 3.2, we are thrilled to announce two game-changing capabilities: Prophecy Package Builder and Prophecy Package Hub.
Mitesh Shah
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
8
min read

How to build generative AI applications on enterprise data

Discover how to build generative AI applications leveraging enterprise data. Learn to identify use cases, choose effective models, and navigate challenges with our comprehensive guide.
Mei Long
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
5
min read

Prompt engineering vs. fine tuning: Which approach is right for your enterprise generative AI strategy?

In this blog, we'll take a look at the differences between prompt engineering and fine-tuning, and provide insights into each approach
Mitesh Shah
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
3
min read

Enterprise data and the taming of the Generative AI frontier

Companies can train small, domain-specific language models in a matter of hours or days rather than weeks or months provided they have governed and accurate training inputs. 
Kevin Petrie, VP of Research at the Eckerson Group
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
4
min read

SQL models are easy to deploy and orchestrate with Prophecy

Stop getting stuck managing SQL files, start making progress for your business today
Anya Bida
February 14, 2025
February 14, 2025
February 14, 2025
ETL modernization
6
min read

Understanding ETL Modernization

Everything you need to know to accelerate ETL modernization
Mei Long
March 27, 2025
March 27, 2025
March 27, 2025
Events + Announcements
4
min read

Prophecy and all things Data + AI Summit - that’s a wrap!

Get an exciting recap from Databricks Data + AI summit including Prophecy’s announcements around low-code data engineering and generative AI app development
Emily Lewis
January 22, 2025
January 22, 2025
January 22, 2025
Data Integration Platform
8
min read

How HealthVerity leverages Prophecy for unmatched data privacy and compliance

Mei Long
June 27, 2023
February 14, 2025
June 27, 2023
February 14, 2025
June 27, 2023
February 14, 2025
Data Integration Platform
9
min read

Introducing the Prophecy Generative AI Platform

Build powerful gen AI applications on private enterprise data in just hours
Raj Bains and Maciej Szpakowski
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025
Data Integration Platform
5
min read

Introducing Prophecy Data Copilot

Unlock the power of generative AI in data engineering with Prophecy’s Data Copilot.
Mitesh Shah
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025
Events + Announcements
10
min read

Prophecy at Data + AI Summit

Top 10 reasons to visit Prophecy at Data + AI Summit 2023
Emily Lewis
June 16, 2023
June 17, 2023
June 16, 2023
June 17, 2023
June 16, 2023
June 17, 2023
Data Integration Platform
6
min read

Getting started with low-code SQL

Empowering business data users to quickly and easily build scalable data pipelines on the lakehouse
Anya Bida
February 14, 2025
February 14, 2025
February 14, 2025
ETL modernization
5
min read

3 ways Prophecy modernizes ETL on Databricks

By modernizing the ETL process on Databricks, Prophecy can provide organizations with a more agile, scalable, and cost-effective solution for managing their data.
Maciej Szpakowski
January 13, 2025
February 26, 2025
January 13, 2025
February 26, 2025
January 13, 2025
February 26, 2025
Data Integration Platform
6
min read

How to implement ETL on Apache Spark

Learn key steps to follow, how to define the ETL pipeline using Spark APIs and dataframes, and best practices for testing and optimizing pipelines for maximum efficiency
Mei Long
May 16, 2024
May 16, 2024
May 16, 2024
Events + Announcements
3
min read

Event spotlight: Prophecy at Data + AI Summit

Bringing the power of low-code data engineering to the masses
Emily Lewis
May 16, 2024
May 16, 2024
May 16, 2024
Data Integration Platform
5
min read

Hitting data driven home runs: How the Texas Rangers win by harnessing Prophecy in their data mesh architecture

Learn how the Texas Rangers use Prophecy and Databricks Lakehouse as the foundation of their data mesh architecture to gain a competitive advantage with low-code data engineering.
Alexander Booth
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
11
min read

Empower all business data users with interactive SQL development

Leverage Prophecy’s low-code approach and integration with dbt Core to build SQL data pipelines without compromising on engineering best practices
Anya Bida
February 14, 2025
February 14, 2025
February 14, 2025
Events + Announcements
5
min read

Announcing Prophecy 3.0: low-code SQL transformations

Discover how Prophecy 3.0 arms all data users with low-code SQL, so they can quickly and easily build scalable data pipelines, resulting in highly impactful data products.
Maciej Szpakowski
April 26, 2023
February 14, 2025
April 26, 2023
February 14, 2025
April 26, 2023
February 14, 2025
ETL modernization
7
min read

From novice to expert: A blueprint for data analysts to build robust data transformation pipelines without relying on engineering

Learn essential skills and techniques to empower non-technical data practitioners to build ETL pipelines without relying on data engineering.
Mei Long
May 30, 2023
May 30, 2023
May 30, 2023
Prophecy for Databricks
3
min read

Data engineering for the data lakehouse: Four guiding principles

A rising number of enterprises are adopting the lakehouse to unite their analytics projects and foster innovation on a shared, cloud-based platform.
Kevin Petrie, VP of Research at the Eckerson Group
May 29, 2023
June 2, 2023
May 29, 2023
June 2, 2023
May 29, 2023
June 2, 2023
Events + Announcements
8
min read

Webinar spotlight — Moneyball: How the Texas Rangers use low-code data engineering and analytics to identify MVPs

Join this webinar to learn how the Texas Rangers are creating a competitive advantage in professional baseball by using data analytics and AI to improve player performance and evaluate new talent.
Emily Lewis
May 28, 2023
June 8, 2023
May 28, 2023
June 8, 2023
May 28, 2023
June 8, 2023
Data Integration Platform
2
min read

Getting started with low-code

Let's create a pipeline using Prophecy's visual, low-code interface for Spark.
Anya Bida
June 8, 2023
June 8, 2023
June 8, 2023
Data Integration Platform
15
min read

PySpark hands-on tutorial using a visual IDE

Let's get started with PySpark using a visual interface to generate open-source Spark code.
Anya Bida
May 16, 2024
May 16, 2024
May 16, 2024
Data Integration Platform
5
min read

Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 2

In Part 1, we learned an easy way to troubleshoot a data pipeline using historical, read-only metadata. Now, I want to dig in and polish my individual spark data frames.
Anya Bida
June 8, 2023
June 8, 2023
June 8, 2023
Data Integration Platform
4
min read

Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 1

Let’s take advantage of Spark’s interim metadata to understand our Spark job behavior with low-code tooling.
Anya Bida
April 22, 2023
April 22, 2023
April 22, 2023
ETL modernization
4
min read

Cloud data engineering on Spark — factors for transitioning to the stack

For enterprises, navigating the cloud transition can be tricky. This describes the two paradigms for ETL in the cloud, and the factors to consider when choosing one.
Raj Bains
November 8, 2022
May 16, 2024
November 8, 2022
May 16, 2024
November 8, 2022
May 16, 2024