Resources and insights

By modernizing the ETL process on Databricks, Prophecy can provide organizations with a more agile, scalable, and cost-effective solution for managing their data.

A practical guide for teams evaluating Prophecy and Lakeflow Designer

The hot topic? Access to data for all users

Prophecy’s latest release democratizes pipeline development with AI agents, keeps humans in the loop

Discover how Prophecy revolutionizes your data operations.

Maximize productivity without the complexity.

Prophecy’s booth will be hopping with book signings, Copilots, and the latest on data and AI

Prophecy brings championship winning data, critical healthcare data, and AI for data transformation to DAIS 2024

Inaugural course addresses the growing data engineering skills gap through agile, self-paced training

With the release of Prophecy 3.2, we are thrilled to announce two game-changing capabilities: Prophecy Package Builder and Prophecy Package Hub.

Learn key steps to follow, how to define the ETL pipeline using Spark APIs and dataframes, and best practices for testing and optimizing pipelines for maximum efficiency

Let's get started with PySpark using a visual interface to generate open-source Spark code.

Let’s take advantage of Spark’s interim metadata to understand our Spark job behavior with low-code tooling.

Just a few days ago, we announced a Prophecy for Databricks. In this blog post — Part 2 of that announcement — we dig into how Prophecy makes data engineering simple for any data practitioner on Databricks.‍

Learn about the four main pillars of productive, powerful, low-code data engineering on Spark. See all the pieces in action!

Announcing the launch of Prophecy SaaS!

Discover how data domains replace centralized bottlenecks with distributed ownership. Stop waiting for data engineering teams.

Discover why data lineage implementations fail and the solutions that fix them.

Learn how data curation turns your data from a cost center to a growth driver and enhances business success.

The Prophecy team will be everywhere at the Databricks Summit next week - make sure to catch us!

Taming impossible data, agents and the impact of GenAI at our biggest data event of the year!

Guest Post By Dan Harris, CRO of Cloudaeon

Stop choosing between control and access. Learn how to build a robust Databricks governance framework that enables true self-service analytics without compromising security, powered by Prophecy.

Discover how self-service analytics tools are empowering non-technical users, enabling data access and insights without coding, streamlining decision-making.

Discover 8 effective ways to build data literacy across business and technical teams, breaking down barriers and enhancing collaboration for data-driven success.

Prophecy and Databricks are redefining how teams build and manage data pipelines on Databricks SQL.

Prophecy Introduces Fully Governed Data Preparation for Databricks SQL

Explore best practices and modern examples in data pipeline strategy. Learn to boost business success with scalable and reliable data solutions.

Everything you need to know to accelerate ETL modernization

We’ve written before about the challenge of having too few data engineers. There is another problem. 

Prophecy and data leaders embrace the GenAI moment at Gartner 2025

Data teams and analysts are inadvertently siloed into different parts of their organizations. These are the 5 data dysfunctions that breed this situation.

Our new survey shows that data leaders are embracing GenAI and bracing for new challenges

Join the Prophecy team in Orlando to see how genAI is reshaping data teams

How copilots will change data transformation, and in the process evolve beyond conversational interfaces

Struggling with data transformation? Hiring more data engineers is not the answer. Learn how low-code data transformation unlocks the full potential of your users and your data.

Discover how to build generative AI applications leveraging enterprise data. Learn to identify use cases, choose effective models, and navigate challenges with our comprehensive guide.

In this blog, we'll take a look at the differences between prompt engineering and fine-tuning, and provide insights into each approach

Companies can train small, domain-specific language models in a matter of hours or days rather than weeks or months provided they have governed and accurate training inputs. 

Stop getting stuck managing SQL files, start making progress for your business today

Build powerful gen AI applications on private enterprise data in just hours

Unlock the power of generative AI in data engineering with Prophecy’s Data Copilot.

Empowering business data users to quickly and easily build scalable data pipelines on the lakehouse

Learn how the Texas Rangers use Prophecy and Databricks Lakehouse as the foundation of their data mesh architecture to gain a competitive advantage with low-code data engineering.

Leverage Prophecy’s low-code approach and integration with dbt Core to build SQL data pipelines without compromising on engineering best practices

Discover how Prophecy 3.0 arms all data users with low-code SQL, so they can quickly and easily build scalable data pipelines, resulting in highly impactful data products.

In this blog, we learn about the concept of financial reporting, its importance, the various challenges faced while generating an efficient and reliable financial report and how Prophecy makes the complete process easy sailing.

Prophecy is delighted to announce we raised a $25M Series A led by Insight Partners, with participation from SignalFire, Dig Ventures and Berkeley SkyDeck.

In a Data Engineering Battle, Prophecy presented a complete, low-code data engineering product with a session for low-code Spark, low-code Airflow and column-level lineage that hundreds attended. Here are the poll results.

The disruption is agile software practices in data engineering made usable for the many. Allow me to explain.

We're excited to share what we have built with you. Sign up and let us know what you think!

The clock strikes noon on Shadow IT

Prophecy also provides a highly automated replacement for legacy ETL products to accelerate the journey to open source and cloud computing.