Resources and insights

A rising number of enterprises are adopting the lakehouse to unite their analytics projects and foster innovation on a shared, cloud-based platform.

By modernizing the ETL process on Databricks, Prophecy can provide organizations with a more agile, scalable, and cost-effective solution for managing their data.

Learn key steps to follow, how to define the ETL pipeline using Spark APIs and dataframes, and best practices for testing and optimizing pipelines for maximum efficiency

Learn essential skills and techniques to empower non-technical data practitioners to build ETL pipelines without relying on data engineering.

Bringing the power of low-code data engineering to the masses

Learn how the Texas Rangers use Prophecy and Databricks Lakehouse as the foundation of their data mesh architecture to gain a competitive advantage with low-code data engineering.

Leverage Prophecy’s low-code approach and integration with dbt Core to build SQL data pipelines without compromising on engineering best practices

Learn more about the evolution of data architectures, from traditional ETL through two-tier and modern data lakehouses. Explore how Prophecy can enable you to leverage the lakehouse by making common use cases like advanced merges and slowly changing dimensions significantly easier.

Discover how Prophecy 3.0 arms all data users with low-code SQL, so they can quickly and easily build scalable data pipelines, resulting in highly impactful data products.

We're excited to be a part of Databricks Partner connect! Read this blog to learn how Databricks Partner Connect makes getting started with Prophecy simple via single-click signup and sign-in.

Prophecy has innovated in metadata management by merging code on git with metadata, making it code-first.

Prophecy computes column-level lineage from code for Spark code on Git.

Prophecy IDE enables visual and code developers to produce high-quality Spark code.

Introducing Prophecy.io — a high-performance, zero-compromise, cloud-native data engineering product powered by Spark for enterprise data engineering teams.

Let's get started with PySpark using a visual interface to generate open-source Spark code.

Let’s take advantage of Spark’s interim metadata to understand our Spark job behavior with low-code tooling.

For enterprises, navigating the cloud transition can be tricky. This describes the two paradigms for ETL in the cloud, and the factors to consider when choosing one.

Prophecy also provides a highly automated replacement for legacy ETL products to accelerate the journey to open source and cloud computing.

Just a few days ago, we announced a Prophecy for Databricks. In this blog post — Part 2 of that announcement — we dig into how Prophecy makes data engineering simple for any data practitioner on Databricks.‍

In this blog, we learn about the concept of financial reporting, its importance, the various challenges faced while generating an efficient and reliable financial report and how Prophecy makes the complete process easy sailing.

Prophecy is delighted to announce we raised a $25M Series A led by Insight Partners, with participation from SignalFire, Dig Ventures and Berkeley SkyDeck.

In a Data Engineering Battle, Prophecy presented a complete, low-code data engineering product with a session for low-code Spark, low-code Airflow and column-level lineage that hundreds attended. Here are the poll results.

Prophecy presented a complete, low-code data engineering product at the Data + AI Summit 2021. Hundreds attended our sessions on low-code Spark, low-code Airflow and column-level lineage. Here are the results from the polls we conducted there.

Learn about the four main pillars of productive, powerful, low-code data engineering on Spark. See all the pieces in action!

Announcing the launch of Prophecy SaaS!

The disruption is agile software practices in data engineering made usable for the many. Allow me to explain.

We discuss the two cloud data engineering architectures and advise which one to pick as you move your ETL to the cloud.

We're excited to share what we have built with you. Sign up and let us know what you think!

Parser combinators allow you to develop sophisticated parsers quickly and see how to use them.

Customer discovery is essential to figuring out product market fit. Learn how to do it well and when to use it.

Explore alternatives to Alteryx for modern data prep. Explore options and how Prophecy delivers scalability and openness to modernize data preparation.

Discover how to build generative AI applications leveraging enterprise data. Learn to identify use cases, choose effective models, and navigate challenges with our comprehensive guide.