Our blog

Resources and insights

The latest industry news, interviews, technologies, and resources.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We care about your data in our Privacy Policy.
ETL modernization
6
min read

Ab Initio to Spark: Modernize your ETL and lower costs

Prophecy also provides a highly automated replacement for legacy ETL products to accelerate the journey to open source and cloud computing.
Raj Bains
July 12, 2022
January 31, 2025
July 12, 2022
January 31, 2025
July 12, 2022
January 31, 2025
Prophecy for Databricks
10
min read

Deep dive into Prophecy for Databricks

Just a few days ago, we announced a Prophecy for Databricks. In this blog post β€” Part 2 of that announcement β€” we dig into how Prophecy makes data engineering simple for any data practitioner on Databricks.‍
Maciej Szpakowski
June 23, 2022
May 16, 2024
June 23, 2022
May 16, 2024
June 23, 2022
May 16, 2024
Data Integration Platform
10
min read

Financial reporting simplified: Working capital forecasting

In this blog, we learn about the concept of financial reporting, its importance, the various challenges faced while generating an efficient and reliable financial report and how Prophecy makes the complete process easy sailing.
Anshuman Agrawal
May 31, 2021
February 14, 2025
May 31, 2021
February 14, 2025
May 31, 2021
February 14, 2025
Prophecy for Databricks
15
min read

Prophecy with Delta β€” making data lakehouses easier

Learn more about the evolution of data architectures, from traditional ETL through two-tier and modern data lakehouses. Explore how Prophecy can enable you to leverage the lakehouse by making common use cases like advanced merges and slowly changing dimensions significantly easier.
Maciej Szpakowski
May 15, 2022
April 27, 2023
May 15, 2022
April 27, 2023
May 15, 2022
April 27, 2023
Events + Announcements
5
min read

Prophecy raises Series A to industrialize data refining

Prophecy is delighted to announce we raised a $25M Series A led by Insight Partners, with participation from SignalFire, Dig Ventures and Berkeley SkyDeck.
Raj Bains
January 20, 2022
February 14, 2025
January 20, 2022
February 14, 2025
January 20, 2022
February 14, 2025
Prophecy for Databricks
5
min read

Prophecy: Low-code data engineering on Databricks lakehouses via Partner Connect

We're excited to be a part of Databricks Partner connect! Read this blog to learn how Databricks Partner Connect makes getting started with Prophecy simple via single-click signup and sign-in.
Shagun Bains
November 18, 2021
April 22, 2023
November 18, 2021
April 22, 2023
November 18, 2021
April 22, 2023
Data Engineering
3
min read

Data Engineering Battle: Python vs SQL++ vs Visual=Code

In a Data Engineering Battle, Prophecy presented a complete, low-code data engineering product with a session for low-code Spark, low-code Airflow and column-level lineage that hundreds attended. Here are the poll results.
Raj Bains
July 13, 2021
February 14, 2025
July 13, 2021
February 14, 2025
July 13, 2021
February 14, 2025
Events + Announcements
5
min read

DATA+AI Summit 2021: Poll results and takeaways for low-code products

Prophecy presented a complete, low-code data engineering product at the Data + AI Summit 2021. Hundreds attended our sessions on low-code Spark, low-code Airflow and column-level lineage. Here are the results from the polls we conducted there.
Prophecy Team
May 1, 2021
May 16, 2024
May 1, 2021
May 16, 2024
May 1, 2021
May 16, 2024
Data Integration Platform
6
min read

Be more productive on Spark with low-code

Learn about the four main pillars of productive, powerful, low-code data engineering on Spark. See all the pieces in action!
Prophecy Team
May 16, 2024
May 16, 2024
May 16, 2024
Data Engineering
3
min read

Prophecy SaaS: Low-code data engineering for your Spark

Announcing the launch of Prophecy SaaS!
Prophecy Team
February 23, 2021
February 14, 2025
February 23, 2021
February 14, 2025
February 23, 2021
February 14, 2025
Data Engineering
4
min read

ELT is not the disruption β€” data engineering is!

The disruption is agile software practices in data engineering made usable for the many. Allow me to explain.
Raj Bains
October 20, 2020
February 14, 2025
October 20, 2020
February 14, 2025
October 20, 2020
February 14, 2025
6
min read

Apache Sparkβ„’ vs Snowflake: The cloud data engineering (ETL) debate!

We discuss the two cloud data engineering architectures and advise which one to pick as you move your ETL to the cloud.
Raj Bains
July 13, 2020
May 16, 2024
July 13, 2020
May 16, 2024
July 13, 2020
May 16, 2024
Events + Announcements
2
min read

Announcing Prophecy's public beta!

We're excited to share what we have built with you. Sign up and let us know what you think!
Prophecy Team
May 22, 2020
February 14, 2025
May 22, 2020
February 14, 2025
May 22, 2020
February 14, 2025
6
min read

ProphecyHub: Metadata re-invented with Git and GraphQL for data engineering

Prophecy has innovated in metadata management by merging code on git with metadata, making it code-first.
Raj Bains
April 22, 2020
April 22, 2023
April 22, 2020
April 22, 2023
April 22, 2020
April 22, 2023
6
min read

Spark: Column-level lineage

Prophecy computes column-level lineage from code for Spark code on Git.
Raj Bains
March 17, 2020
April 22, 2023
March 17, 2020
April 22, 2023
March 17, 2020
April 22, 2023
3
min read

Spark deserves a better IDE

Prophecy IDE enables visual and code developers to produce high-quality Spark code.
Raj Bains
January 28, 2020
April 22, 2023
January 28, 2020
April 22, 2023
January 28, 2020
April 22, 2023
5
min read

Scala packrat parser combinators for DSLs

Parser combinators allow you to develop sophisticated parsers quickly and see how to use them.
Raj Bains
October 11, 2019
May 16, 2024
October 11, 2019
May 16, 2024
October 11, 2019
May 16, 2024
4
min read

Startup superpower: customer discovery machine

Customer discovery is essential to figuring out product market fit. Learn how to do it well and when to use it.
Raj Bains
September 5, 2019
April 22, 2023
September 5, 2019
April 22, 2023
September 5, 2019
April 22, 2023
5
min read

Introducing Prophecy.io β€” cloud-native data engineering

Introducing Prophecy.io β€” a high-performance, zero-compromise, cloud-native data engineering product powered by Spark for enterprise data engineering teams.
Raj Bains
September 15, 2019
April 22, 2023
September 15, 2019
April 22, 2023
September 15, 2019
April 22, 2023