Our Blog

Resources and Insights

The latest industry news, interviews, technologies, and resources.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We care about your data in our Privacy Policy.
Events
8
min read

Webinar spotlight — Moneyball: How the Texas Rangers use low-code data engineering and analytics to identify MVPs

Join this webinar to learn how the Texas Rangers are creating a competitive advantage in professional baseball by using data analytics and AI to improve player performance and evaluate new talent.
Emily Lewis
May 24, 2023
May 24, 2023
Low-code Spark
2
min read

Getting started with low-code

Let's create a pipeline using Prophecy's visual, low-code interface for Spark.
Anya Bida
April 22, 2023
April 22, 2023
Low-code Spark
15
min read

PySpark hands-on tutorial using a visual IDE

Let's get started with PySpark using a visual interface to generate open-source Spark code.
Anya Bida
April 22, 2023
April 22, 2023
Low-code Spark
5
min read

Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 2

In Part 1, we learned an easy way to troubleshoot a data pipeline using historical, read-only metadata. Now, I want to dig in and polish my individual spark data frames.
Anya Bida
April 22, 2023
April 22, 2023
Low-code Spark
4
min read

Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 1

Let’s take advantage of Spark’s interim metadata to understand our Spark job behavior with low-code tooling.
Anya Bida
April 22, 2023
April 22, 2023
ETL modernization
4
min read

Cloud data engineering on Spark — factors for transitioning to the stack

For enterprises, navigating the cloud transition can be tricky. This describes the two paradigms for ETL in the cloud, and the factors to consider when choosing one.
Raj Bains
November 8, 2022
April 22, 2023
November 8, 2022
April 22, 2023