Our Blog
Resources and Insights
The latest industry news, interviews, technologies, and resources.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We care about your data in our Privacy Policy.
Events
8
min read
Webinar spotlight — Moneyball: How the Texas Rangers use low-code data engineering and analytics to identify MVPs
Join this webinar to learn how the Texas Rangers are creating a competitive advantage in professional baseball by using data analytics and AI to improve player performance and evaluate new talent.
Low-code Spark
2
min read
Getting started with low-code
Let's create a pipeline using Prophecy's visual, low-code interface for Spark.
Low-code Spark
15
min read
PySpark hands-on tutorial using a visual IDE
Let's get started with PySpark using a visual interface to generate open-source Spark code.
Low-code Spark
5
min read
Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 2
In Part 1, we learned an easy way to troubleshoot a data pipeline using historical, read-only metadata. Now, I want to dig in and polish my individual spark data frames.
Low-code Spark
4
min read
Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 1
Let’s take advantage of Spark’s interim metadata to understand our Spark job behavior with low-code tooling.
ETL modernization
4
min read
Cloud data engineering on Spark — factors for transitioning to the stack
For enterprises, navigating the cloud transition can be tricky. This describes the two paradigms for ETL in the cloud, and the factors to consider when choosing one.