Resources and Insights
The latest industry news, interviews, technologies, and resources.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Webinar spotlight — Moneyball: How the Texas Rangers use low-code data engineering and analytics to identify MVPs
Join this webinar to learn how the Texas Rangers are creating a competitive advantage in professional baseball by using data analytics and AI to improve player performance and evaluate new talent.
Getting started with low-code
Let's create a pipeline using Prophecy's visual, low-code interface for Spark.
PySpark hands-on tutorial using a visual IDE
Let's get started with PySpark using a visual interface to generate open-source Spark code.
Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 2
In Part 1, we learned an easy way to troubleshoot a data pipeline using historical, read-only metadata. Now, I want to dig in and polish my individual spark data frames.
Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 1
Let’s take advantage of Spark’s interim metadata to understand our Spark job behavior with low-code tooling.
Cloud data engineering on Spark — factors for transitioning to the stack
For enterprises, navigating the cloud transition can be tricky. This describes the two paradigms for ETL in the cloud, and the factors to consider when choosing one.