Our Blog

Low-code Spark

Blogs about Low-code Spark

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We care about your data in our Privacy Policy.
Low-code Spark
6
min read

Be more productive on Spark with low-code

Learn about the four main pillars of productive, powerful, low-code data engineering on Spark. See all the pieces in action!
Prophecy Team
June 8, 2023
June 8, 2023
Low-code Spark
5
min read

Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 2

In Part 1, we learned an easy way to troubleshoot a data pipeline using historical, read-only metadata. Now, I want to dig in and polish my individual spark data frames.
Anya Bida
June 8, 2023
June 8, 2023
Low-code Spark
4
min read

Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 1

Let’s take advantage of Spark’s interim metadata to understand our Spark job behavior with low-code tooling.
Anya Bida
April 22, 2023
April 22, 2023
Low-code Spark
15
min read

PySpark hands-on tutorial using a visual IDE

Let's get started with PySpark using a visual interface to generate open-source Spark code.
Anya Bida
April 22, 2023
April 22, 2023
Low-code Spark
2
min read

Getting started with low-code

Let's create a pipeline using Prophecy's visual, low-code interface for Spark.
Anya Bida
June 8, 2023
June 8, 2023
Low-code Spark
6
min read

How to implement ETL on Apache Spark

Learn key steps to follow, how to define the ETL pipeline using Spark APIs and dataframes, and best practices for testing and optimizing pipelines for maximum efficiency
Mei Long
June 1, 2023
June 1, 2023