Our blog

Resources and insights

The latest industry news, interviews, technologies, and resources.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We care about your data in our Privacy Policy.
Prophecy for Databricks
12
min read

From Bronze to Gold: Navigating Medallion Architecture for Enterprise Success

Learn how Medallion Architecture can transform your enterprise data strategy by navigating its layered approach to data quality, governance, and analytics.
Prophecy Team
March 27, 2025
March 28, 2025
March 27, 2025
March 28, 2025
March 27, 2025
March 28, 2025
Prophecy for Databricks
7
min read

6 Challenges in Databricks CI/CD Implementations And Their Solutions

Explore optimal solutions to overcome challenges in implementing CI/CD for Databricks. Ensure streamlined data pipelines with best practices and tools.
Prophecy Team
March 27, 2025
March 28, 2025
March 27, 2025
March 28, 2025
March 27, 2025
March 28, 2025
Data Governance
8
min read

How to Implement and Balance Self-Service Analytics With Robust Compliance Measures

Learn to implement self-service analytics while ensuring compliance with GDPR and CCPA, using strategies like governance frameworks & data lineage tracking.
Prophecy Team
March 27, 2025
May 27, 2025
March 27, 2025
May 27, 2025
March 27, 2025
May 27, 2025
Data Strategy
10
min read

A Deep Dive into Unstructured Data Examples and Types

Delve into the diverse types of unstructured data shaping today's enterprises, discover their challenges, and unlock valuable insights for competitive edges.
Prophecy Team
March 27, 2025
March 28, 2025
March 27, 2025
March 28, 2025
March 27, 2025
March 28, 2025
Events + Announcements
5
min read

5 Takeaways from the Gartner Data & Analytics Summit

Prophecy and data leaders embrace the GenAI moment at Gartner 2025
Matt Turner
March 20, 2025
March 20, 2025
March 20, 2025
March 20, 2025
March 20, 2025
March 20, 2025
ETL modernization
8
min read

Data Extraction Explained: Building the Foundation for Data-Driven Decisions

Discover what data extraction is and learn why it's essential for accessing, analyzing data from multiple sources to drive business insights, analytics.
Prophecy Team
March 20, 2025
July 1, 2025
March 20, 2025
July 1, 2025
March 20, 2025
July 1, 2025
Data Strategy
13
min read

A Guide to Strategic Data Integration that Transforms Business Operations

Master modern data integration techniques that break down silos and drive business value. Learn practical approaches to combine disparate data sources for actionable insights.
Prophecy Team
March 20, 2025
May 1, 2025
March 20, 2025
May 1, 2025
March 20, 2025
May 1, 2025
Data Strategy
8
min read

Understanding Data Lakes, Data Warehouses, and Data Lakehouses: Making the Right Choice for Data Management

Explore the differences between data lakes, data warehouses, and data lakehouses to make informed decisions for your organization's data management and analytics strategies.
Prophecy Team
March 20, 2025
March 20, 2025
March 20, 2025
March 20, 2025
March 20, 2025
March 20, 2025
Events + Announcements
min read

Self-Service Data Preparation Without the Risk

Prophecy Introduces Fully Governed Data Preparation for Databricks SQL
Mitesh Shah
March 27, 2025
March 27, 2025
March 27, 2025
Data Strategy
10
min read

A Guide to Understanding Structured and Unstructured Data for Data Strategies

Learn how to leverage both structured and unstructured data for competitive advantage. Discover practical integration approaches and technology solutions to effectively manage diverse data types and drive informed decisions.
Prophecy Team
March 13, 2025
July 1, 2025
March 13, 2025
July 1, 2025
March 13, 2025
July 1, 2025
Self Service Data Transformation
8
min read

Reducing IT Dependency Through Self-Service Analytics in Data Retrieval

Discover how leading organizations reduce IT data request burdens with governed self-service analytics. Implement these 6 proven strategies to empower business users without sacrificing security or compliance.
Prophecy Team
March 12, 2025
May 1, 2025
March 12, 2025
May 1, 2025
March 12, 2025
May 1, 2025
Data Governance
8
min read

A Guide to Data Governance in Modern Data Pipelines

Explore modern data governance models and pipeline essentials for optimal data security, privacy, and compliance, enhancing decision-making and data quality.
Prophecy Team
March 12, 2025
March 21, 2025
March 12, 2025
March 21, 2025
March 12, 2025
March 21, 2025
Data Engineering
8
min read

How to Build Scalable and Secure Modern Data Pipelines

Explore modern data pipeline architecture with best practices on scalability, security & performance optimization. Unlock the secrets for seamless data flow.
Prophecy Team
March 12, 2025
March 19, 2025
March 12, 2025
March 19, 2025
March 12, 2025
March 19, 2025
Data Strategy
2
min read

The Five Dysfunctions of a Data Team

Data teams and analysts are inadvertently siloed into different parts of their organizations. These are the 5 data dysfunctions that breed this situation.
Lance Walter
March 6, 2025
March 6, 2025
March 6, 2025
March 6, 2025
March 6, 2025
March 6, 2025
Data Strategy
15
min read

How to Break Down Data Silos in Your Organization

Discover efficient ways to identify and dismantle data silos in your organization, improving collaboration and boosting innovation. Learn strategies like centralizing data, promoting cultural change, and leveraging AI tools.
Matt Turner
March 5, 2025
May 8, 2025
March 5, 2025
May 8, 2025
March 5, 2025
May 8, 2025
Data Strategy
14
min read

The Complete Data Ingestion Guide for Modern Data Strategy

Learn how data ingestion transforms scattered information into powerful insights. This comprehensive guide covers ingestion types, tools, and best practices to overcome common challenges in your data strategy.
Prophecy Team
March 5, 2025
May 1, 2025
March 5, 2025
May 1, 2025
March 5, 2025
May 1, 2025
Data Engineering
9
min read

Data Pipelines: Optimize and Modernize Your Data Strategy

Explore best practices and modern examples in data pipeline strategy. Learn to boost business success with scalable and reliable data solutions.
Mitesh Shah
March 27, 2025
March 27, 2025
March 27, 2025
ETL modernization
12
min read

Escape the Legacy ETL Trap and Embrace Modern Pipelines That Deliver

Legacy ETL pipelines can't handle today's AI demands. This guide explains modern approaches, compares ETL vs. ELT architectures, and provides a practical roadmap for modernizing your data transformation strategy.
Prophecy Team
February 21, 2025
May 15, 2025
February 21, 2025
May 15, 2025
February 21, 2025
May 15, 2025
ETL modernization
5
min read

How to Choose the Best ETL Tool: A Comprehensive Buyer's Guide

Explore top ETL tool considerations for seamless data integration, ensuring scalability, security, and cost-effectiveness.
Prophecy Team
February 20, 2025
February 20, 2025
February 20, 2025
February 20, 2025
February 20, 2025
February 20, 2025
Data Engineering
5
min read

Survey says… GenAI is reshaping data teams

Our new survey shows that data leaders are embracing GenAI and bracing for new challenges
Matt Turner
February 21, 2025
February 21, 2025
February 21, 2025
Events + Announcements
4
min read

3 Ways to Connect with Prophecy at the Gartner Data & Analytics Summit!

Join the Prophecy team in Orlando to see how genAI is reshaping data teams
Mitesh Shah
February 18, 2025
February 18, 2025
February 18, 2025
ETL modernization
15
min read

A Modern Guide to ETL (Extract, Transform, Load) for Data Leaders

Discover how modern ETL powers data extraction, transformation, and loading. Gain insights on real-time processing, cloud-native tools, and business value.
Matt Turner
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
Data Governance
5
min read

12 Must-Have Data Engineering Skills to Transform Your Career

Unlock your career potential with essential data engineering skills. Discover 12 must-have abilities that will transform your professional journey and set you apart in the field.
Mei Long
February 8, 2025
February 14, 2025
February 8, 2025
February 14, 2025
February 8, 2025
February 14, 2025
ETL modernization
7
min read

Unlocking ELT: Enhance Data Integration with Speed and Flexibility

Discover the power of ELT: transform data faster and more flexibly. Learn how this modern approach enhances data integration for improved analytics and insights.
Saurabh Jain
February 6, 2025
April 17, 2025
February 6, 2025
April 17, 2025
February 6, 2025
April 17, 2025
ETL modernization
8
min read

7 Ways AI is Enhancing ETL for Data Leaders

Discover 7 transformative ways AI-powered tools are enhancing ETL, turning routine tasks into business advantages for data leaders.
Matt Turner
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
ETL modernization
11
min read

The Complete Guide To ELT (Extract, Load, Transform) for Data Workflows

Explore how ELT (Extract, Load, Transform) revolutionizes data integration, enabling real-time insights and cost savings with cloud efficiency. Discover more now!
Prophecy Team
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
Events + Announcements
5
min read

Prophecy takes in $47M, to scale up and reimagine data integration with AI

Raj Bains
January 16, 2025
February 14, 2025
January 16, 2025
February 14, 2025
January 16, 2025
February 14, 2025
ETL modernization
5
min read

Five Predictions: Data Integration in 2025

The clock strikes noon on Shadow IT
Mitesh Shah
January 2, 2025
January 31, 2025
January 2, 2025
January 31, 2025
January 2, 2025
January 31, 2025
ETL modernization
5
min read

Gliding into the data wonderland

Bringing data teams together for the holidays
Matt Turner
December 17, 2024
January 31, 2025
December 17, 2024
January 31, 2025
December 17, 2024
January 31, 2025
Events + Announcements
5
min read

Data Intelligence and AI Copilots at the Databricks World Tour

Accelerating data transformation with AI to deliver insights
Matt Turner
October 31, 2024
January 31, 2025
October 31, 2024
January 31, 2025
October 31, 2024
January 31, 2025
Events + Announcements
4
min read

Success With AI Takes Data, Big Data!

Prophecy team was out in force at one of the data world’s biggest events
Matt Turner
October 2, 2024
January 31, 2025
October 2, 2024
January 31, 2025
October 2, 2024
January 31, 2025
ETL modernization
4
min read

Weigh Your Options As You Move Off Alteryx

Explore alternatives to Alteryx for modern data prep. Explore options and how Prophecy delivers scalability and openness to modernize data preparation.
Raj Bains
November 18, 2024
November 18, 2024
November 18, 2024
Prophecy for Databricks
5
min read

Load Data into Databricks Delta Lake in 5 Minutes

Discover how Prophecy revolutionizes your data operations.
Shashank Mishra
July 1, 2025
July 1, 2025
July 1, 2025
Events + Announcements
4
min read

Delivering AI and Data Value at CDOIQ 2024

Prophecy attended the CDOIQ Symposium last week in Boston.
Matt Turner
July 25, 2024
July 25, 2024
July 25, 2024
Prophecy for Databricks
6
min read

Airflow and Databricks: Shorten the Learning Curve with Prophecy

Maximize productivity without the complexity.
Pooja Singhal
July 1, 2025
July 1, 2025
July 1, 2025
Events + Announcements
6
min read

Databricks Data + AI Summit 2024: AI Shapes a Copilot Future

Databricks held their annual Data+AI Summit in San Francisco last week at Moscone Center.
Raveena Kapatkar
June 20, 2024
June 20, 2024
June 20, 2024
Events + Announcements
3
min read

AI, Copilot and Authors at Databricks Data and AI Summit 2024

Prophecy’s booth will be hopping with book signings, Copilots, and the latest on data and AI
Matt Turner
July 1, 2025
July 1, 2025
July 1, 2025
Data Integration Platform
4
min read

The Case for Data Transformation Copilots

How copilots will change data transformation, and in the process evolve beyond conversational interfaces
Raj Bains and Maciej Szpakowski
June 3, 2024
February 14, 2025
June 3, 2024
February 14, 2025
June 3, 2024
February 14, 2025
Events + Announcements
5
min read

AI, the Texas Rangers, and Aetion at Databricks Data + AI Summit 2024

Prophecy brings championship winning data, critical healthcare data, and AI for data transformation to DAIS 2024
Matt Turner
July 1, 2025
July 1, 2025
July 1, 2025
Data Integration Platform
3
min read

Data engineers and business data users: end the back-and-forth

We’ve written before about the challenge of having too few data engineers. There is another problem. 
Mitesh Shah
March 27, 2025
March 27, 2025
March 27, 2025
Events + Announcements
5
min read

Announcing Prophecy University

Inaugural course addresses the growing data engineering skills gap through agile, self-paced training
Mei Long
April 3, 2024
July 1, 2025
April 3, 2024
July 1, 2025
April 3, 2024
July 1, 2025
Events + Announcements
4
min read

Gartner Data & Analytics Summit 2024 - that’s a wrap!

Johnson & Johnson takes center stage with Prophecy
Ashleigh Blalock
March 21, 2024
March 20, 2024
March 21, 2024
March 20, 2024
March 21, 2024
March 20, 2024
Data Integration Platform
5
min read

Too much data work. Too few data engineers. How to make it scale.

Struggling with data transformation? Hiring more data engineers is not the answer. Learn how low-code data transformation unlocks the full potential of your users and your data.
Mitesh Shah
February 14, 2025
February 14, 2025
February 14, 2025
Events + Announcements
5
min read

Johnson & Johnson Takes Center Stage with Prophecy at Gartner Data & Analytics 2024

Join us in Orlando to witness the future of data transformation
Mitesh Shah
February 13, 2024
February 13, 2024
February 13, 2024
Events + Announcements
3
min read

Webinar spotlight – The future of data transformation

Join our webinar and see why self-service is the future of data transformation, through unified visual & code technology
Mitesh Shah
January 16, 2024
January 16, 2024
January 16, 2024
January 16, 2024
January 16, 2024
January 16, 2024
Events + Announcements
3
min read

Modern Data’s Stuck

George K. Mathew
October 18, 2023
February 14, 2025
October 18, 2023
February 14, 2025
October 18, 2023
February 14, 2025
Events + Announcements
3
min read

Prophecy at Databricks Data+AI World Tour: Empowering Data Democratization #DAIWT

Join us in this exciting journey and discover how Prophecy's self-service solutions are revolutionizing the data landscape.
Emily Lewis
September 29, 2023
October 9, 2023
September 29, 2023
October 9, 2023
September 29, 2023
October 9, 2023
Events + Announcements
5
min read

Announcing Prophecy Package Builder and Package Hub: Data engineering, standardized.

With the release of Prophecy 3.2, we are thrilled to announce two game-changing capabilities: Prophecy Package Builder and Prophecy Package Hub.
Mitesh Shah
July 1, 2025
July 1, 2025
July 1, 2025
Data Integration Platform
8
min read

How to build generative AI applications on enterprise data

Discover how to build generative AI applications leveraging enterprise data. Learn to identify use cases, choose effective models, and navigate challenges with our comprehensive guide.
Mei Long
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
5
min read

Prompt engineering vs. fine tuning: Which approach is right for your enterprise generative AI strategy?

In this blog, we'll take a look at the differences between prompt engineering and fine-tuning, and provide insights into each approach
Mitesh Shah
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
3
min read

Enterprise data and the taming of the Generative AI frontier

Companies can train small, domain-specific language models in a matter of hours or days rather than weeks or months provided they have governed and accurate training inputs. 
Kevin Petrie, VP of Research at the Eckerson Group
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
4
min read

SQL models are easy to deploy and orchestrate with Prophecy

Stop getting stuck managing SQL files, start making progress for your business today
Anya Bida
February 14, 2025
February 14, 2025
February 14, 2025
ETL modernization
6
min read

Understanding ETL Modernization

Everything you need to know to accelerate ETL modernization
Mei Long
March 27, 2025
March 27, 2025
March 27, 2025
Events + Announcements
4
min read

Prophecy and all things Data + AI Summit - that’s a wrap!

Get an exciting recap from Databricks Data + AI summit including Prophecy’s announcements around low-code data engineering and generative AI app development
Emily Lewis
January 22, 2025
January 22, 2025
January 22, 2025
Data Integration Platform
8
min read

How HealthVerity leverages Prophecy for unmatched data privacy and compliance

Mei Long
June 27, 2023
February 14, 2025
June 27, 2023
February 14, 2025
June 27, 2023
February 14, 2025
Data Integration Platform
9
min read

Introducing the Prophecy Generative AI Platform

Build powerful gen AI applications on private enterprise data in just hours
Raj Bains and Maciej Szpakowski
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025