Native & Governed Experience
Prophecy works with your existing governance systems, and provides a single native experience to all users.
Prophecy works natively with your governed infrastructure
Prophecy works natively with Databricks. From a user perspective, this means:
- You login with the same authentication system you use for Databricks (such as Active Directory).
- You see all the datasets that you have access to in Databricks Unity Catalog.
- When you read a dataset and build a pipeline, it runs interactively inside Databricks at scale.
- Your data pipelines turn into native code in Spark - SQL, Python or Scala - with zero lock-in.
- You orchestrate jobs to run regularly using Databricks workflows.
Prophecy also works natively with your cloud infrastructure and this means that your processes are robust:
- You use your native authentication and authorization.
- Your data pipelines turn into code and tests that are committed to your git repository.
- You use software development best practices, including DevOps with CI, CD with development and production environments.