Native & Governed Experience

Prophecy works with your existing governance systems, and provides a single native experience to all users.

Prophecy works natively with your governed infrastructure

Prophecy works natively with Databricks. From a user perspective, this means: 

  • You login with the same authentication system you use for Databricks (such as Active Directory).
  • You see all the datasets that you have access to in Databricks Unity Catalog.
  • When you read a dataset and build a pipeline, it runs interactively inside Databricks at scale.
  • Your data pipelines turn into native code in Spark - SQL, Python or Scala - with zero lock-in.
  • You orchestrate jobs to run regularly using Databricks workflows.

Prophecy also works natively with your cloud infrastructure and this means that your processes are robust:

  • You use your native authentication and authorization.
  • Your data pipelines turn into code and tests that are committed to your git repository.
  • You use software development best practices, including DevOps with CI, CD with development and production environments.
Next: Automate Migration