Databricks Connect#
Dataiku can leverage the Databricks Connect framework in order to read Dataiku datasets stored in Databricks, build queries using Dataframes and then write the result back to a Databricks dataset.
Setting up Databricks#
Before using Databricks Connect, you need to configure a Databricks connection in Dataiku. See our documentation for full setup instructions.
Reference documentation#
Handle to create Databricks Connect sessions from DSS datasets or connections |