Databricks Integration with Delta Sharing

Learn how to integrate Databricks with Kubit using Delta Sharing for secure data exchange.

Introduction

Databricks enables seamless data sharing with Kubit through its Delta Sharing feature.

Delta Sharing

Delta Sharing is an open protocol developed by Databricks for secure data sharing across different organizations and platforms. As a Databricks user, you can act as a “data provider” to share data with external “data recipients.” This allows recipients to access the most current version of the shared data immediately.

Delta Sharing

Requirements

To utilize Delta Sharing, ensure you have configured a Databricks Metastore and Catalog.

Configure Delta Share

  1. Access Your Metastore: Log into your Databricks account, select the metastore linked to your workspace, and enable Delta Sharing. Choose the token lifetime and organization name as needed. Note that Databricks to Databricks sharing does not require token authentication.

    Metastore Configuration

  2. Navigate to Your Workspace: In the "Data Science & Engineering" menu, go to the "Data" tab. Select the "Delta Sharing" sub-menu and click "New recipient."

    Workspace Navigation

  3. Create a Recipient: Fill in the form with the following details:

    • Name: kubit
    • Sharing identifier: Unique ID provided by the Kubit Team.

    Recipient Creation

  4. Share Data: Click "Share data" and enter:

    • Share name: kubit

    Share Data

  5. Manage Shares: On the share management screen, click "Add recipient" and select the recipient created in step 3.

    Manage Shares

  6. Add Tables: Select the tables to share with Kubit and click "Save."

    Add Tables

  7. Verify Recipients: Ensure the Kubit recipient is listed under the "Recipients" tab.

  8. Access Confirmation: The Kubit team now has access to the shared data. Thank you!

For more details, refer to the Databricks Delta Sharing documentation or watch the "Databricks Delta Sharing Demo".