VOOZH about

URL: https://www.cdata.com/kb/tech/databricks-cloud-power-pivot.rst

⇱ Use CData Connect AI to Access Databricks Data in Microsoft Power Pivot

Use CData Connect AI to Access Databricks Data in Microsoft Power Pivot

👁 Dibyendu Datta
Dibyendu Datta
Lead Technology Evangelist
Use CData Connect AI to connect to live Databricks data in the Power Pivot business intelligence tool.

This article will explain how to use CData Connect AI to present Databricks data as OData services and then consume the data in Microsoft Excel's Power Pivot business intelligence tool. Follow the steps below to retrieve and edit Databricks data in Power Pivot.

About Databricks Data Integration

Accessing and integrating live data from Databricks has never been easier with CData. Customers rely on CData connectivity to:

  • Access all versions of Databricks from Runtime Versions 9.1 - 13.X to both the Pro and Classic Databricks SQL versions.
  • Leave Databricks in their preferred environment thanks to compatibility with any hosting solution.
  • Secure authenticate in a variety of ways, including personal access token, Azure Service Principal, and Azure AD.
  • Upload data to Databricks using Databricks File System, Azure Blog Storage, and AWS S3 Storage.

While many customers are using CData's solutions to migrate data from different systems into their Databricks data lakehouse, several customers use our live connectivity solutions to federate connectivity between their databases and Databricks. These customers are using SQL Server Linked Servers or Polybase to get live access to Databricks from within their existing RDBMs.

Read more about common Databricks use-cases and how CData's solutions help solve data problems in our blog: What is Databricks Used For? 6 Use Cases.


Getting Started


Connect to Databricks from Power Pivot

To work with Databricks data from Power Pivot, we need to connect to Databricks from Connect AI, provide user access to the connection, and create a Workspace for the Databricks data.

Connect to Databricks from Connect AI

CData Connect AI uses a straightforward, point-and-click interface to connect to data sources.

  1. Log into Connect AI, click Sources, and then click Add Connection
    2. 👁 Adding a Connection
  2. Select "Databricks" from the Add Connection panel
    3. 👁 Selecting a data source
  3. Enter the necessary authentication properties to connect to Databricks.

    To connect to a Databricks cluster, set the properties as described below.

    Note: The needed values can be found in your Databricks instance by navigating to Clusters, and selecting the desired cluster, and selecting the JDBC/ODBC tab under Advanced Options.

    • Server: Set to the Server Hostname of your Databricks cluster.
    • HTTPPath: Set to the HTTP Path of your Databricks cluster.
    • Token: Set to your personal access token (this value can be obtained by navigating to the User Settings page of your Databricks instance and selecting the Access Tokens tab).
    👁 Configuring a connection (Salesforce is shown)
  4. Click Save & Test
  5. Navigate to the Permissions tab in the Add Databricks Connection page and update the User-based permissions. 👁 Updating permissions

Add a Personal Access Token

When connecting to Connect AI through the REST API, the OData API, or the Virtual SQL Server, a Personal Access Token (PAT) is used to authenticate the connection to Connect AI. It is best practice to create a separate PAT for each service to maintain granularity of access.

  1. Click on the Gear icon () at the top right of the Connect AI app to open the settings page.
  2. On the Settings page, go to the Access Tokens section and click Create PAT.
  3. Give the PAT a name and click Create. 👁 Creating a new PAT
  4. The personal access token is only visible at creation, so be sure to copy it and store it securely for future use.

Configure Databricks Endpoints for Power Pivot

After connecting to Databricks, create a workspace for your desired table(s).

  1. Navigate to the Workspaces page and click Add to create a new Workspace (or select an existing workspace). 👁 The Workspaces page.
    👁 Adding a new Workspace.
  2. Click Add to add new assets to the Workspace.
  3. Select the Databricks connection (e.g. Databricks1) and click Next. 👁 Selecting an Asset (Salesforce is shown).
  4. Select the table(s) you wish to work with and click Confirm. 👁 Selecting Tables (Salesforce is shown).
  5. Make note of the OData Service URL for your workspace, e.g. https://cloud.cdata.com/api/odata/{workspace_name}

With the connection, PAT, and Workspace configured, you are ready to connect to Databricks data from Power Pivot.

Import Databricks Tables in Power Pivot

Follow the steps below to import tables that can be refreshed on demand:

  1. In Excel, click Data -> Get Data -> From Other Sources -> From OData Feed 👁 Starting the OData connection.
  2. Fill out the OData feed URL (e.g. https://cloud.cdata.com/api/odata/{workspace_name}) 👁 The URL of the OData endpoint for Connect AI.
  3. On the next screen, select Basic and configure the username and password. Password will be your PAT. 👁 Authenticating with Connect AI

  4. Select the tables that you would like to import into Excel 👁 Selecting tables (Salesforce is shown.)

  5. After selecting your table(s) and clicking Load, you should see the data appear in an Excel spreadsheet 👁 Loading tables (Salesforce is shown.)

  6. Now, click the Power Pivot tab on the ribbon, and then select Add to Data Model. 👁 Loading data into Power Pivot (Salesforce is shown.)
    This can now work with your Databricks data in Power Pivot.

    👁 The Pivot Table that is consuming OData feeds from Connect AI. (Salesforce is shown.)

Free Trial & More Information

If you are interested in connecting to your Databricks data (or data from any of our other supported data sources) from Power Pivot, sign up for a free trial of CData Connect AI today! For more information on Connect AI and to see what other data sources we support, refer to our CData Connect AI page.