VOOZH about

URL: https://www.cdata.com/kb/tech/databricks-cloud-infragistics-reveal.rst

⇱ Analyze Databricks Data in Infragistics Reveal

Analyze Databricks Data in Infragistics Reveal

👁 Jerod Johnson
Jerod Johnson
Director, Technology Evangelism
Use CData Connect AI to create on OData API on top of Databricks data and visualize live Databricks data in Infragistics Reveal.

Reveal, an offering from Infragistics, serves as a data visualization tool that seamlessly integrates with CData Connect AI. Together, they empower users to deliver dynamic dashboards using real-time data from a diverse range of data sources, including Databricks data. In this article, we will guide you through the process of connecting to Databricks via Connect AI and subsequently linking Connect AI with Infragistics Reveal to construct a straightforward dashboard.

About Databricks Data Integration

Accessing and integrating live data from Databricks has never been easier with CData. Customers rely on CData connectivity to:

  • Access all versions of Databricks from Runtime Versions 9.1 - 13.X to both the Pro and Classic Databricks SQL versions.
  • Leave Databricks in their preferred environment thanks to compatibility with any hosting solution.
  • Secure authenticate in a variety of ways, including personal access token, Azure Service Principal, and Azure AD.
  • Upload data to Databricks using Databricks File System, Azure Blog Storage, and AWS S3 Storage.

While many customers are using CData's solutions to migrate data from different systems into their Databricks data lakehouse, several customers use our live connectivity solutions to federate connectivity between their databases and Databricks. These customers are using SQL Server Linked Servers or Polybase to get live access to Databricks from within their existing RDBMs.

Read more about common Databricks use-cases and how CData's solutions help solve data problems in our blog: What is Databricks Used For? 6 Use Cases.


Getting Started


Connect to Databricks from Infragistics Reveal

To work with live Databricks data in Infragistics Reveal, we need to connect to Databricks from Connect AI, provide user access to the connection, and create a Workspace for the Databricks data.

Connect to Databricks from Connect AI

CData Connect AI uses a straightforward, point-and-click interface to connect to data sources.

  1. Log into Connect AI, click Sources, and then click Add Connection
    2. 👁 Adding a Connection
  2. Select "Databricks" from the Add Connection panel
    3. 👁 Selecting a data source
  3. Enter the necessary authentication properties to connect to Databricks.

    To connect to a Databricks cluster, set the properties as described below.

    Note: The needed values can be found in your Databricks instance by navigating to Clusters, and selecting the desired cluster, and selecting the JDBC/ODBC tab under Advanced Options.

    • Server: Set to the Server Hostname of your Databricks cluster.
    • HTTPPath: Set to the HTTP Path of your Databricks cluster.
    • Token: Set to your personal access token (this value can be obtained by navigating to the User Settings page of your Databricks instance and selecting the Access Tokens tab).
    👁 Configuring a connection (Salesforce is shown)
  4. Click Save & Test
  5. Navigate to the Permissions tab in the Add Databricks Connection page and update the User-based permissions. 👁 Updating permissions

Add a Personal Access Token

When connecting to Connect AI through the REST API, the OData API, or the Virtual SQL Server, a Personal Access Token (PAT) is used to authenticate the connection to Connect AI. It is best practice to create a separate PAT for each service to maintain granularity of access.

  1. Click on the Gear icon () at the top right of the Connect AI app to open the settings page.
  2. On the Settings page, go to the Access Tokens section and click Create PAT.
  3. Give the PAT a name and click Create. 👁 Creating a new PAT
  4. The personal access token is only visible at creation, so be sure to copy it and store it securely for future use.

Configure Databricks Endpoints for Infragistics Reveal

After connecting to Databricks, create a workspace for your desired table(s).

  1. Navigate to the Workspaces page and click Add to create a new Workspace (or select an existing workspace). 👁 The Workspaces page.
    👁 Adding a new Workspace.
  2. Click Add to add new assets to the Workspace.
  3. Select the Databricks connection (e.g. Databricks1) and click Next. 👁 Selecting an Asset (Salesforce is shown).
  4. Select the table(s) you wish to work with and click Confirm. 👁 Selecting Tables (Salesforce is shown).
  5. Make note of the OData Service URL for your workspace, e.g. https://cloud.cdata.com/api/odata/{workspace_name}

With the connection, PAT, and Workspace configured, you are ready to connect to Databricks data from Infragistics Reveal.

Create a Dashboard in Reveal

With Connect AI configured, we can visualize Databricks data in Reveal.

  1. Log into Reveal and click Dashboards -> New 👁 Adding a new dashboard
  2. Click Data Sources -> OData Feed 👁 Adding a new OData data source
  3. Specify the Connect AI OData API endpoint URL (found on the OData page): https://cloud.cdata.com/api/odata/{workspace_name} 👁 Configuring the OData URL
  4. Select Generic Credentials and
    • Set Username to a Connect AI username (e.g. [email protected])
    • Set Password to the PAT for the user
    👁 Configuring the credentials
  5. Select the entity you wish to visualize 👁 Selecting an entity to visualize (Salesforce is shown.)
  6. Select fields and choose a chart type 👁 Visualizing data in Reveal (Salesforce is shown.)

More Information & Free Trial

At this point, you have created a simple dashboard from live Databricks data. For more information on creating OData feeds from Databricks (and more than 100 other sources), visit the Connect AI page. Sign up for a free trial and start working live Databricks data in tools that consume OData APIs.