Connect to Azure Data Lake Storage Data in NetBeans

The CData JDBC Driver for Azure Data Lake Storage integrates connectivity to live Azure Data Lake Storage data in IDEs that support JDBC. The JDBC standard enables you to use built-in data access wizards and other tools supporting rapid development. This article shows how to connect to Azure Data Lake Storage data in NetBeans. You will create a connection and load Azure Data Lake Storage data in the Table Editor.

Create a JDBC Data Source for Azure Data Lake Storage in NetBeans

To create the JDBC data source, expand the Database node in the Service window, right-click the Drivers node, and select New Driver. In the New Driver wizard that results, enter the following information:

• Driver File(s): Click Add and, in the file explorer dialog that appears, select the cdata.jdbc.adls.jar file. The driver JAR is located in the lib subfolder of the installation directory.
• Driver Class: Click Find to search for the driver class inside the JAR. Then select cdata.jdbc.adls.ADLSDriver from the menu.
• Name: Enter the name for the driver.

Define Connection Parameters

Follow the steps below to define required connection properties:

1. In the Service window, right-click the Database node and click New Connection.

2. In the New Connection Wizard, enter the following connection properties:

   • Driver Name: In the menu, select the CData JDBC Driver for Azure Data Lake Storage.
   • User Name: Enter the username. This can also be defined in the JDBC URL.
   • Password: Enter the password. This can also be defined in the JDBC URL.

   • JDBC URL: Specify the JDBC URL.

     Authenticating to a Gen 1 DataLakeStore Account

     Gen 1 uses OAuth 2.0 in Entra ID (formerly Azure AD) for authentication.

     For this, an Active Directory web application is required. You can create one as follows:

     1. Sign in to your Azure Account through the
     2. Select "Entra ID" (formerly Azure AD).
     3. Select "App registrations".
     4. Select "New application registration".
     5. Provide a name and URL for the application. Select Web app for the type of application you want to create.
     6. Select "Required permissions" and change the required permissions for this app. At a minimum, "Azure Data Lake" and "Windows Azure Service Management API" are required.
     7. Select "Key" and generate a new key. Add a description, a duration, and take note of the generated key. You won't be able to see it again.

     To authenticate against a Gen 1 DataLakeStore account, the following properties are required:

     • Schema: Set this to ADLSGen1.
     • Account: Set this to the name of the account.
     • OAuthClientId: Set this to the application Id of the app you created.
     • OAuthClientSecret: Set this to the key generated for the app you created.
     • TenantId: Set this to the tenant Id. See the property for more information on how to acquire this.
     • Directory: Set this to the path which will be used to store the replicated file. If not specified, the root directory will be used.

     Authenticating to a Gen 2 DataLakeStore Account

     To authenticate against a Gen 2 DataLakeStore account, the following properties are required:

     • Schema: Set this to ADLSGen2.
     • Account: Set this to the name of the account.
     • FileSystem: Set this to the file system which will be used for this account.
     • AccessKey: Set this to the access key which will be used to authenticate the calls to the API. See the property for more information on how to acquire this.
     • Directory: Set this to the path which will be used to store the replicated file. If not specified, the root directory will be used.

     Built-in Connection String Designer

     For assistance in constructing the JDBC URL, use the connection string designer built into the Azure Data Lake Storage JDBC Driver. Either double-click the JAR file or execute the jar file from the command-line.

     java -jar cdata.jdbc.adls.jar
     

     Fill in the connection properties and copy the connection string to the clipboard.

     👁 Using the built-in connection string designer to generate a JDBC URL (Salesforce is shown.)
     

     A typical JDBC URL is the following:

     jdbc:adls:Schema=ADLSGen2;Account=myAccount;FileSystem=myFileSystem;AccessKey=myAccessKey;InitiateOAuth=GETANDREFRESH;

Query Azure Data Lake Storage Data

To connect to Azure Data Lake Storage data, right-click the connection in the Database node and click Connect. After the connection is established, you can expand it to discover schema information.

To load a table in the Data Views window, right-click the table and then click View Data..