Integrating GitHub Copilot CLI with HDFS data via CData CLI

GitHub Copilot CLI is the terminal interface for GitHub Copilot, giving developers direct access to an AI agent without leaving the command line. It can autonomously complete multi-step tasks driven by natural language instructions, including reading and modifying files, running shell commands, managing pull requests on GitHub, and delegating work to specialized custom agents. Its support for agent skills and custom instructions makes it well-suited for structured, tool-driven workflows, making it a natural fit for connecting to external data sources through CData CLI.

By describing your data goals in plain language, GitHub Copilot CLI can handle the full setup process, from driver configuration and license activation to connection creation and query execution, without manual intervention at each step.

This article details step-by-step directions for how to connect HDFS data to GitHub Copilot CLI through CData CLI.

Prerequisites

1. GitHub Copilot CLI installed
2. CData CLI installed
3. Access to HDFS

Step 1: Download the skill (one-time setup)

Always use CData CLI with the official skill.

1. The official CData CLI Skill is available on GitHub and installs through npx skills in the terminal:

   npx skills add CDataSoftware/cli-skills

2. Follow the prompts in the terminal to install for GitHub Copilot. 👁 Install for GitHub Copilot
   

Step 2: Set up the project directory

Create a project directory to contain all project files.

1. Navigate to the directory within the terminal and start a session with the copilot command: 👁 Start a session
   👁 GitHub Copilot CLI UI
   

Step 3: Establish the driver and connection

Describe what you want to accomplish in this session with the CLI and HDFS data.

I would like to build a command line app that connects to HDFS data and checks for updates from Files. Make sure to include data from important columns like FileId and ChildrenNum.

This prompt automatically loads the skill and kicks off the following process. You can always manually prompt the agent for each of the following steps.

1. Driver setup: GitHub Copilot CLI checks for an existing CData HDFS driver, or searches and downloads a new one:

• cdatacli drivers list

• cdatacli drivers search --driver "HDFS"

• cdatacli drivers download --artifact-id <artifact-id>

2. Activation: Activate the HDFS driver with a single command for a trial or full license:

• cdatacli drivers activate "HDFS" --name "<name>" --email "<email>" --trial

• cdatacli drivers activate "HDFS" --name "<name>" --email "<email>" --key "<product-key>"

3. Establish the HDFS connection: Check for existing HDFS connections or create a new one:

• cdatacli connection list

• cdatacli connection create --driver HDFS --name my_hdfs_connection --connectionstring "Prop1=value1;Prop2=value2;..."

4. Create a HDFS skill (if applicable): CData provides driver instructions for popular sources. You can use these to generate a source-specific skill file that guides the agent through best practices for the driver.
• Run the following command and save the output to your skills directory, either at the project level or globally. (Note: If you receive a "No instructions available for HDFS" message, no driver instructions exist for this source. You can continue using the main driver skill.)

  cdatacli drivers skill "HDFS" > ~/skills/cdata-hdfs/SKILL.md

Step 4: Query HDFS data

With the CData driver fully configured, your agent can now execute queries and write code against live HDFS data:

cdatacli query sql --connection my_hdfs_connection --sql "SELECT * FROM Files"

---

Query HDFS data directly from your terminal with CData CLI

GitHub Copilot CLI and CData CLI together give your AI coding agent a direct path to live HDFS data without custom middleware, scheduled syncs, or manual setup at each step. Describe your goal in plain language, and the agent handles driver configuration, connection setup, and query execution from start to finish in the terminal.

Download the free CData CLI and start a free, 30-day trial of the CData JDBC Driver for HDFS today.