Integrate Spark with JetBrains RubyMine using CData JDBC Drivers

CData JDBC Driver for Apache Spark offer standardized JDBC connectivity to 200+ data sources, allowing developers to treat SaaS and cloud APIs as relational databases. By integrating these drivers into JetBrains RubyMine, user can connect IDE directly to external systems like CRM or ERP platforms, enabling SQL based data access and real-time querying.

RubyMine is a advanced IDE for Ruby and Rails development that offers advanced coding assistance, debugging, and database tools. Through CData JDBC integration, developers can link RubyMine with Spark for easy access to live Spark data.

Overview

Here is a quick overview of the integration process:

1. Set Up Environment: Configure the Ruby interpreter in RubyMine
2. Install JDBC Driver: Add the CData JDBC Driver for Apache Spark to RubyMine's database configuration
3. Connect: Establish a live connection to Spark and begin querying Spark data

Configure the Ruby Interpreter in RubyMine

After installing the Ruby interpreter, open RubyMine and configure the environment.

1. Create a New Empty Project
2. Select the interpreter for example, C:\Ruby34-x64\bin uby.exe
3. Click Create to initialize the project

Add the CData JDBC Driver for Apache Spark

Next, configure the CData JDBC Driver for Apache Spark within RubyMine.

1. Go to View, select Tool Windows and click Database to open the database panel
👁 Open the Database panel

2. Click the "+" icon and choose Driver from the dropdown
👁 Add a new driver

3. In the Data Sources and Drivers window:
   • Provide a Name for the driver (e.g., CData Spark JDBC)
   • Click "+" in the Driver Files section and select Custom JARs
   👁 Select Custom JARs
   
   • Locate and open the cdata.jdbc.sparksql.jar file
   • Set the Class to cdata.jdbc.sparksql.SparkDriver
👁 Configure driver class

Create the Spark data source

1. Click Create Data Source and choose the newly created driver
2. In the connection window, confirm that the selected driver is correct
3. Enter your connection details:
• Name: Spark Connection
• URL: jdbc:sparksql:User=username;Password=password;
• Username and Password: User Spark credentials
👁 Configure data source properties

4. Click Test Connection. If successful, click OK to save
👁 Test the connection

Query live Spark data

Once the connection is established, you can query live Spark data directly within RubyMine.

1. Open the Database Console
2. Run SQL queries, for example:

   SELECT * FROM Spark data_Table LIMIT 10;

👁 Querying inside RubyMine

Developers can now easily access and manipulate Spark data using SQL inside RubyMine bridging code development and live data access in one unified environment.

Connect RubyMine to hundreds of Data Sources with CData

CData JDBC Drivers bring real time data connectivity to your development environment. With support for hundreds of sources, including CRM, ERP, analytics, and cloud APIs, developers can query, visualize, and build data driven applications without leaving their IDE.

Start your 30-day free trial to experience the full potential of live data connectivity.