Connect to ScrapingBee Data in JRuby

JRuby is a high-performance, stable, fully threaded Java implementation of the Ruby programming language. The CData JDBC Driver for ScrapingBee makes it easy to integrate connectivity to live ScrapingBee data in JRuby. This article shows how to create a simple JRuby app that connects to ScrapingBee data, executes a query, and displays the results.

Configure a JDBC Connection to ScrapingBee Data

Before creating the app, note the installation location for the JAR file for the JDBC Driver (typically C:\Program Files\CData\CData JDBC Driver for ScrapingBee\lib).

JRuby natively supports JDBC, so you can easily connect to ScrapingBee and execute SQL queries. Initialize the JDBC connection with the getConnection function of the java.sql.DriverManager class.

Using API Key Authentication

ScrapingBee uses API key authentication. To obtain an API key:

1. Sign in to your ScrapingBee account at https://app.scrapingbee.com
2. Navigate to the Dashboard and locate your API key in the top section.
3. Copy the API key for use in the connection string.

After obtaining your API key, set the following connection properties:

• AuthScheme: Set this to APIKey.

Set the following in the ProfileSettings connection property:

• APIKey: Set this to your ScrapingBee API key.

Example Connection String

Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";

Connecting to ScrapingBee

Once the authentication is configured, you can connect to ScrapingBee and query data from any of the available tables. All tables require at least one input parameter (such as a search query or product ID) to retrieve data.

Built-in Connection String Designer

For assistance in constructing the JDBC URL, use the connection string designer built into the ScrapingBee JDBC Driver. Either double-click the JAR file or execute the jar file from the command-line.

java -jar cdata.jdbc.api.jar

Fill in the connection properties and copy the connection string to the clipboard.

👁 Using the built-in connection string designer to generate a JDBC URL (Salesforce is shown.)

Below is a typical JDBC connection string for ScrapingBee:

jdbc:api:Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";

Create a JRuby App with Connectivity to ScrapingBee Data

Create a new Ruby file (for example: APISelect.rb) and open it in a text editor. Copy the following code into your file:

require 'java'
require 'rubygems'
require 'C:/Program Files/CData/CData JDBC Driver for ScrapingBee 2018/lib/cdata.jdbc.api.jar'

url = "jdbc:api:Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";"
conn = java.sql.DriverManager.getConnection(url)
stmt = conn.createStatement
rs = stmt.executeQuery("SELECT , FROM GoogleSearchResults")
while (rs.next) do
 puts rs.getString(1) + ' ' + rs.getString(2)
end

With the file completed, you are ready to display your ScrapingBee data with JRuby. To do so, simply run your file from the command line:

jruby -S APISelect.rb

Writing SQL-92 queries to ScrapingBee allows you to quickly and easily incorporate ScrapingBee data into your own JRuby applications. Download a free trial today!