Integrate with ScrapingBee Data in JReport Designer

The CData JDBC Driver for ScrapingBee data enables access to live data from dashboards and reports as if ScrapingBee were a relational database, allowing you to query ScrapingBee data using familiar SQL queries. This article shows how to connect to ScrapingBee data as a JDBC data source and create reports based on ScrapingBee data in JReport Designer.

Connect to ScrapingBee Data

1. Edit C:\JReport\Designer\bin\setenv.bat to add the location of the JAR file to the ADDCLASSPATH variable:

   ...
   set ADDCLASSPATH=%JAVAHOME%\lib\tools.jar;C:\Program Files\CData\CData JDBC Driver for ScrapingBee 2016\lib\cdata.jdbc.api.jar;
   ...
   

2. Create a new data source by clicking File New Data Source.
3. In the resulting dialog, create a name for the data source (CData JDBC Driver for ScrapingBee), select JDBC, and click OK.
4. In the Get JDBC Connection Information dialog you will configure your connection to the JDBC driver:
   • Driver: Be sure that the Driver box is checked and fill in the name of the class for the driver:

     cdata.jdbc.api.APIDriver

   • URL: Enter the JDBC URL. This starts with jdbc:api: and is followed by a semicolon-separated list of connection properties.

     Using API Key Authentication

     ScrapingBee uses API key authentication. To obtain an API key:

     1. Sign in to your ScrapingBee account at https://app.scrapingbee.com
     2. Navigate to the Dashboard and locate your API key in the top section.
     3. Copy the API key for use in the connection string.

     After obtaining your API key, set the following connection properties:

     • AuthScheme: Set this to APIKey.
     Set the following in the ProfileSettings connection property:
     • APIKey: Set this to your ScrapingBee API key.

     Example Connection String

     Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";
     

     Connecting to ScrapingBee

     Once the authentication is configured, you can connect to ScrapingBee and query data from any of the available tables. All tables require at least one input parameter (such as a search query or product ID) to retrieve data.

     Built-in Connection String Designer

     For assistance in constructing the JDBC URL, use the connection string designer built into the ScrapingBee JDBC Driver. Either double-click the JAR file or execute the jar file from the command-line.

     java -jar cdata.jdbc.api.jar
     

     Fill in the connection properties and copy the connection string to the clipboard.

     👁 Using the built-in connection string designer to generate a JDBC URL (Salesforce is shown.)
     

     When you configure the JDBC URL, you may also want to set the Max Rows connection property. This will limit the number of rows returned, which is especially helpful for improving performance when designing reports and visualizations.

     Below is a typical JDBC URL:

     jdbc:api:Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";

   • User: The username to authenticate with; typically left blank.
   • Password: The password to authenticate with; typically left blank.
   👁 Configuring the connection to the JDBC Driver (Salesforce is shown.)
   

5. In the Add Table dialog, select the tables you wish to include in your report (or in future reports using this data source) and click Add.

   👁 Adding Tables. (Salesforce is shown.)
   

   Click Done once the dialog has completed loading the tables.

6. In the Catalog Browser, you can create the queries that you will use to populate your reports. You can do this now, or after you create your report. In either case, expand () the data source (CData JDBC Driver for ScrapingBee), right-click on Queries, and select Add Query. 👁 Adding a query for data to be used in the report. (Salesforce is shown.)
   
7. In the Add Table/View/Query dialog, expand () the JDBC URL and Tables and select the table(s) you wish to use in the query and click OK. 👁 Selecting a table for the query. (Salesforce is shown.)
   
8. In the Query Editor dialog, you can select the columns you wish to include or simply click the SQL button and manually input your own query. For example:

   SELECT , FROM GoogleSearchResults WHERE SearchQuery = 'cdata drivers'
   

   👁 Editing the query. (Salesforce is shown.)
   

   With the query built, click OK to close the Query Editor dialog. At this point you are ready to add ScrapingBee data to a new or existing report.

   NOTE: Now that the query is built, you can create a Business View based on the query. With a Business View, you can create Web reports or library components based on the query. For more information on this, refer to the JReport tutorials.

Add ScrapingBee Data to a Report

You are now ready to create a report with ScrapingBee data.

1. Create a new report (File New Page Report) or open the Chart Wizard for an existing report.
2. Select the Query (or create a new one; see above).
👁 Selecting the query to use. (Salesforce is shown.)

3. Assign a Category and Value for the chart from the columns in your Query and click Finish.
👁 Assigning columns to define the chart. (Salesforce is shown.)

4. Click the View tab for your report to see the chart.