VOOZH about

URL: https://www.cdata.com/kb/tech/scrapingbee-ado-powershell.rst

⇱ Automate ScrapingBee Integration Tasks from PowerShell

Automate ScrapingBee Integration Tasks from PowerShell

👁 Jerod Johnson
Jerod Johnson
Director, Technology Evangelism
Are you in search of a quick and easy way to access ScrapingBee data from PowerShell? This article demonstrates how to utilize the ScrapingBee Cmdlets for tasks like connecting to ScrapingBee data, automating operations, downloading data, and more.

The CData API Driver for ADO.NET is a standard ADO.NET Provider that make it easy to accomplish data cleansing, normalization, backup, and other integration tasks by enabling real-time access to ScrapingBee.

ADO.NET Provider

The ADO.NET Provider provides a SQL interface for ScrapingBee; this tutorial shows how to use the Provider to retrieve ScrapingBee data.

Once you have acquired the necessary connection properties, accessing ScrapingBee data in PowerShell can be enabled in three steps.

Using API Key Authentication

ScrapingBee uses API key authentication. To obtain an API key:

  1. Sign in to your ScrapingBee account at https://app.scrapingbee.com
  2. Navigate to the Dashboard and locate your API key in the top section.
  3. Copy the API key for use in the connection string.

After obtaining your API key, set the following connection properties:

  • AuthScheme: Set this to APIKey.
Set the following in the ProfileSettings connection property:
  • APIKey: Set this to your ScrapingBee API key.

Example Connection String

Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";

Connecting to ScrapingBee

Once the authentication is configured, you can connect to ScrapingBee and query data from any of the available tables. All tables require at least one input parameter (such as a search query or product ID) to retrieve data.

  1. Load the provider's assembly: 

    [Reflection.Assembly]::LoadFile("C:\Program Files\CData\CData API Driver for ADO.NET\lib\System.Data.CData.API.dll")

  2. Connect to ScrapingBee:

     
$conn= New-Object System.Data.CData.API.APIConnection("Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";")
$conn.Open()

  3. Instantiate the APIDataAdapter, execute an SQL query, and output the results: 

    $sql="SELECT , from GoogleSearchResults"

$da= New-Object System.Data.CData.API.APIDataAdapter($sql, $conn)
$dt= New-Object System.Data.DataTable
$da.Fill($dt)

$dt.Rows | foreach {
	Write-Host $_. $_.
}
CodeProject