Automate Scrapfly Integration Tasks from PowerShell

The CData API Driver for ADO.NET is a standard ADO.NET Provider that make it easy to accomplish data cleansing, normalization, backup, and other integration tasks by enabling real-time access to Scrapfly.

ADO.NET Provider

The ADO.NET Provider provides a SQL interface for Scrapfly; this tutorial shows how to use the Provider to retrieve Scrapfly data.

Once you have acquired the necessary connection properties, accessing Scrapfly data in PowerShell can be enabled in three steps.

The Scrapfly API uses API Key authentication. The API key is passed as the key query parameter on every request.

Using API Key Authentication

Your Scrapfly API key is required to create a connection. To obtain your API key:

1. Log into your Scrapfly account at scrapfly.io.
2. Navigate to Dashboard and select API Keys.
3. Copy your API key (begins with scp-live- for production or scp-test- for the test environment).

After obtaining your API key, set the following connection properties:

• AuthScheme: Set this to APIKey.
• APIKey: Set this to your Scrapfly API key.

Example connection string:

Profile=C:\profiles\Scrapfly.apip;AuthScheme=APIKey;ProfileSettings='APIKey=your_api_key';

1. Load the provider's assembly:

   [Reflection.Assembly]::LoadFile("C:\Program Files\CData\CData API Driver for ADO.NET\lib\System.Data.CData.API.dll")
    

2. Connect to Scrapfly:

    
   $conn= New-Object System.Data.CData.API.APIConnection("Profile=C:\profiles\Scrapfly.apip;AuthScheme=APIKey;ProfileSettings='APIKey=your_api_key';")
   $conn.Open()
   

3. Instantiate the APIDataAdapter, execute an SQL query, and output the results:

   $sql="SELECT , from Account"
   
   $da= New-Object System.Data.CData.API.APIDataAdapter($sql, $conn)
   $dt= New-Object System.Data.DataTable
   $da.Fill($dt)
   
   $dt.Rows | foreach {
   	Write-Host $_. $_.
   }