VOOZH about

URL: https://apify.com/moving_beacon-owner1/my-actor-10

โ‡ฑ General Purpose Web Scraping and Metadata Extraction ยท Apify


๐Ÿ‘ General Purpose Web Scraping and Metadata Extraction avatar

General Purpose Web Scraping and Metadata Extraction

Pricing

from $10.00 / 1,000 results

Go to Apify Store

General Purpose Web Scraping and Metadata Extraction

This project uses the Apify platform to scrape data from web pages, collect metadata, and store results in an Apify dataset. It features functions for managing date ranges, encoding identifiers, and handling large datasets, aiming to efficiently extract and store structured data for analysis.

Pricing

from $10.00 / 1,000 results

Rating

0.0

(0)

Developer

๐Ÿ‘ Jamshaid Arif

Jamshaid Arif

Maintained by Community

Actor stats

0

Bookmarked

14

Total users

0

Monthly active users

a month ago

Last modified

Share

Airbnb Data Scraper using Apify

This project is an Apify actor designed to scrape data from Airbnb property listings, including availability, pricing, and other details, over a given date range. The actor uses dynamic parameters for flexibility and stores the extracted data in Apify's dataset or a CSV file.


Features

  • Dynamic Date Range: Automatically generates check-in and check-out dates for the specified number of days.
  • Recursive JSON Parsing: Extracts all paths and values from the JSON responses for comprehensive data collection.
  • Data Storage: Pushes the extracted data to the Apify dataset or saves it locally as a CSV.
  • Configurable Inputs: Accepts various input parameters like URLs, stay duration, number of guests, and more.

Input Schema

The script accepts the following inputs via Apify:

ParameterDescriptionExample Value
startUrlsList of Airbnb listing URLs to scrape.[{ "url": "https://www.airbnb.com/rooms/12345" }]
checkInDateStarting date for the scraping."2024-11-21"
Stay_DaysDuration of each stay in days.1
numberOfDaysTotal number of days to scrape data for.60
adultsNumber of adults for the booking.2
childrenNumber of children for the booking.0
petsIndicates if pets are included in the booking.0

How It Works

  1. Dynamic Date Generator:

    • Generates check-in and check-out dates based on the input checkInDate, Stay_Days, and numberOfDays.
  2. Request Construction:

    • Encodes the Airbnb room ID in Base64 format.
    • Constructs GraphQL API requests with dynamically populated variables.
  3. Data Collection:

    • Sends GET requests to Airbnb's API for each listing and date range.
    • Extracts data paths and values using recursive JSON parsing.
  4. Data Storage:

    • Pushes the extracted data to the Apify dataset for further use.
    • Optionally saves data locally as a CSV file.

Output

The script outputs a dataset with the following fields:

FieldDescription
Check-In DateThe generated check-in date.
Check-Out DateThe corresponding check-out date.
PathJSON path of the extracted data.
ValueValue at the extracted JSON path.

Example Input

{
"startUrls":[
{"url":"https://www.airbnb.com/rooms/12345"},
{"url":"https://www.airbnb.com/rooms/67890"}
],
"checkInDate":"2024-11-21",
"Stay_Days":1,
"numberOfDays":10,
"adults":"2",
"children":"0",
"pets":"0"
}

Logs

The script logs progress and errors to the console, including:

  • Current URL and date range being processed.
  • Any errors encountered during requests or data parsing.

You might also like

Apify Store Scraper

applora/apify-store-scraper

A powerful Apify Actor designed to extract comprehensive data from the Apify Store. This scraper can discover available Actors, collect detailed Actor information, and extract key metadata, making it perfect for market research and competitor analysis.

Apify Store Scraper

vulnv/apify-store-scraper

Scrape detailed information about Apify Actors from the Apify Store. Extract actor metadata, pricing, statistics, reviews, and more with advanced filtering options.

Apify Actor Scraper

viridian_butter/apify-actor-scraper

The Apify Actor Scraper is a high-performance, reliable web scraping tool designed to extract comprehensive metadata from the Apify Store. It provides developers and researchers with a clear view of the Apify ecosystem by collecting detailed information on available Actors.

3

Apify Store Scraper

gio21/apify-store-scraper

Scrape and analyze 20,000+ public actors from the Apify Store.

Apify Store Scraper

igolaizola/apify-store-scraper

Scrape the Apify Store at scale. Collect actor listings, descriptions, stats, pricing, categories, and tags. Filter by query, use Apify Proxy, and export JSON/CSV for market research, competitor tracking, and trend analysis.

๐Ÿ‘ User avatar

Iรฑigo Garcia Olaizola

21

Chrome Web Store Scraper

simpleapi/chrome-web-store-scraper

๐Ÿ›’ Chrome Web Store Scraper extracts app listings, reviews, ratings & metadata from Chrome Web Store pages. โšก Automate competitive research, app monitoring & lead gen with fast, reliable scraping. ๐Ÿ“Š Great for marketers, developers & analysts.

Ebay Store Info Scraper

pintostudio/ebay-store-info-scraper

The eBay Store Info Actor is a web scraping tool deployed on the Apify platform that extracts comprehensive information from eBay store pages.

12

Chrome Web Store Extension Scraper

automation-lab/chrome-web-store-extension-scraper

๐Ÿงฉ Scrape Chrome Web Store extension metadata from public search, category, and detail pages for market research and prospecting.

๐Ÿ‘ User avatar

Stas Persiianenko

2

Related articles

What is web scraping?
Read more
What is data extraction?
Read more
Best web scraping APIs
Read more