VOOZH about

URL: https://apify.com/apify/ai-web-agent

⇱ AI Web Agent Β· Apify


Pricing

Pay per usage

Go to Apify Store

Use natural language prompts to browse the web, click on elements, fill and submit forms, extract data, and take screenshots using the OpenAI API.

Pricing

Pay per usage

Rating

4.2

(7)

Developer

πŸ‘ Apify

Apify

Maintained by Apify

Actor stats

104

Bookmarked

1.9K

Total users

7

Monthly active users

88 days

Issues response

a year ago

Last modified

Share

⚠️ The AI Web Agent is an experimental project and is currently not actively maintained. While we have plans for long-term improvements, these will not be implemented in the near future. We welcome and appreciate any contributions, including pull requests or documentation enhancements.

😎 How does AI Web Agent work?

The AI Web Agent is a tool that allows you to browse the web and extract data from websites using simple, natural language instructions. It combines the powers of the Apify platform and large language models from OpenAI API to generate actions that should be performed.

You can use AI Web Agent to automate any action on the web:

🌐 Go to URL

πŸ–±οΈ Click on element

πŸ“ Fill and submit forms

πŸ“¦ Extract data from the page

πŸ’Ύ Save data to output

πŸ“Š Save data to dataset

πŸ“Έ Take and save a screenshotπŸ’Έ

πŸ“š How to use AI Web Agent?

AI Web Agent was designed for an easy start even if you've never tried automating tasks on the web before. To get started, you need to:

  1. Add page URL that you want the Web Agent to start with.
  2. Provide Instructions on what the Web Agent should do while on that page. Use simple and straightforward language.
  3. Set up OpenAI API key. You can get it from OpenAI platform.
  4. Choose GPT Model that decyphers your prompt to the Web Agent: GPT-4o-mini, GPT-4o, o1-mini, o3-mini, GPT-3.5 Turbo 16k, GPT-4, GPT-4 32k.
  5. Click Start.

For example, to browse a website such as https://apify.com/ and get the cheapest pricing plan, you can use the following instructions:

πŸ‘ Image

⬇️ Input

AI Web Agent accepts the following configuration settings:

Start URL

The Start URL (startUrl) field represents the initial page URL that the Agent will visit.

Instructions

This field instructs the Web Agent how to browse the web.

OpenAI API key

The API key for accessing OpenAI. You can get it from OpenAI platform.

GPT Model

The GPT Model (model) option specifies which GPT model to use. You can find more information about the models on the OpenAI API documentation. Keep in mind that each GPT model has different pricing and features.

Proxy configuration

The Proxy configuration (proxyConfiguration) option enables you to set proxies. The Web Agent will use these to prevent getting blocked by target websites. You can use both Apify Proxy and custom HTTP or SOCKS5 proxy servers.

You can enter these either directly in Apify Console or programmatically in a JSON object using the Apify API. Watch this video to learn how get your data via the cURL command and with both Apify's API clients (Python and Node.js).

⬇️ Output

You can find the results of the run in the Storage tab β†’ Key-value store under the OUTPUT key. You can also view the recorded Web Agent's browsing session underrecording.mp4.

πŸ’Έ How much does it cost to use AI Web Agent?

Your total cost will be calculated based on combined costs for running OpenAI’s LLMs and browser runtime.

Cost of the OpenAI API

The cost depends on the model you are using and the action browser process. The cost is calculated based on the number of tokens used. You can see the cost in the log of the Actor run. You can find the cost of the OpenAI API on the OpenAI pricing page.

Cost of the running browser

The Web Agent uses a headless browser. The cost of the browser is based on the amount of time it takes to run the Agent. You can find information about the cost on the pricing page.

πŸ“˜ Resources

You might also like

Dynamic Web Scraper

josejet/dynamic-web-scraper

Dynamic Web Scraper is an Apify Actor that gathers information online by simulating user browsing behavior on the web. It reduces the time and amount of scraped web pages by using a model (ChatGPT) to make decisions regarding browser navigation and results evaluation.

AI Web Scraper

apify/ai-web-scraper

AI-first web scraper that extracts structured data from any website using natural-language prompts. No programming knowledge required. No hard-coded logic that breaks when a website changes.

Stech Clarity Driven Feedback Transformer (SCDFT)

stech_ai/stech-clarity-driven-feedback-transformer-scdft

SPAI turns harsh feedback into total clarity: clear, manager-ready reports. Each item refined one-by-one. Upload CSV/JSON, pick tone per item, export instantly. Stateless, private. Micro Honesty embedded. No data stored. For HR, CS, product, and public service.

Docling

vancura/docling

Docling document parser & converter – Convert documents into structured data without complexity. This Actor leverages the powerful Docling library to parse and transform various document formats into clean, structured outputs ready for analysis or integration.

πŸ‘ User avatar

VÑclav Vančura

433

5.0

X402 Checker

onescales/x402-checker

Check any URL for X402 Support β€” or a bulk list β€” to instantly discover whether it supports the X402 HTTP payment protocol. For every X402 enabled endpoint, the actor extracts the price, currency, network, payment endpoint, and raw payment headers.

10

5.0

Stech Presence Driven Email Transformer (SPDET)

stech_ai/stech-presence-driven-email-transformer-spdet

SPDET is a Single-Purpose AI (SPAI) Actor on the Apify Store that transforms cold, robotic, or overly formal emails into truthful while sounding warm, respectful, and professional. useful for Job rejection emails, Customer apologies, Proposal declines, Delay notifications Formal follow-ups.

Backlink Building Agent

daniil.poletaev/backlink-building-agent

The Backlink Building Agent automates backlink outreach by finding relevant pages & websites, extracting contacts from these websites, and then crafting personalized outreach sequences based on the content to these partners. These sequences can be used on email, LinkedIn, Twitter, & WhatsApp.

πŸ‘ User avatar

Daniil Poletaev

462

Free Addresses Scraper – Find HQ Addresses From Any Domain

s-r/free-addresses-scraper---find-hq-addresses-from-any-domain

Turn any domain into complete business address data in seconds! Just provide a domain name, and our intelligent actor delivers comprehensive location data - perfect for sales teams, market researchers, and data analysts.

Smartcontext AI Web Crawler

bluelightco/smartcontext-ai-crawler

Scrape any website and extract structured data using AI-powered instructions. Provide URLs and a natural language prompt to get tailored JSON outputs.

206

5.0

Website Contact Extractor

betterdevsscrape/contact-details-extractor

The cheapest contact scraper on Apify. Extract emails, phone numbers, company names, addresses & 25+ social profiles at $0.001/page - 50% less than competitors. Smart crawling auto-finds contact pages, bypasses Cloudflare protection, browser mode for JS sites, sitemap discovery.

πŸ‘ User avatar

Better Devs Scrape

367

5.0

Related articles

Selenium click command: complete guide
Read more
Web crawling vs. web scraping
Read more
How to build and monetize an AI agent on Apify
Read more