VOOZH
about
URL: https://dev.to/t/scraping
⇱ Scraping - DEV Community
Stop scraping the page when the data is already in the network tab
👁 anakin_writers profile
Anakin
👁 Image
Anakin
Jun 18
Stop scraping the page when the data is already in the network tab
#
webdev
#
scraping
#
automation
#
api
Add Comment
4 min read
I spent weeks scraping 50 websites—here's what finally worked
👁 __c1b9e06dc90a7e0a676b profile
zhongqiyue
👁 Image
zhongqiyue
Jun 16
I spent weeks scraping 50 websites—here's what finally worked
#
webdev
#
python
#
ai
#
scraping
👁 Image
1
reaction
Add Comment
4 min read
I Built an API That Turns Any Website Into JSON Using Just CSS Selectors
👁 sergio_morales_c705507bcd profile
Sergio Morales
👁 Image
Sergio Morales
Jun 14
I Built an API That Turns Any Website Into JSON Using Just CSS Selectors
#
showdev
#
webdev
#
api
#
scraping
Add Comment
2 min read
Why I ditched regex scrapers for an LLM parser (and when you shouldn't)
👁 __c1b9e06dc90a7e0a676b profile
zhongqiyue
👁 Image
zhongqiyue
Jun 15
Why I ditched regex scrapers for an LLM parser (and when you shouldn't)
#
python
#
webdev
#
ai
#
scraping
👁 Image
1
reaction
Add Comment
4 min read
How to Scrape Google Search Results with Python Without Getting Blocked (2026)
👁 zyvop profile
ZyVOP
👁 Image
ZyVOP
Jun 13
How to Scrape Google Search Results with Python Without Getting Blocked (2026)
#
pythongooglescraper2026
#
googleserpscrapingpython
#
scraping
#
beautifulsoup4
Add Comment
10 min read
Proxy Rotation & Session Management for AI Web Agents
👁 alterlab profile
AlterLab
👁 Image
AlterLab
Jun 11
Proxy Rotation & Session Management for AI Web Agents
#
scraping
#
python
#
api
#
proxies
Add Comment
6 min read
I Built an API That Turns Any Website Into JSON Using Just CSS Selectors
👁 sergio_morales_c705507bcd profile
Sergio Morales
👁 Image
Sergio Morales
Jun 10
I Built an API That Turns Any Website Into JSON Using Just CSS Selectors
#
showdev
#
webdev
#
api
#
scraping
Add Comment
2 min read
Rate Limits & Anti-Bots in Agentic Scraping
👁 alterlab profile
AlterLab
👁 Image
AlterLab
Jun 11
Rate Limits & Anti-Bots in Agentic Scraping
#
antibot
#
scraping
#
ratelimiting
#
python
👁 Image
1
reaction
Add Comment
5 min read
The Anti-Bot Detection Checklist I Use Before Every Scraping Project
👁 charles_90891cea4a1800830 profile
Charles
👁 Image
Charles
Jun 8
The Anti-Bot Detection Checklist I Use Before Every Scraping Project
#
scraping
#
bots
#
tutorial
#
node
Add Comment
4 min read
My Apify Promotion Filter: Scale Clean APIs, Hold Back Noisy Demand
👁 the_aientrepreneur_7ae85 profile
George Kioko
👁 Image
George Kioko
Jun 7
My Apify Promotion Filter: Scale Clean APIs, Hold Back Noisy Demand
#
webdev
#
api
#
apify
#
scraping
Add Comment
3 min read
Regex broke my scraper: Using LLMs for robust data extraction
👁 __c1b9e06dc90a7e0a676b profile
zhongqiyue
👁 Image
zhongqiyue
Jun 11
Regex broke my scraper: Using LLMs for robust data extraction
#
webdev
#
ai
#
python
#
scraping
👁 Image
2
reactions
Add Comment
5 min read
I Thought I Knew Web Scraping — Until I Hit JavaScript
👁 __c1b9e06dc90a7e0a676b profile
zhongqiyue
👁 Image
zhongqiyue
Jun 5
I Thought I Knew Web Scraping — Until I Hit JavaScript
#
webdev
#
python
#
scraping
#
ai
Add Comment
4 min read
My web scraping nightmare ended when I let an LLM read the HTML
👁 __c1b9e06dc90a7e0a676b profile
zhongqiyue
👁 Image
zhongqiyue
Jun 5
My web scraping nightmare ended when I let an LLM read the HTML
#
webdev
#
python
#
ai
#
scraping
Add Comment
5 min read
Why I Gave Up on Regex and Started Using AI for Web Scraping
👁 __c1b9e06dc90a7e0a676b profile
zhongqiyue
👁 Image
zhongqiyue
Jun 5
Why I Gave Up on Regex and Started Using AI for Web Scraping
#
webdev
#
python
#
ai
#
scraping
Add Comment
5 min read
I Spent a Weekend Fighting Flaky Scrapers — Here’s What Finally Worked
👁 __c1b9e06dc90a7e0a676b profile
zhongqiyue
👁 Image
zhongqiyue
Jun 5
I Spent a Weekend Fighting Flaky Scrapers — Here’s What Finally Worked
#
webdev
#
python
#
ai
#
scraping
Add Comment
5 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
👁 DEV Community
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account
👁 Image
👁 Image
👁 Image
👁 Image
👁 Image
