Pricing

Rating

Developer

Actor stats

Categories

Share

SEPE Spain Job Scraper – Ofertas de Empleo ES Pro

The #1 Apify Actor for scraping SEPE Spain job offers with full stealth, smart skills filtering, and K8s-ready Prometheus metrics.

• Anti-bot max: Camoufox (Firefox stealth) + Apify residential proxies + random delays + cookie handling
• Smart skills filter: regex + scikit-learn TF-IDF cosine similarity (catches "contenedores" → Docker, "orquestación" → Kubernetes)
• Change-detection alerts: compares every run against the previous one → new / changed / removed offers
• Deduplication: SHA-256 hash per offer, persisted across runs
• K8s-ready: Prometheus metrics exported to KV store (scrapeable by any Prometheus server)
• Province focus: Vizcaya / Bizkaia by default, all 52 Spanish provinces supported

Output Example

{
"url":"https://www.sepe.es/HomeSepe/Personas/encontrar-empleo/...",
"titulo_oferta":"DevOps Engineer – Kubernetes / AWS",
"empresa":"Tecnología Vasca S.L.",
"provincia":"Vizcaya",
"salario":"35.000 € - 50.000 €/año",
"skills_requeridas":["Kubernetes","Docker","AWS","Terraform","Linux","CI/CD"],
"fecha_publicacion":"2026-04-15",
"enlace_aplicar":"https://www.sepe.es/HomeSepe/Personas/encontrar-empleo/.../solicitar"
}

Input Schema

Quick Start

Run locally

# 1. Clone / enter the project
cd sepe-empleo-es-pro
# 2. Create virtual env and install dependencies
python -m venv .venv
source .venv/bin/activate # Windows: .venv\Scripts\activate
pip install-r requirements.txt
# 3. Install Camoufox browser binaries
python -m camoufox fetch
# 4. Put test input in place
cp test_input.json storage/key_value_stores/default/INPUT.json
# 5. Run
python -m my_actor

Run on Apify

# Login (one-time)
apify login
# Push and deploy
apify push
# Run with test input
apify run --input-file test_input.json

Run via API

curl-X POST \
"https://api.apify.com/v2/acts/YOUR_USERNAME~sepe-empleo-es-pro/runs"\
-H"Content-Type: application/json"\
-H"Authorization: Bearer YOUR_TOKEN"\
-d'{
 "provincias": ["Vizcaya", "Bizkaia"],
 "skills": ["Kubernetes", "Python", "DevOps"],
 "max_pages": 50
 }'

Architecture

my_actor/
├── main.py # Actor entry point, crawler setup, post-processing
├── routes.py # Crawlee router: NAV / LIST / DETAIL handlers + XHR interception
├── extractors.py # Multi-selector SEPE data extraction with JSON-LD + regex fallbacks
├── skills_matcher.py # Regex + TF-IDF scikit-learn skills detection (30+ tech skills)
├── dedup.py # SHA-256 offer deduplication, cross-run persistence
├── alerts.py # Change-detection: new / changed / removed offers diff
├── metrics.py # Prometheus metrics (counters, gauges, histograms)
└── config.py # Province codes (52), SEPE URLs, CSS selectors, rate-limit settings

Anti-bot Stack

Skills Matching Pipeline

Input text (job description)
 │
 ▼
┌───────────────────┐ ┌─────────────────────────┐
│ Regex matcher │ │ TF-IDF cosine similarity │
│ (30+ skills, │ + │ (scikit-learn, threshold │
│ 50+ aliases) │ │ 0.25, ngram 1-2) │
└───────────────────┘ └─────────────────────────┘
 │ │
 └───────────┬───────────────┘
 ▼
 Canonical skill names
["Kubernetes","Docker","Python"]

Prometheus Metrics (K8s-ready)

Metrics are exported in standard Prometheus text format to the Actor's Key-Value Store under the key prometheus_metrics. Retrieve them via:

curl"https://api.apify.com/v2/key-value-stores/STORE_ID/records/prometheus_metrics"\
-H"Authorization: Bearer YOUR_TOKEN"

Available metrics

Kubernetes scraping example

# prometheus-scrape-config.yaml
-job_name: sepe_scraper
metrics_path: /v2/key-value-stores/STORE_ID/records/prometheus_metrics
scheme: https
bearer_token: YOUR_APIFY_TOKEN
static_configs:
-targets:[api.apify.com]

Change Detection Alerts

After each run an alerts_report is saved to the Key-Value Store and also pushed to the dataset as a record with _record_type: "alerts_summary":

{
"_record_type":"alerts_summary",
"generated_at":"2026-04-15T10:30:00Z",
"stats":{
"new_count":47,
"changed_count":12,
"removed_count":3,
"total_current":1024,
"total_previous":980
},
"sample_new_offers":[ ... ],
"changed_offers":[{"offer":{...},"changed_fields":["salario"]}],
"removed_offers":[ ... ]
}

Integrate with Zapier / Make / Slack via the Apify webhook → trigger on run completion.

Province Codes Reference

All 52 Spanish provinces are supported. Examples:

Legal & Compliance

• Only public, freely accessible data is scraped
• Rate-limited to ≤ 1 request/second (configurable)
• Respects SEPE's robots.txt structure
• No login, no personal data, no GDPR-protected content
• Data is from sepe.es which is a Spanish public institution

Troubleshooting

Deploy to Apify

apify login
apify push

👁 Deploy to Apify