Pricing

Rating

Developer

Actor stats

Categories

Share

💫 Welcome to Twitter X-Plorer

🦜 About Twitter.com

Twitter is an online social media and social networking service owned and operated by American company X Corp., the legal successor of Twitter, Inc. Twitter users outside the United States are legally served by the Ireland-based Twitter International Unlimited Company, which makes these users subject to Irish and European Union data protection laws[9][10]

🦜 About This Actor

💫 All-In-One Twitter Data Extractor

• ⭐Scrape User timeline, followers, following, media, likes, lists, topics, highlights, etc.
• ⭐Scrape List timeline, members, followers
• ⭐Scrape Specific Topic
• ⭐Scrape Status & Threads
• ⭐Scrape Media: Photo / Video / Gif, etc.
• ⭐Advanced Search
• ⭐Content Formatting: HTML or Plain TEXT
• ⭐Low Memory Cost
• ⭐A.S.A.P

DISCLAIMER:

• This Twitter scraper only collects data that’s publicly available. This means data that’s accessible without logging in to Twitter and without accepting Twitter’s terms of use. Please note that if you accepted Twitter’s terms of use, your ability to scrape Twitter data may be limited. If that is the case, please review the terms and make an informed decision yourself.
• By providing your personal auth_token, you agree to obey twitter TOS, especially regarding rate-limit policy 50 request per 15 minutes enforced by elonmusk

🦜 Tutorial

👉 Parameters

💫 NOTES :

If a multiline Query is provided (Queries separated by line breaks), each line will be processed separately.

Example :

👉 Basic Usage

Scrape user profiles

{"query":"@elonmusk @apify"}

Scrape user posts

{"query":"@elonmusk/posts"}

Advanced Search (Cookies required)

{"query":"what is happening","limit":10}

Scrape an URL

{"query":"https://x.com/elonmusk/media","limit":10}

👉 Advanced Usage

Twitter Query Language (TQL)

[ <COMMAND:> | # | @ ] [ <NAME> | <ID> | <KEYWORD> | <URL> ] [ /<SECTION> ]

❓ QUERIES Overview

❓ Possible QUERY Values :

👉 TheAUTH_TOKEN parameter (auth_token cookie)

Some function require auth_token cookie to work properly (required sign-in to Twitter.com). When you receive log error something like below, then probably you need to supply parameters with auth_token value.

❌ Authorization: Denied by access control: unspecified reason
❌ HTTP error 404: Not Found

Important Notes :

• This is NOT your APIFY Token, instead a value from your browser cookie, named auth_token.
• Use this only if necessary, as it have risk your account getting blocked by @elonmusk.
• Your cookies is your SECRET. Please don't share it with someone else.
• The auth_token value will always valid until you logged out from Twitter.com

To get auth_token cookie value :

1. Login to Twitter.com
2. Open Chrome Developer Tools (Ctrl + Shift + I)
3. Open Application Tab
4. On left panel, go to: Storage -> Cookies -> https://twitter.com
5. Find cookie named auth_token (40 characters string value).
6. Copy & Paste Here :

{
"query":"@elonmusk/followers",
"auth_token":"YOUR_TWITTER_AUTH_TOKEN"
}

👁 enter image description here

🦜 Input Examples

👉 Example #1 : Searching

Search for Posts by Keyword

{"query":"Web Scraping"}

Search for Posts by #Hashtag

{"query":"#AI"}

👉 Example #2 : User Info

User profile @USERNAME

{"query":"@apify"}

User media @USERNAME/media

{"query":"@apify/media"}

User following Lists: @USERNAME/lists

{"query":"@elonmusk/lists"}

👉 Example #3 : Topic

Topic latest Posts : topic/<TOPIC_ID>

{"query":"topic:1280550787207147521/posts"}# Arts & Culture

List lates Posts :list/<LIST_ID>

{"query":"list:1334803406523953152/posts"}# Web scraping + automation

👉 Example #4 : Advanced Searchfilters

{
"filters.from":"@apify",# (@ symbol is optional)
"filters.hashtag":"#scraper",# (# symbol is optional)
"filters.type":"videos",
"filters.phrase":"Space The Final Frontier",
"filters.replies":250,
"filters.since":"2022-01-20"
}

👉 Example #5 : Content Formatting

In case you want content format in HTML use content parameter :

{"query":"@apify/posts","limit":10,"content":"html"}

🦜 Advanced Search Filters

🦜 Did You Know ?

Twitter internally detect faces on images.

...
"media":[
{
"id":"1695968940185534464",
"image":"https://pbs.twimg.com/media/F4lKw_XawAAT-xn.jpg",
"url":"https://t.co/Lk3VtAaKQ7",
"features":{
"orig":{
"faces":[{"x":315,"y":130,"h":232,"w":232}]
}
},
"__type":"photo",
"key":"3_1695968940185534464"
}
]

🦜 To-Do List

• Constructing status URL: https://twitter.com/_/status/<status_id> or https://twitter.com/<screen-name>/status/<status-id>
• Resize and format images URL: https://pbs.twimg.com/media/xxxxxxxxxx.jpg?format=[jpg|png|webp]&name=[orig|normal|large|medium|thumb]

🦜 Support

⚡️ Feel free to reach out to the developer for any issues or suggestions for improvement.