VOOZH about

URL: https://apify.com/powerai/semantic-scholar-search-scraper

⇱ Semantic Scholar Search Scraper Β· Apify


Pricing

from $4.99 / 1,000 results

Go to Apify Store

Semantic Scholar Search Scraper

Scrape academic papers from Semantic Scholar by keyword search, with automatic pagination and comprehensive research data extraction.

Pricing

from $4.99 / 1,000 results

Rating

0.0

(0)

Developer

πŸ‘ PowerAI

PowerAI

Maintained by Community

Actor stats

2

Bookmarked

3

Total users

0

Monthly active users

2 months ago

Last modified

Categories

Share

πŸ“š Semantic Scholar Search Scraper

This actor allows you to scrape academic papers from Semantic Scholar by providing a search keyword. It automatically handles pagination and extracts comprehensive research paper information including titles, authors, citations, abstracts, publication details, and more.

Features

  • Keyword-based Search: Extract academic papers by providing search keywords or phrases
  • Automatic Pagination: Automatically scrolls and loads more papers until reaching the end or max items limit
  • Comprehensive Research Data: Extract detailed information about each paper including:
    • Paper title and abstract
    • Author information
    • Publication year and venue
    • Citation counts and influential citation metrics
    • Paper IDs (Semantic Scholar, DOI, ArXiv, PubMed, etc.)
    • Field of study classifications
    • TL;DR summaries (when available)

Input Parameters

FieldTypeRequiredDescription
keywordstringYesKeyword or phrase to search for
maxItemsintegerNoMaximum number of papers to fetch (default: 100)
proxyConfigurationobjectNoProxy settings for the crawler

Output

The output is a list of research paper objects, each containing:

  • keyword: The search keyword used
  • paperId: Semantic Scholar unique paper ID
  • title: Title of the research paper
  • abstract: Abstract/summary of the paper
  • year: Publication year
  • citationCount: Number of citations
  • influentialCitationCount: Number of influential citations
  • authors: List of authors with their information
  • venue: Publication venue (journal/conference)
  • publicationVenue: Detailed publication venue information
  • publicationTypes: Types of publication (e.g., JournalArticle, Conference)
  • fieldsOfStudy: Academic fields the paper belongs to
  • s2FieldsOfStudy: Semantic Scholar's field classifications
  • publicationDate: Full publication date
  • journal: Journal information (name, volume, pages)
  • externalIds: External identifiers (DOI, ArXiv, PubMed, etc.)
  • url: Link to the paper on Semantic Scholar
  • openAccessPdf: Link to open access PDF (if available)
  • tldr: Auto-generated summary (if available)
  • isOpenAccess: Whether the paper is open access
  • referenceCount: Number of references in the paper

Example output:

[
{
"keyword":"Thermal Expansion",
"id":"63eb900de0254e938fdadca38cfa1a1102f14e15",
"corpusId":232198276,
"title":{
"text":"Thermal-expansion offset for high-performance fuel cell cathodes",
"fragments":[
{
"start":0,
"end":7
},
{
"start":8,
"end":17
}
]
},
"slug":"Thermal-expansion-offset-for-high-performance-fuel-Zhang-Chen",
"paperAbstract":{
"text":"One challenge for the commercial development of solid oxide fuel cells as efficient energy-conversion devices is thermo-mechanical instability. Large internal-strain gradients caused by the mismatch in thermal expansion behaviour between different fuel cell components are the main cause of this instability, which can lead to cell degradation, delamination or fracture1–4. Here we demonstrate an approach to realizing full thermo-mechanical compatibility between the cathode and other cell components by introducing a thermal-expansion offset. We use reactive sintering to combine a cobalt-based perovskite with high electrochemical activity and large thermal-expansion coefficient with a negative-thermal-expansion material, thus forming a composite electrode with a thermal-expansion behaviour that is well matched to that of the electrolyte. A new interphase is formed because of the limited reaction between the two materials in the composite during the calcination process, which also creates A-site deficiencies in the perovskite. As a result, the composite shows both high activity and excellent stability. The introduction of reactive negative-thermal-expansion components may provide a general strategy for the development of fully compatible and highly active electrodes for solid oxide fuel cells. Highly active but durable perovskite-based solid oxide fuel cell cathodes are realized using a thermal-expansion offset, achieving full thermo-mechanical compatibility between the cathode and other cell components.",
"fragments":[
{
"start":202,
"end":209
},
{
"start":210,
"end":219
},
{
"start":519,
"end":526
},
{
"start":527,
"end":536
},
{
"start":653,
"end":660
},
{
"start":661,
"end":670
},
{
"start":699,
"end":706
},
{
"start":707,
"end":716
},
{
"start":769,
"end":776
},
{
"start":777,
"end":786
},
{
"start":1153,
"end":1160
},
{
"start":1161,
"end":1170
},
{
"start":1405,
"end":1412
},
{
"start":1413,
"end":1422
}
]
},
"paperAbstractTruncated":"One challenge for the commercial development of solid oxide fuel cells as efficient energy-conversion devices is thermo-...",
"tldr":{
"text":"An approach to realizing full thermo-mechanical compatibility between the cathode and other cell components by introducing a thermal-expansion offset is demonstrated and the introduction of reactive negative-thermal-exp expansion components may provide a general strategy for the development of fully compatible and highly active electrodes for solid oxide fuel cells.",
"abstractSimilarityScore":43
},
"authors":[
[
{
"name":"Yichao Zhang",
"ids":[
"48379874"
],
"slug":"Yichao-Zhang",
"structuredName":{
"firstName":"Yichao",
"middleNames":[],
"lastName":"Zhang"
},
"bitmap$0":false
},
{
"text":"Yichao Zhang",
"fragments":[]
}
],
[
{
"name":"Bin Chen",
"ids":[
"1733918331"
],
"slug":"Bin-Chen",
"structuredName":{
"firstName":"Bin",
"middleNames":[],
"lastName":"Chen"
},
"bitmap$0":false
},
{
"text":"Bin Chen",
"fragments":[]
}
],
[
{
"name":"Daqin Guan",
"ids":[
"19204144"
],
"slug":"Daqin-Guan",
"structuredName":{
"firstName":"Daqin",
"middleNames":[],
"lastName":"Guan"
},
"bitmap$0":false
},
{
"text":"Daqin Guan",
"fragments":[]
}
],
[
{
"name":"Meigui Xu",
"ids":[
"73677979"
],
"slug":"Meigui-Xu",
"structuredName":{
"firstName":"Meigui",
"middleNames":[],
"lastName":"Xu"
},
"bitmap$0":false
},
{
"text":"Meigui Xu",
"fragments":[]
}
],
[
{
"name":"R. Ran",
"ids":[
"6994367"
],
"slug":"R.-Ran",
"structuredName":{
"firstName":"Ran",
"middleNames":[],
"lastName":"Ran"
},
"bitmap$0":false
},
{
"text":"R. Ran",
"fragments":[]
}
],
[
{
"name":"M. Ni",
"ids":[
"40438535"
],
"slug":"M.-Ni",
"structuredName":{
"firstName":"Meng",
"middleNames":[],
"lastName":"Ni"
},
"bitmap$0":false
},
{
"text":"M. Ni",
"fragments":[]
}
],
[
{
"name":"Wei Zhou",
"ids":[
"2004812148"
],
"slug":"Wei-Zhou",
"structuredName":{
"firstName":"Wei",
"middleNames":[],
"lastName":"Zhou"
},
"bitmap$0":false
},
{
"text":"Wei Zhou",
"fragments":[]
}
],
[
{
"name":"R. O'Hayre",
"ids":[
"1398376191"
],
"slug":"R.-O'Hayre",
"structuredName":{
"firstName":"Ryan",
"middleNames":[
"P."
],
"lastName":"O'Hayre"
},
"bitmap$0":false
},
{
"text":"R. O'Hayre",
"fragments":[]
}
],
[
{
"name":"Zongping Shao",
"ids":[
"5935089"
],
"slug":"Zongping-Shao",
"structuredName":{
"firstName":"Zongping",
"middleNames":[],
"lastName":"Shao"
},
"bitmap$0":false
},
{
"text":"Zongping Shao",
"fragments":[]
}
]
],
"structuredAuthors":[
{
"firstName":"Yichao",
"middleNames":[],
"lastName":"Zhang"
},
{
"firstName":"Bin",
"middleNames":[],
"lastName":"Chen"
},
{
"firstName":"Daqin",
"middleNames":[],
"lastName":"Guan"
},
{
"firstName":"Meigui",
"middleNames":[],
"lastName":"Xu"
},
{
"firstName":"Ran",
"middleNames":[],
"lastName":"Ran"
},
{
"firstName":"Meng",
"middleNames":[],
"lastName":"Ni"
},
{
"firstName":"Wei",
"middleNames":[],
"lastName":"Zhou"
},
{
"firstName":"Ryan",
"middleNames":[
"P."
],
"lastName":"O'Hayre"
},
{
"firstName":"Zongping",
"middleNames":[],
"lastName":"Shao"
}
],
"year":{
"text":"2021",
"fragments":[]
},
"venue":{
"text":"Nature",
"fragments":[]
},
"venueId":"6c24a0a0-b07d-4d7b-a19b-fd09a3ed453a",
"citationContexts":[],
"citationStats":{
"citedByBuckets":[
{
"startKey":2021,
"endKey":2021,
"count":45
},
{
"startKey":2022,
"endKey":2022,
"count":101
},
{
"startKey":2023,
"endKey":2023,
"count":88
},
{
"startKey":2024,
"endKey":2024,
"count":111
},
{
"startKey":2025,
"endKey":2025,
"count":106
}
],
"keyCitedByBuckets":[],
"numCitations":455,
"estNumCitations":9263.619436843981,
"numReferences":56,
"numKeyCitations":1,
"numKeyReferences":0,
"numViewableReferences":56,
"keyCitationRate":0.002197802197802198,
"citationVelocity":101.66666666666667,
"citationAcceleration":-0.04504504504504504,
"firstCitationVelocityYear":2023,
"lastCitationVelocityYear":2025
},
"earliestAcquisitionsDate":1615529764.601375,
"journal":{
"name":"Nature",
"volume":"591",
"pages":"246 - 251"
},
"doiInfo":{
"doi":"10.1038/s41586-021-03264-1",
"doiUrl":"https://doi.org/10.1038/s41586-021-03264-1"
},
"links":[
{
"url":"https://doi.org/10.1038/s41586-021-03264-1",
"linkType":"publisher",
"publisherName":"Springer Nature"
}
],
"primaryPaperLink":{
"url":"https://doi.org/10.1038/s41586-021-03264-1",
"linkType":"publisher",
"publisherName":"Springer Nature"
},
"alternatePaperLinks":[
{
"url":"https://www.ncbi.nlm.nih.gov/pubmed/33692558",
"linkType":"medline"
}
],
"entities":[],
"entityRelations":[],
"faqs":[],
"scorecardStats":[
{
"typeKey":"cited_by",
"citationCount":455,
"keyCitationCount":1,
"score":10
}
],
"fieldsOfStudy":[
"Engineering",
"Materials Science"
],
"pubDate":"2021-03-01",
"pubUpdateDate":"2021-03-10",
"publisher":{
"name":"Nature Publishing Group UK"
},
"badges":[],
"isPdfVisible":false,
"cues":{}
},
...
]

Use Cases

  • Academic Research: Find relevant papers for literature reviews and research
  • Citation Analysis: Track paper citations and influence metrics
  • Trend Analysis: Identify research trends and emerging topics
  • Researcher Discovery: Find experts and authors in specific fields
  • Publication Monitoring: Monitor new publications in your field of interest
  • Data Collection: Build datasets for bibliometric analysis
  • Knowledge Graph Construction: Extract structured data for academic knowledge bases

Start exploring academic research on Semantic Scholar today!

You might also like

Semantic Scholar Paper Search

ryanclinton/semantic-scholar-search

Search and extract academic research papers from Semantic Scholar's database of over 200 million publications.

Semantic Scholar Scraper - Papers, Authors, Citations

gio21/semantic-scholar-scraper

Search and fetch academic papers, authors, citations, and references via the Semantic Scholar Graph API.

Semantic Scholar Scraper - Cheap πŸ“šπŸ”ŽπŸ€–

scrapestorm/semantic-scholar-scraper---cheap

πŸ”Ž Easily collect research papers from Semantic Scholar Provide one or multiple search keywords, paper URLs or author profiles and extract structured academic data such as πŸ“„ Paper TitleπŸ‘¨β€πŸ”¬ Authors πŸ“… Publication Year πŸ”— Paper URL & more Perfect for academic research & AI research monitoring πŸ“š

3

5.0

Semantic Scholar Scraper

solidcode/semanticscholar-scraper

[πŸ’° $6 / 1K] Extract academic papers, abstracts, citations, references, authors, and open-access PDF links from Semantic Scholar's 200M+ database. Search by keyword, paper ID/DOI/URL, or author. Filter by year, field, and citations. No API key.

Semantic Scholar Scraper

parseforge/semantic-scholar-scraper

Extract detailed academic paper data from Semantic Scholar, including abstracts, citations, authors, and publication details. Ideal for researchers, academics, and analysts who need structured scholarly data for literature reviews, research workflows, and large-scale academic analysis.

36

5.0

Related articles

Top 5 Google Scholar APIs to extract article data
Read more
How to scrape Google Scholar πŸŽ“
Read more