Pricing

Rating

Developer

Actor stats

Categories

Share

Thomasnet.com Companies Scraper

Overview

This actor allows you to scrape detailed information about manufacturing and industrial companies from Thomasnet.com. You can use this tool to gather valuable data about companies, such as their name, contact information, description, website, and other metadata. This information is useful for building B2B leads, market research, or competitor analysis.

Features

• Extract detailed information about companies, including name, phone, website, description, and more.
• Supports scraping multiple Thomasnet.com search result pages by specifying start URLs.
• Customize the scraping settings, such as maximum companies to scrape and request retries.
• Built-in proxy configuration for anonymous and reliable scraping.

How to Use

1. Set Up: Ensure you have an Apify account and access to the Apify platform.
2. Provide Start URLs: Copy and paste the desired Thomasnet.com search result links (e.g., https://www.thomasnet.com/suppliers/discover/alabama/all-cities?searchterm=Machining%2C+Assembly+).
3. Adjust Scraper Settings: Modify settings like maxItems, maxConcurrency, and minConcurrency to suit your requirements.
4. Configure Proxy Settings: (Optional) Configure proxy settings for better reliability and to avoid IP blocks.
5. Run the Scraper: Execute the scraper on the Apify platform. The output will be available in various formats like JSON, CSV, or Excel, depending on your preference.

Input Configuration

Here's an example of how to set up the input for the Thomasnet.com Companies Scraper:

{
"startUrls":[
"https://www.thomasnet.com/suppliers/discover/alabama/all-cities?searchterm=Machining%2C+Assembly+"
],
"maxItems":100,
"maxConcurrency":10,
"minConcurrency":1,
"maxRequestRetries":3,
"proxy":{
"useApifyProxy":true,
"apifyProxyGroups":["RESIDENTIAL"]
}
}

Input Fields Explanation

• Start URLs (startUrls): URLs of Thomasnet.com search result pages to scrape from.
• Max Companies to Scrape per Crawl (maxItems): Maximum number of companies that will be scraped in a single run. Default is 20.
• Max Concurrency (maxConcurrency): Maximum number of pages that can be processed at the same time. Default is 100.
• Min Concurrency (minConcurrency): Minimum number of pages that will be processed at the same time. Default is 1.
• Max Request Retries (maxRequestRetries): Number of times the scraper will retry a failed request before giving up. Default is 20.
• Proxy Configuration (proxy): Specifies proxy servers that will be used by the scraper to ensure anonymity and bypass rate limits. For more details, refer to the Proxy configuration.

Output Structure

The scraper produces a list of companies, with each company's information containing fields like:

{
"__typename":"Company",
"news":null,
"additionalInformation":null,
"brands":null,
"headingBrands":null,
"whitepapers":null,
"products":null,
"families":[
{
"__typename":"CompanyFamily",
"id":"157558",
"name":"Assembly Services"
},
{
"__typename":"CompanyFamily",
"id":"152546",
"name":"Fabrication Services"
},
{
"__typename":"CompanyFamily",
"id":"155411",
"name":"Job Shop Services"
},
{
"__typename":"CompanyFamily",
"id":"151461",
"name":"Machining"
},
{
"__typename":"CompanyFamily",
"id":"152403",
"name":"Manufacturing Services"
},
{
"__typename":"CompanyFamily",
"id":"162578",
"name":"Platforms"
},
{
"__typename":"CompanyFamily",
"id":"162428",
"name":"Tooling"
},
{
"__typename":"CompanyFamily",
"id":"159981",
"name":"Tools"
},
{
"__typename":"CompanyFamily",
"id":"153041",
"name":"Totes"
}
],
"videos":null,
"otherHeadings":null,
"certificationTotals":null,
"affiliatedMemberOf":null,
"affiliationFeaturedMembers":null,
"affiliationContactUrl":null,
"affiliationCompanyLabel":null,
"tgramsId":"30828201",
"name":"Focus Fab, LLC",
"logoUrl":null,
"logoTitle":"Focus Fab, LLC Company Logo",
"website":"http://focusfab.com/",
"isClaimed":false,
"xometryVerified":false,
"isAdvertiser":false,
"primaryPhone":"(888) 449-4877",
"description":"Custom CNC machining, fabrication and assembly services. Materials handled include carbon steel and alloys, aluminum, copper, Delrin® and UHMW. Operator platforms, part nests, and tooling aids can be fabricated. Repairing, sandblast cleaning, frame straightening and repainting services are available.",
"descriptionByCompany":null,
"annualSales":"N/A",
"numberEmployees":"10-49",
"yearFounded":null,
"otherActivities":null,
"premiums":null,
"address":{
"__typename":"CompanyAddress",
"address1":"5540 Parkwood Circle",
"address2":null,
"address3":null,
"city":"Bessemer",
"state":"AL",
"stateName":"Alabama",
"zip":"35022",
"zip4":null,
"country":"USA",
"county":null,
"latitude":33.37,
"longitude":-86.96
},
"tier":"NONE",
"type":"C",
"isMultiLocation":false,
"mainLocationTgramsId":null,
"mainLocationName":null,
"locationTypes":[
{
"__typename":"CompanyLocationType",
"id":999,
"name":"No Location Type Found"
}
],
"heading":null,
"headings":[
{
"__typename":"CompanyHeading",
"headingId":"1420207",
"name":"Aluminum Fabrication",
"familyName":"Fabrication Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"97001686",
"name":"Assembly Services",
"familyName":"Assembly Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"0",
"name":"Company Profile Section",
"familyName":null,
"description":"Custom CNC machining, fabrication and assembly services. Materials handled include carbon steel and alloys, aluminum, copper, Delrin® and UHMW. Operator platforms, part nests, and tooling aids can be fabricated. Repairing, sandblast cleaning, frame straightening and repainting services are available.",
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"19741602",
"name":"Copper Fabrication",
"familyName":"Fabrication Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"27200203",
"name":"Fabrication: Alloy",
"familyName":"Fabrication Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"95990255",
"name":"Fabrication: Carbon Steel",
"familyName":"Fabrication Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"27092006",
"name":"Fabricators",
"familyName":"Fabrication Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"41626003",
"name":"Job Shop Services",
"familyName":"Job Shop Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"45340403",
"name":"Machining",
"familyName":"Machining",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"45328655",
"name":"Machining: Aluminum",
"familyName":"Machining",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"45330503",
"name":"Machining: CNC",
"familyName":"Machining",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"45330586",
"name":"Machining: Copper",
"familyName":"Machining",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"96000401",
"name":"Machining: Steel",
"familyName":"Machining",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"96000484",
"name":"Manufacturing Services",
"familyName":"Manufacturing Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"50550409",
"name":"Metal Fabrication",
"familyName":"Fabrication Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"50855006",
"name":"Metalworking Services",
"familyName":"Machining",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"50855006",
"name":"Metalworking Services",
"familyName":"Fabrication Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"53651204",
"name":"Nests",
"familyName":"Totes",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"61491601",
"name":"Platforms",
"familyName":"Platforms",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"61495503",
"name":"Platforms: Custom",
"familyName":"Platforms",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"79941605",
"name":"Steel Fabrication",
"familyName":"Fabrication Services",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"86013406",
"name":"Tooling",
"familyName":"Tooling",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"86028008",
"name":"Tools",
"familyName":"Tools",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"86169000",
"name":"Tools: Custom",
"familyName":"Tools",
"description":null,
"url":null
},
{
"__typename":"CompanyHeading",
"headingId":"86652138",
"name":"Totes",
"familyName":"Totes",
"description":null,
"url":null
}
],
"personnel":[
{
"__typename":"Personnel",
"name":"David Lomasney",
"title":"Owner"
},
{
"__typename":"Personnel",
"name":"Douglas McLeod",
"title":"Owner"
},
{
"__typename":"Personnel",
"name":"David Lomasney",
"title":"Owner"
},
{
"__typename":"Personnel",
"name":"Douglas McLeod",
"title":"Owner"
}
],
"catalogType":null,
"social":null,
"isAffiliationPage":false,
"companyAd":null,
"ads":null,
"item":{
"__typename":"Company",
"headingBrands":null,
"headings":[
{
"__typename":"CompanyHeading",
"headingId":"97001686",
"naturalName":"Assembly Services"
}
],
"pdm_text":"Custom CNC <em>machining</em>, fabrication and <em>assembly</em> services. Materials handled include carbon steel and alloys, aluminum, copper, Delrin® and UHMW. Operator platforms, part nests, and tooling aids can be fabricated. Repairing, sandblast cleaning, frame straightening and repainting services are available.",
"tgramsId":"30828201",
"name":"Focus Fab, LLC",
"xometryVerified":false,
"isAdvertiser":false,
"primaryPhone":"(888) 449-4877",
"description":"Custom CNC machining, fabrication and assembly services. Materials handled include carbon steel and alloys, aluminum, copper, Delrin® and UHMW. Operator platforms, part nests, and tooling aids can be fabricated. Repairing, sandblast cleaning, frame straightening and repainting services are available.",
"tier":"NONE",
"type":"C",
"mainLocationTgramsId":null,
"mainLocationName":null,
"otherActivities":null,
"rank":"34.854347",
"heading":null,
"address":{
"__typename":"CompanyAddress",
"address1":"5540 Parkwood Circle",
"address2":null,
"address3":null,
"city":"Bessemer",
"state":"AL",
"stateName":"Alabama",
"zip":"35022",
"zip4":null,
"country":"USA",
"county":null,
"latitude":33.37,
"longitude":-86.96
},
"products":null,
"catalogType":null,
"videos":null,
"annualSales":"N/A",
"isMultiLocation":false,
"logoUrl":null,
"logoTitle":"Focus Fab, LLC Company Logo",
"numberEmployees":"10-49",
"yearFounded":null,
"isClaimed":false,
"website":"http://focusfab.com/"
}
}

Output Fields Explanation

• __typename: The GraphQL type of the object (usually "Company", "CompanyFamily", etc.).
• news: News related to the company (if available).
• additionalInformation: Any extra information about the company (if available).
• brands: Brands associated with the company.
• headingBrands: Brands related to specific company headings.
• whitepapers: Whitepapers published by the company.
• products: Products offered by the company.
• families: Array of service or product families the company belongs to. Each family has:
  • id: Unique identifier for the family.
  • name: Name of the family (e.g., "Assembly Services").
• videos: Videos related to the company.
• otherHeadings: Additional headings/categories for the company.
• certificationTotals: Certifications held by the company.
• affiliatedMemberOf: Organizations the company is affiliated with.
• affiliationFeaturedMembers: Featured members in the company’s affiliations.
• affiliationContactUrl: Contact URL for the affiliation.
• affiliationCompanyLabel: Label for the affiliated company.
• tgramsId: Unique Thomasnet company identifier.
• name: Company name.
• logoUrl: URL to the company’s logo image.
• logoTitle: Alt/title text for the company logo.
• website: Company website URL.
• isClaimed: Whether the company has claimed its Thomasnet profile.
• xometryVerified: Whether the company is verified by Xometry.
• isAdvertiser: Whether the company is an advertiser on Thomasnet.
• primaryPhone: Main phone number for the company.
• description: Company description and capabilities.
• descriptionByCompany: Description provided by the company itself.
• annualSales: Annual sales volume (if available).
• numberEmployees: Number of employees.
• yearFounded: Year the company was founded.
• otherActivities: Other activities or sectors the company is involved in.
• premiums: Premium features or listings for the company.
• address: Object containing address details:
  • address1: Street address.
  • address2: Additional address info.
  • address3: Additional address info.
  • city: City name.
  • state: State abbreviation.
  • stateName: Full state name.
  • zip: ZIP code.
  • zip4: ZIP+4 code.
  • country: Country.
  • county: County.
  • latitude: Latitude coordinate.
  • longitude: Longitude coordinate.
• tier: Thomasnet tier (e.g., NONE, REGISTERED, VERIFIED).
• type: Company type (e.g., "C" for company).
• isMultiLocation: Whether the company has multiple locations.
• mainLocationTgramsId: ID of the main location.
• mainLocationName: Name of the main location.
• locationTypes: Array of location types (e.g., "No Location Type Found").
• heading: Main heading/category for the company.
• headings: Array of headings/categories the company is listed under. Each heading has:
  • headingId: Unique identifier for the heading.
  • name: Name of the heading.
  • familyName: Family/category name.
  • description: Description of the heading.
  • url: URL for the heading.
• personnel: Array of key personnel at the company. Each person has:
  • name: Person’s name.
  • title: Person’s title/role.
• catalogType: Type of catalog (if any).
• social: Social media links or info.
• isAffiliationPage: Whether this is an affiliation page.
• companyAd: Company advertisement info.
• ads: Other advertisements.
• item: A nested object containing a summary or alternate representation of the company. This often duplicates key fields from the main company object, but may include additional or differently formatted data for convenience or internal use. Typical fields inside item include:
  • __typename: The GraphQL type (usually "Company").
  • headingBrands: Brands related to specific company headings.
  • headings: Array of headings/categories, sometimes with a naturalName property.
  • pdm_text: Company description with HTML formatting (e.g., <em> tags for emphasis).
  • tgramsId: Unique Thomasnet company identifier.
  • name: Company name.
  • xometryVerified: Whether the company is Xometry verified.
  • isAdvertiser: Whether the company is an advertiser.
  • primaryPhone: Main phone number.
  • description: Company description.
  • tier: Thomasnet tier.
  • type: Company type.
  • mainLocationTgramsId: ID of the main location.
  • mainLocationName: Name of the main location.
  • otherActivities: Other activities or sectors.
  • rank: Company ranking or score (if available).
  • heading: Main heading/category.
  • address: Address object (see above for address fields).
  • products: Products offered.
  • catalogType: Type of catalog.
  • videos: Videos related to the company.
  • annualSales: Annual sales volume.
  • isMultiLocation: Whether the company has multiple locations.
  • logoUrl: URL to the company’s logo.
  • logoTitle: Alt/title text for the logo.
  • numberEmployees: Number of employees.
  • yearFounded: Year the company was founded.
  • isClaimed: Whether the company has claimed its profile.
  • website: Company website URL.

Explore More Scrapers

If you found this Apify Smartbuyglasses Scraper useful, be sure to check out our other powerful scrapers and actors at memo23's Apify profile. We offer a wide range of tools to enhance your web scraping and automation needs across various platforms and use cases.

Support

• For issues or feature requests, please use the Issues section of this actor.
• If you need customization or have questions, feel free to contact the author:
  • Author's website: https://muhamed-didovic.github.io/
  • Email: muhamed.didovic@gmail.com

Additional Services

• Request customization or whole dataset: muhamed.didovic@gmail.com
• If you need anything else scraped, or this actor customized, email: muhamed.didovic@gmail.com
• For API services of this scraper (no Apify fee, just usage fee for the API), contact: muhamed.didovic@gmail.com
• Email: muhamed.didovic@gmail.com