How to Install Python Scrapy on Windows?

Scrapy is a web scraping library that is used to scrape, parse and collect web data. Now once our spider has scrapped the data then it decides whether to:

• Keep the data.
• Drop the data or items.
• stop and store the processed data items.

In this article, we will look into the process of installing the Scrapy module on Windows.

Pre-requisites:

The only thing that you need for installing the Scrapy module on Windows are:

• Python 
• PIP or Conda (depending upon user preference)

Installing Scrapy on Windows:

For Conda Users:

If you want the installation to be done through conda, you can use the below command:

conda install scrapy

Type y for yes when prompted.

You will get a similar message once the installation is complete

👁 installing scrapy using conda

Make sure you follow the best practices for installation using conda as:

• Use an environment for installation rather than in the base environment using the below command:

conda create -n my-env
conda activate my-env

Note: If your preferred method of installation is conda-forge, use the below command:

conda config --env --add channels conda-forge

For PIP Users:

Users who prefer to use pip can use the below command to install the Scrapy package on Windows:

pip install scrapy

You will get a similar message once the installation is complete:

👁 installing scrapy using pip

Verifying Scrapy Module Installation:

To verify if Scrapy has been successfully installed in your system run the below code in a python IDE of your choice:

If successfully installed you will get the following output.

👁 verifying scrapy installation