How To Install python-scrapy on Debian 9

In this tutorial we learn how to install python-scrapy on Debian 9. python-scrapy is Python web scraping and crawling framework

Introduction

In this tutorial we learn how to install python-scrapy on Debian 9.

What is `python-scrapy`

python-scrapy is:

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

This package provides the python-scrapy script and modules.

There are three methods to install python-scrapy on Debian 9. We can use apt-get, apt and aptitude. In the following sections we will describe each method. You can choose one of them.

Install python-scrapy Using apt-get

Update apt database with apt-get using the following command.

sudo apt-get update

After updating apt database, We can install python-scrapy using apt-get by running the following command:

sudo apt-get -y install python-scrapy

Install python-scrapy Using apt

Update apt database with apt using the following command.

sudo apt update

After updating apt database, We can install python-scrapy using apt by running the following command:

sudo apt -y install python-scrapy

Install python-scrapy Using aptitude

If you want to follow this method, you might need to install aptitude first since aptitude is usually not installed by default on Debian. Update apt database with aptitude using the following command.

sudo aptitude update

After updating apt database, We can install python-scrapy using aptitude by running the following command:

sudo aptitude -y install python-scrapy

How To Uninstall python-scrapy on Debian 9

To uninstall only the python-scrapy package we can use the following command:

sudo apt-get remove python-scrapy

Uninstall python-scrapy And Its Dependencies

To uninstall python-scrapy and its dependencies that are no longer needed by Debian 9, we can use the command below:

sudo apt-get -y autoremove python-scrapy

Remove python-scrapy Configurations and Data

To remove python-scrapy configuration and data from Debian 9 we can use the following command:

sudo apt-get -y purge python-scrapy

Remove python-scrapy configuration, data, and all of its dependencies

We can use the following command to remove python-scrapy configurations, data and all of its dependencies, we can use the following command:

sudo apt-get -y autoremove --purge python-scrapy

Dependencies

python-scrapy have the following dependencies:

References

python-scrapy website

Summary

In this tutorial we learn how to install python-scrapy package on Debian 9 using different package management tools: apt, apt-get and aptitude.