How To Install python-scrapy on Ubuntu 18.04

In this tutorial we learn how to install python-scrapy on Ubuntu 18.04. python-scrapy is Python web scraping and crawling framework (Python 2)

Introduction

In this tutorial we learn how to install python-scrapy on Ubuntu 18.04.

What is python-scrapy

python-scrapy is:

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

This package provides the scrapy module for Python 2.

There are three methods to install python-scrapy on Ubuntu 18.04. We can use apt-get, apt and aptitude. In the following sections we will describe each method. You can choose one of them.

Install python-scrapy Using apt-get

Update apt database with apt-get using the following command.

sudo apt-get update

After updating apt database, We can install python-scrapy using apt-get by running the following command:

sudo apt-get -y install python-scrapy

Install python-scrapy Using apt

Update apt database with apt using the following command.

sudo apt update

After updating apt database, We can install python-scrapy using apt by running the following command:

sudo apt -y install python-scrapy

Install python-scrapy Using aptitude

If you want to follow this method, you might need to install aptitude first since aptitude is usually not installed by default on Ubuntu. Update apt database with aptitude using the following command.

sudo aptitude update

After updating apt database, We can install python-scrapy using aptitude by running the following command:

sudo aptitude -y install python-scrapy

How To Uninstall python-scrapy on Ubuntu 18.04

To uninstall only the python-scrapy package we can use the following command:

sudo apt-get remove python-scrapy

Uninstall python-scrapy And Its Dependencies

To uninstall python-scrapy and its dependencies that are no longer needed by Ubuntu 18.04, we can use the command below:

sudo apt-get -y autoremove python-scrapy

Remove python-scrapy Configurations and Data

To remove python-scrapy configuration and data from Ubuntu 18.04 we can use the following command:

sudo apt-get -y purge python-scrapy

Remove python-scrapy configuration, data, and all of its dependencies

We can use the following command to remove python-scrapy configurations, data and all of its dependencies, we can use the following command:

sudo apt-get -y autoremove --purge python-scrapy

References

Summary

In this tutorial we learn how to install python-scrapy package on Ubuntu 18.04 using different package management tools: apt, apt-get and aptitude.