How To Install python3-scrapy on Ubuntu 18.04

In this tutorial we learn how to install python3-scrapy on Ubuntu 18.04. python3-scrapy is Python web scraping and crawling framework (Python 3)

Introduction

In this tutorial we learn how to install python3-scrapy on Ubuntu 18.04.

What is python3-scrapy

python3-scrapy is:

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

This package provides the scrapy module for Python 3.

There are three methods to install python3-scrapy on Ubuntu 18.04. We can use apt-get, apt and aptitude. In the following sections we will describe each method. You can choose one of them.

Install python3-scrapy Using apt-get

Update apt database with apt-get using the following command.

sudo apt-get update

After updating apt database, We can install python3-scrapy using apt-get by running the following command:

sudo apt-get -y install python3-scrapy

Install python3-scrapy Using apt

Update apt database with apt using the following command.

sudo apt update

After updating apt database, We can install python3-scrapy using apt by running the following command:

sudo apt -y install python3-scrapy

Install python3-scrapy Using aptitude

If you want to follow this method, you might need to install aptitude first since aptitude is usually not installed by default on Ubuntu. Update apt database with aptitude using the following command.

sudo aptitude update

After updating apt database, We can install python3-scrapy using aptitude by running the following command:

sudo aptitude -y install python3-scrapy

How To Uninstall python3-scrapy on Ubuntu 18.04

To uninstall only the python3-scrapy package we can use the following command:

sudo apt-get remove python3-scrapy

Uninstall python3-scrapy And Its Dependencies

To uninstall python3-scrapy and its dependencies that are no longer needed by Ubuntu 18.04, we can use the command below:

sudo apt-get -y autoremove python3-scrapy

Remove python3-scrapy Configurations and Data

To remove python3-scrapy configuration and data from Ubuntu 18.04 we can use the following command:

sudo apt-get -y purge python3-scrapy

Remove python3-scrapy configuration, data, and all of its dependencies

We can use the following command to remove python3-scrapy configurations, data and all of its dependencies, we can use the following command:

sudo apt-get -y autoremove --purge python3-scrapy

References

Summary

In this tutorial we learn how to install python3-scrapy package on Ubuntu 18.04 using different package management tools: apt, apt-get and aptitude.