How To Install parsero on Fedora 34

parsero is A Python based Robots.txt audit tool

Introduction

In this tutorial we learn how to install parsero on Fedora 34.

What is parsero

Parsero is a free script written in Python which reads the Robots.txt file of a web server and looks at the Disallow entries. The Disallow entries tell the search engines what directories or files hosted on a web server mustn’t be indexed. For example, “Disallow means that the content on www.example.com/portal/login it’s not allowed to be indexed by crawlers like Google, Bing, Yahoo… This is the way the administrator have to not share sensitive or private information with the search engines.

We can use yum or dnf to install parsero on Fedora 34. In this tutorial we discuss both methods but you only need to choose one of method to install parsero.

Install parsero on Fedora 34 Using dnf

Update yum database with dnf using the following command.

sudo dnf makecache --refresh

The output should look something like this:

Fedora 34 - x86_64                               20 kB/s | 6.6 kB     00:00
Fedora 34 openh264 (From Cisco) - x86_64        1.4 kB/s | 989  B     00:00
Fedora Modular 34 - x86_64                       68 kB/s | 6.5 kB     00:00
Fedora 34 - x86_64 - Updates                    3.5 kB/s | 6.2 kB     00:01
Fedora Modular 34 - x86_64 - Updates             17 kB/s | 5.9 kB     00:00
Metadata cache created.

After updating yum database, We can install parsero using dnf by running the following command:

sudo dnf -y install parsero

Install parsero on Fedora 34 Using yum

Update yum database with yum using the following command.

sudo yum makecache --refresh

The output should look something like this:

Fedora 34 - x86_64                               20 kB/s | 6.6 kB     00:00
Fedora 34 openh264 (From Cisco) - x86_64        1.4 kB/s | 989  B     00:00
Fedora Modular 34 - x86_64                       68 kB/s | 6.5 kB     00:00
Fedora 34 - x86_64 - Updates                    3.5 kB/s | 6.2 kB     00:01
Fedora Modular 34 - x86_64 - Updates             17 kB/s | 5.9 kB     00:00
Metadata cache created.

After updating yum database, We can install parsero using yum by running the following command:

sudo yum -y install parsero

How To Uninstall parsero on Fedora 34

To uninstall only the parsero package we can use the following command:

sudo dnf remove parsero

parsero Package Contents on Fedora 34

/usr/bin/parsero
/usr/lib/python3.9/site-packages/__pycache__/parsero.cpython-39.opt-1.pyc
/usr/lib/python3.9/site-packages/__pycache__/parsero.cpython-39.pyc
/usr/lib/python3.9/site-packages/parsero-0.81-py3.9.egg-info
/usr/lib/python3.9/site-packages/parsero-0.81-py3.9.egg-info/PKG-INFO
/usr/lib/python3.9/site-packages/parsero-0.81-py3.9.egg-info/SOURCES.txt
/usr/lib/python3.9/site-packages/parsero-0.81-py3.9.egg-info/dependency_links.txt
/usr/lib/python3.9/site-packages/parsero-0.81-py3.9.egg-info/entry_points.txt
/usr/lib/python3.9/site-packages/parsero-0.81-py3.9.egg-info/requires.txt
/usr/lib/python3.9/site-packages/parsero-0.81-py3.9.egg-info/top_level.txt
/usr/lib/python3.9/site-packages/parsero.py
/usr/share/doc/parsero
/usr/share/doc/parsero/LICENSE.txt
/usr/share/doc/parsero/README.md

References

Summary

In this tutorial we learn how to install parsero on Fedora 34 using yum and dnf.