How To Install syslog-ng-mod-kafka on Ubuntu 18.04

In this tutorial we learn how to install syslog-ng-mod-kafka on Ubuntu 18.04. syslog-ng-mod-kafka is Enhanced system logging daemon (kafka destination)

Introduction

In this tutorial we learn how to install syslog-ng-mod-kafka on Ubuntu 18.04.

What is syslog-ng-mod-kafka

syslog-ng-mod-kafka is:

syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, message queues, databases (SQL and NoSQL alike) and more.

Key features:

  • receive and send RFC3164 and RFC5424 style syslog messages
  • work with any kind of unstructured data
  • receive and send JSON formatted messages
  • classify and structure logs with builtin parsers (csv-parser(), db-parser(), etc.)
  • normalize, crunch and process logs as they flow through the system
  • hand on messages for further processing using message queues (like AMQP), files or databases (like PostgreSQL or MongoDB).

This destination enables sending logs to Apache Kafka messaging system.

There are three methods to install syslog-ng-mod-kafka on Ubuntu 18.04. We can use apt-get, apt and aptitude. In the following sections we will describe each method. You can choose one of them.

Install syslog-ng-mod-kafka Using apt-get

Update apt database with apt-get using the following command.

sudo apt-get update

After updating apt database, We can install syslog-ng-mod-kafka using apt-get by running the following command:

sudo apt-get -y install syslog-ng-mod-kafka

Install syslog-ng-mod-kafka Using apt

Update apt database with apt using the following command.

sudo apt update

After updating apt database, We can install syslog-ng-mod-kafka using apt by running the following command:

sudo apt -y install syslog-ng-mod-kafka

Install syslog-ng-mod-kafka Using aptitude

If you want to follow this method, you might need to install aptitude first since aptitude is usually not installed by default on Ubuntu. Update apt database with aptitude using the following command.

sudo aptitude update

After updating apt database, We can install syslog-ng-mod-kafka using aptitude by running the following command:

sudo aptitude -y install syslog-ng-mod-kafka

How To Uninstall syslog-ng-mod-kafka on Ubuntu 18.04

To uninstall only the syslog-ng-mod-kafka package we can use the following command:

sudo apt-get remove syslog-ng-mod-kafka

Uninstall syslog-ng-mod-kafka And Its Dependencies

To uninstall syslog-ng-mod-kafka and its dependencies that are no longer needed by Ubuntu 18.04, we can use the command below:

sudo apt-get -y autoremove syslog-ng-mod-kafka

Remove syslog-ng-mod-kafka Configurations and Data

To remove syslog-ng-mod-kafka configuration and data from Ubuntu 18.04 we can use the following command:

sudo apt-get -y purge syslog-ng-mod-kafka

Remove syslog-ng-mod-kafka configuration, data, and all of its dependencies

We can use the following command to remove syslog-ng-mod-kafka configurations, data and all of its dependencies, we can use the following command:

sudo apt-get -y autoremove --purge syslog-ng-mod-kafka

References

Summary

In this tutorial we learn how to install syslog-ng-mod-kafka package on Ubuntu 18.04 using different package management tools: apt, apt-get and aptitude.