What Is Kibana Software
Download Kibana For Windows

Kibana Tutorial
Kibana Useful Resources

I have the download page for Kibana opened up. To save you from some clicking around, I have attached the link to this lecture. Simply click on the download link that matches your operating system - either macOS or Linux in this case. Elastic stack (ELK) on Docker. Run the latest version of the Elastic stack with Docker and Docker Compose. It will give you the ability to analyze any data set by using the searching/aggregation capabilities of Elasticsearch and the visualization power of Kibana.

Selected Reading

To start working with Kibana we need to install Logstash, Elasticsearch and Kibana. In this chapter, we will try to understand the installation of the ELK stack here.

We would discuss the following installations here −

Elasticsearch Installation
Logstash Installation
Kibana Installation

Elasticsearch Installation

A detailed documentation on Elasticsearch exists in our library. You can check here for elasticsearch installation. You will have to follow the steps mentioned in the tutorial to install Elasticsearch.

Once done with the installation, start the elasticsearch server as follows −

Step 1

For Windows

Please note for windows user, the JAVA_HOME variable has to be set to the java jdk path.

For Linux

The default port for elasticsearch is 9200. Once done, you can check the elasticsearch at port 9200 on localhost http://localhost:9200/as shown below −

Logstash Installation

For Logstash installation, follow this elasticsearch installation which is already existing in our library.

Kibana Installation

Go to the official Kibana site −https://www.elastic.co/products/kibana

Click the downloads link on the top right corner and it will display screen as follows −

Click the Download button for Kibana. Please note to work with Kibana we need 64 bit machine and it will not work with 32 bit.

In this tutorial, we are going to use Kibana version 6. The download option is available for Windows, Mac and Linux. You can download as per your choice.

Create a folder and unpack the tar/zip downloads for kibana. We are going to work with sample data uploaded in elasticsearch. Thus, for now let us see how to start elasticsearch and kibana. For this, go to the folder where Kibana is unpacked.

For Windows

For Linux

Once Kibana starts, the user can see the following screen −

Once you see the ready signal in the console, you can open Kibana in browser using http://localhost:5601/.The default port on which kibana is available is 5601.

The user interface of Kibana is as shown here −

In our next chapter, we will learn how to use the UI of Kibana. To know the Kibana version on Kibana UI, go to Management Tab on left side and it will display you the Kibana version we are using currently.

At the end of this section, you will have all you need to check and visualize OCDS format Contracting data.

In order to have a better understanding of this section, it is recommended to be familiar with the command terminal:

Goals¶

Starting an ElasticSearch server with Kibana.
Uploading the Contracting published data in a format that is easy to check.
Checking data.

This example project has been developed to effortlessly start any of the 3 services.

Prerequisites¶

Open the Operative System’s command terminal
Unzip the downloaded file and access the folder that has just been created

Command line command: cdManualKibanaOCDS-master

Start Server Container with ElasticSearch and Kibana¶

Now we can start the server by executing the following command in the terminal:

This command indicates Docker program to create the container shown in the fileelastic-kibana.yaml. Here, we specify both programs should start.

After some minutes, depending on available resources, we should be able to open this linkhttp://localhost:5601/app/kibana and Kibana should appear as available.

From now on, ElasticSearch and Kibana will be ready to use, even though we still do not have available data.

Upload OCDS data to ElasticSearch¶

For this process, we should start the terminal at the folder elk-gobmx-csv-master/pipeline:

Downloading data packages¶

If we want to work with all the Contracts published in OCDS standard without taking into account the last data published,we should first be sure we have downloaded Contracts in OCDS format by json package, published on the websitedatos.gob.mx

By September 2 2018 , this file’s name is contratacionesabiertas_bulk_paquetes.json.zip and its size is about 310.5 MB.

It is important to mention that this information is recognized with OCDS standard through the following formatrecordPackages or Record Package; all tools and codes included in this manual use this format. In order to use another one, such as releases or releasePackages, or another structure non-defined by OCDS standard, it would be required to modify the code.

As these files can have a big size, it is recommended to have at least 2GB availableto continue.

Now, we need to unzip contratacionesabiertas_bulk_paquetes.json.zip file, which will create multiple.json files inside a folder:

IMPORTANT: We must know the full file path of .json files to this folder, as it will be necessary for the upload stage.

Let’s suppose that the files were downloaded and unzipped inside the same operative system Download file. Its path should be¹

Linux/Ubuntu/Mac: /home/{username}/DownloadWe can shorten it as $HOME/Download
Windows: C:Users{username}DownloadWe can shorten it as %HOMEPATH%Download

When it is confirmed or we could get the path to the files folder, we can continue.

Processing and uploading data¶

What Is Kibana Software

IMPORTANT¶

The current process specifically uploads the compiledRelease part of each OCDS document, in order to analize the last version available among OCDS releases. We recommend to read previous chapters before continuing

In this same folder, we have another tool designed for data upload. It also uses a Docker container. We will just use two commands: the first one is to get the container ready and the second one to execute it.

With this command, Docker will make the container ready with everything necessary to process and upload data.

Once finished, we can execute the upload process according to the available operating system.

Linux/Ubuntu o Mac

Windows

This command will use the container that is already executing the data processing and upload. For more information, please check the technical documentation of thisprocess.

The screen now must show the process information. This could take some minutes.

After finishing everything successfully, this caption should pop up: Uploadsuccessfullycomplete and Kibanaisreadytouse.

Now, we can visit [Kibana] web page(http://localhost:5601/app/kibana) and see all data uploaded.

To know more about technical details on how to upload data, we will explain next how to use LogStash for this process.

Extra: Download OCDS data directly from datos.gob.mx API¶

Previously, we explained how to download the OCDS dataset through a single file. In this section, we will introduce an alternative to download only the contracts we are looking for or the most updated contracts that have not been published yet in the final file. For this, we will use the API of datos.gob.mx, provided by the Mexican government.

In order to see the full API documentation, please check Basic guide to use API,where you can see in detail the specific filter options.

In order to download and manipulate data, the fol

Download Kibana For Mac