My Logstash Plugin

As you might have already known, logstash does not provide a plugin for uploading data to MySql or parsing Xlsx files. So, I have coded some generic tools for doing so.

They are not very perfect solutions as you might expect but nonetheless, if they are working as expected then it should not be a problem.

We are using logstash-input-exec for doing this work.

For XLSX, we are actually writing a converter to CSV. As logstash provide CSV support, we want to reduce the coding to minimal and provide a solution.

So if your goal is

XSLX(LOGSTASH INPUT) --> << file processing >> --> (LOGSTASH OUTPUT)

we are breaking it down to following

XSLX(LOGSTASH INPUT) --> [[ << external input triger >> --> (CSV OUTPUT) ]]]
CSV(LOGSTASH INPUT) --> << file processing >> --> (LOGSTASH OUTPUT)

Similarly, for to upload data to MySql.

(LOGSTASH INPUT) --> << file processing >> --> (LOGSTASH OUTPUT)MySQL

We are breaking it down to following

(LOGSTASH INPUT) --> << file processing >> --> (LOGSTASH OUTPUT)CSV
CSV(LOGSTASH INPUT) --> [[ << external input triger >> --> (LOGSTASH OUTPUT) ]]

Please check my GitHub page for repo.

Advertisements