How far along is logstash in processing a file -


i have logstash running this:

input {   file {     path => ["/home/logdata/*.log"]     codec => json {         charset => "utf-8"         }   } } output {   elasticsearch {         protocol => "http"         host => "whatever"         cluster => "recordings"         index => "logstash-%{+yyyymmdd}"   } } 

some of these files many gb in size. how can tell logstash in process? there progress indicator? can tell how many lines in or left?

amongst other things, i'm trying figure out when delete original log files knowing when logstash finished useful.

logstash uses sincedb files track current read position of each input file. understanding sincedb files logstash file input describes format of files, , name of each sincedb file devised filename patterns (specifically, md5 hash of comma-separated list of patterns; see file.rb). suspect logstash 2.0 might improve situation roadmap talks monitoring improvements.

see logstash parsing progress bar example of how continuously track logstash's progress.


Popular posts from this blog