Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Use actual log timestamp as logstash timestamp #1522

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
marcingrzejszczak merged 1 commit into spring-cloud:master from rafaelrenanpacheco:patch-1
Jan 13, 2020
Merged

Use actual log timestamp as logstash timestamp #1522

marcingrzejszczak merged 1 commit into spring-cloud:master from rafaelrenanpacheco:patch-1
Jan 13, 2020

Conversation

@rafaelrenanpacheco
Copy link
Contributor

@rafaelrenanpacheco rafaelrenanpacheco commented Jan 13, 2020

Based on the grok example from the docs, a Filebeat + Logstash stack will produce the following:

  • a @timestamp field based on the time that filebeat sends the log to logstash, as timestamp type.
  • a timestamp field from the Spring Boot log, as string type.

In order to use the Spring Boot timestamp as the real Logstash @timestamp I use the following filters after the grok pattern:

 date {
 match => ["timestamp", "ISO8601"]
 }
 mutate {
 remove_field => ["timestamp"]
 }

Using these filters will result in @timestamp being the Spring Boot's timestamp, as a timestamp type, and will remove the now duplicated (string type) timestamp.

Copy link

codecov bot commented Jan 13, 2020

Codecov Report

Merging #1522 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@ Coverage Diff @@
## master #1522 +/- ##
=========================================
 Coverage 59.67% 59.67% 
 Complexity 845 845 
=========================================
 Files 159 159 
 Lines 4617 4617 
 Branches 514 514 
=========================================
 Hits 2755 2755 
 Misses 1626 1626 
 Partials 236 236

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b93e739...1a98c2b. Read the comment docs.

@marcingrzejszczak marcingrzejszczak merged commit a1ca008 into spring-cloud:master Jan 13, 2020
Copy link
Contributor

Very good point, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Projects

None yet

Milestone

2.2.2.RELEASE

Development

Successfully merging this pull request may close these issues.

AltStyle によって変換されたページ (->オリジナル) /