Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filebeat apache error fileset doesn't support timezones #12772

Closed
exekias opened this issue Jul 3, 2019 · 2 comments · Fixed by #13304
Closed

Filebeat apache error fileset doesn't support timezones #12772

exekias opened this issue Jul 3, 2019 · 2 comments · Fixed by #13304
Assignees
Labels
bug Filebeat Filebeat good first issue Indicates a good issue for first-time contributors module Team:Integrations Label for the Integrations team

Comments

@exekias
Copy link
Contributor

exekias commented Jul 3, 2019

Apache error fileset is not timezone aware, so dates are read as UTC.

We should update it to include the add_locale processor and take the local timezone into account when ingesting them. Similar NGINX module is already doing it with:

processors:
- add_locale: ~

"date": {
"if": "ctx.event.timezone != null",
"field": "@timestamp",
"formats": ["ISO8601"],
"timezone": "{{ event.timezone }}",
"on_failure": [{"append": {"field": "error.message", "value": "{{ _ingest.on_failure_message }}"}}]
}

@exekias exekias added bug module Filebeat Filebeat Team:Integrations Label for the Integrations team good first issue Indicates a good issue for first-time contributors labels Jul 3, 2019
@pa-jberanek
Copy link

It's worth stating that Apache access time parsing is OK, it's only error log parsing which is assuming UTC even though Apache writes out local time, with no TZ specifier.

Access:
[05/Jul/2019:03:40:43 +0100]
Error:
[Fri Jul 05 03:40:53.570294 2019]

@exekias exekias changed the title Filebeat apache module doesn't support timezones Filebeat apache error fileset doesn't support timezones Jul 5, 2019
@exekias
Copy link
Contributor Author

exekias commented Jul 5, 2019

You are right! I updated the description, thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Filebeat Filebeat good first issue Indicates a good issue for first-time contributors module Team:Integrations Label for the Integrations team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants