Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOCS] Warn about compression and Azure Event Hub for Kafka #21578

Merged
merged 1 commit into from
Oct 27, 2020

Conversation

lucabelluccini
Copy link
Contributor

As stated at Azure/azure-event-hubs-for-kafka#37 (comment), it seems Azure Event Hub for Kafka do not support compression.

I've not been able to find a public facing documentation except https://docs.microsoft.com/en-us/azure/event-hubs/apache-kafka-configurations (which can be included in the PR).

What does this PR do?

Add some details on integrations with Azure Event Hub for Kafka.

Why is it important?

It can be useful to know which settings to use in case of integration with Azure Event Hub

Author's Checklist

  • Review the wording and format
  • Decide if we should include the link to Microsoft documentation
  • Backporting to first inclusion of Kafka output

Related issues

Collateral issue to raise log level of the error we face when using Filebeat with Kafka output and Azure Event Hub with default compression: #21577

As stated at Azure/azure-event-hubs-for-kafka#37 (comment), it seems Azure Event Hub for Kafka do not support compression.

I've not been able to find a public facing documentation except https://docs.microsoft.com/en-us/azure/event-hubs/apache-kafka-configurations (which can be included in the PR).
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Oct 6, 2020
@elasticmachine
Copy link
Collaborator

💚 Build Succeeded

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #21578 opened]

  • Start Time: 2020-10-06T15:11:52.309+0000

  • Duration: 25 min 32 sec

@andresrc andresrc added the Team:Docs Label for the Observability docs team label Oct 6, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/obs-docs (Team:Docs)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 6, 2020
Copy link
Contributor

@dedemorton dedemorton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@bmorelli25 bmorelli25 merged commit 202c7fe into master Oct 27, 2020
@bmorelli25 bmorelli25 deleted the docs-kafka-output-azure-kafka branch October 27, 2020 17:09
bmorelli25 pushed a commit to bmorelli25/beats that referenced this pull request Oct 27, 2020
bmorelli25 pushed a commit to bmorelli25/beats that referenced this pull request Oct 27, 2020
v1v added a commit to v1v/beats that referenced this pull request Oct 29, 2020
* upstream/master: (93 commits)
  Update commands used in the quick start (elastic#22248)
  Add interval documentation to `monitor` metricset (elastic#22152)
  [CI] enable x-pack/packetbeat in the CI (elastic#22252)
  Fix awscloudwatch input documentation (elastic#22247)
  Add support for different Azure Cloud environments in the metricbeat azure module (elastic#21044)
  [CI] support windows-2008-r2 (elastic#19791)
  protect against accessing undefined variables in sysmon module (elastic#22236)
  [CI] archive only if failed steps (elastic#22220)
  Add pe fields to Sysmon module (elastic#22217)
  [CI][flaky] Support 7.x branches and PRs (elastic#22197)
  Perfmon - Fix regular expressions to comply to multiple parentheses in instance name and object (elastic#22146)
  ci: improve linting speed (elastic#22103)
  Move cloudfoundry tags with metadata to common metadata fields (elastic#22150)
  [Docs] Update custom beat docs (elastic#22194)
  [Ingest Manager] Agent fix snapshot download for upgrade (elastic#22175)
  Update shared-autodiscover.asciidoc (elastic#21827)
  [DOCS] Warn about compression and Azure Event Hub for Kafka (elastic#21578)
  [CI][flaky] reporting for PRs in GitHub (elastic#21853)
  [Packetbeat] Create x-pack magefile (elastic#21979)
  [Elastic Agent] Fix deb/rpm installation (elastic#22153)
  ...
v1v added a commit to v1v/beats that referenced this pull request Oct 29, 2020
* upstream/master: (93 commits)
  Update commands used in the quick start (elastic#22248)
  Add interval documentation to `monitor` metricset (elastic#22152)
  [CI] enable x-pack/packetbeat in the CI (elastic#22252)
  Fix awscloudwatch input documentation (elastic#22247)
  Add support for different Azure Cloud environments in the metricbeat azure module (elastic#21044)
  [CI] support windows-2008-r2 (elastic#19791)
  protect against accessing undefined variables in sysmon module (elastic#22236)
  [CI] archive only if failed steps (elastic#22220)
  Add pe fields to Sysmon module (elastic#22217)
  [CI][flaky] Support 7.x branches and PRs (elastic#22197)
  Perfmon - Fix regular expressions to comply to multiple parentheses in instance name and object (elastic#22146)
  ci: improve linting speed (elastic#22103)
  Move cloudfoundry tags with metadata to common metadata fields (elastic#22150)
  [Docs] Update custom beat docs (elastic#22194)
  [Ingest Manager] Agent fix snapshot download for upgrade (elastic#22175)
  Update shared-autodiscover.asciidoc (elastic#21827)
  [DOCS] Warn about compression and Azure Event Hub for Kafka (elastic#21578)
  [CI][flaky] reporting for PRs in GitHub (elastic#21853)
  [Packetbeat] Create x-pack magefile (elastic#21979)
  [Elastic Agent] Fix deb/rpm installation (elastic#22153)
  ...
bmorelli25 added a commit that referenced this pull request Nov 2, 2020
…22198)

Co-authored-by: Luca Belluccini <luca.belluccini@elastic.co>
bmorelli25 added a commit that referenced this pull request Nov 2, 2020
…22199)

Co-authored-by: Luca Belluccini <luca.belluccini@elastic.co>
v1v added a commit to v1v/beats that referenced this pull request Nov 2, 2020
* upstream/7.x:
  Cherry-pick to 7.x: [CI] support windows-7 (elastic#19803) (elastic#22343)
  Update contributing content (elastic#22338) (elastic#22353)
  [DOCS] Warn about compression and Azure Event Hub for Kafka (elastic#21578) (elastic#22198)
  Typo (elastic#22272) (elastic#22274)
  Change to default analyzer (elastic#22300) (elastic#22333)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs enhancement Team:Docs Label for the Observability docs team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants