Stream labels empty in response when sending logs via fluentd

[davkal]

@lfdominguez commented on Tue Feb 12 2019

What Grafana version are you using?

Master v6.0.0-pre3 (e38cfc1)

What datasource are you using?

Loki

Hello I'm testing Loki with fluentd and code an addon to the fluentd loki ingestor to add support for dynamic labels (get the value from the message). I'm currently use Docker Swarm in my infra with fluentd docker log driver. All works great, but in the explorer UI are showed the labels on the menu of labels, but when i active to show labels on the logs list not show me nothing, are these labels hardcoded?

Here you can see how the label test exists and the query if for label ueb, but in the logs panel not show me any label.

---

@dprokop commented on Tue Feb 12 2019

@lfdominguez Thanks for your report.

Labels displayed in the explore's logs list are those that are unique to a given log entry in a logs stream. Can you please provide us with a response you get for a given query?

@davkal Can you also take a look at this, please?

---

@davkal commented on Tue Feb 12 2019

I'm suspecting loki as well. Would be great to get a screenshot of the query response from the browser dev tools.
Another thing you can try is using logcli to check if loki returns correct labels. It's my feeling that the labels will be empty.

It would be great to get verification via logcli. And if no labels are returned, then we should open an issue in the loki repo.

---

@lfdominguez commented on Tue Feb 12 2019

yeap, response from Loki without labels

[lfdominguez]

Not only fluentd... finnaly I can code a simple golang program that send snappy protobuff logs to Loki... and the labels not show.

[woodsaj]

@lfdominguez this looks like #307 Are you using the latest version of Loki?

[lfdominguez]

let me exec docker pull again

[lfdominguez]

Fail....
Can check that always send the labels of the first log.... i will send some logs with differents sets of labels and is showed on list, but Loki not send to back....

[lfdominguez]

now is working great with #341

[lfdominguez]

[candlerb]

Could this be related to #453 ?

[cyriltovena]

probably related to #453 yes. If not please @lfdominguez reopen.