CCR UI should work with data streams

[jethr0null]

Why should we add this?

Elasticsearch is adding a new primitive called data streams. Everywhere in our UI's where a user could reference/use an Index we should allow a user to reference a data stream.

What should be changed?

CCR Top-level Menu needs to account for creating a follower data stream

Add follower index view (let's discuss how we want to represent data streams here cc @zuketo @matt-davis-elastic @cjcenizal )

Auto-follower pattern view (let's discuss how we want to represent data streams here cc @zuketo @matt-davis-elastic @cjcenizal )

I may be missing some items as I don't have any remotes enabled at the moment (I'll set one up and double-check as soon as I have time). I suspect we may also want to update how this is surfaced in monitoring (basing this on a screenshot from this blog) cc @mukeshelastic

@zuketo @matt-davis-elastic if you could please provide guidance around the user experience we're looking to provide, we can translate that into some mockups.

[elasticmachine]

Pinging @elastic/es-ui (Team:Elasticsearch UI)

[jethr0null]

Relates to: elastic/elasticsearch#56259

[yuliacech]

Hi Michelle @jethr0null , I've been testing data streams in CCR today and got it working with the following setup:

• a 'local' cluster with Kibana
• a 'remote' cluster with a data stream
• auto-follow pattern matching the 'remote' data stream created in CCR
• data stream and its backing indices are automatically created in the 'local' cluster

I think we need to make auto-follow pattern aware of data streams. If the pattern matches a data stream in the 'remote' it should indicate so in UI. Also for the data stream to work we need to disable 'prefix' and 'suffix' input fields in the form. Otherwise, the replication will fail with an error ("a backing index name in the local and remote cluster must remain the same"). And the details flyout for the pattern should have a link to Index Management where the follower data stream is selected in the Data Streams tab. Then in the Index Management app, we need to label both follower data streams and its backing indices accordingly.

[stigok]

Hi! Is there any progress on this or a plan for release?

[cjcenizal]

@stigok Sorry, no there has been no progress on this yet.

[elasticmachine]

Pinging @elastic/kibana-management (Team:Kibana Management)