DASHBOARD_CROSS_FILTER causes some bugs and performance issues

[iercan]

Hi.
I was unable to edit filter scopes on dashboards and also when I changed time range and save as dashboard they weren't persistent. We were also experiencing very slow load when dashboard size gets bigger.
After some test I realized this is because DASHBOARD_CROSS_FILTER flag enabled. After disabled it, dashboard get much faster and I can save scopes and times of filter.

Although this flag listed as stable looks like it has serious bug and performance issue.

How to reproduce the bug

1. Enable DASHBOARD_CROSS_FILTER in feature flag.
2. Add some filter box and chart to dashboard
3. Try to change filter scopes and default time range
4. Refresh dashboard

Expected results

Scopes should be persistent
Time settings should be saved
Dashboard should load faster

Actual results

Scopes are not saved
Time settings are not saved
Dashboard loads slow

Environment

• browser type and version: Chrome 94
• superset version: using apache/superset:1.3 docker image
• enabled feature flags:

    "SQLLAB_BACKEND_PERSISTENCE": True,
    "THUMBNAILS": True,
    "THUMBNAILS_SQLA_LISTENERS": True,
    "ALERT_REPORTS": True,
    "DASHBOARD_NATIVE_FILTERS": True,
    "DASHBOARD_CROSS_FILTERS": True,
    "DASHBOARD_RBAC": True,
    "ENABLE_EXPLORE_DRAG_AND_DROP": True,

Checklist

Make sure to follow these steps before submitting your issue - thank you!

• I have checked the superset logs for python stacktraces and included it here as text if there are any.
• I have reproduced the issue with at least the latest released version of superset.
• I have checked the issue tracker for the same issue and I haven't found one similar.

[junlincc]

Hi @iercan thanks for reporting this issue!

So there are _ issues here.

• When Cross-filtering is enabled, dashboard perf is being affected
  Question: 1. how large is your dashboard? number of charts, types of charts etc.
  2. is it happening when you try to emit filters? or while you perform other tasks in dashboard, or just slow in
  general?
• Unable to edit filter scope of NATIVE FILTER when Cross-filtering is enabled (?) or Cross-filter scope
• Time range issue also happen only when Cross-filtering is enabled? or without it as well?

@villebro let's wait for more information before jumping in

[junlincc]

Also, is there a specific reason you are still adding filterbox to the dashboard while native filter is available? these two are not compatible, especially on time filter. and we dont have plan to maintain the combination. can you try remove filter box to see if the time range issue still persist?

[iercan]

Hi @iercan thanks for reporting this issue!

So there are _ issues here.

• When Cross-filtering is enabled, dashboard perf is being affected
  Question: 1. how large is your dashboard? number of charts, types of charts etc.
  2. is it happening when you try to emit filters? or while you perform other tasks in dashboard, or just slow in
  general?

Dashboard has about 80 chart and 3 different filter box. It slows on loads and also navigating through tabs in the dashboard. and also while selecting filters

• Unable to edit filter scope of NATIVE FILTER when Cross-filtering is enabled (?) or Cross-filter scope

Problem is not about native filter, we added filter boxes.

• Time range issue also happen only when Cross-filtering is enabled? or without it as well?

It happens when option is enabled. Again this is also for filter boxes, not native filter.

Also, is there a specific reason you are still adding filterbox to the dashboard while native filter is available? these two are not compatible, especially on time filter. and we dont have plan to maintain the combination. can you try remove filter box to see if the time range issue still persist?

We experienced very slow load and navigate with native filter when dahsboard gets too big. Thats why we decided to use filter boxes for big dashboards. We are not using hybrid

[junlincc]

@iercan thanks for the details! We suspect that having FilterBox coexist in Native filter enabled dashboard caused some of the issues your mention. Can you please remove your filterbox and create the same filters using native filters? and let us know if perf is still an issue. If so, we are happy to address.

I'm pretty sure time range and scoping works as expected in that case.

We are in the process of deprecating filterbox, im afraid that we can not help you troubleshoot Filterboxes are on your dashboard.

[iercan]

Yeah performance issue still exist. As I mention on previous answer we tried native filter first but it was very slow that's why we decided to try filter boxes. At last we resolved issue by disabling cross filters and using filter box. I also tried native filters with cross filter disabled but still it is very slow compared to filter boxes.

Native filter don't have other bugs but it is so slow to use in that case.

[junlincc]

@kgabryje 🙏

[kgabryje]

@iercan Current master contains changes that improve dashboard performance significantly (see PRs #16421, #16444, #16525, #16545). They are not included in the latest released version (1.3), but should be in the upcoming 1.4. I hope you'll give native filters another shot then 🙂

[iercan]

On the date I open this issue I also tried master branch and result was same in terms of performance. I checked the dates of PR links you send. Looks like I already tried them. But sure I will check new releases...

[iercan]

I just also tried master branch again. Result looks same. Also let me remind you that point of this issue is not just native filter. I wanted to point issues about cross filter too.

[kgabryje]

Thanks for clarifying! I've created a test dashboard with ~80 charts and ~15 native filters and the performance after load is pretty similar with and without cross filtering and native filters feature flags. Would you be able to share a recording of your dashboard so that I can reproduce it as closely as possible? If you can't, can you share some details like the layout of your dashboard (like the number of tabs, nested tabs, number of charts under each tab)?

[iercan]

I can not share video since they contain sensitive informations. We have about 20+ native filters, 120+ charts, and many nested tabs with depths vary from 1 to 4. Problem is not just loading time here. When we try to navigate through tabs, page response 2-5 seconds after click and it is frustrating.

[iercan]

I've tested 1.4.0 and problem still exist. We are still not able to use native filters for big dashboards.

[cyanoboy]

The same happens to me.
Superset v1.3.2 with DASHBOARD_CROSS_FILTER enabled, big dashboards take a few seconds to switch from one tab to the other. By disabling DASHBOARD_CROSS_FILTER it works flawlessly.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. For admin, please label this issue .pinned to prevent stale bot from closing the issue.

[iercan]

I've tested 1.5.0rc3 and this issue looks resolved.

[kgabryje]

Glad that problem FINALLY went away @iercan 🙂

[iercan]

Native filters aren't slowing dashboard now but we still can not save filter scopes (in case filter box used) if DASHBOARD_CROSS_FILTER enabled. At least we can migrate native filters to get rid of this. Thanks for the effort.

[bhargavi1234567890]

Hi Team,

I have couple of issues where i need your help to resolve.

1. I have enabled DASHBOARD_CROSS_FILTER in config file, but not finding ENABLE DASHBOARD CROSS FILTERS in the charts to make use of drill down.
2. How to create red, amber, green symbol and color for the data in Superset (Table chart). Is there any option. Please provide any sample chart if available.
3. Is there any option to add external link to the chart. ( i want to show the react app table in the Superset dashboard. is it possible)
   

[kunitdmi]

Hi Team,

I have couple of issues where i need your help to resolve.

1. I have enabled DASHBOARD_CROSS_FILTER in config file, but not finding ENABLE DASHBOARD CROSS FILTERS in the charts to make use of drill down.
2. How to create red, amber, green symbol and color for the data in Superset (Table chart). Is there any option. Please provide any sample chart if available.
3. Is there any option to add external link to the chart. ( i want to show the react app table in the Superset dashboard. is it possible)
   

I deal with the same.. Use version 2.0.1 for apache/superset and you'll get ENABLE DASHBOARD CROSS FILTERS.

[villebro]

@kunitdmi the feature flag is called DASHBOARD_CROSS_FILTERS, can you check the exact spelling?