Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

distribute-table: support to scatter the region distribution of the given table and engine #19534

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

distribute-table: support to scatter the region distribution of the given table and engine #19534

wants to merge 6 commits into from
+216 −0

Conversation

bufferflies
Copy link
Contributor

@bufferflies bufferflies commented Jan 13, 2025 •
edited
Loading

First-time contributors' checklist

What is changed, added or deleted? (Required)

Which TiDB version(s) do your changes apply to? (Required)

Tips for choosing the affected version(s):

By default, CHOOSE MASTER ONLY so your changes will be applied to the next TiDB major or minor releases. If your PR involves a product feature behavior change or a compatibility change, CHOOSE THE AFFECTED RELEASE BRANCH(ES) AND MASTER.

For details, see tips for choosing the affected versions (in Chinese).

  • master (the latest development version)
  • v9.0 (TiDB 9.0 versions)
  • v8.5 (TiDB 8.5 versions)
  • v8.4 (TiDB 8.4 versions)
  • v8.3 (TiDB 8.3 versions)
  • v8.1 (TiDB 8.1 versions)
  • v7.5 (TiDB 7.5 versions)
  • v7.1 (TiDB 7.1 versions)
  • v6.5 (TiDB 6.5 versions)
  • v6.1 (TiDB 6.1 versions)
  • v5.4 (TiDB 5.4 versions)

What is the related PR or file link(s)?

  • This PR is translated from:
  • Other reference link(s):

Do your changes match any of the following descriptions?

  • Delete files
  • Change aliases
  • Need modification after applied to another branch
  • Might cause conflicts after applied to another branch

@bufferflies
add distribute table fd
ca62ac6 
Signed-off-by: 童剑 <1045931706@qq.com>
@ti-chi-bot ti-chi-bot bot added missing-translation-status This PR does not have translation status info. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Jan 13, 2025
@qiancai qiancai requested a review from niubell January 13, 2025 08:48
@qiancai qiancai self-assigned this Jan 13, 2025
@qiancai qiancai added v9.0 translation/doing This PR’s assignee is translating this PR. labels Jan 13, 2025
@ti-chi-bot ti-chi-bot bot removed the missing-translation-status This PR does not have translation status info. label Jan 13, 2025
qiancai
qiancai reviewed Jan 26, 2025
View reviewed changes
sql-statements/sql_statement_distribute_table.md Outdated
@@ -0,0 +1,84 @@
---
title: distribute table 使用文档
aliases: ['/docs-cn/dev/sql-statements/sql-statement-distribute-table/','/docs-cn/dev/reference/sql/statements/distribute-table/']
Copy link
Collaborator

@qiancai qiancai Jan 26, 2025 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

新增文档不需要 aliases

Suggested change
aliases: ['/docs-cn/dev/sql-statements/sql-statement-distribute-table/','/docs-cn/dev/reference/sql/statements/distribute-table/']

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

qiancai
qiancai reviewed Jan 26, 2025
View reviewed changes
sql-statements/sql_statement_distribute_table.md Outdated
summary: TiDB 中的 distribute table 功能可以解决表中 region 分布不均衡问题。通过重新调整 table 中的 region 的分布，可以让指定 table 下的 region 按照一定的策略进行均衡。重新分配可以指定不同的存储引擎，比如 TIFLASH 和 TIKV。同时也可以指定不同的 raft role，比如 learner，leader，voter。
---

# Distribute Table 使用文档
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# Distribute Table 使用文档
# DISTRIBUTE TABLE

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

qiancai
qiancai reviewed Jan 26, 2025
View reviewed changes
sql-statements/sql_statement_distribute_table.md Outdated
+---------+------------+----------------+----------+------------+-------------------+--------------------+-----------------+------------------+

### Distribute Table Region

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

“### Distribute Table Region” 里面目前没有内容，请看看是需要删除还是添加

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

删除了

@bufferflies
address comment
a4fc306 
Signed-off-by: 童剑 <1045931706@qq.com>
@ti-chi-bot ti-chi-bot
Copy link

ti-chi-bot bot commented Feb 6, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from qiancai, ensuring that each of them provides their approval before proceeding. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

qiancai
qiancai reviewed Feb 6, 2025
View reviewed changes
sql-statements/sql_statement_distribute_table.md Outdated
Comment on lines 2 to 7
title: distribute table 使用文档
summary: TiDB 中的 distribute table 功能可以解决表中 region 分布不均衡问题。通过重新调整 table 中的 region 的分布，可以让指定 table 下的 region 按照一定的策略进行均衡。重新分配可以指定不同的存储引擎，比如 TIFLASH 和 TIKV。同时也可以指定不同的 raft role，比如 learner，leader，voter。
---

# DISTRIBUTE TABLE 使用文档
`DISTRIBUTE TABLE` 用于对指定表范围内的 region 进行重新打散调度， 使其按照表纬度进行均衡分布，防止个别 region 集中在少数的 TIFLASH 和 TIKV。
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
title: distribute table 使用文档
summary: TiDB 中的 distribute table 功能可以解决表中 region 分布不均衡问题。通过重新调整 table 中的 region 的分布，可以让指定 table 下的 region 按照一定的策略进行均衡。重新分配可以指定不同的存储引擎，比如 TIFLASH 和 TIKV。同时也可以指定不同的 raft role，比如 learner，leader，voter。
---
# DISTRIBUTE TABLE 使用文档
`DISTRIBUTE TABLE` 用于对指定表范围内的 region 进行重新打散调度， 使其按照表纬度进行均衡分布，防止个别 region 集中在少数的 TIFLASH 和 TIKV。
title: DISTRIBUTE TABLE
summary: 介绍 TiDB 数据库中 DISTRIBUTE TABLE 的使用概况。
---
# DISTRIBUTE TABLE
`DISTRIBUTE TABLE` 语句用于对指定表的 Region 进行重新打散和调度，以实现表维度的均衡分布。执行该语句可以防止个别 Region 集中在少数 TiFlash 或 TiKV 节点上，从而解决表中 Region 分布不均衡的问题。

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

summary 里的内容不会显示到文档正文中，只是用于搜索引擎检索和显示

sql-statements/sql_statement_distribute_table.md Outdated

## 示例

对表A 上的 tikv 上的 leader 重新进行均衡调度
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
对表A 上的 tikv 上的 leader 重新进行均衡调度
通过 `DISTRIBUTE TABLE` 语句重新调度表中的 Region 时，你可以根据需求指定存储引擎（如 TiFlash 或 TiKV）以及不同的 Raft 角色（如 learner、leader、voter）。
对表 `t1` 在 TiKV 上的 leader 所在的 Region 重新进行均衡调度：

sql-statements/sql_statement_distribute_table.md Outdated



显示当前所有的调度任务
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
显示当前所有的调度任务
显示当前所有的调度任务：

sql-statements/sql_statement_distribute_table.md Outdated
+---------+------------+------------+-----------------+------------+-----------+----------+-------------+---------------+


显示当前表 t1 的 region 分布情况
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
显示当前表 t1 的 region 分布情况
显示表 `t1` 当前的 Region 分布情况：

sql-statements/sql_statement_distribute_table.md Outdated
+---------+------------+------------+-----------------+------------+-----------+----------+-------------+---------------+
| JOB_ID | DB_NAME | TABLE_NAME | PARTITION_NAMES | ENGINE_TYPE | ROLE_TYPE | STATUS | CREATE_USER | CREATE_TIME |
+---------+------------+------------+-----------------+------------+-----------+--------+---------------+---------------+
| 1 | db_1 | t1 | | TIKV | LEADER | RUNNING | ADMIN | 20240712 |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| 1 | db_1 | t1 | | TIKV | LEADER | RUNNING | ADMIN | 20240712 |
| 1 | db_1 | t1 | | TIKV | LEADER | RUNNING | ADMIN | 20240712 |

sql-statements/sql_statement_distribute_table.md Outdated
Comment on lines 76 to 77
Distribute Table 语句重新调度 table 下的 region 也会受到 PD 中热点调度器的影响。 同时该任务会在均衡后退出，退出后该表的分布可能会
被被破坏。
Copy link
Collaborator

@qiancai qiancai Feb 6, 2025 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Distribute Table 语句重新调度 table 下的 region 也会受到 PD 中热点调度器的影响。 同时该任务会在均衡后退出，退出后该表的分布可能会
被被破坏。
`DISTRIBUTE TABLE` 语句在重新调度表中的 Region 时，可能会受到 PD 热点调度器的影响。调度完成后，随着时间推移，表的 Region 分布可能再次失衡。

@ti-chi-bot ti-chi-bot bot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Feb 13, 2025
@bufferflies
address comment
c0b9415 
Signed-off-by: 童剑 <1045931706@qq.com>
@qiancai qiancai mentioned this pull request Feb 21, 2025
Open
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@qiancai qiancai qiancai left review comments

@niubell niubell Awaiting requested review from niubell

Assignees

@qiancai qiancai

Labels
size/L Denotes a PR that changes 100-499 lines, ignoring generated files. translation/doing This PR’s assignee is translating this PR. v9.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@bufferflies @qiancai