Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

http api “api/v1/changefeeds” was refused by owner when cdc cluster is rolling update #3483

Closed
maxshuang opened this issue Nov 16, 2021 · 0 comments · Fixed by #3490
Closed
Assignees
Labels
area/ticdc Issues or PRs related to TiCDC. component/status-server Status server component. severity/moderate type/bug The issue is confirmed as a bug.

Comments

@maxshuang
Copy link
Contributor

maxshuang commented Nov 16, 2021

What did you do?

  1. Update cdc version one by one in cdc cluster
  2. Query changefeed status in the middle of rolling update:
    curl -X GET http://172.16.6.140:8300/api/v1/changefeeds
    (owner is 5.3.0-master,other is 5.2.1)

What did you expect to see?

query successfully on owner

What did you see instead?

[maxshuang@copy-of-vm-ee-centos76-v1 tidb_cluster]$ curl -X GET http://172.16.6.140:8300/api/v1/changefeeds
{
    "error_msg": "context deadline exceeded",
    "error_code": ""
}

[maxshuang@copy-of-vm-ee-centos76-v1 tidb_cluster]$ curl -X GET http://172.16.6.140:8301/api/v1/changefeeds
[
    {
        "id": "kv-reconn",
        "state": "normal",
        "checkpoint_tso": 429141621833990146,
        "checkpoint_time": "2021-11-16 14:49:31.376",
        "error": {
            "addr": "172.16.6.140:8300",
            "code": "CDC:ErrOwnerUnknown",
            "message": "[CDC:ErrReachMaxTry]reach maximum try: 20: [CDC:ErrMySQLTxnError]Error 1049: Unknown database 'workload': Error 1049: Unknown database 'workload'"
        }
    }

It seems that owner refuses to serve the http request. Is it acceptable?

Versions of the cluster

Upstream TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):

5.2.1

TiCDC version (execute cdc version):

5.3.0-master
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ticdc Issues or PRs related to TiCDC. component/status-server Status server component. severity/moderate type/bug The issue is confirmed as a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants