首页 > 其他分享 >TIDB-DM数据迁移第三部(集群管理)

TIDB-DM数据迁移第三部(集群管理)

时间:2022-12-17 19:12:28浏览次数:36  
标签:dm 1.13 worker tiup TIDB 第三部 DM 172.16 root

1、对现在 dm 集群进行缩容,将 free 状态的 worker 下线。

tiup dm display dm-test
查看 free 状态节点
tiup dm scale-in dm 172.16.1.13:8262 -N

2、扩容 DM 集群

我是在一个机器上启的多实例,所以用的是另一个端口

#配置文件
worker_servers:
  - host: 172.16.1.13
    ssh_port: 22
    port: 8263
    deploy_dir: "/dm-deploy/dm-worker-8263"
    log_dir: "/dm-deploy/dm-worker-8263/log"

[root@root dm]# tiup dm scale-out dm-test dm-scale.yaml -uroot -p
tiup is checking updates for component dm ...
Starting component `dm`: /root/.tiup/components/dm/v1.11.1/tiup-dm scale-out dm-test dm-scale.yaml -uroot -p
Input SSH password: 

+ Detect CPU Arch Name
  - Detecting node 172.16.1.13 Arch info ... Done

+ Detect CPU OS Name
  - Detecting node 172.16.1.13 OS info ... Done
Please confirm your topology:
Cluster type:    dm
Cluster name:    dm-test
Cluster version: v6.4.0
Role       Host         Ports  OS/Arch       Directories
----       ----         -----  -------       -----------
dm-worker  172.16.1.13  8263   linux/x86_64  /dm-deploy/dm-worker-8263,/dm-data/dm-worker-8263
Attention:
    1. If the topology is not what you expected, check your yaml file.
    2. Please confirm there is no port/directory conflicts in same host.
Do you want to continue? [y/N]: (default=N) y
+ [ Serial ] - SSHKeySet: privateKey=/root/.tiup/storage/dm/clusters/dm-test/ssh/id_rsa, publicKey=/root/.tiup/storage/dm/clusters/dm-test/ssh/id_rsa.pub
+ [Parallel] - UserSSH: user=root, host=172.16.1.13
+ [Parallel] - UserSSH: user=root, host=172.16.1.13
+ [Parallel] - UserSSH: user=root, host=172.16.1.13
+ [Parallel] - UserSSH: user=root, host=172.16.1.13
+ [Parallel] - UserSSH: user=root, host=172.16.1.13
+ Download TiDB components
  - Download dm-worker:v6.4.0 (linux/amd64) ... Done
+ Initialize target host environments
+ Deploy TiDB instance
  - Deploy instance dm-worker -> 172.16.1.13:8263 ... Done
+ Copy certificate to remote host
+ Generate scale-out config
  - Generate scale-out config dm-worker -> 172.16.1.13:8263 ... Done
+ Init monitor config
Enabling component dm-worker
        Enabling instance 172.16.1.13:8263
        Enable instance 172.16.1.13:8263 success
+ [ Serial ] - Save meta
+ [ Serial ] - Start new instances
Starting component dm-worker
        Starting instance 172.16.1.13:8263
        Start instance 172.16.1.13:8263 success
+ Refresh components conifgs
  - Generate config dm-master -> 172.16.1.13:8261 ... Done
  - Generate config dm-worker -> 172.16.1.13:8262 ... Done
  - Generate config dm-worker -> 172.16.1.13:8263 ... Done
  - Generate config prometheus -> 172.16.1.13:9090 ... Done
  - Generate config grafana -> 172.16.1.13:3000 ... Done
  - Generate config alertmanager -> 172.16.1.13:9093 ... Done
+ Reload prometheus and grafana
  - Reload prometheus -> 172.16.1.13:9090 ... Done
  - Reload grafana -> 172.16.1.13:3000 ... Done
Scaled cluster `dm-test` out successfully

再次查看集群状态

[root@root dm]# tiup dm display dm-test
tiup is checking updates for component dm ...
Starting component `dm`: /root/.tiup/components/dm/v1.11.1/tiup-dm display dm-test
Cluster type:       dm
Cluster name:       dm-test
Cluster version:    v6.4.0
Deploy user:        root
SSH type:           builtin
Grafana URL:        http://172.16.1.13:3000
ID                Role          Host         Ports      OS/Arch       Status     Data Dir                    Deploy Dir
--                ----          ----         -----      -------       ------     --------                    ----------
172.16.1.13:9093  alertmanager  172.16.1.13  9093/9094  linux/x86_64  Up         /dm-data/alertmanager-9093  /dm-deploy/alertmanager-9093
172.16.1.13:8261  dm-master     172.16.1.13  8261/8291  linux/x86_64  Healthy|L  /dm-data/dm-master-8261     /dm-deploy/dm-master-8261
172.16.1.13:8262  dm-worker     172.16.1.13  8262       linux/x86_64  Bound      /dm-data/dm-worker-8262     /dm-deploy/dm-worker-8262
172.16.1.13:8263  dm-worker     172.16.1.13  8263       linux/x86_64  Free       /dm-data/dm-worker-8263     /dm-deploy/dm-worker-8263
172.16.1.13:3000  grafana       172.16.1.13  3000       linux/x86_64  Up         -                           /dm-deploy/grafana-3000
172.16.1.13:9090  prometheus    172.16.1.13  9090       linux/x86_64  Up         /dm-data/prometheus-9090    /dm-deploy/prometheus-9090

4、停止复制任务

[root@root dm]#  tiup dmctl --master-addr 172.16.1.13:8261 stop-task dm_task.yml 
tiup is checking updates for component dmctl ...
Starting component `dmctl`: /root/.tiup/components/dmctl/v6.4.0/dmctl/dmctl --master-addr 172.16.1.13:8261 stop-task dm_task.yml
{
    "op": "Delete",
    "result": true,
    "msg": "",
    "sources": [
        {
            "result": true,
            "msg": "",
            "source": "mysql-01",
            "worker": "dm-172.16.1.13-8262"
        }
    ]
}

5、关闭 DM 集群

[root@root dm]# tiup dm stop dm-test

6、销毁 DM 集群

tiup dm destory dm-test

7、其它

即使停了同步任务,但 worker 节点也不是 free 状态,因为之前创建过数据源,绑定到了 worker 节点,需要将 数据源停掉。

[root@root dm]# tiup dmctl --master-addr 172.16.1.13:8261 operate-source stop source-mysql-01.yaml 
tiup is checking updates for component dmctl ...
Starting component `dmctl`: /root/.tiup/components/dmctl/v6.4.0/dmctl/dmctl --master-addr 172.16.1.13:8261 operate-source stop source-mysql-01.yaml
{
    "result": true,
    "msg": "",
    "sources": [
        {
            "result": true,
            "msg": "",
            "source": "mysql-01",
            "worker": "dm-172.16.1.13-8262"
        }
    ]
}

再次查看集群信息, worker 节点都是 free 状态。

[root@root dm]# tiup dm display dm-test
tiup is checking updates for component dm ...
Starting component `dm`: /root/.tiup/components/dm/v1.11.1/tiup-dm display dm-test
Cluster type:       dm
Cluster name:       dm-test
Cluster version:    v6.4.0
Deploy user:        root
SSH type:           builtin
Grafana URL:        http://172.16.1.13:3000
ID                Role          Host         Ports      OS/Arch       Status     Data Dir                    Deploy Dir
--                ----          ----         -----      -------       ------     --------                    ----------
172.16.1.13:9093  alertmanager  172.16.1.13  9093/9094  linux/x86_64  Up         /dm-data/alertmanager-9093  /dm-deploy/alertmanager-9093
172.16.1.13:8261  dm-master     172.16.1.13  8261/8291  linux/x86_64  Healthy|L  /dm-data/dm-master-8261     /dm-deploy/dm-master-8261
172.16.1.13:8262  dm-worker     172.16.1.13  8262       linux/x86_64  Free       /dm-data/dm-worker-8262     /dm-deploy/dm-worker-8262
172.16.1.13:8263  dm-worker     172.16.1.13  8263       linux/x86_64  Free       /dm-data/dm-worker-8263     /dm-deploy/dm-worker-8263
172.16.1.13:3000  grafana       172.16.1.13  3000       linux/x86_64  Up         -                           /dm-deploy/grafana-3000
172.16.1.13:9090  prometheus    172.16.1.13  9090       linux/x86_64  Up         /dm-data/prometheus-9090    /dm-deploy/prometheus-9090
Total nodes: 6

标签:dm,1.13,worker,tiup,TIDB,第三部,DM,172.16,root
From: https://www.cnblogs.com/nanxiang/p/16989366.html

相关文章

  • TIDB-DM数据迁移第二部(创建同步任务)
    文档:https://docs.pingcap.com/zh/tidb/stable/quick-start-create-source实验环境源(MySQL):10.255.8.122:3306目标(TiDB):172.16.1.10:3306全量加增量模式,忽略test......
  • vue-template-admin 模板
    1.替换登录页的样式       ......
  • macOS Big Sur 11.7.2 (20G1020) 正式版 ISO、PKG、DMG、IPSW 下载
    本站提供的macOSBigSur软件包,既可以拖拽到Applications(应用程序)下直接安装,也可以制作启动U盘安装,或者在虚拟机中启动安装。请访问原文链接:https://sysin.org/blog/......
  • TIDB-DM数据迁移第一部(安装部署)
    官方连接:https://docs.pingcap.com/zh/tidb/stable/dm-overview1、安装DMdownloadhttps://tiup-mirrors.pingcap.com/dm-v1.11.1-linux-amd64.tar.gz8.09MiB/8.09......
  • 3Dmax界面_视图调整
    一.试图模型显示效果的切换'默认是真实显示效果'线框模式 快捷键F3 ---->真实显示效果和线框显示效果的切换(切换到线框显示效果再按F3就切换到了真实显示效果)。线面......
  • 数据库的DDL、DML和DCL的区别与理解
    DML(datamanipulationlanguage):它们是SELECT、UPDATE、INSERT、DELETE,就象它的名字一样,这4条命令是用来对数据库里的数据进行操作的语言 DDL(datadefinitionlangu......
  • cdc cdma ECM
    CDCCommunicationsDeviceClass连接设备配置CDMACodeDivisionMultipleAccess码分多址接入ECMEthernetNetworkingControlModel以太网控制模型GPSGlobalPo......
  • 项目管理软件Redmine+Ruby+Passenger+Nginx的安装
    Redmine是一个开源的、基于Web的项目管理和缺陷跟踪工具。它用日历和甘特图辅助项目及进度可视化显示,同时它又支持多项目管理。这里博主想用它来记录个人工作中碰到的问题和......
  • DM集群自动切换问题排查
    目前经历的原因有4种1、数据库备份由于服务器cpu和内存内存配置过低(可能是备份脚本开了并行)导致。2、虚拟机快照备份导致集群之间ping无响应。3、网络故障,排查交换机或......
  • HDMI协议1.4 好文推荐!
    版权声明:本文为博主原创文章,遵循CC4.0BY-SA版权协议,转载请附上原文出处链接和本声明。本文链接:https://blog.csdn.net/zhoutaopower/article/details/112182490手上的......