CrateDB高可用测试 kill一个datanode节点
2017-03-04 15:01
375 查看
第1步，节点正常存活
[mf@cratedb-test-01 /data/mf/crate]$ curl http://10.209.15.212:8080/_cat/shards/.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 p STARTED 326253 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 r STARTED 326253 44.8mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 r STARTED 327110 45.4mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 p STARTED 327110 45.4mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 r STARTED 326896 44.8mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 p STARTED 326896 44.8mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 p STARTED 326391 45.3mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 r STARTED 326391 45.3mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 r STARTED 326682 45mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 p STARTED 326682 45mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 p STARTED 326668 45.1mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 r STARTED 326668 45.1mb 10.10.10.2 cratedb-test-02
第2步：kill掉cratedb-test-02(10.10.10.2)
[mf@cratedb-test-02 /root]$ curl http://10.209.15.212:8080/_cat/shards/.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 p STARTED 326253 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 r STARTED 326253 44.8mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 p STARTED 327110 45.4mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 r UNASSIGNED
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 p STARTED 326896 44.8mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 r UNASSIGNED
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 p STARTED 326391 45.3mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 r STARTED 326391 45.3mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 r STARTED 326682 45mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 p STARTED 326682 45mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 p STARTED 326668 45.1mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 r UNASSIGNED
327110 主分片所在节点cratedb-test-02(10.10.10.2)宕机后， 327110
副分片立即变成主分片。 经过10秒钟左右，327110 副分片在cratedb-test-01上分配、生成，分片情况如下：
[mf@cratedb-test-02 /root]$ curl http://10.209.15.212:8080/_cat/shards/.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 p STARTED 326253 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 r STARTED 326253 44.8mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 p STARTED 327110 45.4mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 r STARTED 327110 45.4mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 r STARTED 326896 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 p STARTED 326896 44.8mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 p STARTED 326391 45.3mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 r STARTED 326391 45.3mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 r STARTED 326682 45mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 p STARTED 326682 45mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 r STARTED 326668 45.1mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 p STARTED 326668 45.1mb 10.10.10.1 cratedb-test-01
第3步，启动cratedb-test-02
[mf@cratedb-test-02 /root]$ curl http://10.209.15.212:8080/_cat/shards/.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 p STARTED 326253 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 r STARTED 326253 44.8mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 p STARTED 327110 45.4mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 r STARTED 327110 45.4mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 r STARTED 326896 44.8mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 p STARTED 326896 44.8mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 p STARTED 326391 45.3mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 r STARTED 326391 45.3mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 r STARTED 326682 45mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 p STARTED 326682 45mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 p STARTED 326668 45.1mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 r STARTED 326668 45.1mb 10.10.10.3 cratedb-test-03
启动cratedb-test-02，经过30秒后，节点cratedb-test-02上有了分片。分片327110的主副分片仍分别在cratedb-test-04、cratedb-test-01上(可能会有分片转移)。
重新启动的节点上，上面只有副分片。
对读写的影响？
---- kill一个节点，对读写无影响。
[mf@cratedb-test-01 /data/mf/crate]$ curl http://10.209.15.212:8080/_cat/shards/.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 p STARTED 326253 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 r STARTED 326253 44.8mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 r STARTED 327110 45.4mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 p STARTED 327110 45.4mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 r STARTED 326896 44.8mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 p STARTED 326896 44.8mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 p STARTED 326391 45.3mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 r STARTED 326391 45.3mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 r STARTED 326682 45mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 p STARTED 326682 45mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 p STARTED 326668 45.1mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 r STARTED 326668 45.1mb 10.10.10.2 cratedb-test-02
第2步：kill掉cratedb-test-02(10.10.10.2)
[mf@cratedb-test-02 /root]$ curl http://10.209.15.212:8080/_cat/shards/.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 p STARTED 326253 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 r STARTED 326253 44.8mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 p STARTED 327110 45.4mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 r UNASSIGNED
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 p STARTED 326896 44.8mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 r UNASSIGNED
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 p STARTED 326391 45.3mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 r STARTED 326391 45.3mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 r STARTED 326682 45mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 p STARTED 326682 45mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 p STARTED 326668 45.1mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 r UNASSIGNED
327110 主分片所在节点cratedb-test-02(10.10.10.2)宕机后， 327110
副分片立即变成主分片。 经过10秒钟左右，327110 副分片在cratedb-test-01上分配、生成，分片情况如下：
[mf@cratedb-test-02 /root]$ curl http://10.209.15.212:8080/_cat/shards/.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 p STARTED 326253 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 r STARTED 326253 44.8mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 p STARTED 327110 45.4mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 r STARTED 327110 45.4mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 r STARTED 326896 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 p STARTED 326896 44.8mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 p STARTED 326391 45.3mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 r STARTED 326391 45.3mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 r STARTED 326682 45mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 p STARTED 326682 45mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 r STARTED 326668 45.1mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 p STARTED 326668 45.1mb 10.10.10.1 cratedb-test-01
第3步，启动cratedb-test-02
[mf@cratedb-test-02 /root]$ curl http://10.209.15.212:8080/_cat/shards/.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 p STARTED 326253 44.8mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 4 r STARTED 326253 44.8mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 p STARTED 327110 45.4mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 3 r STARTED 327110 45.4mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 r STARTED 326896 44.8mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 1 p STARTED 326896 44.8mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 p STARTED 326391 45.3mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 2 r STARTED 326391 45.3mb 10.10.10.1 cratedb-test-01
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 r STARTED 326682 45mb 10.10.10.4 cratedb-test-04
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 5 p STARTED 326682 45mb 10.10.10.3 cratedb-test-03
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 p STARTED 326668 45.1mb 10.10.10.2 cratedb-test-02
.partitioned.test_cratedb_node_fail_1.045j4c1h6omj2chd64sg 0 r STARTED 326668 45.1mb 10.10.10.3 cratedb-test-03
启动cratedb-test-02，经过30秒后，节点cratedb-test-02上有了分片。分片327110的主副分片仍分别在cratedb-test-04、cratedb-test-01上(可能会有分片转移)。
重新启动的节点上，上面只有副分片。
对读写的影响？
---- kill一个节点，对读写无影响。
内容来自用户分享和网络整理，不保证内容的准确性，如有侵权内容，可联系管理员处理 
相关文章推荐
- Hadoop中正常启动了datanode但管理界面却却显示0个datanode节点或者只有本机的一个datanade，DFS Used显示0（100%）
- 一个MapReuce作业的从开始到结束--第4章 DataNode节点启动分析
- HDFS中datanode节点block损坏后的自动恢复过程
- 判断一个字符串中是否含有中文字符（测试可用）
- Hadoop集群中引入新DataNode节点
- 在搭建好Hadoop集群后，namenode与datanode两个过程不能起来，或者一个启动之后另一个自动关闭
- [MapReduce]MapReduce调试：在DataNode节点上查看打印信息
- 很久没有启动datanode服务的节点，重新启动，出现的Block更新情况
- 回文链表 请编写一个函数，检查链表是否为回文。 给定一个链表ListNode* pHead，请返回一个bool，代表链表是否为回文。 测试样例： {1,2,3,2,1} 返回：true {1,2,3,
- 怎样在创建TreeView时为每一个节点的data属性赋予一个长字符串值(长度不确定，几十个字符或者上万个字符），在单击节点的时候再将每个节
- hadoop 关闭datanode节点时发生异常：no datanode to stop
- Hadoop集群实施成功后，再次格式化名称节点，datanode如何加入集群
- Hadoop集群启动之后,datanode节点未正常启动的问题
- Hadoop Cluster启动后数据节点（Datanode）进程状态丢失
- Hadoop动态添加/删除节点（datanode和tacktracker）
- hadoop DataNode节点超时
- hadoop运行故障问题解决1——datanode节点启动后自动关闭
- 关于hadoop中datanode节点不同的dfs.data.dir之间数据均衡问题
- Hadoop动态添加Datanode节点
- Hadoop 生产环境集群平滑下线节点（datanode/tasktracker or nodemanager）