作者：李毓

redis是属于数据库，在ceph为后端存储的情况下，适合rbd模式。所以我们先搭建RBD模式的存储。

紧接上一节CEPH所讲，创建自动供给PV.

[root@adm-master src]# cd external-storage-master/ceph/rbd/deploy/
[root@adm-master deploy]# ls
non-rbac  rbac  README.md
[root@adm-master deploy]# pwd
/usr/local/src/external-storage-master/ceph/rbd/deploy
kubectl apply -f ./rbac

[root@adm-master rbac]# kubectl get pods
NAME                                     READY   STATUS    RESTARTS   AGE
rbd-provisioner-c968dcb4b-fws8q          1/1     Running   0          42m

创建secret

[root@adm-master test-rbd]# cat ceph-secret-rbd.yaml
apiVersion: v1
kind: Secret
metadata:
name: ceph-secret-rbd
namespace: test-redis
type: "ceph.com/rbd"
data:
key: QVFCem9UOWdiQWNwRXhBQXFET0VKTnFMWGJRZm1TTmhObkRRdUE9PQo=

在ceph节点创建pool池

ceph osd pool create k8stest 256

rbd create rbda -s 1024 -p k8stest

rbd feature disable  k8stest/rbda object-map fast-diff deep-flatten

创建storageclass

[root@adm-master test-rbd]# cat rbd-sc.yaml
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
name: k8s-rbd
provisioner: ceph.com/rbd
parameters:
monitors: 192.168.0.131:6789,192.168.0.132:6789,192.168.0.133:6789
adminId: admin
adminSecretName: ceph-secret-rbd
pool: k8stest
userId: admin
userSecretName: ceph-secret-rbd
fsType: xfs
imageFormat: "2"
imageFeatures: "layering"

接着安装redis集群

第一步，按套路来先添加库。
helm repo add stable http://mirror.azure.cn/kubernetes/charts/

添加成功

[root@adm-master jenkins]# helm repo list
NAME    URL
apphub  https://apphub.aliyuncs.com
stable  http://mirror.azure.cn/kubernetes/charts/

查询一下我们需要的redis

[root@adm-master jenkins]# helm search repo redis
NAME                                CHART VERSION   APP VERSION     DESCRIPTION
apphub/prometheus-redis-exporter    3.2.2           1.3.4           Prometheus exporter for Redis metrics
apphub/redis                        10.5.3          5.0.7           Open source, advanced key-value store. It is of...
apphub/redis-cache                  0.5.0           4.0.12-alpine   A pure in-memory redis cache, using statefulset...
apphub/redis-ha                     4.3.3           5.0.6           Highly available Kubernetes implementation of R...
apphub/redis-operator               1.0.0                           Redis Operator provides high availability redis...
apphub/redispapa                    0.0.1           0.0.1           利用redis的info信息对redis的使用情况进行监控的一...
stable/prometheus-redis-exporter    3.5.1           1.3.4           DEPRECATED Prometheus exporter for Redis metrics
stable/redis                        10.5.7          5.0.7           DEPRECATED Open source, advanced key-value stor...
stable/redis-ha                     4.4.6           5.0.6           DEPRECATED - Highly available Kubernetes implem...
stable/sensu                        0.2.5           0.28            DEPRECATED Sensu monitoring framework backed by...
apphub/codis                        3.2             3.2             A Helm chart for Codis

查看历史版本命令

helm search repo redis -

拉取最新的redis部署文件

helm pull stable/redis-ha

[root@adm-master src]# cd redis-ha/
[root@adm-master redis-ha]# ls
Chart.yaml  ci  README.md  templates  values.yaml

部署文件的变量值一般保存在values.yaml里面

修改一下子values.yaml里面的副本数

改为一主一从即可

存储方式改为rbd，具体搭建cephfs的方式参考我之前的文档。

部署redis集群

[root@adm-master redis-ha]# kubectl create ns test-redis
namespace/test-redis created
[root@adm-master redis-ha]# helm install redis . -f ./values.yaml -n test-redis
WARNING: This chart is deprecated
NAME: redis
LAST DEPLOYED: Sun Mar 14 22:55:28 2021
NAMESPACE: test-redis
STATUS: deployed
REVISION: 1
NOTES:
Redis can be accessed via port 6379 and Sentinel can be accessed via port 26379 on the following DNS name from within your cluster:
redis-redis-ha.test-redis.svc.cluster.local

To connect to your Redis server:
1. Run a Redis pod that you can use as a client:

kubectl exec -it redis-redis-ha-server-0 sh -n test-redis

2. Connect using the Redis CLI:

redis-cli -h redis-redis-ha.test-redis.svc.cluster.local

暴露出外网

[root@adm-master redis-ha]# cat redis-services.yaml
apiVersion: v1
kind: Service
metadata:
name: redis-ha-service
namespace: test-redis        #名称：随意
labels:
app: redis                  #部署的 redis-ha 名称
spec:
ports:
- name: redis                 #部署的 redis-ha 名称
protocol: "TCP"                     #TCP 协议
port: 26379
targetPort: 6379
nodePort: 30379                     #此为外部连接k8s redis-ha 服务的端口
selector:
statefulset.kubernetes.io/pod-name: redis-redis-ha-server-0
type: NodePort

其他可用的命令有

redis 的 upgrade

修改了 values.yaml中的 replicas 数量之后需要更新一下

helm upgrade redis .

查看历史记录回滚

helm -n redis history

删除项目

helm uninstall redis