一、基本介紹

基于 Kubernetes 實現 CI/CD 配置，其實和往常那些 CI/CD 配置并沒有太大區別。都是通過 提交代碼，拉取代碼，構建代碼，發布代碼來實現的。 只不過要是通過 K8s 來實現的話，則是需要將構建好的代碼打包成鏡像，通過鏡像的方式來運行。

CI/CD 流程圖：

開發將代碼提交代碼倉庫后，我們便可以通過在 Jenkins 上配置腳本或是 Pipline 的方式來實現代碼發布，其中發布有兩種方式，一種是通過手動發布，另外一種可以通過 WebHook 插件來實現提交代碼便自動發布（生產環境不建議自動發布)

腳本內容一般分為：克隆代碼、編譯代碼、將編譯好的代碼打包成鏡像、運行鏡像幾個步驟。

二、基于 Kubernetes 實現 CI/CD 配置

下面我們是通過容器的方式安裝配置，物理安裝參考：

https://blog.csdn.net/weixin_46902396/article/details/118337250

1.配置 GitLab

1）安裝 Docker-Compose

[root@k8s-master01~]#wget"https://github.com/docker/compose/releases/download/v2.3.2/docker-compose-$(uname-s)-$(uname-m)"-O/usr/local/bin/docker-compose
[root@k8s-master01~]#chmod+x/usr/local/bin/docker-compose
[root@k8s-master01~]#docker-compose--version

2）安裝 GitLab

[root@k8s-master01~]#vimdocker-compose.yml
version:'3'
services:
web:
image:'gitlab/gitlab-ce:14.8.5-ce.0'
restart:always
hostname:192.168.1.1
environment:
GITLAB_OMNIBUS_CONFIG:|
external_url'http://192.168.1.1'
ports:
-'1080:80'
-'1443:443'
-'1022:22'
volumes:
-'/app/gitlab/config:/etc/gitlab'
-'/app/gitlab/logs:/var/log/gitlab'
-'/app/gitlab/data:/var/opt/gitlab'
[root@k8s-master01~]#docker-composeup-d

因為博主的電腦配置不是很高，所以就不使用上面的方式安裝 GitLab，而是直接使用 GitHub 上面的倉庫。

2.配置 Jenkins

1）安裝 NFS 存儲，并配置共享目錄

[root@k8s-master01~]#yum-yinstallnfs-utilsrpcbind
[root@k8s-master01~]#echo"/app/jenkins*(rw,sync,no_root_squash)">/etc/exports
[root@k8s-master01~]#mkdir/app/jenkins
[root@k8s-master01~]#systemctlstartrpcbindnfs

2）創建 PV 和 PVC

[root@k8s-master01~]#vimjenkins-pv.yaml
apiVersion:v1
kind:PersistentVolume
metadata:
name:jenkins-pv
spec:
capacity:
storage:10Gi
accessModes:
-ReadWriteMany
nfs:
server:192.168.1.1
path:/app/jenkins
---
apiVersion:v1
kind:PersistentVolumeClaim
metadata:
name:jenkins-pvc
spec:
resources:
requests:
storage:10Gi
accessModes:
-ReadWriteMany
[root@k8s-master01~]#kubectlcreate-fjenkins-pv.yaml

3）創建 RBAC 授權

[root@k8s-master01~]#vimjenkins-sa.yaml
apiVersion:v1
kind:ServiceAccount
metadata:
name:jenkins-sa
---
apiVersion:rbac.authorization.k8s.io/v1beta1
kind:ClusterRole
metadata:
name:jenkins-cr
rules:
-apiGroups:["extensions","apps"]
resources:["deployments"]
verbs:["create","delete","get","list","watch","patch","update"]
-apiGroups:[""]
resources:["services"]
verbs:["create","delete","get","list","watch","patch","update"]
-apiGroups:[""]
resources:["pods"]
verbs:["create","delete","get","list","patch","update"]
-apiGroups:[""]
resources:["pods/exec"]
verbs:["create","delete","get","list","patch","update"]
-apiGroups:[""]
resources:["pods/log"]
verbs:["get","list","update"]
-apiGroups:[""]
resources:["secrets"]
verbs:["get"]
---
apiVersion:rbac.authorization.k8s.io/v1beta1
kind:ClusterRoleBinding
metadata:
name:jenkins-crb
roleRef:
kind:ClusterRole
name:jenkins-cr
apiGroup:rbac.authorization.k8s.io
subjects:
-kind:ServiceAccount
name:jenkins-sa
namespace:default
[root@k8s-master01~]#kubectlcreate-fjenkins-sa.yaml

4）創建 StatefulSet

[root@k8s-master01~]#vimjenkins-statefulset.yaml
apiVersion:apps/v1
kind:StatefulSet
metadata:
name:jenkins
spec:
serviceName:jenkins
replicas:1
selector:
matchLabels:
app:jenkins
template:
metadata:
name:"jenkins"
labels:
app:jenkins
spec:
serviceAccountName:jenkins-sa
containers:
-name:jenkins
image:jenkins/jenkins:lts
imagePullPolicy:IfNotPresent
ports:
-containerPort:8080
-containerPort:50000
volumeMounts:
-name:jenkins
mountPath:/var/jenkins_home
volumes:
-name:jenkins
persistentVolumeClaim:
claimName:jenkins-pvc
[root@k8s-master01~]#chown-R1000/app/jenkins
[root@k8s-master01~]#kubectlcreate-fjenkins-statefulset.yaml

5）創建 Service

[root@k8s-master01~]#vimjenkins-svc.yaml
apiVersion:v1
kind:Service
metadata:
name:jenkins
spec:
type:NodePort
ports:
-name:http
port:8080
targetPort:8080
nodePort:30080
-name:agent
port:50000
targetPort:50000
nodePort:30090
selector:
app:jenkins
[root@k8s-master01~]#kubectlcreate-fjenkins-svc.yaml

6）配置 Jenkins

[root@k8s-master01~]#cat/app/jenkins/secrets/initialAdminPassword
a303d66e915e4ee5b26648a64fdff4be

我們這里安裝推薦的插件即可，后面有需求可以再進行安裝

3.實現 CI/CD 配置

1）在 Jenkins 宿主機上創建 SSH 密鑰

[root@k8s-master01~]#ssh-keygen-trsa#三連回車
[root@k8s-master01~]#cat~/.ssh/id_rsa.pub#查看公鑰

2）將公鑰上傳到 GitLab 上

3)將倉庫克隆到本地

[root@k8s-master01~]#gitclonegit@github.com:ChenZhuang1217/test.git

4）編寫 Go 代碼

[root@k8s-master01~]#cdtest
[root@k8s-master01test]#vimmain.go
packagemain
import(
"fmt"
"net/http"
)
funcHelloHandler(whttp.ResponseWriter,r*http.Request){
fmt.Fprintf(w,"HelloWorld")
}
funcmain(){
http.HandleFunc("/",HelloHandler)
http.ListenAndServe(":8080",nil)
}

5）編寫 Dockerfile

[root@k8s-master01test]#vimDockerfile
FROMgolang:1.16asbuilder
ENVGO111MODULE=on
GOPROXY=https://goproxy.cn,direct
WORKDIR/app
COPY..
RUNCGO_ENABLED=0GOOS=linuxGOARCH=amd64gobuild-ldflags="-w-s"-omainmain.go

FROMbusybox:1.28.4
WORKDIR/app
COPY--from=builder/app/.
EXPOSE8080
CMD["./main"]
[root@k8s-master01test]#dockerbuild-ttest-web-server:devops-$(date+%Y-%m-%d-%H-%M-%S).

6）提交代碼

[root@k8s-master01test]#gitadd.#提交到暫存區
[root@k8s-master01test]#gitconfig--globaluser.email"Zhuang_zz1217@163.com"#配置用戶郵箱
[root@k8s-master01test]#gitcommit-m"ThisistestCI/CD"#提交到本地倉庫
[root@k8s-master01test]#gitpush#推送到遠程倉庫

7）創建 Deployment 和 Service

[root@k8s-master01~]#vimtest-web-server.yaml
apiVersion:apps/v1
kind:Deployment
metadata:
name:test-web-server
spec:
replicas:1
selector:
matchLabels:
app:test-web-server
template:
metadata:
labels:
app:test-web-server
spec:
containers:
-name:test-web-server
image:test-web-server:devops-2022-04-25-17-16-54
imagePullPolicy:IfNotPresent
ports:
-containerPort:8080
---
apiVersion:v1
kind:Service
metadata:
name:test-web-server
spec:
type:NodePort
ports:
-name:test-web-server
port:8080
targetPort:8080
nodePort:30188
selector:
app:test-web-server
[root@k8s-master01~]#kubectlcreate-ftest-web-server.yaml

8)編寫 Jenkins 發版腳本

[root@k8s-master01~]#vimtest.sh
#!/bin/bash

>基于SpringCloudAlibaba+Gateway+Nacos+RocketMQ+Vue&Element實現的后臺管理系統+用戶小程序，支持RBAC動態權限、多租戶、數據權限、工作流、三方登錄、支付、短信、商城等功能
>
>*項目地址：
>*視頻教程：

#固定時間格式
Second=$(date+%Y-%m-%d-%H-%M-%S)

#備份舊的鏡像
Image=$(kubectl-shttps://192.168.1.1:6443describepod|grepImage:|awk'{print$2}'|greptest)
echo$Image>/opt/test-image-$Second

#克隆代碼
cd/root
if[-dtest];
then
mvtest/opt/test-devops-$Second
gitclonegit@github.com:ChenZhuang1217/test.git
else
gitclonegit@github.com:ChenZhuang1217/test.git
fi

#發布新的鏡像
cd/root/test&&dockerbuild-ttest-web-server:devops-$Second.

#上傳到鏡像倉庫
if[$?-eq0];
then
dockertagtest-web-server:devops-$Secondharbor.tianya.com:5000/test-web-server:devops-$Second
dockerpushharbor.tianya.com:5000/test-web-server:devops-$Second
else
exit1#退出(防止運行下面命令)
fi

#替換鏡像
sed-i's/image:.*/image:harbor.tianya.com:5000/test-web-server:devops-'$Second'/g'/root/test-web-server.yaml

#重啟應用
kubectldelete-f/root/test-web-server.yaml
kubectlcreate-f/root/test-web-server.yaml
[root@k8s-master01~]#chmod+xtest.sh

上面這個腳本有兩步需要注意：

「上傳到鏡像倉庫：」 如果你們沒有自己的鏡像倉庫，可以選擇調整腳本或看博主前面寫的文章來安裝 Harbor 倉庫。

「替換鏡像：」 我們上面配置的腳本是針對單個模塊的，多個模塊可以根據 for 循環來實現。

4.驗證

1）在 Jenkins 上安裝 SSH 插件

安裝 SSH 插件的原因是因為，我們這個 Jenkins 是容器安裝的，而腳本是在宿主機寫的，所以通過遠程到宿主機來運行腳本。

2）配置遠程主機的用戶名和密碼

3）創建 Jenkins 私鑰憑證（類型選擇：SSH Username with private key）

4）配置 Jenkins 流水線

5）修改代碼

6）在 Jenkins 上發布

審核編輯：劉清