Kubernetes基于helm安裝jenkins
jenkins支持war包、docker鏡像、系統安裝包、helm安裝等。在Kubernetes上使用Helm安裝Jenkins可以簡化安裝和管理Jenkins的過程。同時借助Kubernetes，jenkins可以實現工作節點的動態調用伸縮，更好的提高資源利用率。通過Jenkins的kubernetes-plugin來實現將Jenkins運行在Kubernetes上的功能。
準備工作
- 已經安裝并配置好了Kubernetes集群。
# k8s版本及環境信息
root@master1:~# kubectl get node -o wide
NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
master1 Ready control-plane 25h v1.28.2 192.168.0.61 <none> Ubuntu 24.04 LTS 6.8.0-36-generic containerd://1.7.12
node1 Ready <none> 25h v1.28.2 192.168.0.62 <none> Ubuntu 24.04 LTS 6.8.0-36-generic containerd://1.7.12
node2 Ready <none> 25h v1.28.2 192.168.0.63 <none> Ubuntu 24.04 LTS 6.8.0-36-generic containerd://1.7.12# 操作系統信息
root@master1:~# cat /etc/issue
Ubuntu 24.04 LTS \n \lroot@master1:~# uname -a
Linux master1 6.8.0-36-generic #36-Ubuntu SMP PREEMPT_DYNAMIC Mon Jun 10 10:49:14 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
- 已經安裝并配置好了Helm。
# helm版本
root@master1:~# helm version
version.BuildInfo{Version:"v3.15.2", GitCommit:"1a500d5625419a524fdae4b33de351cc4f58ec35", GitTreeState:"clean", GoVersion:"go1.22.4"}
- 已經部署了提供pv、pvc等資源的存儲資源。
root@master1:~# helm ls -n openebs
NAME NAMESPACE REVISION UPDATED STATUS CHART APP VERSION
openebs openebs 1 2024-07-02 14:38:40.928808834 +0800 CST deployed openebs-4.0.1 4.0.1
root@master1:~# kubectl get pod -n openebs
NAME READY STATUS RESTARTS AGE
openebs-localpv-provisioner-6b8bff68bd-vmwp7 1/1 Running 0 121m
openebs-lvm-localpv-controller-778b75449c-mmvw6 5/5 Running 0 121m
openebs-lvm-localpv-node-d2trc 2/2 Running 0 121m
openebs-lvm-localpv-node-md5wh 2/2 Running 0 121m
openebs-zfs-localpv-controller-6665568c7c-snw4q 5/5 Running 0 121m
openebs-zfs-localpv-node-mc8tv 2/2 Running 0 121m
openebs-zfs-localpv-node-w6nns 2/2 Running 0 121m
root@master1:~# kubectl get sc -n openebs
NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE
openebs-hostpath openebs.io/local Delete WaitForFirstConsumer false 121m
可以參考我的另外一篇文章部署openebs，《Kubernetes云原生存儲解決方案openebs部署實踐-3.10.0版本（helm部署）》。
helm安裝步驟
1. 添加Jenkins的Helm倉庫
# 添加更新倉庫
helm repo add jenkins https://charts.jenkins.io
helm repo update# 查看版本列表
helm search repo -l jenkins/jenkins# 查看最新版本
helm search repo jenkins# 下載chart包，不加--version則加載最新版本
helm pull jenkins/jenkins --version 5.1.9
關于chart版本和jenkins版本的對應關系，下面是部分映射關系：
| NAME | CHART VERSION | APP VERSION | DESCRIPTION |
|---|---|---|---|
| jenkins/jenkins | 5.3.3 | 2.452.2 | Jenkins - Build great things at any scale! As t… |
| jenkins/jenkins | 5.3.2 | 2.452.2 | Jenkins - Build great things at any scale! As t… |
| jenkins/jenkins | 5.3.1 | 2.452.2 | Jenkins - Build great things at any scale! As t… |
| … | … | … | … |
| jenkins/jenkins | 5.1.9 | 2.440.3 | Jenkins - Build great things at any scale! As t… |
| … | … | … | … |
2. 創建命名空間
kubectl create namespace jenkins
3. 安裝Jenkins
# 查看values
helm show values jenkins/jenkins# 下面安裝的參數來自于values。指定服務暴露方式為NodePort并指定端口，pv由存儲類openebs-hostpath提供
helm upgrade --install jenkins jenkins/jenkins --namespace jenkins --set persistence.storageClass="openebs-hostpath" --set controller.serviceType=NodePort --set controller.nodePort=30080# 卸載安裝
helm uninstall jenkins -n jenkins # 測試環境執行
root@master1:~/jenkins# helm upgrade --install jenkins jenkins/jenkins --namespace jenkins --set persistence.storageClass="openebs-hostpath" --set controller.serviceType=NodePort --set controller.nodePort=30080
Release "jenkins" does not exist. Installing it now.
NAME: jenkins
LAST DEPLOYED: Wed Jul 3 14:07:47 2024
NAMESPACE: jenkins
STATUS: deployed
REVISION: 1
NOTES:
1. Get your 'admin' user password by running:kubectl exec --namespace jenkins -it svc/jenkins -c jenkins -- /bin/cat /run/secrets/additional/chart-admin-password && echo
2. Get the Jenkins URL to visit by running these commands in the same shell:export NODE_PORT=$(kubectl get --namespace jenkins -o jsonpath="{.spec.ports[0].nodePort}" services jenkins)export NODE_IP=$(kubectl get nodes --namespace jenkins -o jsonpath="{.items[0].status.addresses[0].address}")echo http://$NODE_IP:$NODE_PORT3. Login with the password from step 1 and the username: admin
4. Configure security realm and authorization strategy
5. Use Jenkins Configuration as Code by specifying configScripts in your values.yaml file, see documentation: http://$NODE_IP:$NODE_PORT/configuration-as-code and examples: https://github.com/jenkinsci/configuration-as-code-plugin/tree/master/demosFor more information on running Jenkins on Kubernetes, visit:
https://cloud.google.com/solutions/jenkins-on-container-engineFor more information about Jenkins Configuration as Code, visit:
https://jenkins.io/projects/jcasc/# 查看安裝的資源
root@master1:~/jenkins# kubectl get all -n jenkins
NAME READY STATUS RESTARTS AGE
pod/jenkins-0 2/2 Running 0 10mNAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/jenkins NodePort 10.102.102.102 <none> 8080:30080/TCP 10m
service/jenkins-agent ClusterIP 10.99.77.201 <none> 50000/TCP 10mNAME READY AGE
statefulset.apps/jenkins 1/1 10m
參數說明：
- persistence.storageClass參數：用于動態申請pv，持久化jenkins數據。
- serviceType參數：指定服務暴露的方式，nodePort范圍：30000-32767。
也可以通過自定義 values.yaml 文件來配置Jenkins安裝參數。例如，創建一個 myvalues.yaml 文件：
controller:JCasC:enabled: trueconfigScripts:welcome-message: |jenkins:systemMessage: "Welcome to Jenkins on Kubernetes with Helm"installPlugins:- kubernetes- workflow-aggregator- git- configuration-as-codeserviceType: NodePort
然后使用以下命令安裝Jenkins：
helm install jenkins jenkins/jenkins --namespace jenkins -f myvalues.yaml
4. 配置jenkins
- 查詢admin密碼
kubectl --namespace jenkins get secret jenkins -o jsonpath="{.data.jenkins-admin-password}" | base64 --decode
# 或者
kubectl exec --namespace jenkins -it svc/jenkins -c jenkins -- /bin/cat /run/secrets/additional/chart-admin-password && echo# 我這里獲取的隨機密碼
EepJvUf9a8ryLo1JPDzdqo
- 配置Jenkins插件源
root@master1:~# kubectl get pod -n jenkins
NAME READY STATUS RESTARTS AGE
jenkins-0 2/2 Running 0 22m
root@master1:~# kubectl exec -itn jenkins jenkins-0 sh$ echo $JENKINS_HOME
/var/jenkins_home$ cp $JENKINS_HOME/hudson.model.UpdateCenter.xml{,.bak}$ sed -i 's#https://updates.jenkins.io/update-center.json#https://mirrors.huaweicloud.com/jenkins/updates/update-center.json#g' $JENKINS_HOME/hudson.model.UpdateCenter.xml5. 訪問Jenkins
svc設置為NodePort方式，通過節點ip+30080端口訪問：
kubectl --namespace jenkins get svc
用戶名為admin，密碼為上面查到的隨機密碼。
參考資料
- jenkins 5.3.3 · jenkins/jenkinsci (artifacthub.io)
- charts/stable/jenkins at master · helm/charts (github.com)
- Jenkins
