안녕하세요
일을 하다 보니...console이 필요한데... 클라우드에서 제공하는 console이 있는 경우도 있고..없는 경우도 있고 때로는 내가 원하는 환경을 잠시 쓰거나 또는 내가 원하는걸 쉽게 만들어서 쓰거나
등등등등....으로 이유로 만든 애들을 소개하면 좋을꺼 같아서 정리합니다.
vagrant를 통해서 virtualbox에 프로비저닝하도록 되어 있습니다.
https://github.com/sysnet4admin/IaC/tree/master/k8s/k8s-console
쿠버네티스의 kubeconfig만 가지고 오면 가볍게 사용할 수 있도록 하는 콘솔
이에 따라 다음의 내용들이 적용되어 있음
CKS를 위한 3줄 요약
- CKA와 다른 관점으로 진행 하지만 시간이 많이 부족하지 않다. 편하게 풀어라
- 3개의 외부 도구(영상) 그리고 그 외에 쿠버네티스의 third party 들에 대해서 미리 알아두고 가자
(허용하는 링크이기도 함)
- 높은 점수의 문제가 의외로 안 어렵다. 그러니 높은 것부터 풀자
CKS는 정말 재밌는 시험이에요 :) 이것저것 알아보면서도 흥미로웠고..특히 killer.sh를 시험자체에서 2번에나 제공하기 때문에 랩을 구매하겠다고 유데미의 인도분 강의를 살 필요도 없다고 봐요. (이 부분은 다시 영상으로 정리할께요! 아마 youtube 여기에 올라갈꺼에요 )
다들 즐거운 쿠버네티스 자격증을 통해서 더 즐거운 쿠버네티스 생활이 되면 좋겠어요!
Hoon이 2021년에 마지막 드리는 메시지!
테스트라고 쓰긴 했는데 진짜 별거 없고, 아직 k8s랑은 안 붙여 봤는데..
이정도면 문제 없이 잘 storageclass도 지원해 줄 것 같네요.
주로 쓰는 가상화 / k8s 환경에서 이거만 실행하고 테스트한 결과 입니다.
wget https://dl.min.io/server/minio/release/linux-amd64/minio chmod +x minio MINIO_ROOT_USER=admin MINIO_ROOT_PASSWORD=password ./minio server /mnt/data
나중에 내가 보려고 정리합니당 :) 하하하;;;
제가 주로 쓰는 랩 환경이 있는데요
https://github.com/sysnet4admin/_Lecture_k8s.starterkit
거기서 Zipkin을 구현하는 방법입니다.
k create deploy zipkin --image=openzipkin/zipkin --port=9411
k expose deployment zipkin --type=NodePort --port=9411
yum install nodejs npm -y
npm install -g n
npm install -g express
git clone https://github.com/openzipkin/zipkin-js-example.git
cd /root/zipkin-js-example/web
[수정 전]
// Send spans to Zipkin asynchronously over HTTP
const zipkinBaseUrl = 'http://localhost:9411';
[수정 후]
// Send spans to Zipkin asynchronously over HTTP
const zipkinBaseUrl = 'http://<Zipkin주소>:<Zipkin포트>';
[root@m-k8s web]# npm start
> zipkin-js-example@0.0.1 start /root/zipkin-js-example/web
> node servers.js
Backend listening on port 9000!
Frontend listening on port 8081!
https://zipkin.io/pages/quickstart.html
https://ondemand.tistory.com/229
https://github.com/openzipkin
여기서도 볼 수 있긴 한데...진짜 같은가 궁금해서 쳐 봤어요 :)
https://github.com/kubernetes/kubernetes/releases
이게 최신이네요.
kubelet.x86_64 1.20.2-0 kubernetes
A Powerful Chaos Engineering Platform for Kubernetes
저번에 유저그룹 (https://www.facebook.com/groups/InfraEngineer) 에서 잠깐 얘기도 했고 저도 궁금하기도 해서 좀 다뤄봤는데요. 역시 바퀴는 사용하는게 맛맛 그 맛!
생각보다 쉽고요
https://chaos-mesh.org/
홈페이지에 나온대로 설치
curl -sSL https://mirrors.chaos-mesh.org/v1.0.2/install.sh | bash
[설치 과정]
[root@m-k8s ~]# curl -sSL https://mirrors.chaos-mesh.org/v1.0.2/install.sh | bash
Install Chaos Mesh chaos-mesh
customresourcedefinition.apiextensions.k8s.io/iochaos.chaos-mesh.org created
customresourcedefinition.apiextensions.k8s.io/kernelchaos.chaos-mesh.org created
customresourcedefinition.apiextensions.k8s.io/networkchaos.chaos-mesh.org created
customresourcedefinition.apiextensions.k8s.io/podchaos.chaos-mesh.org created
customresourcedefinition.apiextensions.k8s.io/podiochaos.chaos-mesh.org created
customresourcedefinition.apiextensions.k8s.io/podnetworkchaos.chaos-mesh.org created
customresourcedefinition.apiextensions.k8s.io/stresschaos.chaos-mesh.org created
customresourcedefinition.apiextensions.k8s.io/timechaos.chaos-mesh.org created
namespace/chaos-testing created
serviceaccount/chaos-controller-manager created
secret/chaos-mesh-webhook-certs created
clusterrole.rbac.authorization.k8s.io/chaos-mesh:chaos-controller-manager-target-namespace created
clusterrole.rbac.authorization.k8s.io/chaos-mesh:chaos-controller-manager-cluster-level created
clusterrolebinding.rbac.authorization.k8s.io/chaos-mesh:chaos-controller-manager-cluster-level created
clusterrolebinding.rbac.authorization.k8s.io/chaos-mesh:chaos-controller-manager-target-namespace created
role.rbac.authorization.k8s.io/chaos-mesh:chaos-controller-manager-control-plane created
rolebinding.rbac.authorization.k8s.io/chaos-mesh:chaos-controller-manager-control-plane created
service/chaos-dashboard created
service/chaos-mesh-controller-manager created
daemonset.apps/chaos-daemon created
deployment.apps/chaos-dashboard created
deployment.apps/chaos-controller-manager created
mutatingwebhookconfiguration.admissionregistration.k8s.io/chaos-mesh-mutation created
validatingwebhookconfiguration.admissionregistration.k8s.io/chaos-mesh-validation created
Waiting for pod running
chaos-controller-manager-59886dfb4d-x7zpk 0/1 ContainerCreating 0 10s
Waiting for pod running
Waiting for pod running
Chaos Mesh chaos-mesh is installed successfully
[설치하고 나서 파드와 서비스]
[root@m-k8s ~]# k get pod -n chaos-testing
NAME READY STATUS RESTARTS AGE
chaos-controller-manager-59886dfb4d-x7zpk 1/1 Running 0 2m8s
chaos-daemon-26dth 1/1 Running 0 2m8s
chaos-daemon-4pgmk 1/1 Running 0 2m8s
chaos-daemon-vpk2r 1/1 Running 0 2m9s
chaos-dashboard-6cbc9987f-8dg55 1/1 Running 0 2m8s
[root@m-k8s ~]# k get svc -A
NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
chaos-testing chaos-dashboard LoadBalancer 10.110.250.102 192.168.1.12 2333:30176/TCP 6s
chaos-testing chaos-mesh-controller-manager ClusterIP 10.104.101.134 <none> 10081/TCP,10080/TCP,443/TCP 4m21s
default kubernetes ClusterIP 10.96.0.1 <none> 443/TCP 28d
default nginx LoadBalancer 10.97.98.8 192.168.1.11 80:31681/TCP 12d
kube-system kube-dns ClusterIP 10.96.0.10 <none> 53/UDP,53/TCP,9153/TCP 28d
참고: 디폴트는 nodePort라 LB로 바꿨어요
하고 나서 아래와 같이 클릭클릭하면 하면 짠 하고 테스트 프로시져가 돌아가는 구조네요
내부 스탠다드 QA만들때 괜찮을꺼 같아요 혹은 CI/CD 중에 QA에 넣고 성공적인 흐름을 만들때도 나쁘지 않을꺼 같고요.
QA Test procedure 만들기
하고 나서요 대략 한 20-30 분정도 k get pod -o wide -w를 하고 봤더니..뿅!
[root@m-k8s ~]# k get pod -o wide -w
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
nginx-f89759699-2rrth 1/1 Running 0 17s 172.16.103.140 w2-k8s <none> <none>
nginx-f89759699-9lnvz 1/1 Running 4 12d 172.16.221.141 w1-k8s <none> <none>
nginx-f89759699-hsdqh 1/1 Running 2 4d22h 172.16.221.144 w1-k8s <none> <none>
<<< 시작 >>>>
nginx-f89759699-2rrth 1/1 Terminating 0 60s 172.16.103.140 w2-k8s <none> <none>
nginx-f89759699-2rrth 1/1 Terminating 0 60s 172.16.103.140 w2-k8s <none> <none>
nginx-f89759699-x2czg 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-x2czg 0/1 Pending 0 0s <none> w2-k8s <none> <none>
nginx-f89759699-x2czg 0/1 ContainerCreating 0 0s <none> w2-k8s <none> <none>
nginx-f89759699-x2czg 0/1 ContainerCreating 0 1s <none> w2-k8s <none> <none>
nginx-f89759699-x2czg 1/1 Running 0 5s 172.16.103.141 w2-k8s <none> <none>
nginx-f89759699-hsdqh 1/1 Terminating 2 4d22h 172.16.221.144 w1-k8s <none> <none>
nginx-f89759699-hsdqh 1/1 Terminating 2 4d22h 172.16.221.144 w1-k8s <none> <none>
nginx-f89759699-8gt7j 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-8gt7j 0/1 Pending 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-8gt7j 0/1 ContainerCreating 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-8gt7j 0/1 ContainerCreating 0 1s <none> w3-k8s <none> <none>
nginx-f89759699-8gt7j 1/1 Running 0 10s 172.16.132.8 w3-k8s <none> <none>
nginx-f89759699-9lnvz 1/1 Terminating 4 12d 172.16.221.141 w1-k8s <none> <none>
nginx-f89759699-nk52b 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-9lnvz 1/1 Terminating 4 12d 172.16.221.141 w1-k8s <none> <none>
nginx-f89759699-nk52b 0/1 Pending 0 0s <none> w1-k8s <none> <none>
nginx-f89759699-nk52b 0/1 ContainerCreating 0 0s <none> w1-k8s <none> <none>
nginx-f89759699-nk52b 0/1 ContainerCreating 0 1s <none> w1-k8s <none> <none>
nginx-f89759699-nk52b 1/1 Running 0 6s 172.16.221.146 w1-k8s <none> <none>
nginx-f89759699-8gt7j 1/1 Terminating 0 2m 172.16.132.8 w3-k8s <none> <none>
nginx-f89759699-8gt7j 1/1 Terminating 0 2m 172.16.132.8 w3-k8s <none> <none>
nginx-f89759699-2tnpc 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-2tnpc 0/1 Pending 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-2tnpc 0/1 ContainerCreating 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-2tnpc 0/1 ContainerCreating 0 1s <none> w3-k8s <none> <none>
nginx-f89759699-2tnpc 1/1 Running 0 5s 172.16.132.9 w3-k8s <none> <none>
nginx-f89759699-2tnpc 1/1 Terminating 0 60s 172.16.132.9 w3-k8s <none> <none>
nginx-f89759699-2tnpc 1/1 Terminating 0 60s 172.16.132.9 w3-k8s <none> <none>
nginx-f89759699-w72sz 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-w72sz 0/1 Pending 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-w72sz 0/1 ContainerCreating 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-w72sz 0/1 ContainerCreating 0 1s <none> w3-k8s <none> <none>
nginx-f89759699-w72sz 1/1 Running 0 5s 172.16.132.10 w3-k8s <none> <none>
nginx-f89759699-w72sz 1/1 Terminating 0 60s 172.16.132.10 w3-k8s <none> <none>
nginx-f89759699-w72sz 1/1 Terminating 0 60s 172.16.132.10 w3-k8s <none> <none>
nginx-f89759699-w8cz8 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-w8cz8 0/1 Pending 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-w8cz8 0/1 ContainerCreating 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-w8cz8 0/1 ContainerCreating 0 1s <none> w3-k8s <none> <none>
nginx-f89759699-w8cz8 1/1 Running 0 5s 172.16.132.11 w3-k8s <none> <none>
nginx-f89759699-nk52b 1/1 Terminating 0 4m 172.16.221.146 w1-k8s <none> <none>
nginx-f89759699-nk52b 1/1 Terminating 0 4m 172.16.221.146 w1-k8s <none> <none>
nginx-f89759699-62mnq 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-62mnq 0/1 Pending 0 0s <none> w1-k8s <none> <none>
nginx-f89759699-62mnq 0/1 ContainerCreating 0 0s <none> w1-k8s <none> <none>
nginx-f89759699-62mnq 0/1 ContainerCreating 0 1s <none> w1-k8s <none> <none>
nginx-f89759699-62mnq 1/1 Running 0 5s 172.16.221.147 w1-k8s <none> <none>
nginx-f89759699-x2czg 1/1 Terminating 0 7m 172.16.103.141 w2-k8s <none> <none>
nginx-f89759699-x2czg 1/1 Terminating 0 7m 172.16.103.141 w2-k8s <none> <none>
nginx-f89759699-r9pwl 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-r9pwl 0/1 Pending 0 0s <none> w2-k8s <none> <none>
nginx-f89759699-r9pwl 0/1 ContainerCreating 0 0s <none> w2-k8s <none> <none>
nginx-f89759699-r9pwl 0/1 ContainerCreating 0 1s <none> w2-k8s <none> <none>
nginx-f89759699-r9pwl 1/1 Running 0 6s 172.16.103.142 w2-k8s <none> <none>
nginx-f89759699-r9pwl 1/1 Terminating 0 60s 172.16.103.142 w2-k8s <none> <none>
nginx-f89759699-czrbr 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-r9pwl 1/1 Terminating 0 60s 172.16.103.142 w2-k8s <none> <none>
nginx-f89759699-czrbr 0/1 Pending 0 0s <none> w2-k8s <none> <none>
nginx-f89759699-czrbr 0/1 ContainerCreating 0 0s <none> w2-k8s <none> <none>
nginx-f89759699-czrbr 0/1 ContainerCreating 0 1s <none> w2-k8s <none> <none>
nginx-f89759699-czrbr 1/1 Running 0 6s 172.16.103.143 w2-k8s <none> <none>
nginx-f89759699-w8cz8 1/1 Terminating 0 4m 172.16.132.11 w3-k8s <none> <none>
nginx-f89759699-w8cz8 1/1 Terminating 0 4m 172.16.132.11 w3-k8s <none> <none>
nginx-f89759699-2tkmz 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-2tkmz 0/1 Pending 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-2tkmz 0/1 ContainerCreating 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-2tkmz 0/1 ContainerCreating 0 1s <none> w3-k8s <none> <none>
nginx-f89759699-2tkmz 1/1 Running 0 6s 172.16.132.12 w3-k8s <none> <none>
nginx-f89759699-2tkmz 1/1 Terminating 0 60s 172.16.132.12 w3-k8s <none> <none>
nginx-f89759699-2tkmz 1/1 Terminating 0 60s 172.16.132.12 w3-k8s <none> <none>
nginx-f89759699-q9nrh 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-q9nrh 0/1 Pending 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-q9nrh 0/1 ContainerCreating 0 0s <none> w3-k8s <none> <none>
nginx-f89759699-q9nrh 0/1 ContainerCreating 0 1s <none> w3-k8s <none> <none>
nginx-f89759699-q9nrh 1/1 Running 0 5s 172.16.132.13 w3-k8s <none> <none>
nginx-f89759699-czrbr 1/1 Terminating 0 3m 172.16.103.143 w2-k8s <none> <none>
nginx-f89759699-czrbr 1/1 Terminating 0 3m 172.16.103.143 w2-k8s <none> <none>
nginx-f89759699-fzkgc 0/1 Pending 0 0s <none> <none> <none> <none>
nginx-f89759699-fzkgc 0/1 Pending 0 0s <none> w2-k8s <none> <none>
nginx-f89759699-fzkgc 0/1 ContainerCreating 0 0s <none> w2-k8s <none> <none>
nginx-f89759699-fzkgc 0/1 ContainerCreating 0 1s <none> w2-k8s <none> <none>
nginx-f89759699-fzkgc 1/1 Running 0 5s 172.16.103.144 w2-k8s <none> <none>
