Kubernetes: Pod๊ฐ€ ContainerCreating ์ƒํƒœ๋กœ ๋ฉˆ์ถค

์— ๋งŒ๋“  2016๋…„ 08์›” 06์ผ  ยท  3์ฝ”๋ฉ˜ํŠธ  ยท  ์ถœ์ฒ˜: kubernetes/kubernetes

์˜ค๋Š˜ ์–ด๋–ค ์ด์œ ๋กœ ๋ฐฐํฌ ์ค‘ ํ•˜๋‚˜์— ์ƒˆ ๋ฒ„์ „์„ ์ถœ์‹œํ–ˆ์„ ๋•Œ ํฌ๋“œ๊ฐ€ ์ด ์˜ค๋ฅ˜ ์ด๋ฒคํŠธ์™€ ํ•จ๊ป˜ ContainerCreating์—์„œ ๋ฉˆ์ท„์Šต๋‹ˆ๋‹ค.

1h          1m         37        some-api-2275263275-01pq7              Pod                                             Warning   FailedMount               {kubelet gke-cluster-1-default-pool-4399eaa3-os4v}      Unable to mount volumes for pod "some-api-2275263275-01pq7_default(afc5ae68-5b5e-11e6-afbb-42010a800105)": timeout expired waiting for volumes to attach/mount for pod "some-api-2275263275-01pq7"/"default". list of unattached/unmounted volumes=[default-token-880jy]
1h          1m         37        some-api-2275263275-01pq7              Pod                                             Warning   FailedSync                {kubelet gke-cluster-1-default-pool-4399eaa3-os4v}      Error syncing pod, skipping: timeout expired waiting for volumes to attach/mount for pod "some-api-2275263275-01pq7"/"default". list of unattached/unmounted volumes=[default-token-880jy]

๊ทธ๋Ÿฐ ๋‹ค์Œ ํด๋Ÿฌ์Šคํ„ฐ๋ฅผ ํ™•์žฅํ•˜๋ ค๊ณ  ์‹œ๋„ํ–ˆ๊ณ  ์ด์ „์— ์‹คํ–‰ ์ค‘์ธ ํฌ๋“œ์˜ 75% ์ด์ƒ์ด ContainerCreating์œผ๋กœ ์ „ํ™˜ํ–ˆ๊ณ  ๋˜ํ•œ ๊ฑฐ๊ธฐ์—์„œ ๋ฉˆ์ท„์Šต๋‹ˆ๋‹ค. ์ด๋กœ ์ธํ•ด ์šฐ๋ฆฌ ์‹œ์Šคํ…œ์— ๊ด‘๋ฒ”์œ„ํ•œ ์žฅ์• ๊ฐ€ ๋ฐœ์ƒํ–ˆ๊ณ  ๋‚˜๋Š” ์ƒˆ ํด๋Ÿฌ์Šคํ„ฐ๋ฅผ ๋น ๋ฅด๊ฒŒ ์ƒ์„ฑํ•ด์•ผ ํ–ˆ์Šต๋‹ˆ๋‹ค.

Google ํด๋ผ์šฐ๋“œ ํ”Œ๋žซํผ์˜ ์ปจํ…Œ์ด๋„ˆ ์—”์ง„์„ ์‚ฌ์šฉํ•˜๊ณ  ์žˆ์œผ๋ฉฐ ํด๋Ÿฌ์Šคํ„ฐ ๋ฒ„์ „์€ 1.3.2์ž…๋‹ˆ๋‹ค.

arekubectl kinbug sistorage

๊ฐ€์žฅ ์œ ์šฉํ•œ ๋Œ“๊ธ€

v1.3.3์—์„œ๋„ ๋น„์Šทํ•œ ๋ฌธ์ œ๋ฅผ ๋ณด์•˜์ง€๋งŒ ์ œ ๊ฒฝ์šฐ์—๋Š” ๊ทผ๋ณธ ์›์ธ์ด ํ›จ์”ฌ ๋” ๋ณดํ–‰์ž์˜€์Šต๋‹ˆ๋‹ค. ๋‚ด ๋ฐฐํฌ์—๋Š” ๋น„๋ฐ€ ๋ณผ๋ฅจ์ด ํ•„์š”ํ•˜๋ฉฐ ์ƒˆ ๋ฐฐํฌ๋ฅผ ์ˆ˜ํ–‰ํ•˜๋ ค๋Š” ํด๋Ÿฌ์Šคํ„ฐ์— ๋Œ€ํ•ด ์—ฐ๊ฒฐ๋œ ๋น„๋ฐ€์„ ๋งŒ๋“œ๋Š” ๊ฒƒ์„ ์žŠ์—ˆ์Šต๋‹ˆ๋‹ค. kubectl describe ๋˜๋Š” kubectl logs ์‚ฌ์šฉํ•  ๋•Œ ์˜ค๋ฅ˜๊ฐ€ ๋ฐœ์ƒํ•˜์ง€ ์•Š์•˜์ง€๋งŒ ๊ฒฐ๊ตญ ๋ฐฐํฌ๊ฐ€ ์˜์กดํ•˜๋Š” ๋ณผ๋ฅจ์ด ๋ˆ„๋ฝ๋œ ๊ฒฝ์šฐ ๋ฐฐํฌ๊ฐ€ ContainerCreating ์ƒํƒœ(๋กœ๊ทธ ์—†์Œ)์— ๋ฉˆ์ถฐ ์žˆ๋‹ค๋Š” ๊ฒƒ์„ ๊นจ๋‹ฌ์•˜์Šต๋‹ˆ๋‹ค.

๋ชจ๋“  3 ๋Œ“๊ธ€

@montanaflynn v1.3.4์—์„œ ์ˆ˜์ •๋œ v1.3.2 ์—์„œ ๋งŽ์€ ์Šคํ† ๋ฆฌ์ง€ ๊ด€๋ จ ๋ฌธ์ œ ๊ฐ€ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค . ์•„๋งˆ ๊ทธ ์ค‘ ํ•˜๋‚˜๋ฅผ ์ณค์„ ๊ฒƒ์ž…๋‹ˆ๋‹ค.

๋ฐฐํฌ๊ฐ€ ์ค‘๋‹จ๋œ ๋…ธ๋“œ์—์„œ ์ „์ฒด /var/log/kubelet log ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ์ œ๊ฐ€ ์‚ดํŽด๋ณด๊ณ  ์•Œ๋ ค์ง„ ๋ฌธ์ œ์ธ์ง€ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋งˆ์Šคํ„ฐ ๋กœ๊ทธ๋ฅผ ๊ฐ€์ ธ์˜ค๋ ค๋ฉด GKE ํ”„๋กœ์ ํŠธ ์ด๋ฆ„/ํด๋Ÿฌ์Šคํ„ฐ ์ด๋ฆ„/์˜์—ญ๋„ ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค. ๊ณต๊ฐœ์ ์œผ๋กœ ๊ณต์œ ํ•˜๊ณ  ์‹ถ์ง€ ์•Š๋‹ค๋ฉด ์–ธ์ œ๋“ ์ง€ ์ €์—๊ฒŒ ์ด๋ฉ”์ผ์„ ๋ณด๋‚ด์ฃผ์‹ญ์‹œ์˜ค.

v1.3.3์—์„œ๋„ ๋น„์Šทํ•œ ๋ฌธ์ œ๋ฅผ ๋ณด์•˜์ง€๋งŒ ์ œ ๊ฒฝ์šฐ์—๋Š” ๊ทผ๋ณธ ์›์ธ์ด ํ›จ์”ฌ ๋” ๋ณดํ–‰์ž์˜€์Šต๋‹ˆ๋‹ค. ๋‚ด ๋ฐฐํฌ์—๋Š” ๋น„๋ฐ€ ๋ณผ๋ฅจ์ด ํ•„์š”ํ•˜๋ฉฐ ์ƒˆ ๋ฐฐํฌ๋ฅผ ์ˆ˜ํ–‰ํ•˜๋ ค๋Š” ํด๋Ÿฌ์Šคํ„ฐ์— ๋Œ€ํ•ด ์—ฐ๊ฒฐ๋œ ๋น„๋ฐ€์„ ๋งŒ๋“œ๋Š” ๊ฒƒ์„ ์žŠ์—ˆ์Šต๋‹ˆ๋‹ค. kubectl describe ๋˜๋Š” kubectl logs ์‚ฌ์šฉํ•  ๋•Œ ์˜ค๋ฅ˜๊ฐ€ ๋ฐœ์ƒํ•˜์ง€ ์•Š์•˜์ง€๋งŒ ๊ฒฐ๊ตญ ๋ฐฐํฌ๊ฐ€ ์˜์กดํ•˜๋Š” ๋ณผ๋ฅจ์ด ๋ˆ„๋ฝ๋œ ๊ฒฝ์šฐ ๋ฐฐํฌ๊ฐ€ ContainerCreating ์ƒํƒœ(๋กœ๊ทธ ์—†์Œ)์— ๋ฉˆ์ถฐ ์žˆ๋‹ค๋Š” ๊ฒƒ์„ ๊นจ๋‹ฌ์•˜์Šต๋‹ˆ๋‹ค.

์ด ๋ฌธ์ œ๋Š” ์˜ค๋ž˜๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ํ์‡„.

์ด ํŽ˜์ด์ง€๊ฐ€ ๋„์›€์ด ๋˜์—ˆ๋‚˜์š”?
0 / 5 - 0 ๋“ฑ๊ธ‰