What to Do When Your Kubernetes Node Shows "The node was low on resource: ephemeral-storage"
2021-01-15 23:38 (3 years ago)
ytyng
- Pod exits with the error: "The node was low on resource: ephemeral-storage."
- Storage usage of the node is at 85%
- There is an unusually heavy process running in Kubernetes, causing the load average to be abnormally high (like 100)
In this case, it is a storage shortage.
The 85% figure is the default value for Kubernetes' image-gc-high-threshold. When storage usage exceeds this, image garbage collection starts.
However, because the cause of the storage bloat was not directly related to Kubernetes, it could not be handled and resulted in issues.
This time, there was leftover junk from Docker containers, so I removed it using docker prune.
docker container prune
Or
docker system prune
Comments