• Pods across one or more namespaces enter  Evicted ,  Pending ,  CrashLoopBackOff ,  Unknown , or similar failed states.
• Core Chef 360 services may fail to run, resulting in loss of access to the Chef 360 UI.
• The cluster will not recover on its own — the disk-pressure persists until free disk space is restored below the threshold.

• 85% disk utilization is the default  imageGCHighThresholdPercent  threshold used by kubelet.
• When  /var  usage crosses this threshold, kubelet begins evicting pods that exceed their ephemeral storage soft limit in order to reclaim space.
• Once evictions begin, the affected node is tainted with  node.kubernetes.io/disk-pressure:NoSchedule.
• This prevents any new pods from being scheduled on the node.
• Kubernetes will still attempt to replace evicted pods (via Deployments/ReplicaSets), but the new pods are immediately blocked and evicted again — creating a self-reinforcing eviction loop.
• The most common driver of this issue is unbounded growth of MinIO storage (used for centralized log storage), specifically the  general-logs  and  audit-logs  buckets. If log retention is not enforced, these buckets can consume very large amounts of disk space (100+ GB) over time especially when running 100's or 1000's of pods.

Proactively monitor  /var  disk utilization on Chef 360 nodes and set up alerts before reaching 85%.

• We suggest setting alerts at 75% disk utilization of the /var directory)

Ensure log retention policies are configured for MinIO  general-logs  and  audit-logs  per the Chef documentation - https://docs.chef.io/360/1.7/get_started/install_server/#centralized-log-storage:

If you selected MinIO as your storage option and enabled log storage, configure the following retention settings:

• In the General Logs Retention Period (Days) field, enter the number of days to retain general logs in MinIO storage. General logs older than this period are automatically deleted. The default retention period is 30 days.
• In the Audit Logs Retention Period (Days) field, enter the number of days to retain audit logs in MinIO storage. Audit logs older than this period are automatically deleted. The default retention period is 365 days (1 year). 
• Typically, the General Logs impacts storage more than Audit Logs even although its retention period is smaller. You can set the Retention Period for General/Audit logs to a value that is lower than the default. The retention period for both, General Logs and Audit Logs, must be greater than 0.

If the 85% utilization threshold has already been exceeded on the /var directory and the UI is inaccessible, follow KB Article:

• Resolving Disk Pressure and Cleaning Up /var Partition on Chef 360 - Progress Community
• The article is meant to be used when /var is already beyond 85%, but when you know you reached 75% as a precaution you can follow the same cleanup steps to maintain the required disk space.  

In the case that /var directory is below the 85% threshold but the Admin Console is still throwing 502 Bad Gateway error, please refer to the following KB article:

• Chef360 Admin Console Not Accessible Returning 502 - Progress Community 

Log Centralization - https://docs.chef.io/360/1.7/centralized_log_storage/

General-logs - https://docs.chef.io/360/1.7/centralized_log_storage/general_logs/

Audit-Logs - https://docs.chef.io/360/1.7/centralized_log_storage/audit_logs/

Log retention for general-logs/audit-logs for MinIO - https://docs.chef.io/360/1.7/get_started/install_server/#centralized-log-storage