Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add diagnosis for NodeFilesystemAlmostOutOfFiles #50

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions content/runbooks/node/NodeFilesystemAlmostOutOfFiles.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,11 @@ of the cluster.

## Diagnosis

- Check the current inode usage by running the command df -i. This will show you the inode usage for all mounted file systems. Identify the file system(s) that are running low on inodes.
awcodify marked this conversation as resolved.
Show resolved Hide resolved
- Identify the directories that are consuming the most inodes by running the command sudo find <directory> -xdev -type f | cut -d "/" -f 2 | sort | uniq -c | sort -n. Replace <directory> with the path to the directory that you want to check. This command will show you the number of files in each directory under <directory>.
awcodify marked this conversation as resolved.
Show resolved Hide resolved
- Check if there are any unnecessary or temporary files that can be deleted to free up some inodes. You can use the command sudo find <directory> -type f -mtime +<n> -print to find files that haven't been modified in the last <n> days. Replace <directory> with the path to the directory that you want to search and <n> with the number of days that you want to search back.
awcodify marked this conversation as resolved.
Show resolved Hide resolved
- If the above steps don't help to free up enough inodes, consider resizing the file system or moving some files to another file system with more available inodes.
awcodify marked this conversation as resolved.
Show resolved Hide resolved


## Mitigation

Expand Down