This command will go through your entire server, count the number of files per directory, then output the list sorted:
find / -type d | while read dir; do count=$(find "$dir" -maxdepth 1 | wc -l); echo "$count ; $dir"; done | sort -g
The output will look like:
100 ; /path/to/directory
200 ; /path/to/directory2
…