The number of unread messages in any folder is displayed in parentheses next to the folder name. So, if you have seven unread messages in a folder named Mom, it will show as Mom (7).
Read messages are not indicated in the folder name, and the only way to check whether the folder contains any is to open the folder.