You can either manually uncheck folders in the folders tree or use the "Hide empty directories" option on the "Display" page. This will automatically hide empty folders from the listing.