When you go to a contact card, the notes will display MANUAL NOTES (notes made by the user).
If you want to also see ALL of the System Notes… check the INCLUDE SYSTEM NOTES box.
(Your selection will be remembered until you change it.)
BTW.
The note count will always include the System Notes AND the Manual Notes – even if you are not including system notes in your view.