Finger food comes to mind. You were close with your thumb!
They are also conventionally called appetizers or hors d'oeuvres, even though according to the strict definitions appetizers or hors d'oeuvres precede proper meals, whereas at cocktail parties, an actual meal does not normally follow.
Best Answer
Those pieces are called segments.
Segment (Cambridge Dictionary)