In the PHB, page 195, it is stated in the rules of shoving that:
If you're able to make multiple attacks with the attack action, this
attack replace one of them.
Because of this, combined with the ability to break up your movement on your turn, could someone shove a creature with their first attack, move up, then shove again?
Best Answer
Yes
As you said, the rules for shoving say:
Since the shove only replaces one of the attacks, you then have enough actions left from the other attacks to shove again. Of course, this assumes that you have enough movement to move 5 feet forward to get into range to shove the creature again.
If you have attack(s) and movement available, then you can absolutely shove multiple times.
This argument is essentially the same one that you can read with regards to grappling in this Q&A.
Official ruling
Jeremy Crawford, lead rules designer for D&D, agrees with this ruling (even including the very similar case of Grappling):