When you move a grappled opponent, your speed is halved.
However, while mounted, your mount is moving you.
Is your mount's speed halved when you move a grappled opponent ?
[RPG] Does moving a grappled opponent while mounted reduce your mount’s speed
dnd-5egrapplemount
Best Answer
It would reduce only the grappling character's speed, as the other answers explain it, but when taking it strictly RAW you can only use the grappling creatures movement to move the grappled creature: (emphasis mine)
Basically, your steeds movement would end the grappled condition, because it would remove the grappled creature out of the grapplers reach.