Scenario 1: The mount is charmed.
If the mount is charmed, then it will probably fall. From the section on Flying Movement in the Combat chapter (PHB 191):
If a flying
creature is knocked prone, has its speed reduced to 0, or
is otherwise deprived of the ability to move, the creature
falls, unless it has the ability to hover or it is being held
aloft by magic, such as by the fly spell.
Hypnotic Pattern sets affected creatures' movement to 0, so unless the mount can hover or is being held aloft by magic, it will fall.
It's unclear how long falling takes, so depending on your DM, the rider may or may not get a turn before they hit the ground. If they do, they can use their action to shake their mount out of its stupor as described in the spell. If not, their mount will fall and hit the ground.
If the mount can hover, or is held up by magic, then they still won't be able to do anything, but they won't fall, either.
Scenario 2: The rider is charmed.
If the rider is charmed, things get a little ambiguous. I won't post the entire text of the Controlling a Mount section here for copyright reasons, but suffice to say, it doesn't actually mention under what circumstances a rider can or can't control their mount.
If your DM decides that the rider can control their mount while incapacitated (seems unlikely, but you never know), then the rider will still lose their own turn but can (somehow) direct their mount on its turn.
If your DM decides that the rider can't control their mount while incapacitated, then the mount will act independently as described in the Controlling a Mount section. In this case, the rider will either be sitting there while the mount does whatever it wants, or possibly be thrown off. This is all pretty much up to your DM to decide.
Scenario 3: Both rider and mount are charmed.
As in scenario 1, if the mount can hover or is held up by magic, it won't fall, so rider and mount will stay exactly where they are. But if not, there's nothing either of them can do except fall helplessly to the ground.
Best Answer
Yes, this should work
There is no language in the spell that requires you to "see" your target location, just that you pick a point within 120' of you.
In addition, you know exactly where you are, so you could choose to go "blind" and cast the spell.
Caveat Emptor
You may now be under the Blinded condition until the start of your next turn. Whether or not your DM will allow you to re-open your eyes will likely be under their control. Hypnotic Pattern "appears for a moment" so you may be able to reopen, but it would also be very understandable that you need to have your eyes closed for your turn in order to avoid the effects. This would put you under the Blinded condition until the start of your next turn.