From the Player's Basic Rules, page 71 (or PHB p. 191):
In contrast, you can move through a hostile creature's space only if the creature is two sizes larger or two sizes smaller than you.
An ogre is a large creature and elves are medium. So an ogre can't move through an elf's space. In your previous example, if we have a 10-foot wide passageway with two elves standing side by side, the ogre can't get through without killing one of the elves or forcing them to move.
The rules on squeezing into a smaller space are for an ogre trying to move along a 5 foot corridor. The rules on creature size that you've quoted back this up—the ogre isn't actually 10 feet wide, that's just the space he controls. So he can move through a 5 foot wide gap, but it's cramped and he can't move freely.
Now, you might be thinking that it's a bit unfair on the ogre if the 2 elves can form an impenetrable barrier against it. As you've said, he'd rather shove them aside than squeeze between them. And he can do just that! From the Player's Basic Rules, page 74:
Using the Attack action, you can make a special melee attack to shove a creature, either to knock it prone or push it away from you. If you're able to make multiple attacks with the Attack action, this attack replaces one of them.
The target of your shove must be no more than one size larger than you, and it must be within your reach. You must make a Strength(Athletics) check contested by the target's Strength(Athletics) or Dexterity(Acrobatics) check (the target chooses the ability to use). If you win the contest, you either knock the target prone or push it 5 feet away from you.
So you're right, shoving is the ogre's answer here.
Now, with your new example, (2 elves in a 15 foot corridor with a 5 foot gape between them), things are different. The ogre does indeed have to squeeze between them. Fortunately for him, it's not going to matter all that much.
Why? Because he's almost guaranteed to be moving on his own turn. Unless there are more enemies than just the elves, he's not going to provoke any opportunity attacks while squeezing, and he can attack before or after he squeezes. So the only squeezing penalty that is actually going to apply to him in this situation is the double cost for movement.
Note that if he stopped between the elves, all these penalties would apply to him. That makes sense though—standing between two enemies with not enough space to move around in would make it difficult to dodge attacks or attack effectively.
Space doesn't only mean the area you physically inhabit in combat
An ogre isn't 10 feet tall by 10 feet wide, they simply command a 10 X 10 combat square area. It would have a penalty to Dex moving through a 5 foot wide square because it can't effectively dodge when the walls are brushing up on it's sides.
This is the same for Medium and Small creatures, who command a 5 X 5 square. They don't command that area because they're that big, they command it because they're actively engaged in combat inside of it and moving within it.
Basically, you've equated combat squares with obstacles to movement in general.
For example: A space large enough for a medium creature to move freely through would be a standard door. However an ogre would need to squeeze through because they're wider and taller than a standard door.
So when you're looking at a medium creature squeezing through a small creatures opening, it's akin to an average person trying to move through a crawl space. While the small creature would be able to do it easily, the medium creature would need to squeeze.
For example, I ran a game with a bunch of small creatures pestering the party and retreating to bolt holes with an opening that would only accommodate small creatures. That means the opening isn't 5 feet wide. By squeezing rules, a party member of medium size could have traversed the tunnels, albeit slowly and at significant disadvantage. Whereas the enemies could freely move and attack using the tunnels for cover and being an extreme and persistent annoyance.
Best Answer
This is largely up to the DM to determine, but it's probably worth talking about the reason for that clause.
In general, sections like these are just meant to tell everyone involved what the options are: "you become large" or "you don't grow bigger". It implicitly tells the DM and player that you can't use this power to grow large and break open a coffin you're trapped in, or burst your chains, or explode a purple worm from inside, or whatever.
Both players and DMs have a long history of attempting to treat any size-changing effect as if size change were an unstoppable force, whether it's a creature doing it or an item ("I put one end of the Compliant Staff against the wall and the other end against the stone door, and command it to grow!") Worse, how to rule the power can easily become a point of contention: "I use my Giant's Might to become big and explode out of the coffin!" "Okay you become large. You are crushed to jelly against the inside of the coffin, roll up a new character." "WHAT?! THAT IS NOT HOW IT WORKS!"
As a result, size change effects generally have some kind of explanation of what happens when there's not enough space, which is usually "it fails" or "you get as big as you can given the space".
In other words, there isn't really a balance issue whether the DM decides you become large and have to squeeze or the ability just doesn't work (though I'd probably have you squeeze because we all saw Alice in Wonderland get stuck inside the White Rabbit's house and it's hilarious). Rather, the benefit is in giving a clear and concise answer about what happens when squeezing isn't a possibility.