In addition to the below answer, there are now 4 additional spirit orbs (from the second DLC pack) that allow for one further upgrade to either your stamina wheels or your heart containers, bringing to the maximum to 31 heart containers and 3 1/5 stamina wheels.
From various posts like this one, it seems like the maximum number of hearts is 30 and the maximum stamina is 3 full wheels.
There are 120 shrines, the first four spirit orbs being used to obtain the paraglider
That leaves 116 shrines with spirit orbs capable of increasing life/stamina. 116/4 = 29, which means there are a total of 29 upgrades
Correction: these 4 Spirit orbs are not consumed, so they are still able to be used towards upgrades. Thus, 120/4 = 30 possible upgrades.
There are 30 max hearts, and you start with three, so it would take 27 upgrades to max your life
And this thread:
You can upgrade stamina 10 times, each time you upgrade it you get 20% of a wheel. So you can have a maximum of 3 wheels.
Therefore, you can, at most, have 30 hearts and only 2 & 2/5 stamina wheels or 3 full stamina wheels and 27 hearts, as there are 30 upgrades available plus the 4 heart containers given as rewards from the main dungeons.
At this time, it's not certain whether you can fully max out both of these in a single playthrough (the math makes it seem unlikely), but you are able to respec, as explained in this guide:
Make your way to Hateno Village and then head to the bottom of the hill on the other side of the entrance to the village. You should see a sad-looking statue here.
If you talk to this, it’ll start a sidequest that sees the statue steal either a Heart Container or Stamina Vessel from you, but interact with the statue again to reclaim it.
Talk to the statue after this and it’ll offer you a deal whereby you can sell one of your Heart Containers or Stamina Vessels for 100 Rupees. This isn’t as bad as it sounds, though, as if you speak to the statue once more, you’ll be given the option to purchase either a Heart Container or Stamina Vessel for 120 Rupees.
Therefore, you can essentially pay 20 Rupees each time and completely switch your health and stamina upgrades. You can use this statue as many times as you want as long as you have the 20 Rupees necessary.
Best Answer
Based on your explanation, you are at the beginning stage of the quest The Statue's Bargain. The statue steals either a heart container or stamina vessel, and the quest is regain whichever the statue took from you.
After you finish the quest, the Horned Statue will allow you to exchange heart containers for stamina vessels (and vice versa). This is designed to reallocate your stats as you see fit after already increasing them with spirit orbs.