With an ultimate magus, it’s more important to keep yourself as close as possible to a single-classed spellcaster on one side than it is to keep the two even.
Thus you want to circumvent as much as possible ultimate magus’s attempts to progress your lower-level class.
Because at 1st, 4th, and 7th level, ultimate magus advances the class with lower caster level (your choice in the case of a tie), this has a tendency to even out your two classes. If you avoid that, and continue to progress in the more advanced class, you will have more of your highest-level spell slots, which are also higher level than they would be.
Practiced Spellcaster is the solution to taking manual control over which class ultimate magus progresses. Practiced Spellcaster increases a class’s caster level (but no other facet of its spellcasting) by up to 4 (capped at the spellcaster’s HD, so the feat is only beneficial to multiclassed spellcasters). Normally, caster level is nice but not as crucial as things like spell slots or higher spell levels. Ultimate magus switches this up, though.
If a Wizard 4/Sorcerer 1 takes Practiced Spellcaster for sorcerer, his weaker class, his sorcerer caster level is 5th. This puts it higher than his wizard spellcasting’s 4th caster level, so first level of ultimate magus advances wizard. This is despite the fact that the ultimate magus’s wizard spellcasting is, for most purposes, more advanced than his sorcerer spellcasting.
Now you have some control over your advancement, and that allows you to maximize your spell slots.
At 4th level, both classes are even, so you should choose wizard. At 7th, barring finding some other bonus to sorcerer caster level, though, you have to accept some sorcerer progression, which is a shame but not the end of the world. You’ll end up “missing” a total of two wizard spellcasting levels (compared to a single-classed wizard), but gain a total of nine sorcerer levels, plus of course all the rest of the ultimate magus class features.
Otherwise, you need to improve the abilities that grant you bonus spells. Consider the beguiler (Player's Handbook II) instead of sorcerer: you'll use Intelligence for both classes.
Versatile Spellcaster is another feat that will make your slots more flexible.
And pearls of power and rings of wizardry can help by letting you reuse slots. Memento magicka are like pearls of power for spontaneous spellcasters but they are 50% more expensive, which is badly overpriced.
Caster Level Looping
I'm going to open this answer by saying - there is no definitive rules text on how to treat, or in what order, stacking caster levels from classes or prestige classes. There is a general rule from the 3.5e FAQ that states that 'in general' one should apply bonuses in order most beneficial to the creature, but it's not exactly specific, or definitive, especially in this edge case.
Also, Caster Level Looping And You (by Bauglir) has how the CO people think all this works, also, nearly every way to multiplicatively increase Caster Level in the game.
It's worth noting that there are two ways to read this. One (the one CO likes) is that 'spellcaster level' is referring to 'caster level', and indeed, this is actually the way the game parses it in other abilities. But it could also be referring to 'levels in spellcasting classes', which means basically NONE of the shenanigans outlined here will do anything.
In my answer, I will be assuming the former, due to the way the question is asked. In the case of the latter, simply count up your class levels in arcane casting classes (which doesn't include PrC's that say '+1 level in existing blah', tough luck), and that's your CL for everything.
It's worth noting that former reading is not suitable for play or practical optimization in any sense. Neither are any of the other caster level loops, even (or especially) the ones that are written more explicitly.
But on to the questions.
Question 1
Alex is a Spellthief 2 / Wizard 16 / Green Star Adept 2 who possesses the feat Master Spellthief. What's Alex's caster level for his wizard spells?
Alex's Master Spellthief feat means his Spellthief CL is 18 (16 Wizard + 2 Spellthief) and his Wizard CL is 18 (''), before he takes any levels of Green Star Adept, 'when determining caster level for arcane spells'. So for arcane spells it's 18, otherwise it's the normal numbers - 2 for spellthief, 16 for wizard. This is fine, as the numeric effects of Arcane Spells is kind of what you want to use a caster level for as an arcane caster. But it's important to note that his caster level is still just 2, and 16, not 18.
So when he takes Green Star Adept, he adds his Green Star Adept levels (2) to his Wizard levels (16) to get his new Wizard 'effective caster level' (18). So he now has three things related to being a Wizard;
His Actual Wizard Caster Level: 16
His 'Effective' Wizard Caster Level: 18
His Wizard Caster Level For the Purposes of Casting Arcane Spells: 20.
There's no reason why 'effective caster level' would not be counted as a caster level for the purposes of Master Spellthief, so 2 + 18 = 20 = what you use as your CL for arcane spells cast either from the Spellthief class or the Wizard class.
Additionally, the Wizard has the spells known and per day of a 17th level Wizard, due to Green Star Adept's Spells per Day/Spells Known class feature.
Question 2
Bob is a Spellthief 4 / Wizard 15 / Knight of the Weave 1 who possesses the feat Master Spellthief. What's Bob's caster level for his A) spellthief spells, B) wizard spells, and C) knight of the weave spells?
And here starteth le fromage. Basically, Knight of the Weave's caster level is equal to Bob's Spellthief AND Wizard caster levels added together, but again NOT the Master Spellthief total, which is purely for the purposes of casting arcane spells only. So 4 + 15 = Knight of the Weave Caster Level of 19.
But whenever Bob casts an arcane spell, Master Spellthief kicks in. And it goes 'hmm what caster levels you got', finds Spellthief at 4, Wizard at 15, and some wacky prestige class called Knight of the Weave at 19, and then adds all those numbers together because they are all 'arcane spellcaster levels' and comes out with the absurd number of caster level of 38 for the purposes of casting arcane spells.
Question 3
Chris is a Bard 1 / Spellthief 1 / Wizard 8 / Sublime Chord 10 who possesses the feat Master Spellthief. She applies the sublime chord class feature spells per day to her wizard casting. What's Chris's caster level for A) wizard spells and B) sublime chord spells?
Sublime Chord sets all arcane casting classes Caster Level to 18, in this scenario, due to the wording of it's 'spells per day' ability.
Then along comes our good friend Master Spellthief, sees 4 Caster Levels (Bard, Spellthief, Wizard, Sublime Chord) set at 18. It goes, you know what? Let's add all those together, and end up with a CL for the purposes of casting Arcane Spells of 72.
Then everyone cries.
Question 4
Dylan is a Sorcerer 1 / Spellthief 4 / Wizard 3 / Ultimate Magus 10 who possesses the feat Master Spellthief. He applies the ultimate magus class feature spellcasting and extraordinary ability arcane spell power to his wizard casting when he can and his sorcerer casting when he must. What's Dylan's caster level for his A) wizard spells and B) sorcerer spells?
He starts out with Sorc CL 10, Spellthief CL 4, Wizard CL 11. He possesses a +4 to CL for the purposes of arcane spells. Master Spellthief turns his CL for all his arcane casting classes for the purposes of casting arcane spells into 25 (4+11+10). To which you then add +4. Master Spellthief (under the nice reading) sums the totals of your caster levels, not the totals of your 'caster level for the purposes of arcane spells', so UM's ability simply adds, it doesn't get multiplied across.
Question 5
Ethan is a Bard 1 / Sorcerer 1 / Spellthief 2/ Wizard 3 / Green Star Adept 2 / Knight of the Weave 1 / Sublime Chord 6 / Ultimate Magus 4 (or another more favorable combination you choose) with the feat Master Spellthief. He applies everything he can to his wizard casting until he can apply it to his sublime chord casting and everything he must to his wizard casting or his sorcerer casting, favoring wizard. What are his caster levels for his A) bard spells, B) sorcerer spells, C) wizard spells, D) knight of the weave spells, and E) sublime chord spells?
Why are you doing this to me.
Right. Following the FAQ guideline about adding things in most beneficial order, this is actually relatively simple. Ultimate Magus advances Sublime Chord 2 steps (you'd be better off just taking more wizard levels, you only care about highest non-sublime-chord CL when sublime chord is in the mix, and dipping as many other arcane casting classes as possible), putting total 'sublime chord levels' at 8. Sublime Chord adds itself to Wizard to determine your CL for ALL arcane spellcasting clsases, so all your arcane spellcasting classes now have a CL of 3+8=11. Green Star Adept adds +2 to Sublime Chord on top, so you end up with a CL of 13 on all your arcane casting classes.
Knight of the Weave now does it's thing. You can't have it do it's thing 'first' and then add sublime chord to it and then have everything be CL 22 or something because Sublime Chord adds itself to 'level in a spellcasting class', not 'CL'. So '+1 existing level' prestige classes etc mean nothing to Sublime Chord unless they are advancing Sublime Chord, since it determines it's CL based on class levels in another class + Sublime Chord levels/prestige class bonuses/stuff. Anyway, you've got 5 caster levels (Bard, Sorcerer, Wizard, Spellthief, Sublime Chord) and Sublime has set them all to 13. So, 5x13=65, +1 for your Knight of the Weave level, gives a Knight of the Weave CL of 66.
Master Spellthief then does it's thing when you go to cast a spell, as normal. 66+65= CL 131.
Then Ultimate Magus does it's Arcane Power thing for +2 more, giving you a final total of
CL 133.
Important Concepts for Understanding This Stuff
Prestige classes that advance spellcasting do not themselves have a 'caster level' - they simply modify the caster level and spells known etc of another class.
'Caster level' is not the same as 'caster level for the purposes of arcane spells', it's like 'hp while raging' or 'hp while buffed with Aid' is not the same as 'base hp'.
Sublime Chord finds a base class, adds that base class' class levels to Sublime Chord levels, adds any randumb CL modifiers (Orange Ioun Stone, Green Star Adept) then sets every arcane CL the character has to that number, including it's own. It's not adding or involving CLs at all, just class level + class level + magic items or spells or whatever. Prestige classes that say '+1 spellcaster level' that apply to sublime chord count, but not those that apply to the class it is adding to itself.
Knight of the Weave doesn't do any of that, it just finds all the CLs around, adds them together, and uses that as it's own CL.
Master Spellthief doesn't ever modify any CLs. It just adds all existing CLs together to get a number used AS the CL for casting arcane spells. It doesn't actually change the actual CLs the classes have, just the number you use to cast spells.
'Effective caster level' is mostly the same as 'caster level' since you use it for anything involving caster level.
You do all of these transformations only once, in whatever order you like, but you can't just have them feeding back into each other forever due to the way they're written.
If one of these guys with Sublime Chord or Knight of the Weave picked up an Orange Ioun Stone, it would increment all their numbers and therefore change Sublime Chord's CL or Knight of the Weave's CL. You'd go back to the start and apply all the bonuses again, but this time including the Orange Ioun Stone, in whatever order was most advantageous to you as normal. So you'd undo the transformations and go from the top, work it all out again but with the new factor. Same if you gain a level, etc.
Best Answer
Sandstorm has several races in it that gain Heat Endurance as a bonus feat:
Since these are racial bonus feats, you do not need to worry about meeting the Fortitude requirement. Any one of them except the half-orc works fine for a wizard.
However, taking one of these races has a problem with Southern Magician—none of them are human. Alternate Source Spell becomes an option, but that’s more costly to take (and if you were dipping a divine class, you could just dip cleric and get the Fortitude anyway). Interestingly, the half-orc is better here: per Races of Destiny, a half-human can take things specific to humans (depending on your DM, you may need to take the Human Heritage feat from the same source first, though).
The −2 Int is a problem, though. And since half-orcs never get any love, I’m not sure there’s any way to make a half-orc without the Intelligence penalty (still looking). A Kingdoms of Kalamar supplement, Fury in the Wastes: The Orcs of Tellene, includes black orcs that do not have an Intelligence penalty, but no word on what black half-orcs might be like (or whether they’d be compatible with scablands half-orcs). Likewise, Dragon vol. 339 updates the Spelljammer races to 3.5 rules and includes the scro, orcs-in-space, and they have no Intelligence penalty, but there is no mention of half-scro.
If you want more cheese, these are all Humanoids. That means alter self will let you become one, gaining Heat Endurance. The rules for qualifying for prestige classes say you only need to meet the prerequisites to take the first level—if you can ensure you level-up to 4th while alter self is in effect, you are eligible, RAW, to take walker in the waste and then keep its class features and keep taking its levels after alter self wears off. Most DMs are unlikely to go for that, though.