OK, so here’s the text in question:
Spell Rage (Ex)
A rage mage can cast spells while in a rage, as long as the spell’s casting time is no more than 1 full round. When she casts a spell of the abjuration, conjuration, evocation, necromancy, or transmutation school while in a rage, the rage mage uses her character level as her caster level. This ability only works when the rage mage is in a spell rage.
While in a spell rage, a rage mage becomes reckless and loses her some of her ability to defend herself. She temporarily takes a –2 penalty to Armor Class. She can attempt Concentration checks to avoid having a spell disrupted, but can’t use any other Charisma-, Dexterity-, or Intelligence-based skills (except for Balance, Escape Artist, Intimidate, and Ride) while in a spell rage.
A fit of rage lasts for a number of rounds equal to 3 + the character’s Constitution modifier. A rage mage can end her rage voluntarily. At the end of the rage, the character is fatigued (–2 Strength, –2 Dexterity, can’t charge or run) for the duration of the current encounter (unless the rage mage is 10th level, when this limitation no longer applies). A rage mage can only fly into a rage once per encounter, and only a certain number of times per day (determined by level). Entering a rage takes no time itself, but a rage mage can only do it during her action, not in response to somebody else’s action.
This is a bit ambiguous. It mostly refers to Rage, not Spell Rage. From the text, it could be read as a change to all Rages. However, the table indicates “Spell Rage 1/day” and then later “Rage +1 use/day.” This indicates that they are separate features with a separate pool of uses.
Effectively, Spell Rage is a separate effect that has to be activated separately from Rage, and uses a different pool of uses. Since both are activated as free actions, you can always activate both at once to gain the benefits of each. Note that Spell Rage specifically allows you to cast spells during a normal Rage, overwriting the usual restriction in Rage that prevents that.
In Dungeons and Dragons 3.5
Rage says, in part,
While raging, a barbarian cannot use any Charisma-, Dexterity-, or Intelligence-based skills (except for Balance, Escape Artist, Intimidate, and Ride), the Concentration skill, or any abilities that require patience or concentration, nor can he cast spells or activate magic items that require a command word, a spell trigger (such as a wand), or spell completion (such as a scroll) to function. He can use any feat he has except Combat Expertise, item creation feats, and metamagic feats. (PH 25).
That raging restricts other abilities requiring patience and concentration, but never specifies what those might be, means the DM has a free hand in declaring certain tasks require patience and concentration and therefore are beyond the raging barbarian. But the DM should probably rarely place such restrictions on tasks, given the limits present later in the description of rage.
Thus, as no mention's made of the raging creature being unable to do it, fighting defensively (PH 140) remains an option, as does total defense (PH 142).
It is odd, but the Player's Handbook just doesn't restrict rage beyond these limits. The game says that if it's not on this list (or specifically prohibited by an option in a later book), the barbarian can probably do it while raging; so it's perfectly acceptable for a barbarian, for example, to apply extra sneak attack damage if he has any, the target's vulnerable to it, and the circumstances mean he'd inflict it; fight defensively or use total defense; attempt disarms or otherwise use nonlethal force; and take the withdraw action.
The goal is to limit the raging barbarians' actions in exchange for increased combat prowess not precisely simulate violent psychopathy in a table top role-playing game. In this case an exclusive list is better than an inclusive list (i.e. the raging barbarian can't do these things versus the raging barbarian can only do these things) because the game knew dozens of books with far more options would follow, so rather than limiting the raging barbarian to actions--requiring every future option to note if a barbarian could use it while raging--, it prevents him from taking some actions, so the raging barbarian can use future options freely.
In Pathfinder
Rage says, in part,
While in rage, a barbarian cannot use any Charisma-, Dexterity-, or Intelligence-based skills (except Acrobatics, Fly, Intimidate, and Ride) or any ability that requires patience or concentration.
And then omits the remainder. Without the rest of the list it's in the DM's hands as to what, exactly, requires "patience and concentration."
A cursory search of the skills turned up nothing explicitly requiring patience, in feats only the aptly named Patient Strike would seem to need it, and the bonus from a traveler's dictionary is increased if the user is patient. But the concept of concentration is loaded with meaning. Concentration is what's needed to cast spells ("To cast a spell you must concentrate"), for instance, and at least one use of the skill Use Magic Device requires concentration.
But the exclusions given for D&D 3.5's rage aren't otherwise present, so a raging barbarian can use Combat Expertise, magic items, and other D&D 3.5 restricted options if the DM rules these don't require patience or concentration. Thus it is up to the DM whether a Pathfinder raging barbarian can use the total defense action or fight defensively.
Best Answer
It exists
The Quantum Barbarian hinges on the Berserker option (which causes him to start raging below a certain amount of hit points, and stop above that amount) and the Bear Warrior prestige class. Bear warriors turn into bears when they rage, gaining a certain amount of hit points in the process that they lose when the rage ends. As a result, if the berserker dips into their rage threshold within the amount given by Bear Warrior, they get caught in a cycle of rage-start-rage-end that won't end until or unless their HP drops below or above that threshold.
Beserker Strength (PHB2): When HP falls below Barbarian level x5, you enter rage. There is no limit to how many times this can happen. This rage can only end when you fall unconscious, helpless, or receive healing to bring your current HP above the threshold.
Bear Warrior (Complete Warrior Prestige Class): When you rage, you can choose to enter a bear form. This provides some extra bonuses, the important one being a +4/+8 (depending on level) CON bonus.
So:
As mentioned, this wouldn't work by RAW due to the part about rage ending when you get healing to raise you above the limit. A CON increase is not technically healing, so #3 in the above sequence wouldn't happen by RAW. It's also worth noting that Berserker Strength is technically not "Rage" and thus may not qualify for Bear Warrior at all (though your DM may not get fussy over that detail).