Pretty much - it's any spell coming from a corporeal source (you know, a dude).
Now, it can get more complicated than that with things that aren't just incorporeal but also ethereal. Only force spells affect them directly but there's a lot of spells (e.g. blink) that can be used to make someone ethereal/incorporeal and then it's fireball time.
This Answer has been updated to reflect newly found material
Yes, the Demilich can use Astral Projection, even on himself. Infact, from reading the spell you HAVE to go with your intended travelers if you want to use the spell at all.
As my other answer clarified, "Magic Immunity" is not the same as "Spell Immunity," and while I would argue that they are nearly identical that doesn't matter for the Astral Projection SLA as it's own definition is enough to allow the spell.
As I stated in my other answer, the definition of "Magic Immunity" is (Emphasis Mine):
(Creature) is immune to any spell or spell-like ability that allows spell resistance. In addition, certain spells and effects function differently against the creature, as noted in its entry.
This clearly states that magic immunity is not 100% set in stone. This is what allows the Demilich to use it's 'At Will' Harm SLA on itself. Since both Harm (which explicitly states it is mainly used to 'heal' itself) & "Astral Projection" (again, normal casting requires the caster to be the primary target) are listed in it's SLAs then RAW they are able to be cast on itself. Someone might ask why it didn't explicitly state how this spell would work on the demilich, the answer is simple, "it doesn't have to." The only time it HAS to list how something interacts with something else is if that interaction is different from normal. So, had the writers intended to allow the Demilich to cast the spell without it being the primary target (& avoid traveling) THIS exception/variation would have had to have been stated. However, listing the spell without modifications means simply that it was to be cast as usual.
Some may ask, "was it simply an oversight?" And while none of us can disprove a negative, I can state they WotC deliberately & explicitly removed it's "Alter Self" SLA 1 (which ironically doesn't require Spell Resistance) but left this spell! The fact that exists in the first place is enough to infer that it was intended to be usable, but the fact that the definition explicitly allows it cements the usability in the affirmative. Hence meeting the RAW requirement.
Bottom Line: The rules explicitly (maybe not too clearly) allow the Demilich to use it's Astral Projection SLA on itself.
1 The SRD is not updated to reflect that "Altar Self" has been removed from the Demilich's SLA, but according to the errata dated 2/6/2006 it has been removed.
Best Answer
Probably yes. In general when a creature is immune to magic, the text of the ability says it only applies to things that allow spell resistance. For example, the text on the pathfinder flesh golem ability "immune to magic" reads:
Even the spell immunity spell only grants "unbeatable spell resistance" to the spells the target is immune to.