There might be a specific linguistic term. But I don't know it, and I wouldn't be surprised if there isn't one.
So how about subject? Or if that's got too many connotations for the context, perhaps target?
LATER - I'm also minded to wonder why there might not be an established term. Adjectives and adverbs are easily-identified 'modifiers', but actually a modifier can be a pretty long subordinate clause in a sentence. And the text element(s) it modifies can be complex too.
The lack of a term might simply be down to the conceptual difficulty of naming something so epen-ended. It might just be the noun next to the modifying adjective, or it might be the whole sentence excluding the modifier. All they have in common is the capacity to be modified - not a very significant attribute for most considerations.
At least with actual modifiers, you could say their capacity to modify is a defining characteristic, so it makes some sense to identify and name such a linguistic class. The things which they modify are so heterogeneous it's a bitmeaningless to lump them all together as a class with a specific name.
Cutting to the chase, I realised that the obvious candidate would be modificand if I really needed such a word, and Lo! - it turns out linguists do indeed use that term when pressed.
Best Answer
Mot juste means the exact, appropriate word.