The reason the two choices (undemonstrative panache and deflect) go together is that undemonstrative emphasizes that the dancer isn't attempting to show off his talent.
Rather than draw in the audience's attention with dance moves that emphasize the skill they necessitate - that is, moves that make their technical difficulty visible to the audience - he dances subtly and smoothly, so that the audience perceives his performance to be effortless. (In fact, this demands even more effort - imagine trying to complete a difficult move, all the while revealing no physical or mental exertion.)
In this way, he is deflecting (pushing away) the type of attention his ability is capable of garnering. He's so good he could demand the audience's complete attention, but chooses instead to let it linger on the dance itself.
If the only direction for answering this question is to choose the best fit for the blank in the sentence, then I have to agree with you that B) is the answer.
Both C) and D) result in grammatical errors. C) results in a subject that's missing a verb, and D) results in a verb that's missing a subject. We can easily ignore those possibilities.
Both A) and B) result in grammatically sound sentences. "Floated" could be the simple past tense form, or it could be the so-called past participle form. "Floating" could be the so-called present participle form, or it could be the gerund form. The blank in the model sentence can be filled with a participle. If we have to choose only one of these answers, then we have have to look at more than grammatical correctness.
You found a good reference sentence. Tectonic plates float on the molten mantle. This sentence uses the common intransitive sense of the verb "to float", and it employs the active voice. The same structure can be used to describe some of the information in the model sentence: Rubbish floats in the sea.
The verb "to float" also has a transitive sense. In fact, it has more than one. The molten mantle floats the tectonic plates. Children float their toy boats in this pond. We can form passive voice sentences from the information in these active voice statements: Tectonic plates are floated by the mantle. Toy boats are floated by children.
We cannot choose between A) and B) on the basis of which voice makes sense. Both voices make sense. The rubbish is floating. The rubbish was floated by someone or something.
I would choose B) because the resulting sentence is less confusing. It is easy to mistake the form "floated" for the simple past tense, since the forms are identical. The passive form implies an unmentioned agent, but no such agent is needed for the model sentence to make sense. The intransitive sense of "to float" is more common. English is my native (and only) language, so I can choose the option which sounds the most natural.
If I had to choose only one answer, I'd choose B) as the best answer. If I had to choose all applicable answers, I'd choose both A) and B) as correct answers. I don't see any way to eliminate B) as a valid choice.
Best Answer
Demur as a noun is relatively uncommon, and I at least would consider it at least "dated". It means a pause, hesitation, but even that couldn't suit the context. Just my opinion, but I think the noun sense is rarely used except in the context of negation (accept without demur, there shall be no demur, etc.)
Demur is normally used as a verb today, meaning to hesitate, object, prevaricate. It's definitely not some "weaker" version of schism a split between strongly opposed parties, caused by differences in opinion.
In short, schism really is the only plausible candidate, regardless of whether the test writer forgot that demur can be used as a noun.