First, that description of "been to" and "gone to" is mostly accurate. However, to "have gone to" a place can mean that you're no longer there, the same as if you "have been to" a place. (There are other subtle differences between these two expressions; see the previous edit to see them.)
It seems to me that the same logic doesn't quite apply for "have been on a trip"/"have gone on a trip". The latter two are mostly interchangeable, although there might be slightly different nuances about the "default" interpretation. I'll quickly go through some examples.
Both of the "on a trip" expressions can be used to mean you're still on that trip:
(1) I've been on a trip to Europe these past six months.
The speaker is still in Europe.
(2) I've gone on a trip to Europe and I won't be back till August.
The speaker is still in Europe.
And both of them can mean that you are not still on that trip (helped by including the word "ever"):
(3) Have you ever been on a trip to Europe?
The speaker is no longer in Europe.
(4) Have you ever gone on a trip to Europe?
The speaker is no longer in Europe.
So the two expressions pattern like "been to" and "gone to" except that "been to" would not work where "been on a trip to" works in sentence (1):
(1b) ✗? I've been to Europe these past six months.
If this works at all, it means the speaker went in the past six months and is no longer in Europe.
Since both meanings are possible, what's the default interpretation without context?
In British English, I'd say it's the same as "been to" and "gone to". In North American English, I would say it's the reverse. (This is based on my and my relatives' usage. I am AmE and my relatives BrE.)
(5) I've been on a trip to Europe.
BrE: The speaker is probably back. AmE: The speaker is probably still there.
(6) I've gone on a trip to Europe.
BrE: The speaker is probably still there. AmE: The speaker is probably back.
To generalize a bit, I imagine that both the above pattern and the account you cited in your question owe a lot to the fact that in British English, "to have been" is often used in the sense that NA English uses the simple past.
— "Was there anything in the mailbox?"
— "I've just been. There wasn't anything." (BrE)
— "I just went. There wasn't anything." (AmE)
Even two phrases that appear identical can mean two different things depending on the region.
"I've been swimming today."
usually means "I went swimming earlier today." (BrE)
usually means "I was swimming earlier today." (AmE)
P.S. Another minor difference between "been to"/"gone to" and "been on a trip"/"gone on a trip" is that the "been" in "been on a trip" can be conjugated in any tense:
✓ Next week I'll be on a trip to Europe.
✗ Next week I'll be to Europe.
✓ Right now I am on a trip to Europe.
✗ Right now I am to Europe.
We use the Future Perfect to make predictions about actions which we expect to be completed before a particular time in the future:
I'll have finished this assignment by Friday.
When I finish this book, it means I'll have read all of her books.
He'll have had the operation by July and should be a lot fitter then.
We usually use a time adverb/phrase (e.g. soon, by then, within the next week etc.) with this kind of prediction. The times can be very close to "now".
So, by the time we get there, he'll have been gone is perfectly correct. You use the time phrase "by the time we get there", and you point out that something will have happened by the time you arrive. It makes even more sense if there is more information/context (e.g. By the time we get there, he'll have been gone for 3 hours).
I feel that "he'll have been gone" is more correct than "he'll be gone" in this particular context. But I'd use the Future Simple with some other time clause, not "by". For example, When we get there, he'll be gone.
Best Answer
I think you want to know the difference between "go to some place" and "have been to some place". The difference is that when you use "go to," you are talking about the action of just going to that place. Whereas, when you use "have been to," you're talking about the action of going and coming back. That's the difference between "go to a place" and "have been to a place". In your sentences:
Both of these sentences are correct. There is a slight difference in meaning. In the first one, the speaker is asking about the listener's visit to London (action of returning included). In the second one, the speaker is just asking about the action of going to London (action of returning excluded). I hope that it's clear now. By the way, the first sentence is commoner than the second one.