Since the question on whether or not a sprite can remain invisible and use its help action has already been answered, I'll jump to the one bit that hasn't been answered so far:
"My only concern is: is such help strong enough to provide me with advantage?"
Yes you get advantage
The Help action itself is quite remarkable (and underused in my experience): you give up your attack - and thus your ability to do damage yourself - in order to give one of your allies advantage on its next attack on one specific creature you choose.
You give up your Sprite's damage to the foe and in return you get a greater chance to hit, and thus have a bigger chance of doing damage yourself.
The way your sprite's Help action plays out is mostly flavour. What is does, however, is determined by the Help action's definition, which you've already found.
My answer to your question would be: Yes the Sprite would grant you advantage.
But...
You have already stated you're aware of the fact that creatures could sense the fact that your sprite is standing/flying next to them, when you wrote: "(but of course can still be sensed by some creatures, or heard by them)"
Keep in mind that your Sprite has to be within five feet of the enemy in order to take the Help action and can still be attacked while invisible, although this means the attacker will do so with disadvantage, due to the way the Invisible condition is described:
Invisible
An invisible creature is impossible to see without the aid of magic or a Special sense. For the purpose of Hiding, the creature is heavily obscured. The creature’s location can be detected by any noise it makes or any tracks it leaves.
Attack rolls against the creature have disadvantage, and the creature’s Attack rolls have advantage.
If your sprite were to stay in the enemy's reach, this means they could attack it on their turn, but with disadvantage. Your Sprite can, however, fly out of the enemy's reach without provoking an attack of opportunity, assuming it has any movement left.
RAW-wise, an attack of opportunity can only be made against a creature the enemy can see, which gives your Sprite the possibility to aid and move out of the enemy's reach without taking any damage and without requiring the owl's "Flyby" feature.
Edit: I found out this question has already been answered, for more elaborate explanations, go here.
Yes, the familiar can grant advantage with the Help action, and its presence adjacent to an enemy can allow sneak attacks. Bear in mind, though, that most familiars have extremely low health and AC, and will likely die in a single hit, requiring 10g and at least 1 hour to resummon.
Best Answer
You must be within 5ft of the Enemy
As it states:
The action of helping is performed by affecting the enemy and not the ally. It could be ruled that either would work but the RAW state you should be within 5ft of the enemy.
It's much easier to distract the enemy you are near than you grab your ally's sword and swing it for them.
Also, this help action applies to ranged attacks as well. It makes little sense to be able to help and archer by standing near them, vs by standing near the target and hindering their ability to dodge.