The 1935 definition in Albin Jay Pollock's The Underworld Speaks (apparently published by the FBI to help people spot gangsters by their speech) is:
He's bananas, he's sexually perverted; a degenerate.
This may be alluding to bent, the shape of a banana.
Bent is 1914 US criminal slang meaning dishonest or crooked, and 1930 US slang meaning illegal or stolen.
The eccentric, perverted or homosexual meaning of bent may be originally UK slang; it appears in 1930 in Brophy and Partridge's Songs and slang of the British soldier: 1914-1918 meaning spoiled or ruined. It soon after appears in 1942's The American thesaurus of slang: a complete reference book of colloquial speech in the definition for eccentric: "Balmy, bats, bent, [etc.]".
Another 1833 US slang meaning of bent is to intoxicated with alcohol or drugs.
The 1935 bananas is in brackets in the OED, so they're not convinced it is the same meaning.
Etymonline says the crazy meaning is much later: 1968. This year matches with the OED's third quotation from the University of South Dakota's Current Slang:
Bananas, adj., excited and upset; ‘wild’.—College students, both sexes, Kentucky.—I'd say it, but everyone would just go bananas.
The OED's second quotation is from a 1956 Ohio newspaper caption:
We heard the police broadcast!! They say you're bananas!!
But it's hard to gauge the exact meaning without seeing the picture.
Edit: I found a possible example of crazy bananas earlier than 1968 in The Spokesman-Review (Jun 22, 1962):
I refer to the taunt, suspenseful, real-life drama NBC brought us from Oakmount Country Club over the weekend - the National Open. Compared to it, Bonanza is bananas, and Dr Bon Casey is just another pill-roll.
This Ngram suggests this meaning really took off in the early seventies:
Turning to slang dictionaries, The American Heritage Dictionary of Idioms (1997) says of go bananas:
According to the lexicographer J. E. Lighter, this expression may allude to the similar go ape, in that apes and other primates are closely associated with eating bananas.
However, The Concise New Partridge Dictionary of Slang and Unconventional English (2007) says bananas (madly excited; mad; behaving oddly) is from 1957 and derives from banana oil (nonsense; persuasive talk) from 1924.
Contemporary synonyms are horsefeathers and appleseauce. The origins of banana oil are also unknown, but The American Heritage Dictionary of Idioms (1997) says it's possibly variation on snake oil (quack medicine) extended to mean nonsense.
Edit 2: Green's Dictionary of Slang Online has the noun back to 1957:
With * go bananas* from 1964 and drive bananas from 1975.
This one’s complicated in a fun way, according to the history related by Merriam-Webster. A word for a small garden snail came to be used for small, stout-bodied men (especially in a scornful way) and for small, stout-bodied birds, and mutated considerably as it traveled over time.
In the beginning, there was dodman. We don’t know its origin, but it meant, and in some locales still means, a snail. (See more at Wikipedia.) This was altered to
hodmadod, “snail” or “snail shell”, which acquired a secondary meaning of “deformed or clumsy person” or “scarecrow”. This in turn altered to
hoddy-doddy, also meaning “garden snail” or “snail shell”, and additionally used to mean “short and stout person”, “henpecked man”, “cuckold”, and “fool, blockhead, simpleton”. Then, much like the compounds “lamebrain” and “blockhead”,
hoddypoll began to be seen. From hoddy-doddy + poll (head), it meant “fumbling inept person” or “cuckold”, but apparently also preserved the original sense of small and stout-bodied: it was shortened and altered by way of noddypoll to
noddy as early as 1530, meaning “stupid person” but also a kind of stout-bodied tern, which brings us to
tomnoddy, from Tom (nickname for Thomas) + noddy, meaning “fool, dunce, noddy” but in Scotland also a kind of Atlantic puffin. It is like calling someone Jack Pumpkinhead or Joe Cool.
When Tolkien uses it
Old Tomnoddy, all big body,
Old Tomnoddy can’t spy me!
it is clear he is using it in both its sense of “stout-bodied” as well “inept” or “stupid”.
Best Answer
It may be the for all that originally carried most of the 'forever' meaning, as in the expression once and for all, which covers pretty nearly the same ground. If so, the good part may have been largely an intensifier, with a sense somewhat akin to that of good in a good handful, a good while, etc. However, the relevant entry in the Middle English Dictionary notes by gode inspeccioun 'by thorough inspection', in hys good lyve 'during his whole life', and gode journeie 'a full day’s journey', in which good has the sense 'full, entire, complete'. This is an even better fit with the conjecture, but it could also suggest that for good by itself might have carried some of the same sense as for all -- the 'completely' part, if not the 'forever' part. In this connection it may be significant that Dutch voorgoed, literally 'for-good', has about the same range of senses as for good (and all); unfortunately, I’ve not discovered anything about its history.