If you want to be perfectly and unimpeachably correct, you will pronounce the word forte, meaning something that is one’s strong point, identically to the word fort, and reserve the FOR-tay pronunciation only for the musical term.
Most people don't know about this distinction and pronounce it FOR-tay for all senses, both the “strong point” sense as well as the musical term. Most people will not notice or care if you do that. In fact, if you say that some subject is or is not your “fort”, people will look at you quizzically and perhaps even ask “do you mean FOR-tay?”. On the other hand, if you use the pronunciation “FOR-tay” those of us who know the difference may judge you to be ignorant.
In either case, you take a risk of some sort. Bryan Garner came up with the name “skunked term” for words like this, in his 1998 Dictionary of Modern American Usage:
When a word undergoes a marked change from one use to another … it’s likely to be the subject of dispute. Some people (Group 1) insist on the traditional use; others (Group 2) embrace the new use.… Any use of [the word] is likely to distract some readers. The new use seems illiterate to Group 1; the old use seems odd to Group 2. The word has become “skunked.”
My advice is to find a substitute word or phrase.
When English arrived in the country, it was (makes sense) from the English.
To over-simplify the complex non-native history, and attempt to dodge any political discussion, the English kinda chased the ex-Dutch (Afrikaans) people across the country.
As a result, there became sort of four regions of non-native speakers. The Cape (around Cape Town), Orange Free State (around Bloemfontein), Natal (Around Durban) and Traansvaal (around Johannesburg).
Because of the ports of Port Natal (now Durban) and Cape Town being more English, and the center and north being more Afrikaans, even though most of them speak English now, there are distinctly different accents, even in the same country.
These days, many non-colonist descendents may also speak it as their first language.
As a result, anyone from South Africa where they are speaking it as their first language can generally be considered to speak SAE. Of course in some cases (like myself) as you move to other countries your accent changes, so I now have a SAE/Kiwi/English/start-of-Canadian-English accent forming ;) But when I get a cold, my SAE starts becoming more pronounced...
Simplified summary:
Two main groups who generally spoke English as a 1st language - from Dutch descent (Afrikaners) and from English descent (English). They have similar 'South African' accents - as one has affected the other, but the Afrikaner accent is usually deeper, some might say harsher.
Then there are the locals / natives who were there before the Dutch/English - Zulu, Xhosa, Ndebele etc. They mostly(!!) spoke their own languages, and have English as a second language (there are, however, always exceptions). They too, have different accents, but are still often recognisable to the trained ear as 'South African'.
!! - This is becoming less common after apartheid as there is more integration between the races and communities in social and work circles, and as travel around the country becomes easier and more common.
EDIT:
This link on Dialects and Accents of South Africa may help, as it has a variety of samples of accents explaining the speakers' backgrounds.
Best Answer
The pronunciation of "Afrikaans" differs from "Africans" in two ways.
1) Accent is on the last syllable.
2) The last syllable rhymes with "swans".