In Markarth, there's a Shrine of Talos in the centre of town, underneath the Temple of Dibella, where the mission, "The Forsworn Conspiracy", begins.
The White-Gold Concordat clearly states that such worship is disallowed:
The two most controversial terms of the concordant were the banning of the worship of Talos and the cession of a large section of southern Hammerfell (most of what was already occupied by Aldmeri forces).
If you go up the stairs in Understone Keep, before Jarl Igmund of Markarth's throne, and stand around the Thalmor Wizard or Soldiers for a while, eventually they'll just say "Worship of Talos is strictly forbidden" over and over so you never forget that the Thalmor prohibit worship of Talos.
The Thalmor seem to have significant clout with the Jarl, hence why they hang around his Keep all the time, and both the Nords/Imperials and the Thalmor are fervently against deviance or worship of false gods like Talos.
Given all this, why does Markarth's Shrine of Talos yet stand, and continue to operate, and allow people to pray there? Why haven't the Thalmor or other Talos revisionists firebombed or shuttered it?
Best Answer
As mentioned by @DCShannon in the comments, the Markarth Incident played a big part in the worship of Talos in Markarth, and Skyrim on the whole. 25 years prior to the events of the game Ulfric Stormcloak (re)took Markarth from the native Reachmen, who later became the Forsworn as a result of this event. The requirement stipulated by the While Gold Concordat of outlawing the worship of Talos was not actively enforced by the empire, hence why the shrine was still used at the time.
However the Thalmor used the carnage Ulfric caused - however nobly - to insist that the Empire strictly adhere to the Concordate. This played a notable part in the uprising of Ulfric's rebellion and the city of Markarth supported him - as such the pressure from the Empire to suppress Talos worship was less strongly felt in the city, however, the presence of Thalmor agents forced worshippers of Talos to do so in secret. You can even choose to aid the Thalmor if you feel so inclined!
For all intents and purposes as far as the Thalmor are concerned the shrine is closed and remains unused. This is why a certain someone decides to meet you here - no one will disturb you.
As for why the Thalmor didn't actively shut it down, dismantle, or otherwise destroy it isn't made clear - perhaps they thought the threat was enough to stop people, or perhaps they secretly wanted people to keep praying in private so that they could be routed out and imprisoned. Just to clarify, the shrine is basically entombed within a small mountain - you couldn't destroy the entire structure, but it would make sense to remove the statue itself.