I think the shame and guilt, though not deserved by the victim, are themselves very hard hurdles to cross. If you add in a personality that is loved and respected by a large part of the public, or who is in an authoritative position, you may have a "squared" effect. Perhaps the fear is multiplied rather than merely added.
If the abuse happens at a very young age and does not continue for a long period it can get pushed behind a memory barrier. Associated events and the life-time effects happen still but the event itself is "buried". How do you describe an event "buried" many years ago in a court of law? The circumstantial evidence, the grooming etc, are also memories from far back and unprovable.
But, if others with more "mature" memories come forward the less sure people may be pursuaded to have their say, which may help alter "the balance of evidence" against the accused. This will give still others confidence. But the court still has to be wary of mistaken identity, "false memory" and malicious claims etc, so no-one gets an easy ride.