The Possibility Of Evil by Shirley Jackson

An elderly, proper woman who takes pride in her family's long-standing place in a small town secretly writes cruel anonymous letters to neighbors, convinced she is protecting the community’s moral order; when a child traces the letters back to her and the townspeople learn the truth, they retaliate by destroying what she values most, shattering her self-righteous illusion and exposing the harm she has caused.