Garden Of Scandal by Jennifer Blake

From the author of SWEET PIRACY, a novel about a woman wrongly accused of murder. A small-town American woman decides that she is tired of living as a recluse, simply to avoid the gossip of a local community who have branded her a murderer. She meets a mysterious handsome stranger but her happiness is threatened by someone with a very long memory.