Kindred by Octavia Butler. This is a science fiction novel that takes the main character back and forth between 1970s California and the Old South. She doesn't exactly know why, but she is drawn to the slave-holding family again and again. A staple in the scifi genre.
Some Sing, Some Cry by Ntozake Shange. A hefty but deliciously well-written epic of a novel that follows a family from their time at a plantation at the time of the Civil War through to modern day.
Sag Harbor by Whitehead Colson. A privileged teen finds escape in his family's summer retreat in the mid-1980s as he goes through usual teenage-mishaps and starts to form his identity.
Let us know your favorites!