The museum is set in the Old Stone House, which is considered to be the oldest residential building in Richmond, but Poe never lived here. His childhood home would have been a few blocks away from here. However, the museum contains lots of the original furniture from his home.