The iron fence outside the First Baptist Church in Charleston provides for a beautiful frame for its impressive doors and columns. First Baptist is the oldest Baptist church in the South and its congregation was founded in 1682… in Kittery, Maine (it moved to South Carolina in 1683).