Live Like A Pirate This stretch of colonial era buildings on Church Street ends with the Pirate’s Courtyard… a famous hangout for pirates, including the infamous Blackbeard.