The Shrine of St. Elizabeth Ann Bayley Seton is located in the Church of Our Lady of the Holy Rosary, a Roman Catholic parish church of the Roman Catholic Archdiocese of New York

Elizabeth Ann Seton lived next door at 8 State Street after the bankruptcy of William Seton's business forced them to give up the Seton family home at 61 Stone Street. They stayed here from 1801 to 1803 before sailing to Italy for William's health. In 1840 the site held the offices of a number of transportation companies, such as the New York and Hammondsport Lake Line Boats, the New York and Ithaca Line, and the New York and Seneca Falls Line Lake Boats. It also served as the "Eight South Street Hotel". The Georgian Revival / Colonial Revival brick church was built in 1964-5 and was designed by the firm of Shanley & Sturges.

The church is located next to the James Watson House, a New York City landmark which is also listed on the National Register of Historic Places. Built in 1793 and extended in 1806, the eastern portion is the work of an unknown architect, and the western half is attributed to John McComb, Jr. In 1975, the house became the Rectory of the Shrine.