During the 1920s, the Ku Klux Klan was active in the Pascack Valley area and intimidated those with different beliefs using cross burnings and threats. In one such instance, the KKK threatened residents who supported the development of a Catholic church, including a resident of Rivervale on Cedar Lane. They also warned Helen Riley, wife of prominent Hillsdale resident John Riley, against selling her property for the construction of a new Catholic church in Hillsdale. Mrs. Helen Riley then donated the plot of land on Hillsdale Ave for the erection of the original St. John The Baptist Church on March 16, 1925. About 28 families gathered in Mrs. Riley’s home to pledge donations and lawn parties were held on her property to raise money for the church. Ground was broken on April 4, 1925 by Father O’Donnell and lay trustees Mayor Henry J. Werner and John T. Buckley. The church was dedicated on December 13, 1925. Father Cornelius A. Corcoran was appointed the first resident pastor on October 14, 1927 and the property at 109 Yesler Way was purchased soon after for use as the church rectory.