New Rumley was established in 1813. It is the birthplace of George Armstrong Custer.

Custer Memorial. Tribute to well-known general.
Lutheran Church. Construction of the church was started in 1847 on two parcels of land donated by Jacob Custer, great-uncle of General Custer. It was dedicated in 1879 and closed in 1951. In the early 1990’s, the church building was donated to the Custer Memorial Association. There were close ties between the Custer family and this church.