First State Bank was established almost as soon as the town of Hordville started. The bank’s charter is dated September 10, 1906. The building materials were all hauled from Stromsburg by team and wagon. While the building was in progress, the bank operations were transacted in the drug store building as was the post office. The bank was organized by Wesley, Nathan, and Victor Wilson with C. Victor Nelson as cashier. The bank was incorporated with capital of $10,000.00. In 1910 it was sold to W.I. Farley and A.W. Hickman with P. J. Refshauge as cashier. In 1918 L.G. Crampton became cashier and R.C. Gustafson started as bank clerk. In 1922 R.C. Gustafson became cashier and then the bank’s president in 1927. In 1957 Richard Anderson was hired as cashier and later became president. The bank has been robbed twice in its existence, first in the fall of 1928 and the second time on December 26, 1974.