John Harris Greer died on May 10, 1926, at the age of 60 after a long bout with pneumonia. He is buried in the St. Johns Cemetery next to his beloved wife Orpha. His obituary gives a sense of the kind of man he was:
"In the death of J. H. Greer we lose a highly respected man; a man of high moral standards; a man who was strictly honest and reliable in all his dealings with his fellowmen; a man in whose integrity and ability we had implicit faith and confidence, which he never violated as a citizen nor as a public official; a man who at all times spoke openly and fearlessly against corruption of any kind, and at all times took a leading part in public affairs and in the administration of the state and county.
Because of his honesty, his integrity, and general character, he has made the world a better place in which to live, and we who knew him best are better men and women because of our association with him."