John Floyd was born on April 24, 1783 at Floyds Station in Jefferson County (this area is now part of Kentucky). He attended Dickinson College in Pennsylvania and graduated from the medical department of the University of Pennsylvania in 1806. Upon graduation, Floyd moved to Christiansburg in Montgomery County where he practiced medicine.

In 1807, Floyd was appointed Justice of the Peace for Montgomery County. He was a Major in the Virginia State Militia beginning in 1807. Floyd served in the War of 1812 and attained the rank of Brigadier-General. In 1814 and 1815, he served in the House of Delegates. From 1817-1829, he was elected as a Republican to six terms in Congress. Floyd was then elected Governor in 1830. During this time, in 1831, the county of Floyd was formed from part of Montgomery County. It was named for Governor Floyd. Notably, South Carolina gave its electoral vote to Floyd for President in 1833. This was due to Floyd's stance on tariffs.