The Oxford English Dictionary dates the word puzzle (as a verb) to the
end of the 16th century. Its earliest use documented in the OED was in a
book titled The Voyage of Robert Dudley...to the West Indies, 1594–95,
narrated by Capt. Wyatt, by himself, and by Abram Kendall, master
(published circa 1595). The word later came to be used as a noun, first
as an abstract noun meaning 'the state or condition of being puzzled',
and later developing the meaning of 'a perplexing problem'. The OED's
earliest clear citation in the sense of 'a toy that tests the player's
ingenuity' is from Sir Walter Scott's 1814 novel Waverley, referring to
a toy known as a "reel in a bottle".[2]
Read on Wikipedia