The hobby of collecting gemstones is called lapidary or rockhounding.
Lapidary is a hobby that involves collecting, cutting, polishing, and setting precious stones. The word
comes from the Latin word lapis, which means "stone".
Rockhounding is a recreational activity that involves searching for and collecting rocks, gems,
minerals,
and fossils in their natural environment.
Read on Webster