Mammoth Uncensored Word List:
14 words ending with oy, 5 letters long

accoy alloy annoy decoy duroy enjoy envoy peeoy poboy savoy sepoy stroy tepoy uncoy