Mammoth Uncensored Word List:
11 words ending with ye, 5 letters long

aleye barye bedye cloye debye herye inbye oxeye pioye redye upbye