Mammoth Uncensored Word List:
4 words ending with ya, 10 letters long

jamahiriya jumhouriya kabaragoya parakeelya