I don’t know what a cup cozy is, but I do know this isn’t its plural on Yahoo! DIY:
Seriously. What is wrong with the writers at DIY? They can’t seem to form a plural without an apostrophe and an S. The plural of cozy is cozies. No apostrophe.