Can I set restrictions on a product level?

Yes, sure. You can use SKUs in the conditions.

 

Magento Shipping Restrictions - Amasty

Rate the answer?