Can I set restrictions on a product level?

Yes, sure. You can use SKUs in the conditions.

 

Magento Shipping Restrictions - Amasty

See more details on Shipping Restrictions page
Rate the answer?