Can I set particular shipping rules for certain customer groups only?

Yes, it is possible to apply the rule to a specific customer group:

Magento Shipping Rules - Amasty

Rate the answer?