Can I set particular shipping rules for certain customer groups only?

Yes, it is possible to apply the rule to a specific customer group:

Magento Shipping Rules - Amasty

See more details on Shipping Rules page
Rate the answer?