Can I create different banners for each category of my store?

Yes, it’s possible with this promo Banners module:

Magento Promo Banners by Amasty

See more details on Promo Banners page
Rate the answer?