Is it possible to set this shipping rate through a csv product import?

Yes, it’s possible since shipping rate is a product attribute.

See more details on Shipping per Product page
Rate the answer?