Can I customize the AJAX cart window to match my theme?

Yes, of course. You can choose how the pop-up window should look like by changing colors of its elements. This can be done in System > Configuration > AJAX Cart > Visual Options: