Linen does a great job, somehow stays fresh for longer than cotton in my experience. The fibers are a bit rough compared to cotton, and I actually prefer that.

I have a flat weave one that packs down really small but will probably take a waffle weave one next time as I enjoy the fluffiness.