Yes, caller allocates space. But the part of "waste of time" was about dumping registers to that space. Allocating space does not cost anything. It's moving registers to it is what wastes time (memory accesses, cache pollution).
No idea why they talk about address taking in varargs section.