From what I remember the chip itself is pretty small, the size is all due to the cooling component.

Also keep in mind you’ve probably seen a development version of a quantum computer, where things are set up to be easily accessible to allow fixing and tinkering, without regard for size and optimization of space.