First we find the center of mass of each cube. It is located by symmetry: (0.5,0.5,0.5) (1.5,0.5,0.5) (0.5,1.5,0.5) (0.5,0.5,1.5)
Now we find the center of mass by treating the COM of each cube as a point particle:
