Making something smaller would lead to wasted or unused space, but isn’t necessarily incompatible. That’s why I think decreasing block size would be a soft fork instead of hard. This differs from increasing in that you can’t fit something larger in something smaller, hence hard fork