I have compiled PHP with Zend before, it is not bad.  I have never tried doing an upgrade of Zend so I am sure you are right, it would probably not be nice.

Maybe the best thing is to start from the core appliance and add from there.