Thats what I did. Made it nearly impossible to put it back on now. I may not have needed to, but I had a cover made to cover the hole left by the missing evaporator case. I also have only one fan speed now, but that should be addressable.
I did it for better access to the plugs and wires. That I certainly have.