intake mismatch

I am thinking of using a big block Chevy rectangle port intake manifold on a set of aluminum Edelbrock heads that have big oval ports. Will that be okay or will there be a big horsepower loss? I’ve read that you shouldn’t do this because the engine will suffer a big power loss. I was