You will see that the panel now fits into the rabbet, but the bit leaves rounded corners that won’t allow the panel to go completely in.
Square up the corners using a chisel and a hammer. First, tap to outline the corner shape. Then, work your way down by tapping and then paring out the waste. It only takes a few minutes to do the door. With the corners squared up, the panel will drop right in.