Yes the oil pan has to come off.
Depending on if your engine has a factory windage tray or not also will determine the lower dipstick tube you should have. Providing someone did not forget to install that.
The dipstick tube is installed from inside the block.