If reinstall is not an issue, then I would suggest it then redo the let's encrypt method as explained stopping apache.
It may have created a config file the first time so that any additional changes would use the errored config from the first try thus causing issues.
It may have created a config file the first time so that any additional changes would use the errored config from the first try thus causing issues.