So i gave it one more go. And it wasn’t even too many adjustments, just an inch on either side and realigning the zipper. I also tried to act a little more professional by tacking down the interfacing and actually pressing it.
Worth the effort as I’m so much happier with it.