Congratulations on the new addition to-be. I would like to share an experience on similarly placed sliding door on a machine shed that may have interest to you.
Years ago, my dad placed the sliding door on machine shed that he had built for the farm. That door was always problematic in high winds. A few years later in my low speed aerodynamic courses, I learned why. Flow around such a corner results in pockets of unsteady accelerated flow that buffeted and pulled outwardly on the door. In the case of our machine shed; in the coming years, the wind ripped it loose two or three times and it was hardened more each time it was replaced. In the final solution which never tore loose again, the door utilized several 4x4 re-enforcements that resulted in significant time to remove / then re-install these re-enforcements whenever the door was opened. This limited its utility as a door from then on.
Your case might be entirely different ... I have no insight into how you plan to place the building relative to the prevailing winds/topography/... So you have the true understanding of such a consideration and already planned for it. My apology for being such a worry-wart, but the scares of our experience have stuck with me.