Now,I had faced this issue in my work, I think most of the developer or Azure Administrator also facing this issue when the developer or architect asked for it due to very less blog or documentation.
Overall we need to do two main steps:
- add the inbound security rule to your NSG.
- allow ICMP traffic in the Windows Server operating system.
Add the inbound security rule to your NSG