Colin may be able to help Lyn but I have a feeling most records have been destroyed.
Birth records only need to be kept for a minimum of 25 years, so think it's doubtful that they still survive, see https://www.nhs.uk/chq/Pages/1889.aspx?CategoryID=68&SubCategoryID=160
It opened in 1907 https://www.bhamb14.co.uk/index_files/LOVEDAYSTREETMATERNITYHOSPITAL.htm
Colin