I found the birth registration of Joseph Leonard Goldsbury - Aston June qtr 1895. I also checked all Goldsbury's registered in Aston around that date, as it could give an idea of siblings. However the previous was 1880 and the next 1902. So unless Free BMD is not updated, is there a possibility that Josph's mother may not have been married?
There is a Joseph L Goldsbury on the 1919 electoral roll - address shown as 5 Court 46, Windsor Street. Nechells/Duddeston. Also noted as 1st South Staffs.
Ernie, did he die whilst on active service do you know?
There is a Joseph Goldsbbury with 26-10-17 as date of death, entered battle on 17-12-14 in France, won the Victory medal in france roll7/101/35 p540 and the Star in 1915 roll F/2B2 p155.
He is listed as killed in action in France and Flanders Western Front.
He was aPrivate in 1st batallion South Staffs regiment, no 11071.
I can't see any next of kin or address details on Ancestry, but other members have FMP and broader access to Ancestry, they may be able to help more.
If I do find anything else, will let you know.
There is a J Goldsbury named in the Birmingham City Battalions Book of Honour (1920) page 467.
Roll of Honour. GOLD & CO. (Birmingham) LTD. SWAN HINGE WORKS, LOVE LANE, BIRMINGHAM.
Included in the List of Men who joined H. M. Forces. J. GOLDSBURY, 1st South Staffs.
I hope this is useful to you. I have tried to post an image of the page to site, but no luck so far, if anyone can help me with posting I would be grateful.