There were far more anti-protestant riots (meaning the 'non-conformist' churches) in Birmingham than anti-Catholic. The free thinkers like Dr Priestley had a hard time, which is sad, considering the amount he had contributed to scientific research in the late 18th century. Poor man, after his house was burned down he emigrated to the USA, but was too old to do in that different environment as much as he could have done here.
So far as the anti-Catholic feeling was concerned, we have to remember that Henry VIII's time, that view was enforced by the authorities, apart from a short period under his daughter Mary Tudor, and very nearly under James 2, until he was 'dealt with'. It was not until 1829 that the Catholic church was officially permitted to hold services in public. That must have been very difficult for the many immigrants who came from Catholic countries. But there are records of under-cover Catholic meetings almost all the intervening time.
Peter