The lower part of Elm Grove was developed mainly in the 1860s; the higher part in the 1880s.  Its significance for the town increased with the opening of a new workhouse, now the General Hospital.