Victoria's prison population has surged by 62 per cent in the last 20 years as the number of accused held on remand triples.