Norman J. Colman, First secretary of agriculture