DES Y1 results: Splitting growth and geometry to test $\Lambda$CDM