Infrastructure engineering for modern data applications