Do I need to keep the MESH app running and nearby to use the MESH blocks?

Yes. The MESH app is your hub to run and program MESH blocks, so your smartphone or tablet with the MESH app must be nearby (within 30 feet) of the MESH blocks to run your smart recipes.