The quarry might pollute groundwater and waterbodies, and affect agricultural activities, say residents