Minister says he ‘should have been more cautious’ and that he had only sought to ‘make a political point’ that poverty existed in Kerala