His party suffered a significant setback in the recent elections with its vote share shrinking to 4%