The Centre has removed higher education secretary Vineet Joshi amid controversies including NEET-UG paper leaks.