The Pentagon announced Wednesday that the Navy's top civilian official, Secretary of the Navy John Phelan, is leaving his job.