The panel asked the government to undertake a comprehensive assessment of the security, housing and other concerns that are holding them back.