A legal challenge against government plans to move hundreds of asylum seekers into a military camp in east Sussex has been launched in the high court.

This is thought to be the first challenge against a mass accommodation site for asylum seekers to reach the high court since Labour came to power.

The government confirmed that it was planning to move asylum seekers to two military sites – Crowborough training camp in east Sussex and Cameron Barracks in Inverness, after media reports.

People opposing the plan accuse the government of a lack of transparency surrounding the decision. Photograph: Sean Smith/The Guardian

Protests against the plans have taken place over the last five weekends with a mix of anti asylum seeker protesters such as the Pink Ladies and local people taking part.

Crowborough Shield, a community interest company established by local residents, has launched a crowdfunder to challenge the government in the high court.

It accuses the government of making a “secret decision” to redevelop Crowborough into accommodation for 540 asylum seekers.

It says there has been a lack of transparency surrounding the decision despite construction work being under way and adverts for jobs working with asylum seekers on the site.

Crowborough training camp, where construction work is under way for the arrival of asylum seekers. Photograph: James Manning/PA

The organisation argues that the government has acted unlawfully by going ahead without planning permission, community consultation or due consideration of the site’s proximity to the Ashdown Forest special protection area and special area of conservation.

The legal claim argues that the government’s actions breach the community’s common law rights to justice and procedural fairness and cites article 6 of the European convention on human rights, which protects the right to a fair hearing. It claims the community has been denied the opportunity to understand, scrutinise or challenge the decision-making process.

The legal claim argues that the community has been denied the opportunity to understand, scrutinise or challenge the decision-making process. Photograph: Sean Smith/The Guardian

Kim Bailey, the director of Crowborough Shield, said: “There is huge frustration in the community that a decision with such a fundamental impact on our town has been made without consultation or engagement. It feels as though the government doesn’t think we matter. The barracks site is unsuitable for housing asylum seekers – many of whom will have fled conflict and trauma – and its location beside the Ashdown Forest risks significant environmental harm. In the absence of any clear information, fear and uncertainty are growing across the town.”

Polly Glynn, a solicitor at Deighton Pierce Glynn who is representing Crowborough Shield, said: “This is an important case that tests the limits of government power. It is about a community’s right to be heard when decisions are made under the guise of ‘emergency’ powers and about ensuring that transparency and fairness are not sacrificed in the process.”

The Home Office was approached for comment.