A 30-year-old man from Gippsland in Victoria who allegedly set fire to the doors of Old Parliament House last week is back behind bars within hours of being granted bail in the ACT Magistrates Court.

The man, whose name was suppressed by the court, was charged with arson and damage to Commonwealth property following a joint investigation by ACT Policing and the Australian Federal Police.

On Tuesday, the court heard more details about how authorities believe the fire took hold of the historic building's front entrance, with the man allegedly carrying burning coals from a nearby fire to the front doors.

Special Magistrate Jane Campbell said the man acted in "wilful disregard for those people inside the building or in the area at the time," but granted him bail under strict conditions.

The conditions included, except for in the company of a police officer to collect his belongings, he not attend the Aboriginal tent embassy or enter the suburb of Parkes, where Old Parliament House and the tent embassy are located.

He was also told after collecting his belongings, he was not allowed into the ACT unless for the purpose of attending court or legal appointments.

On Tuesday evening, ACT police confirmed that the man had been arrested in Parkes for breaching his bail conditions and would be remanded in custody overnight to appear in court again on Wednesday.

In court, Special Magistrate Campbell noted that the man had been a part of a group holding ongoing protests at Old Parliament House.

"This incident occurs at a time where there are significant protests outside Old Parliament House … that have been continuing since December 17, 2021," she said.

Crowds have been gathering outside the building ahead of the 50th anniversary of the Aboriginal tent embassy, which was established on Australia Day in 1972.

But the actions of protesters were last week condemned by Indigenous elders, and the Aboriginal tent embassy issued a statement saying it did not condone the protesters' actions, nor the destruction of property.

Woman's request to represent the accused denied

At the start of the Gippsland man's hearing, a woman was present in court wearing a kangaroo skin, asking to represent the accused.

The woman identified herself as Jennifer Stefanac and said she was a Wiradjuri woman who represented the 'United Sovereign Nations of Terra Australis'.

Special Magistrate Campbell asked Ms Stefanac whether she was a lawyer, to which she replied that she was not.

Special Magistrate Campbell denied her request, and the accused was instead assisted by Legal Aid.

Outside the court, dozens of protesters gathered with many wearing traditional clothing and carrying Indigenous flags.