At the moment alliance HQs under construction can't be attacked. However, you can destroy them by building an outpost close to them. This will overlap the territory they are being built in, removing them before they are completed.