Can the applicant withdraw his settlement application once filed?

No. As per section 15 of IGST Act, once an application
has been made, it cannot be allowed to be withdrawn by
the applicant.