If you want to remove HACS you need to do that using the folowing steps.

1. Remove the configuration from configuration.yaml(if configured with legacy(YAMl)) or remove it using the trashbin icon on the integration page.
2. Restart Home Assistant important
3. Restart Home Assistant (yes, this needs to be done twice) important
4. Delete the hacs directory under custom_components.
5. Delete all files and directories containing hacs under the .storage directory.
6. Restart Home Assistant.

When removed the wrong way. An option is to install it again. Just move hacs back to custom components and reboot. And start the remove procedure again.