Delete Tag
The tools menu that shows up while hovering the tag contains a delete icon. Clicking on that icon will prompt for confirmation of tag deletion.
Clicking on Delete forever will delete the tag and its references to content items permanently.