You can delete a task by clicking on the options button when viewing a task in the Tasks page and selecting the option labelled Delete Task.