You can do this via the following steps:
Expenses > Vendors

On the screen, you can see the Action tab.

You will get two options:
1) Edit – This option helps to add up or change information about the vendor.
2) Delete – This option allows you to delete the vendor in just one click.