Can I edit my widget when it is already on my site?

Yes. Go to the edit page, select your widget,click edit and Add/remove items. The changes will be immediately available on your site. No need to get a new tag or to edit the post/page.