You can use xm to destroy an existing virtual network device:

 
xm network-detach [domain-id] [DevID] 

This destroys the virtual network device you specify.