It will be a great feature, when it's completed and (intentionally) released. In it's current incomplete form it's going to cause errors in Muse and/or errors in the generated site.
Copy and Paste will no longer result in an SVG graphic once 2014.1.1 is released, but the items already in your .muse file will remain SVG. We strongly recommend you remove them and replace them with images in order to avoid errors due to the incomplete nature of the SVG implementation.
I encourage you to join the Adobe Muse Private Beta Program by going to http://museprerelease.com. The Beta program is open to all active subscribers who can accept the terms of the Non-Disclosure Agreement. The Private Beta program will give you more visibility into what's coming, as well as access to Beta builds for upcoming releases. At present the Beta program is somewhat dormant, but we'll have a Beta 1 of 2014.2 available soon.