{"id":560,"date":"2017-04-14T02:11:55","date_gmt":"2017-04-14T09:11:55","guid":{"rendered":"https:\/\/porkrind.org\/missives\/?p=560"},"modified":"2017-04-14T02:11:55","modified_gmt":"2017-04-14T09:11:55","slug":"fedora-libvirtqemu-error-on-upgrade","status":"publish","type":"post","link":"https:\/\/porkrind.org\/missives\/fedora-libvirtqemu-error-on-upgrade\/","title":{"rendered":"Fedora libvirt\/qemu error on upgrade"},"content":{"rendered":"<p>Today we upgraded a server that ran a bunch of VMs to Fedora 25 and all the VMs failed to come back online after rebooting.<\/p>\n<p>Checking the logs I found this:<\/p>\n<pre><code>2017-04-14T08:39:35.304547Z qemu-system-x86_64: Length mismatch: 0000:00:03.0\/virtio-net-pci.rom: 0x10000 in != 0x20000: Invalid argument\n2017-04-14T08:39:35.304579Z qemu-system-x86_64: error while loading state for instance 0x0 of device 'ram'\n2017-04-14T08:39:35.304759Z qemu-system-x86_64: load of migration failed: Invalid argument\n2017-04-14 08:39:35.305+0000: shutting down\n<\/code><\/pre>\n<p>After searching fruitlessly for all of those error messages in Google, I finally discovered the problem. The upgrade had shut libvirt down, which saved the state of all the machines into <code>\/var\/lib\/libvirt\/qemu\/save\/<\/code>. Then it started it back up and the save files were no longer compatible with the new qemu\/libvirt binaries.<\/p>\n<p>The solution was to just delete the save files in <code>\/var\/lib\/libvirt\/qemu\/save\/<\/code> (which is a little sad, because it&#8217;s like yanking the power cord out of a running box). The VMs all started fine after that.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today we upgraded a server that ran a bunch of VMs to Fedora 25 and all the VMs failed to come back online after rebooting. Checking the logs I found this: 2017-04-14T08:39:35.304547Z qemu-system-x86_64: Length mismatch: 0000:00:03.0\/virtio-net-pci.rom: 0x10000 in != 0x20000: Invalid argument 2017-04-14T08:39:35.304579Z qemu-system-x86_64: error while loading state for instance 0x0 of device &#8216;ram&#8217; 2017-04-14T08:39:35.304759Z &hellip; <a href=\"https:\/\/porkrind.org\/missives\/fedora-libvirtqemu-error-on-upgrade\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Fedora libvirt\/qemu error on upgrade<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-560","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/posts\/560","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/comments?post=560"}],"version-history":[{"count":3,"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/posts\/560\/revisions"}],"predecessor-version":[{"id":563,"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/posts\/560\/revisions\/563"}],"wp:attachment":[{"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/media?parent=560"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/categories?post=560"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/porkrind.org\/missives\/wp-json\/wp\/v2\/tags?post=560"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}