2022-01-20T11:32:39.448 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-20T11:32:39.607 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi040.front.sepia.ceph.com' reimaging
2022-01-20T11:32:39.608 INFO:teuthology.lock.ops:Updating [ubuntu@smithi040.front.sepia.ceph.com]: reset os type and version on server
2022-01-20T11:32:39.608 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2022-01-20T11:32:39.635 INFO:teuthology.lock.ops:Node 'ubuntu@smithi040.front.sepia.ceph.com' reimaging is complete
2022-01-20T11:32:39.638 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging
2022-01-20T11:32:39.639 INFO:teuthology.lock.ops:Updating [ubuntu@smithi049.front.sepia.ceph.com]: reset os type and version on server
2022-01-20T11:32:39.643 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2022-01-20T11:32:39.677 INFO:teuthology.lock.ops:Node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging is complete
2022-01-20T11:32:39.900 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 8.stream
2022-01-20T11:32:39.915 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.stream
2022-01-20T11:32:40.353 INFO:teuthology.orchestra.console:Power off smithi040
2022-01-20T11:32:40.376 INFO:teuthology.orchestra.console:Power off smithi049
2022-01-20T11:32:52.888 INFO:teuthology.orchestra.console:Power off for smithi040 completed
2022-01-20T11:32:52.931 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2022-01-20T11:32:52.990 INFO:teuthology.orchestra.console:Power on smithi040
2022-01-20T11:32:53.032 INFO:teuthology.orchestra.console:Power on smithi049
2022-01-20T11:32:57.246 INFO:teuthology.orchestra.console:Power on for smithi040 completed
2022-01-20T11:32:57.348 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2022-01-20T11:33:01.401 INFO:teuthology.orchestra.console:Power on for smithi049 completed
2022-01-20T11:33:01.502 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2022-01-20T11:36:46.134 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-20T11:37:06.542 INFO:teuthology.provision.fog.smithi040:Node is ready
2022-01-20T11:37:06.603 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2022-01-20T11:37:06.663 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2022-01-20T11:37:07.027 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2022-01-20T11:38:21.060 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-20T11:38:41.822 INFO:teuthology.provision.fog.smithi049:Node is ready
2022-01-20T11:38:41.847 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2022-01-20T11:38:41.913 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2022-01-20T11:38:42.301 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2022-01-20T11:38:42.548 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2022-01-20T11:38:42.550 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-20T11:38:42.568 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2022-01-20T11:38:42.568 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-20T11:38:42.585 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2022-01-20T11:38:42.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2022-01-20T11:38:42.831 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2022-01-20T11:38:42.887 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2022-01-20T11:38:42.887 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8"
2022-01-20T11:38:42.887 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2022-01-20T11:38:42.888 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2022-01-20T11:38:42.888 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8"
2022-01-20T11:38:42.888 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8"
2022-01-20T11:38:42.888 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-20T11:38:42.889 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2022-01-20T11:38:42.889 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-20T11:38:42.889 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2022-01-20T11:38:42.889 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-20T11:38:42.890 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-20T11:38:42.890 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-20T11:38:42.891 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2022-01-20T11:38:42.908 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2022-01-20T11:38:42.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2022-01-20T11:38:43.111 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2022-01-20T11:38:43.169 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2022-01-20T11:38:43.169 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2022-01-20T11:38:43.169 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2022-01-20T11:38:43.170 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2022-01-20T11:38:43.170 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2022-01-20T11:38:43.170 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2022-01-20T11:38:43.170 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-20T11:38:43.171 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2022-01-20T11:38:43.171 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-20T11:38:43.171 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2022-01-20T11:38:43.171 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-20T11:38:43.171 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-20T11:38:43.172 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-20T11:38:43.172 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2022-01-20T11:38:43.258 INFO:teuthology.dispatcher.supervisor:Running job 6628932
2022-01-20T11:38:43.258 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-01-20_11:01:55-rados:cephadm-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6628932 --name gabrioux-2022-01-20_11:01:55-rados:cephadm-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi --description rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2022-01-20_11:01:55-rados:cephadm-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6628932/orig.config.yaml
2022-01-20T11:38:43.261 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-01-20_11:01:55-rados:cephadm-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6628932
2022-01-20T11:38:43.262 INFO:teuthology.dispatcher.supervisor:Job PID: 4794
2022-01-20T11:38:43.262 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-20T18:09:12.687 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-20T18:09:12.870 INFO:teuthology.kill:Killing Pids: {4794}
2022-01-20T18:09:14.137 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-20T18:09:14.138 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-20T18:09:14.138 INFO:teuthology.misc:Compressing logs...
2022-01-20T18:09:14.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2022-01-20T18:09:14.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2022-01-20T18:09:14.387 INFO:teuthology.orchestra.run.smithi040.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-20T18:09:14.579 INFO:teuthology.orchestra.run.smithi049.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-20T18:09:14.622 INFO:teuthology.orchestra.run.smithi040.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-20T18:09:14.623 INFO:teuthology.orchestra.run.smithi040.stderr:tar: Error is not recoverable: exiting now
2022-01-20T18:09:14.662 INFO:teuthology.orchestra.run.smithi049.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-20T18:09:14.663 INFO:teuthology.orchestra.run.smithi049.stderr:tar: Error is not recoverable: exiting now
2022-01-20T18:09:14.665 INFO:teuthology.misc:Compressing logs...
2022-01-20T18:09:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-20T18:09:14.984 INFO:teuthology.misc:Compressing logs...
2022-01-20T18:09:26.284 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-mon.smithi040.log: file size changed while zipping
2022-01-20T18:09:44.601 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-20T18:09:51.610 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-20T18:10:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-20T18:10:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-20T18:10:28.706 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-20T18:10:31.765 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-20T18:10:52.686 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-20T18:10:53.746 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-20T18:10:55.649 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-mon.smithi049.log: file size changed while zipping
2022-01-20T18:10:58.533 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/d40f3ec6-79e6-11ec-8c34-001a4aab830c/ceph-mgr.smithi040.qnbwef.log: file size changed while zipping
2022-01-20T18:11:38.927 INFO:teuthology.kill:No teuthology processes running
2022-01-20T18:11:40.080 INFO:teuthology.kill:Nuking machines: ['smithi040', 'smithi049']
2022-01-20T18:11:41.096 INFO:teuthology.kill:2022-01-20 18:11:41,095.095 INFO:teuthology.nuke:targets:
2022-01-20T18:11:41.097 INFO:teuthology.kill:  smithi040.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9ZoEsGDCBPuM+/Z2f9splDZcDkUJ6b53k4foTQwzRF51LX/jhUqHQGsl5U7Lhok0jCNnEaN4TroVUY6YqF1j7Mt+QK11WQt1OASLugq5qj0C6OKc9iAjedNBNly4Zk5aWWp9cSMoAcQ0CrnvMG1SCu7OCtNtmJC1DnzhXiOKmcZMPhTOcZT+bblJiuXMA7Q0ua5oNqB3mI/dkA30fivEcjxvjU/g9o96Yo8lTs+aRLyJn/REWdypBXiKkQZWnOMZPbIJ64Ki+z4pQwJM/yUrVBzDHQnmjlpWtPyOStU76mZWpLpJ69BGtiYQRrSId3f7QQawp5KUgCrFMGzUfIftuCUOmD7+CjNEYrjyX0uU+FlmmcSGL4zTE+Knx13Qf6agDC+pu3HQ8McMIhNkg+/vLBnWXvhEdXLS2ZLAUP09IhiZaIPbs7JO/WpztlEInxvJVnblXjOTwXSLWlzMf64NykPsXimKnBml8n4El8WpkT4l28aVzYxrr/9lNBQ++Mi8=
2022-01-20T18:11:41.097 INFO:teuthology.kill:  smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE7STbxNPLbB/WdiiLXeNgTQdudjdxI46xN61etQ4ZPPRAefqZmkJg/2n5HaaPAcypYdUUmr5YUjeo3TgZjFXziqUm7pB8HuVRlrdeCsrwL1aymSSlj7YMEPJX3WaADGodw2Xc6cipzemhJY0Trl+l85t1xAT8xST13YXjsaDufB6jDiKhTLsGgzUWQ6dnjW/IwAtb9kJYESnRizCGkn15w945jWVUK1vwftpRnnSL/onucQ0imJKIBUBuBFiieKhuJMUBNOKoWh9jA4V7BwjRZ8RbS8BMkL6mB/o+axNQzjQPzCM8B4Ap3zK6w3DUTiN2ow7BJTvzYIDSmGwvwPD6VvM8XNy0ilZGYnIkpsUah7TIY2gusDDGOjCxwLJsBKFCWLGME1Jrpjvp1TtyQd8cDQwKQtwnqXECIb39GkysPsUYw75mSCeZWK6YN6P79lZhgpfxs336AAun9xyaQ+3RIaMsIEfQzXguOvt4K7TkNxcQABLjZV1Qlcjtt40h3bk=
2022-01-20T18:11:41.122 INFO:teuthology.kill:2022-01-20 18:11:41,122.122 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-20T18:11:41.125 INFO:teuthology.kill:2022-01-20 18:11:41,125.125 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-20T18:11:41.200 INFO:teuthology.kill:2022-01-20 18:11:41,200.200 INFO:teuthology.orchestra.console:Power off smithi040
2022-01-20T18:11:41.214 INFO:teuthology.kill:2022-01-20 18:11:41,213.213 INFO:teuthology.orchestra.console:Power off smithi049
2022-01-20T18:11:49.580 INFO:teuthology.kill:2022-01-20 18:11:49,579.579 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2022-01-20T18:11:49.729 INFO:teuthology.kill:2022-01-20 18:11:49,729.729 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2022-01-20T18:11:53.684 INFO:teuthology.kill:2022-01-20 18:11:53,683.683 INFO:teuthology.orchestra.console:Power off for smithi040 completed
2022-01-20T18:11:53.829 INFO:teuthology.kill:2022-01-20 18:11:53,829.829 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com
2022-01-20T18:13:54.128 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-20T18:13:54.232 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi040 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-20_17:34:11-fs-wip-yuri5-testing-2022-01-20-0652-pacific-distro-default-smithi/6629308
2022-01-20T18:13:54.233 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi049 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-20_17:34:11-fs-wip-yuri5-testing-2022-01-20-0652-pacific-distro-default-smithi/6629308