2022-01-18T21:11:07.791 INFO:root:teuthology version: 1.1.0-3ff86a5d
2022-01-18T21:11:07.911 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging
2022-01-18T21:11:07.912 INFO:teuthology.lock.ops:Updating [ubuntu@smithi134.front.sepia.ceph.com]: reset os type and version on server
2022-01-18T21:11:07.912 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2022-01-18T21:11:07.931 INFO:teuthology.lock.ops:Node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging is complete
2022-01-18T21:11:07.931 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging
2022-01-18T21:11:07.932 INFO:teuthology.lock.ops:Updating [ubuntu@smithi140.front.sepia.ceph.com]: reset os type and version on server
2022-01-18T21:11:07.932 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2022-01-18T21:11:07.952 INFO:teuthology.lock.ops:Node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging is complete
2022-01-18T21:11:08.138 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 8.stream
2022-01-18T21:11:08.161 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of centos 8.stream
2022-01-18T21:11:08.485 INFO:teuthology.orchestra.console:Power off smithi134
2022-01-18T21:11:08.524 INFO:teuthology.orchestra.console:Power off smithi140
2022-01-18T21:11:16.889 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2022-01-18T21:11:16.991 INFO:teuthology.orchestra.console:Power on smithi140
2022-01-18T21:11:20.967 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2022-01-18T21:11:21.069 INFO:teuthology.orchestra.console:Power on smithi134
2022-01-18T21:11:25.324 INFO:teuthology.orchestra.console:Power on for smithi134 completed
2022-01-18T21:11:25.419 INFO:teuthology.orchestra.console:Power on for smithi140 completed
2022-01-18T21:11:25.426 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2022-01-18T21:11:25.521 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2022-01-18T21:16:30.186 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-18T21:16:30.285 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-18T21:16:30.437 INFO:teuthology.provision.fog.smithi140:Node is ready
2022-01-18T21:16:30.455 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com
2022-01-18T21:16:30.512 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140
2022-01-18T21:16:30.561 INFO:teuthology.provision.fog.smithi134:Node is ready
2022-01-18T21:16:30.577 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2022-01-18T21:16:30.634 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2022-01-18T21:16:30.853 INFO:teuthology.provision.fog.smithi140:Deploy complete!
2022-01-18T21:16:30.967 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2022-01-18T21:16:31.115 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2022-01-18T21:16:31.116 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-18T21:16:31.133 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com
2022-01-18T21:16:31.133 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-18T21:16:31.150 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2022-01-18T21:16:31.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2022-01-18T21:16:31.337 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2022-01-18T21:16:31.391 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2022-01-18T21:16:31.392 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8"
2022-01-18T21:16:31.392 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2022-01-18T21:16:31.392 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2022-01-18T21:16:31.393 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8"
2022-01-18T21:16:31.393 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2022-01-18T21:16:31.393 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-18T21:16:31.393 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2022-01-18T21:16:31.394 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-18T21:16:31.394 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2022-01-18T21:16:31.394 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-18T21:16:31.394 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-18T21:16:31.394 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-18T21:16:31.396 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2022-01-18T21:16:31.414 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server
2022-01-18T21:16:31.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com'
2022-01-18T21:16:31.599 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64
2022-01-18T21:16:31.654 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="CentOS Stream"
2022-01-18T21:16:31.655 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8"
2022-01-18T21:16:31.655 INFO:teuthology.orchestra.run.smithi140.stdout:ID="centos"
2022-01-18T21:16:31.655 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="rhel fedora"
2022-01-18T21:16:31.655 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8"
2022-01-18T21:16:31.656 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8"
2022-01-18T21:16:31.656 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-18T21:16:31.656 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31"
2022-01-18T21:16:31.656 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-18T21:16:31.657 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://centos.org/"
2022-01-18T21:16:31.657 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-18T21:16:31.657 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-18T21:16:31.657 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-18T21:16:31.658 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2022-01-18T21:16:31.756 INFO:teuthology.dispatcher.supervisor:Running job 6625237
2022-01-18T21:16:31.757 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-01-18_19:08:00-rados:cephadm-wip-guits-testing-2022-01-18-1557-pacific-distro-default-smithi/6625237 --name gabrioux-2022-01-18_19:08:00-rados:cephadm-wip-guits-testing-2022-01-18-1557-pacific-distro-default-smithi --description rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2022-01-18_19:08:00-rados:cephadm-wip-guits-testing-2022-01-18-1557-pacific-distro-default-smithi/6625237/orig.config.yaml
2022-01-18T21:16:31.761 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-01-18_19:08:00-rados:cephadm-wip-guits-testing-2022-01-18-1557-pacific-distro-default-smithi/6625237
2022-01-18T21:16:31.761 INFO:teuthology.dispatcher.supervisor:Job PID: 11756
2022-01-18T21:16:31.762 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-19T03:47:01.449 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-19T03:47:01.672 INFO:teuthology.kill:Killing Pids: {11756}
2022-01-19T03:47:02.853 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-19T03:47:02.854 INFO:teuthology.task.internal:roles: ubuntu@smithi140.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-19T03:47:02.855 INFO:teuthology.misc:Compressing logs...
2022-01-19T03:47:02.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2022-01-19T03:47:03.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com'
2022-01-19T03:47:03.099 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-19T03:47:03.288 INFO:teuthology.orchestra.run.smithi140.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-19T03:47:03.334 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-19T03:47:03.335 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now
2022-01-19T03:47:03.411 INFO:teuthology.orchestra.run.smithi140.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-19T03:47:03.412 INFO:teuthology.orchestra.run.smithi140.stderr:tar: Error is not recoverable: exiting now
2022-01-19T03:47:03.413 INFO:teuthology.misc:Compressing logs...
2022-01-19T03:47:03.574 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-19T03:47:03.795 INFO:teuthology.misc:Compressing logs...
2022-01-19T03:47:04.229 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-19T03:47:04.552 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-19T03:47:04.830 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-mon.smithi134.log: file size changed while zipping
2022-01-19T03:47:04.920 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-19T03:47:05.219 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-19T03:47:05.332 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-mon.smithi140.log: file size changed while zipping
2022-01-19T03:47:05.865 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-19T03:47:06.287 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-mgr.smithi134.xiimux.log: file size changed while zipping
2022-01-19T03:47:07.078 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-19T03:47:07.719 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-19T03:47:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/14acfa6a-78a5-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-19T03:47:40.607 INFO:teuthology.kill:No teuthology processes running
2022-01-19T03:47:41.718 INFO:teuthology.kill:Nuking machines: ['smithi134', 'smithi140']
2022-01-19T03:47:42.682 INFO:teuthology.kill:2022-01-19 03:47:42,682.682 INFO:teuthology.nuke:targets:
2022-01-19T03:47:42.683 INFO:teuthology.kill:  smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEOyNArzv+JXvx7xJFeZMsM78OS+wQXZ0cT9phjVMCEX4fyelV1Dv/hQL+ygxiQbV0tvyRedasnlGf1lD6ubLjntUnb84h2zjYab3E5cZWrSUB/uamAZzfGx/etpDOADhz50luQN3hHvwNKlnHtOQWDwe1R8HL+rFFoM1e8bD2+ZsVpkjhj8uqe94v3g6KSB5yAu4EjX/fGhb/FK6bN5SX1zxY7wK+1hut2/9HGLiKPiWHFM36nQ62xaJ6JydWhQ86NrBsF0gALL4mjxRR8zcXff1EobvtnkP/hdWJr/3cQ+6zPbbUMoyRhlRmIF/s0sx+bfmhb9bFQHpEMgKtBuXGbQQeQBmoXIEqvWnPWMd4kb4dak/0YQu/DhRH2zkXzZ+2YbAoKzvCMNgCZ4rMdw/6cO7ijfx/wm7eoDofWkJfXHpbAR7LsdbhoeXPgnsAYrp3lwcB6ZqO+BxbG6Kqq93mbQaPqQSm9cjRacq5AZb46i26v65MQtHyllpl9UsS5l0=
2022-01-19T03:47:42.684 INFO:teuthology.kill:  smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD32bFzNG8nl0rl+Ow9KopyfO2Dtlo/BreAIQvL2IE0hDxh6VS14trHN9RGgevGYk6oFEroDQHaqTFX+FBdrW/pYjOlP7cnPHYEiQH2X7O57UCcc+gbBPOqxVxmOLSdrPEtvloDVA2/6u6KRowu10Oz4GRa6TlFdyEEjlXk+QYNMlie0g3iubbNKv4hWkdnRMcc1P1GuSSAkVSwAaTXSty4aXbhMJIcJavKhYd1+O5p23HADHkMljjxinGoNMfi39LTEdv1Ja+I57wXm6FY7UVEn+bsC9WDLh9fEDP6Vr5rBtzM1RQF67zCTKtUpL+bdbwKIPa6lIoYdl1rD2u9Zo8e5nvKa0Tk20Xj53Yx4UNdfGle+ue/j89QSDT3mnhANxsO6fiC8EZNZ42GGVkxlulHfAnXQnz9wXVkGkRV9Ff8K4SfXxool6G3mCrqeDUJy3gCLbwPqhP0XfPmM6S4WLr0JubEnFWQnAnIYYO5YAGakjB4H/SofrHmwf7RP3O9qDU=
2022-01-19T03:47:42.714 INFO:teuthology.kill:2022-01-19 03:47:42,714.714 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-19T03:47:42.720 INFO:teuthology.kill:2022-01-19 03:47:42,720.720 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-19T03:47:42.833 INFO:teuthology.kill:2022-01-19 03:47:42,833.833 INFO:teuthology.orchestra.console:Power off smithi134
2022-01-19T03:47:42.855 INFO:teuthology.kill:2022-01-19 03:47:42,854.854 INFO:teuthology.orchestra.console:Power off smithi140
2022-01-19T03:47:51.258 INFO:teuthology.kill:2022-01-19 03:47:51,258.258 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2022-01-19T03:47:51.327 INFO:teuthology.kill:2022-01-19 03:47:51,326.326 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2022-01-19T03:47:51.404 INFO:teuthology.kill:2022-01-19 03:47:51,403.403 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com
2022-01-19T03:47:51.471 INFO:teuthology.kill:2022-01-19 03:47:51,470.470 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com
2022-01-19T03:49:51.783 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-19T03:49:51.881 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi134 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-18_19:05:09-rbd-wip-yuri7-testing-2022-01-18-0832-pacific-distro-default-smithi/6625180
2022-01-19T03:49:51.882 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi140 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-18_19:05:09-rbd-wip-yuri7-testing-2022-01-18-0832-pacific-distro-default-smithi/6625180