2022-01-15T10:28:37.731 INFO:root:teuthology version: 1.1.0-3ff86a5d
2022-01-15T10:28:37.867 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging
2022-01-15T10:28:37.869 INFO:teuthology.lock.ops:Updating [ubuntu@smithi006.front.sepia.ceph.com]: reset os type and version on server
2022-01-15T10:28:37.869 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2022-01-15T10:28:37.889 INFO:teuthology.lock.ops:Node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging is complete
2022-01-15T10:28:37.890 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging
2022-01-15T10:28:37.890 INFO:teuthology.lock.ops:Updating [ubuntu@smithi070.front.sepia.ceph.com]: reset os type and version on server
2022-01-15T10:28:37.891 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2022-01-15T10:28:37.911 INFO:teuthology.lock.ops:Node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging is complete
2022-01-15T10:28:38.112 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.4
2022-01-15T10:28:38.162 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of rhel 8.4
2022-01-15T10:28:38.452 INFO:teuthology.orchestra.console:Power off smithi006
2022-01-15T10:28:38.523 INFO:teuthology.orchestra.console:Power off smithi070
2022-01-15T10:28:46.892 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2022-01-15T10:28:46.994 INFO:teuthology.orchestra.console:Power on smithi070
2022-01-15T10:28:50.936 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2022-01-15T10:28:51.042 INFO:teuthology.orchestra.console:Power on smithi006
2022-01-15T10:28:55.297 INFO:teuthology.orchestra.console:Power on for smithi006 completed
2022-01-15T10:28:55.399 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish
2022-01-15T10:28:55.464 INFO:teuthology.orchestra.console:Power on for smithi070 completed
2022-01-15T10:28:55.566 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish
2022-01-15T10:33:45.060 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-15T10:33:45.097 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-15T10:33:45.283 INFO:teuthology.provision.fog.smithi070:Node is ready
2022-01-15T10:33:45.297 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com
2022-01-15T10:33:45.336 INFO:teuthology.provision.fog.smithi006:Node is ready
2022-01-15T10:33:45.351 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com
2022-01-15T10:33:45.352 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070
2022-01-15T10:33:45.407 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006
2022-01-15T10:33:45.665 INFO:teuthology.provision.fog.smithi070:Deploy complete!
2022-01-15T10:33:45.738 INFO:teuthology.provision.fog.smithi006:Deploy complete!
2022-01-15T10:33:45.891 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com
2022-01-15T10:33:45.892 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-15T10:33:45.911 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com
2022-01-15T10:33:45.912 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-15T10:33:45.932 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server
2022-01-15T10:33:45.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2022-01-15T10:33:46.159 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64
2022-01-15T10:33:46.213 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux"
2022-01-15T10:33:46.213 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.4 (Ootpa)"
2022-01-15T10:33:46.214 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel"
2022-01-15T10:33:46.214 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora"
2022-01-15T10:33:46.214 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.4"
2022-01-15T10:33:46.214 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8"
2022-01-15T10:33:46.214 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-15T10:33:46.215 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2022-01-15T10:33:46.215 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-15T10:33:46.215 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/"
2022-01-15T10:33:46.215 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-15T10:33:46.216 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-15T10:33:46.216 INFO:teuthology.orchestra.run.smithi006.stdout:
2022-01-15T10:33:46.216 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-15T10:33:46.216 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-15T10:33:46.217 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-15T10:33:46.217 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-15T10:33:46.218 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2022-01-15T10:33:46.239 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server
2022-01-15T10:33:46.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com'
2022-01-15T10:33:46.458 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64
2022-01-15T10:33:46.514 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux"
2022-01-15T10:33:46.514 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.4 (Ootpa)"
2022-01-15T10:33:46.515 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel"
2022-01-15T10:33:46.515 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora"
2022-01-15T10:33:46.515 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.4"
2022-01-15T10:33:46.515 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8"
2022-01-15T10:33:46.516 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-15T10:33:46.516 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31"
2022-01-15T10:33:46.516 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-15T10:33:46.517 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/"
2022-01-15T10:33:46.517 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-15T10:33:46.517 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-15T10:33:46.517 INFO:teuthology.orchestra.run.smithi070.stdout:
2022-01-15T10:33:46.517 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-15T10:33:46.518 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-15T10:33:46.518 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-15T10:33:46.518 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-15T10:33:46.519 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2022-01-15T10:33:46.623 INFO:teuthology.dispatcher.supervisor:Running job 6619108
2022-01-15T10:33:46.623 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6619108 --name yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6619108/orig.config.yaml
2022-01-15T10:33:46.626 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6619108
2022-01-15T10:33:46.627 INFO:teuthology.dispatcher.supervisor:Job PID: 12306
2022-01-15T10:33:46.627 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-15T17:04:16.348 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-15T17:04:16.499 INFO:teuthology.kill:Killing Pids: {12306}
2022-01-15T17:04:17.686 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-15T17:04:17.687 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-15T17:04:17.687 INFO:teuthology.misc:Compressing logs...
2022-01-15T17:04:17.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2022-01-15T17:04:17.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com'
2022-01-15T17:04:17.953 INFO:teuthology.orchestra.run.smithi006.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-15T17:04:18.195 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-15T17:04:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-15T17:04:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:tar: Error is not recoverable: exiting now
2022-01-15T17:04:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-15T17:04:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now
2022-01-15T17:04:18.297 INFO:teuthology.misc:Compressing logs...
2022-01-15T17:04:18.569 INFO:teuthology.misc:Compressing logs...
2022-01-15T17:04:37.758 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-15T17:04:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-15T17:04:48.387 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-15T17:04:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-15T17:05:05.262 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-15T17:05:08.471 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-mon.smithi070.log: file size changed while zipping
2022-01-15T17:05:12.791 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-15T17:05:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-15T17:05:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-15T17:05:41.971 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-mon.smithi006.log: file size changed while zipping
2022-01-15T17:05:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/26dd40a8-75f0-11ec-8c32-001a4aab830c/ceph-mgr.smithi006.oiwmzg.log: file size changed while zipping
2022-01-15T17:06:16.160 INFO:teuthology.kill:No teuthology processes running
2022-01-15T17:06:17.270 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi070']
2022-01-15T17:06:18.250 INFO:teuthology.kill:2022-01-15 17:06:18,250.250 INFO:teuthology.nuke:targets:
2022-01-15T17:06:18.251 INFO:teuthology.kill:  smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzdvumxgyTo4oSxojIiJ+BDQBzXGgqX6VzRkbb2vzy1aRBFxEhL8/ucKEMaeQvRpEKeWs3zK9LkfONG6JxqOaxI6WnyxvesWYLmyo3KEJ6m3FsCVOfDDKHgw8at44mdreGga5H6aUyWBW5BTHBUflP8jp6n662hVYyB5A6vBRydaMVQp2/XpiiztvbTOAIAUl8q7lJIj4cjNOzdtZwuIqw5YfdRN6CmGS0XPIQ2FmWVsc+Lppw6mLZr2sB/jlXSvUrKWF5/dJXBZwmwl7oXF30mvuf97t0owzRzM0r5+X+CJskxoIp9PrYv0QQzD/cfYSC1Icp09EuUtHOkbggoIfgZbS/KJb2bAUFtW01Iu9DcG3c9GuZEztkS+ieTEpMKVk5r8NZvg9goxHvn4ZT6xZ54yDIDZf4GE+rgYH4LlG8xxkpmW9vHvVTHTcJ59aOJ6iiN465G/xUclry4uAfmuc4emmv6JYhoQWFCz2qWqWEWpO5zLN4xEDPCAY2pMQpmlc=
2022-01-15T17:06:18.252 INFO:teuthology.kill:  smithi070.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4xJTqNZab1jCRoFDRZgFrY1YwIke1BzwB8X6hZ6s5jVSbV/GelHJ+UMkERzsRuxApUP0FQW4OcMuv21hHNl+F07OzYKJ3Z71wEZ1TP8bcplMUYtnHviLFkGJc5uDz3EA4wi9wAAWxCxK+K2ZSlPAlTKsqaJth60efhJWOgRWuzA4RaOlKFPqjFZ0g82G2dYDyQkMLpuuHxPdPz1aIFJXsysiE809EComaExboyKx2Tf5N2EMzhX6ne/skVHIN1OeC7cpCJGn8DtKrt4+6VOKdhHsAlQxh1YQPzoJ27KaRNVnFTWoBiBTsq/OaSsuxenes580DkG9EVkDssMf+IF3U/aKbD4BP0D9/1GZtx5OUfjrO0lNTQTJCDwa+lpm0JJBj1K/IlvOdVLgSsSj18qwY7J00AcQuo7PJGoTUblnztbFIkyvb+k4grmjMv1/bKFXOJEapxPADPAuVbWkJ7OcilQZ1S558pjoo5m/P+14dpyT4YWylxrAwm68aWfF64UU=
2022-01-15T17:06:18.277 INFO:teuthology.kill:2022-01-15 17:06:18,277.277 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-15T17:06:18.281 INFO:teuthology.kill:2022-01-15 17:06:18,281.281 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-15T17:06:18.359 INFO:teuthology.kill:2022-01-15 17:06:18,358.358 INFO:teuthology.orchestra.console:Power off smithi070
2022-01-15T17:06:18.372 INFO:teuthology.kill:2022-01-15 17:06:18,372.372 INFO:teuthology.orchestra.console:Power off smithi006
2022-01-15T17:06:26.736 INFO:teuthology.kill:2022-01-15 17:06:26,735.735 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2022-01-15T17:06:26.743 INFO:teuthology.kill:2022-01-15 17:06:26,743.743 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2022-01-15T17:06:26.883 INFO:teuthology.kill:2022-01-15 17:06:26,882.882 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com
2022-01-15T17:06:26.885 INFO:teuthology.kill:2022-01-15 17:06:26,885.885 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com
2022-01-15T17:08:27.115 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-15T17:08:27.207 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi006 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_15:15:15-upgrade-wip-yuriw-quincy-1.14.22-distro-default-smithi/6619853
2022-01-15T17:08:27.208 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi070 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_15:15:15-upgrade-wip-yuriw-quincy-1.14.22-distro-default-smithi/6619853