2022-07-28T21:21:36.827 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1
2022-07-28T21:21:37.028 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2022-07-28T21:21:37.030 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2022-07-28T21:21:37.031 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2022-07-28T21:21:37.061 INFO:teuthology.lock.ops:Node 'smithi169.front.sepia.ceph.com' reimaging is complete
2022-07-28T21:21:37.062 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2022-07-28T21:21:37.063 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2022-07-28T21:21:37.063 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2022-07-28T21:21:37.106 INFO:teuthology.lock.ops:Node 'smithi175.front.sepia.ceph.com' reimaging is complete
2022-07-28T21:21:37.300 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.4
2022-07-28T21:21:37.331 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.4
2022-07-28T21:21:37.679 INFO:teuthology.orchestra.console:Power off smithi169
2022-07-28T21:21:37.739 INFO:teuthology.orchestra.console:Power off smithi175
2022-07-28T21:21:37.911 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2022-07-28T21:21:37.930 INFO:teuthology.orchestra.console:Power off for smithi175 completed
2022-07-28T21:21:38.012 INFO:teuthology.orchestra.console:Power on smithi169
2022-07-28T21:21:38.033 INFO:teuthology.orchestra.console:Power on smithi175
2022-07-28T21:21:42.311 INFO:teuthology.orchestra.console:Power on for smithi175 completed
2022-07-28T21:21:42.415 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2022-07-28T21:21:46.421 INFO:teuthology.orchestra.console:Power on for smithi169 completed
2022-07-28T21:21:46.527 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2022-07-28T21:26:07.636 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-28T21:26:27.700 INFO:teuthology.provision.fog.smithi169:Node is ready
2022-07-28T21:26:27.720 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2022-07-28T21:26:27.777 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2022-07-28T21:26:28.119 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2022-07-28T21:26:29.233 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-28T21:26:29.469 INFO:teuthology.provision.fog.smithi175:Node is ready
2022-07-28T21:26:29.486 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com
2022-07-28T21:26:29.543 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175
2022-07-28T21:26:29.889 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2022-07-28T21:26:30.087 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2022-07-28T21:26:30.088 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-28T21:26:30.126 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com
2022-07-28T21:26:30.127 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-28T21:26:30.148 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2022-07-28T21:26:30.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2022-07-28T21:26:30.399 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2022-07-28T21:26:30.456 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux"
2022-07-28T21:26:30.460 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.4 (Ootpa)"
2022-07-28T21:26:30.460 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel"
2022-07-28T21:26:30.461 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora"
2022-07-28T21:26:30.461 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.4"
2022-07-28T21:26:30.462 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2022-07-28T21:26:30.462 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-07-28T21:26:30.463 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2022-07-28T21:26:30.463 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-07-28T21:26:30.464 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/"
2022-07-28T21:26:30.464 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-28T21:26:30.464 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-28T21:26:30.465 INFO:teuthology.orchestra.run.smithi169.stdout:
2022-07-28T21:26:30.465 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-28T21:26:30.466 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-07-28T21:26:30.466 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-28T21:26:30.467 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-07-28T21:26:30.469 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2022-07-28T21:26:30.489 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server
2022-07-28T21:26:30.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com'
2022-07-28T21:26:30.780 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64
2022-07-28T21:26:30.836 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux"
2022-07-28T21:26:30.836 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.4 (Ootpa)"
2022-07-28T21:26:30.837 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel"
2022-07-28T21:26:30.837 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora"
2022-07-28T21:26:30.837 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.4"
2022-07-28T21:26:30.838 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8"
2022-07-28T21:26:30.838 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-07-28T21:26:30.839 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2022-07-28T21:26:30.839 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-07-28T21:26:30.839 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/"
2022-07-28T21:26:30.840 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-28T21:26:30.840 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-28T21:26:30.841 INFO:teuthology.orchestra.run.smithi175.stdout:
2022-07-28T21:26:30.841 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-28T21:26:30.841 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-07-28T21:26:30.842 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-28T21:26:30.842 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-07-28T21:26:30.843 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2022-07-28T21:26:30.944 INFO:teuthology.dispatcher.supervisor:Running job 6952648
2022-07-28T21:26:30.944 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-07-28_15:19:26-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6952648 --name yuriw-2022-07-28_15:19:26-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi --description rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} -- /home/teuthworker/archive/yuriw-2022-07-28_15:19:26-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6952648/orig.config.yaml
2022-07-28T21:26:30.950 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-07-28_15:19:26-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6952648
2022-07-28T21:26:30.951 INFO:teuthology.dispatcher.supervisor:Job PID: 25796
2022-07-28T21:26:30.953 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-29T09:27:24.476 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-29T09:27:24.650 INFO:teuthology.kill:Killing Pids: {25796}
2022-07-29T09:27:26.219 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2022-07-29T09:27:26.221 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2022-07-29T09:27:26.221 INFO:teuthology.misc:Compressing logs...
2022-07-29T09:27:26.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2022-07-29T09:27:26.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com'
2022-07-29T09:27:26.473 INFO:teuthology.orchestra.run.smithi169.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-07-29T09:27:26.650 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-07-29T09:27:26.689 INFO:teuthology.orchestra.run.smithi169.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-07-29T09:27:26.690 INFO:teuthology.orchestra.run.smithi169.stderr:tar: Error is not recoverable: exiting now
2022-07-29T09:27:26.736 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-07-29T09:27:26.737 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now
2022-07-29T09:27:26.738 INFO:teuthology.misc:Compressing logs...
2022-07-29T09:27:26.909 INFO:teuthology.misc:Compressing logs...
2022-07-29T09:27:27.785 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/115c8110-0ebd-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-07-29T09:27:28.668 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/115c8110-0ebd-11ed-8430-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-07-29T09:27:28.789 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/115c8110-0ebd-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-07-29T09:27:30.577 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/115c8110-0ebd-11ed-8430-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-07-29T09:27:31.418 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/115c8110-0ebd-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-07-29T09:27:33.837 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/115c8110-0ebd-11ed-8430-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-07-29T09:27:36.915 INFO:teuthology.kill:No teuthology processes running
2022-07-29T09:27:38.216 INFO:teuthology.kill:Nuking machines: ['smithi169', 'smithi175']
2022-07-29T09:27:39.304 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-29T09:27:39.306 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-29T09:27:39.306 INFO:teuthology.kill:2022-07-29 09:27:39,304.304 INFO:teuthology.nuke:targets:
2022-07-29T09:27:39.307 INFO:teuthology.kill:  smithi169.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXioQgEU3QL9bsrrySNB4qDn1CurIIkcleG8NsrNyEV8uelqzTr1rKbdgvuXOfia3l6TXky6i9Ntq5wxgPr0N/x8ddwtyZyJ5+bjWwLnvtPHiDTsAQrv9/1VRbiMMqC75o8OwCuclB01bV2gxeE6hg7WgSXPXcV7M1ZejQKJsUHYBDl419cNyZfg/xVYr+VzK+4ayKFU15IVmyojCsI672HDMr9p9fQbFOfk9apkOxLyJWA1IN4mO0xm3Sy3xZvcDkKWrc3HwVkbhu7i9TuBw/Zhqa2uokfVo1JNBgOMYRMShCb8jxhrPpA89yZZTK/dmIJi+ZOkAwpVYl4Zp3b1lhUNRDx9qxXKxNcuy0uh57+BN0fLhcHkJb9wPoN3CfS6d5l5/sOEFc1NJg/J+vdvXRAybY6CDj4De4cE3f3cmINPdk9t43V7/HRTvEYcTeEi6cUR23/KyBb3OzzCiyJa961MZ1TXWVX7fljGGnaKLOus8Y0Rf9XqdQGImwQTp/59E=
2022-07-29T09:27:39.308 INFO:teuthology.kill:  smithi175.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCk3cCqn+KnYFKdqgYJvH/Ab91ZmWdbLyfHxi+sXTLBfPFr8jUIMXcINUuUSENt+W9yLK3wmq26HYGS3PI0Cj3xzsFm9t8J7h1i7z+/QPL5UlcI3AtdiVf9XlnIT6wYPkb7fcAz/DGo7LS/nq9MIyOsVUD9TkxidBAtUOEOfzdX0k1YMK6vg4Bfmaz/Hiwvv3o6zF5EmlaU9a0eB20JSKyrUSwwzsFJ3Aa1RMDW3s6XjxTqmPJ1Tgb5+3B4+SnLgjTU5wPVVHrJCN/5j5lhSUs/SajpLE+c6UKsRexOhuGq4osdSbTneSdCNLmLhlKxMtLIU619saKSihKXdzksAmvHhEbgMUIG1k6zPGra3d2GJuFUgBWVa05ky7gRC0obQT2ZJu3sdtsCJThqwG0Nqd0DH1Oon8plxpFBC7YsbZ22f+Tccd+U15ZDunA858ldg4BRQ9JaFTGlV35QWwokF0Lw/XM13oGTwR9inYduIXevEECy+/JXbDVvv6/0s+Miogs=
2022-07-29T09:27:39.308 INFO:teuthology.kill:2022-07-29 09:27:39,304.304 INFO:teuthology.nuke:Checking targets against current locks
2022-07-29T09:27:39.357 INFO:teuthology.kill:2022-07-29 09:27:39,357.357 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-29T09:27:39.385 INFO:teuthology.kill:2022-07-29 09:27:39,385.385 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-29T09:27:39.436 INFO:teuthology.kill:2022-07-29 09:27:39,436.436 INFO:teuthology.orchestra.console:Power off smithi169
2022-07-29T09:27:39.472 INFO:teuthology.kill:2022-07-29 09:27:39,472.472 INFO:teuthology.orchestra.console:Power off smithi175
2022-07-29T09:27:47.803 INFO:teuthology.kill:2022-07-29 09:27:47,803.803 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2022-07-29T09:27:47.832 INFO:teuthology.kill:2022-07-29 09:27:47,832.832 INFO:teuthology.orchestra.console:Power off for smithi175 completed
2022-07-29T09:27:47.959 INFO:teuthology.kill:2022-07-29 09:27:47,958.958 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com
2022-07-29T09:27:47.997 INFO:teuthology.kill:2022-07-29 09:27:47,997.997 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com
2022-07-29T09:29:48.234 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-29T09:29:48.329 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi169 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-28_15:36:15-rbd-wip-yuri5-testing-2022-07-25-0646-quincy-distro-default-smithi/6952846
2022-07-29T09:29:48.330 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi175 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-28_15:36:15-rbd-wip-yuri5-testing-2022-07-25-0646-quincy-distro-default-smithi/6952845