2023-03-02T06:11:59.457 INFO:root:teuthology version: 0.0.1.dev49+gc7c3cc8
2023-03-02T06:11:59.606 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2023-03-02T06:11:59.608 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2023-03-02T06:11:59.608 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-03-02T06:11:59.636 INFO:teuthology.lock.ops:Node 'smithi098.front.sepia.ceph.com' reimaging is complete
2023-03-02T06:11:59.636 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging
2023-03-02T06:11:59.637 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server
2023-03-02T06:11:59.637 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2023-03-02T06:11:59.661 INFO:teuthology.lock.ops:Node 'smithi139.front.sepia.ceph.com' reimaging is complete
2023-03-02T06:11:59.815 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 8.stream
2023-03-02T06:11:59.833 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream
2023-03-02T06:12:00.089 INFO:teuthology.orchestra.console:Power off smithi139
2023-03-02T06:12:00.106 INFO:teuthology.orchestra.console:Power off smithi098
2023-03-02T06:12:12.579 INFO:teuthology.orchestra.console:Power off for smithi139 completed
2023-03-02T06:12:12.585 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2023-03-02T06:12:12.681 INFO:teuthology.orchestra.console:Power on smithi139
2023-03-02T06:12:12.689 INFO:teuthology.orchestra.console:Power on smithi098
2023-03-02T06:12:16.948 INFO:teuthology.orchestra.console:Power on for smithi098 completed
2023-03-02T06:12:17.049 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2023-03-02T06:12:21.054 INFO:teuthology.orchestra.console:Power on for smithi139 completed
2023-03-02T06:12:21.156 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish
2023-03-02T06:15:06.153 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-03-02T06:15:10.089 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-03-02T06:15:15.237 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-03-02T06:15:19.145 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-03-02T06:15:24.293 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-03-02T06:15:28.197 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-03-02T06:15:33.349 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-03-02T06:15:37.253 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-03-02T06:15:42.409 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-03-02T06:15:46.309 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-03-02T06:15:51.493 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-03-02T06:15:55.365 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-03-02T06:16:00.549 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-03-02T06:16:38.546 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-02T06:16:59.224 INFO:teuthology.provision.fog.smithi098:Node is ready
2023-03-02T06:16:59.244 INFO:teuthology.orchestra.run.smithi098.stdout:smithi001
2023-03-02T06:16:59.302 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.1 smithi001 smithi001
2023-03-02T06:16:59.667 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2023-03-02T06:17:01.369 WARNING:teuthology.provision.fog:timed out
2023-03-02T06:17:07.641 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-02T06:17:07.898 INFO:teuthology.provision.fog.smithi139:Node is ready
2023-03-02T06:17:07.957 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com
2023-03-02T06:17:08.015 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139
2023-03-02T06:17:08.375 INFO:teuthology.provision.fog.smithi139:Deploy complete!
2023-03-02T06:17:08.587 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2023-03-02T06:17:08.588 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-02T06:17:08.617 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com
2023-03-02T06:17:08.617 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-02T06:17:08.635 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2023-03-02T06:17:08.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-03-02T06:17:08.834 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2023-03-02T06:17:08.893 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2023-03-02T06:17:08.893 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2023-03-02T06:17:08.894 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2023-03-02T06:17:08.894 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2023-03-02T06:17:08.894 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2023-03-02T06:17:08.894 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-03-02T06:17:08.894 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-02T06:17:08.894 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-03-02T06:17:08.895 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-02T06:17:08.895 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2023-03-02T06:17:08.895 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-02T06:17:08.895 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-02T06:17:08.895 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-02T06:17:08.896 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-03-02T06:17:08.917 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server
2023-03-02T06:17:08.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-03-02T06:17:09.107 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64
2023-03-02T06:17:09.165 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream"
2023-03-02T06:17:09.165 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8"
2023-03-02T06:17:09.165 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos"
2023-03-02T06:17:09.166 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora"
2023-03-02T06:17:09.166 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8"
2023-03-02T06:17:09.166 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8"
2023-03-02T06:17:09.166 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-02T06:17:09.166 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31"
2023-03-02T06:17:09.166 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-02T06:17:09.167 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/"
2023-03-02T06:17:09.167 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-02T06:17:09.167 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-02T06:17:09.167 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-02T06:17:09.168 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2023-03-02T06:17:09.271 INFO:teuthology.dispatcher.supervisor:Running job 7191455
2023-03-02T06:17:09.271 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-03-02_00:09:05-rados-wip-yuri11-testing-2023-03-01-1424-distro-default-smithi/7191455 --name yuriw-2023-03-02_00:09:05-rados-wip-yuri11-testing-2023-03-01-1424-distro-default-smithi --description rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} -- /home/teuthworker/archive/yuriw-2023-03-02_00:09:05-rados-wip-yuri11-testing-2023-03-01-1424-distro-default-smithi/7191455/orig.config.yaml
2023-03-02T06:17:09.275 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-03-02_00:09:05-rados-wip-yuri11-testing-2023-03-01-1424-distro-default-smithi/7191455
2023-03-02T06:17:09.276 INFO:teuthology.dispatcher.supervisor:Job PID: 5187
2023-03-02T06:17:09.276 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-02T18:18:08.625 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-02T18:18:08.785 INFO:teuthology.kill:Killing Pids: {5187}
2023-03-02T18:18:09.985 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2']
2023-03-02T18:18:09.986 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['osd.3', 'osd.4', 'osd.5', 'client.0']
2023-03-02T18:18:09.986 INFO:teuthology.misc:Compressing logs...
2023-03-02T18:18:09.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-03-02T18:18:10.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-03-02T18:18:10.569 INFO:teuthology.misc:Compressing logs...
2023-03-02T18:18:11.679 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-02T18:18:11.698 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-02T18:18:25.858 INFO:teuthology.misc:Compressing logs...
2023-03-02T18:26:56.319 INFO:teuthology.kill:No teuthology processes running
2023-03-02T18:26:57.096 INFO:teuthology.kill:Nuking machines: ['smithi098', 'smithi139']
2023-03-02T18:26:57.702 INFO:teuthology.kill:2023-03-02 18:26:57,701.701 INFO:teuthology.nuke:targets:
2023-03-02T18:26:57.703 INFO:teuthology.kill:  smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBxLrmPuqA2/bbRCPHL3Rv3qCRab7JAdh3FWZ8mxzhflwH9uyT1AGRn4jA9DfAKhu0ZYmjyMjIEyglaX5Bg7LtgE3buNbUn2rvP0N6fL9qBUt+EbpTkMJnngTwyCi/mrpWTu7wrtKDu1AgcyA3taWwB3aognCVk6w5Y3mIe/5DWXTtCAq8PIwhgv4H8A5U1CYEIwleaHjUn0g3P/w8uQZ08QO52uFz1CUL6Sk3K1OIcyC0mVFbxUky51r15nkYvIt93LO9DFPFinY/z4p5Xupy0vgngaKP9picTp35er8p4ROZkOw3Jv9GHYl0SHSoHUrj1+/msueDvRWgJUXMo+xalqRefLVB7q4T6CVe18aUk+qYMjrXiAqPgd0MEMjt/SAMAO6xmOvo03SyUj5b13s7ygkENqRrxNrZVa18bg2R+J12BYfjoBQAsijEg7sCLchZ2ujwH2qgmxbC6lckKHZR8u502uoS5TCbG8t4MBtrHuTtTGfd0Bflw0M3Waz621k=
2023-03-02T18:26:57.703 INFO:teuthology.kill:  smithi139.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCbGt9v2kC8ipvf3IFyKNaKCvwxmE0AdIYo48SUSqtzJeg1v97ZH2yBGEGPow2nme19FnCiPEvZ7X3CiVXut9KJ8cTpWJCY3pU3o1NX+IxCwsAjIqbMYg8zQYYBMYA2BDYBWNlfhu73W5BlLrZeUyF18+C5PnkvAZtD9J4LwqjWff6opguVqyUSnl1QmrqE9w/UrVyl8PVgja/DMxiTlRB5nno+GUJVY2qR4RxhHcSzWkiAKV7rbC9B5Opgr9yg/xz//xT22xgfcXSIVR3/O1hjwoJ9B/GX6zqDY+sFjxuUbjZdvjzeiqQxlW4KciNin6jBzTR2GoaW8/LHKBUlJgCl62++4Zu1mFkDdj6Lx/xgJK6wWGihASfUHQCIrMaJhUm/FlrdDlj4cOSqlbr7zRDbYSh5fG9oBaJOF9L5tyVzaaK0n3RfAMLJguO+535VoPOSbUSGQeRq2WVwVleo9nNyXHWKT8f5ZQC8eLscNGPgUtRVW09GL85PytoalzElEM=
2023-03-02T18:26:57.703 INFO:teuthology.kill:2023-03-02 18:26:57,702.702 INFO:teuthology.nuke:Checking targets against current locks
2023-03-02T18:26:57.763 INFO:teuthology.kill:2023-03-02 18:26:57,763.763 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-02T18:26:57.777 INFO:teuthology.kill:2023-03-02 18:26:57,777.777 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-02T18:26:57.836 INFO:teuthology.kill:2023-03-02 18:26:57,836.836 INFO:teuthology.orchestra.console:Power off smithi098
2023-03-02T18:26:57.853 INFO:teuthology.kill:2023-03-02 18:26:57,853.853 INFO:teuthology.orchestra.console:Power off smithi139
2023-03-02T18:27:06.209 INFO:teuthology.kill:2023-03-02 18:27:06,209.209 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2023-03-02T18:27:06.363 INFO:teuthology.kill:2023-03-02 18:27:06,363.363 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com
2023-03-02T18:27:10.332 INFO:teuthology.kill:2023-03-02 18:27:10,332.332 INFO:teuthology.orchestra.console:Power off for smithi139 completed
2023-03-02T18:27:10.496 INFO:teuthology.kill:2023-03-02 18:27:10,496.496 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com
2023-03-02T18:29:10.837 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-03-02T18:29:10.950 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi098 but it was locked by another job: /home/teuthworker/archive/bhubbard-2023-02-28_21:37:28-powercycle-main-distro-default-smithi/7188585
2023-03-02T18:29:10.951 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi139 but it was locked by another job: /home/teuthworker/archive/bhubbard-2023-02-28_21:37:28-powercycle-main-distro-default-smithi/7188584