2023-02-11T16:10:36.961 INFO:root:teuthology version: 0.0.1.dev37+g00690ec
2023-02-11T16:10:37.251 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2023-02-11T16:10:37.251 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2023-02-11T16:10:37.252 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2023-02-11T16:10:37.269 INFO:teuthology.lock.ops:Node 'smithi100.front.sepia.ceph.com' reimaging is complete
2023-02-11T16:10:37.269 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-02-11T16:10:37.269 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-02-11T16:10:37.269 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-02-11T16:10:37.287 INFO:teuthology.lock.ops:Node 'smithi161.front.sepia.ceph.com' reimaging is complete
2023-02-11T16:10:37.417 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 8.stream
2023-02-11T16:10:37.446 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream
2023-02-11T16:10:37.649 INFO:teuthology.orchestra.console:Power off smithi100
2023-02-11T16:10:37.700 INFO:teuthology.orchestra.console:Power off smithi161
2023-02-11T16:10:46.359 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-02-11T16:10:46.463 INFO:teuthology.orchestra.console:Power on smithi161
2023-02-11T16:10:50.463 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2023-02-11T16:10:50.565 INFO:teuthology.orchestra.console:Power on smithi100
2023-02-11T16:10:54.828 INFO:teuthology.orchestra.console:Power on for smithi100 completed
2023-02-11T16:10:54.835 INFO:teuthology.orchestra.console:Power on for smithi161 completed
2023-02-11T16:10:54.932 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2023-02-11T16:10:54.957 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-02-11T16:13:59.174 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-02-11T16:13:59.198 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-02-11T16:14:08.261 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-02-11T16:14:08.261 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-02-11T16:14:17.349 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-02-11T16:14:17.349 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-02-11T16:14:26.405 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-02-11T16:14:26.437 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-02-11T16:14:35.461 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-02-11T16:14:35.493 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-02-11T16:14:44.549 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-02-11T16:15:41.520 WARNING:teuthology.provision.fog:timed out
2023-02-11T16:15:47.786 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-02-11T16:15:48.073 INFO:teuthology.provision.fog.smithi100:Node is ready
2023-02-11T16:15:48.092 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2023-02-11T16:15:48.151 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2023-02-11T16:15:48.516 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2023-02-11T16:15:50.553 WARNING:teuthology.provision.fog:timed out
2023-02-11T16:15:56.893 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-02-11T16:15:57.191 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-02-11T16:15:57.210 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-02-11T16:15:57.270 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-02-11T16:15:57.622 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-02-11T16:15:57.988 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2023-02-11T16:15:57.989 INFO:teuthology.lock.ops:New key found. Updating...
2023-02-11T16:15:58.006 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-02-11T16:15:58.006 INFO:teuthology.lock.ops:New key found. Updating...
2023-02-11T16:15:58.025 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2023-02-11T16:15:58.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2023-02-11T16:15:58.222 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2023-02-11T16:15:58.281 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 8"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-02-11T16:15:58.282 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-02-11T16:15:58.283 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2023-02-11T16:15:58.298 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-02-11T16:15:58.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-02-11T16:15:58.488 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-02-11T16:15:58.546 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-02-11T16:15:58.547 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-02-11T16:15:58.547 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-02-11T16:15:58.547 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-02-11T16:15:58.629 INFO:teuthology.dispatcher.supervisor:Running job 7160936
2023-02-11T16:15:58.630 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7160936 --name yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7160936/orig.config.yaml
2023-02-11T16:15:58.655 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7160936
2023-02-11T16:15:58.655 INFO:teuthology.dispatcher.supervisor:Job PID: 2932
2023-02-11T16:15:58.655 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-02-12T04:16:58.698 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-02-12T04:17:03.286 INFO:teuthology.kill:Killing Pids: {2932}
2023-02-12T04:17:13.138 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2023-02-12T04:17:13.138 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2023-02-12T04:17:13.287 INFO:teuthology.misc:Compressing logs...
2023-02-12T04:17:13.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2023-02-12T04:17:17.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-02-12T04:17:18.746 INFO:teuthology.kill:No teuthology processes running
2023-02-12T04:17:20.678 INFO:teuthology.kill:Nuking machines: ['smithi100', 'smithi161']
2023-02-12T04:17:21.872 INFO:teuthology.kill:2023-02-12 04:17:21,871.871 INFO:teuthology.nuke:targets:
2023-02-12T04:17:21.872 INFO:teuthology.kill:  smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIICaNGc7j2KOTLcUI8/SdYmgQwTl2dT6OvnEpwTCxKwipiDhAUHEJ2BrkZ1OH2jE3aX6prcB9p8tT7UGMQwXAg=
2023-02-12T04:17:21.872 INFO:teuthology.kill:  smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFJVncbLCuJcjrf/UvRtwb7QMQDd2g93X+iVxzIGSWFYxq+FNv3h1QbttxVEeD8wrqkfPdpNeemL9Uz0NipLWI=
2023-02-12T04:17:21.872 INFO:teuthology.kill:2023-02-12 04:17:21,871.871 INFO:teuthology.nuke:Checking targets against current locks
2023-02-12T04:17:21.919 INFO:teuthology.kill:2023-02-12 04:17:21,919.919 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-02-12T04:17:21.940 INFO:teuthology.kill:2023-02-12 04:17:21,940.940 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-02-12T04:17:22.062 INFO:teuthology.kill:2023-02-12 04:17:22,062.062 INFO:teuthology.orchestra.console:Power off smithi100
2023-02-12T04:17:22.174 INFO:teuthology.kill:2023-02-12 04:17:22,174.174 INFO:teuthology.orchestra.console:Power off smithi161
2023-02-12T04:17:33.592 INFO:teuthology.kill:2023-02-12 04:17:33,592.592 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-02-12T04:17:33.693 INFO:teuthology.kill:2023-02-12 04:17:33,692.692 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2023-02-12T04:17:33.738 INFO:teuthology.kill:2023-02-12 04:17:33,737.737 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2023-02-12T04:17:33.832 INFO:teuthology.kill:2023-02-12 04:17:33,832.832 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com
2023-02-12T04:19:34.652 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-02-12T04:19:34.914 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi100 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7161070
2023-02-12T04:19:34.915 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi161 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7161070