2023-02-11T11:44:24.825 INFO:root:teuthology version: 0.0.1.dev37+g00690ec
2023-02-11T11:44:25.425 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging
2023-02-11T11:44:25.425 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server
2023-02-11T11:44:25.425 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2023-02-11T11:44:25.443 INFO:teuthology.lock.ops:Node 'smithi049.front.sepia.ceph.com' reimaging is complete
2023-02-11T11:44:25.758 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-02-11T11:44:25.758 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-02-11T11:44:25.758 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-02-11T11:44:25.784 INFO:teuthology.lock.ops:Node 'smithi203.front.sepia.ceph.com' reimaging is complete
2023-02-11T11:44:25.907 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of ubuntu 20.04
2023-02-11T11:44:25.973 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of ubuntu 20.04
2023-02-11T11:44:26.185 INFO:teuthology.orchestra.console:Power off smithi203
2023-02-11T11:44:26.312 INFO:teuthology.orchestra.console:Power off smithi049
2023-02-11T11:44:34.733 INFO:teuthology.orchestra.console:Power off for smithi203 completed
2023-02-11T11:44:34.741 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2023-02-11T11:44:34.835 INFO:teuthology.orchestra.console:Power on smithi203
2023-02-11T11:44:34.847 INFO:teuthology.orchestra.console:Power on smithi049
2023-02-11T11:44:43.212 INFO:teuthology.orchestra.console:Power on for smithi203 completed
2023-02-11T11:44:43.219 INFO:teuthology.orchestra.console:Power on for smithi049 completed
2023-02-11T11:44:43.314 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-02-11T11:44:43.320 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2023-02-11T11:49:02.854 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-02-11T11:49:11.941 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-02-11T11:49:21.001 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-02-11T11:49:30.085 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-02-11T11:49:39.141 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-02-11T11:49:48.165 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-02-11T11:49:57.225 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-02-11T11:50:06.313 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-02-11T11:50:15.397 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-02-11T11:50:24.453 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-02-11T11:50:33.513 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-02-11T11:50:42.601 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-02-11T11:50:45.149 WARNING:teuthology.provision.fog:timed out
2023-02-11T11:50:51.388 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-02-11T11:50:51.653 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-02-11T11:50:51.860 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-02-11T11:50:51.867 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2023-02-11T11:50:51.873 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-02-11T11:50:52.014 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-02-11T11:51:57.721 WARNING:teuthology.provision.fog:timed out
2023-02-11T11:52:03.925 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-02-11T11:52:04.394 INFO:teuthology.provision.fog.smithi049:Node is ready
2023-02-11T11:52:04.400 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2023-02-11T11:52:04.406 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2023-02-11T11:52:04.590 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2023-02-11T11:52:04.857 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2023-02-11T11:52:04.857 INFO:teuthology.lock.ops:New key found. Updating...
2023-02-11T11:52:04.936 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-02-11T11:52:04.937 INFO:teuthology.lock.ops:New key found. Updating...
2023-02-11T11:52:05.003 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2023-02-11T11:52:05.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2023-02-11T11:52:05.185 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2023-02-11T11:52:05.201 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu"
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="20.04"
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/"
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=focal
2023-02-11T11:52:05.202 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=focal
2023-02-11T11:52:05.203 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2023-02-11T11:52:05.222 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-02-11T11:52:05.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-02-11T11:52:05.477 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu"
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="20.04"
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/"
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-02-11T11:52:05.484 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=focal
2023-02-11T11:52:05.485 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=focal
2023-02-11T11:52:05.485 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-02-11T11:52:05.659 INFO:teuthology.dispatcher.supervisor:Running job 7160712
2023-02-11T11:52:05.659 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7160712 --name yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} -- /home/teuthworker/archive/yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7160712/orig.config.yaml
2023-02-11T11:52:05.663 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-02-08_19:43:15-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7160712
2023-02-11T11:52:05.664 INFO:teuthology.dispatcher.supervisor:Job PID: 8335
2023-02-11T11:52:05.664 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-02-11T23:53:08.613 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-02-11T23:53:13.721 INFO:teuthology.kill:Killing Pids: {8335}
2023-02-11T23:53:30.411 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2023-02-11T23:53:30.411 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2023-02-11T23:53:30.417 INFO:teuthology.misc:Compressing logs...
2023-02-11T23:53:30.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2023-02-11T23:53:33.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-02-11T23:53:34.580 INFO:teuthology.kill:No teuthology processes running
2023-02-11T23:53:36.084 INFO:teuthology.kill:Nuking machines: ['smithi049', 'smithi203']
2023-02-11T23:53:37.200 INFO:teuthology.kill:2023-02-11 23:53:37,200.200 INFO:teuthology.nuke:targets:
2023-02-11T23:53:37.201 INFO:teuthology.kill:  smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=
2023-02-11T23:53:37.201 INFO:teuthology.kill:  smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=
2023-02-11T23:53:37.201 INFO:teuthology.kill:2023-02-11 23:53:37,200.200 INFO:teuthology.nuke:Checking targets against current locks
2023-02-11T23:53:37.256 INFO:teuthology.kill:2023-02-11 23:53:37,256.256 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-02-11T23:53:37.281 INFO:teuthology.kill:2023-02-11 23:53:37,281.281 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-02-11T23:53:37.366 INFO:teuthology.kill:2023-02-11 23:53:37,366.366 INFO:teuthology.orchestra.console:Power off smithi049
2023-02-11T23:53:37.439 INFO:teuthology.kill:2023-02-11 23:53:37,439.439 INFO:teuthology.orchestra.console:Power off smithi203
2023-02-11T23:53:45.970 INFO:teuthology.kill:2023-02-11 23:53:45,969.969 INFO:teuthology.orchestra.console:Power off for smithi203 completed
2023-02-11T23:53:46.118 INFO:teuthology.kill:2023-02-11 23:53:46,118.118 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com
2023-02-11T23:53:50.087 INFO:teuthology.kill:2023-02-11 23:53:50,087.087 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2023-02-11T23:53:50.244 INFO:teuthology.kill:2023-02-11 23:53:50,243.243 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2023-02-11T23:55:50.619 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-02-11T23:55:50.852 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi049 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-02-11_16:16:51-rgw-wip-cbodley-testing-distro-default-smithi/7169667
2023-02-11T23:55:50.852 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi203 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-02-11_16:16:51-rgw-wip-cbodley-testing-distro-default-smithi/7169667