2022-12-23T02:04:05.883 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-23T02:04:06.077 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2022-12-23T02:04:06.077 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2022-12-23T02:04:06.078 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-12-23T02:04:06.102 INFO:teuthology.lock.ops:Node 'smithi133.front.sepia.ceph.com' reimaging is complete 2022-12-23T02:04:06.102 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2022-12-23T02:04:06.102 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2022-12-23T02:04:06.102 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2022-12-23T02:04:06.127 INFO:teuthology.lock.ops:Node 'smithi148.front.sepia.ceph.com' reimaging is complete 2022-12-23T02:04:06.331 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 20.04 2022-12-23T02:04:06.333 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 20.04 2022-12-23T02:04:06.604 INFO:teuthology.orchestra.console:Power off smithi148 2022-12-23T02:04:06.637 INFO:teuthology.orchestra.console:Power off smithi133 2022-12-23T02:04:19.139 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2022-12-23T02:04:19.148 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-12-23T02:04:19.240 INFO:teuthology.orchestra.console:Power on smithi148 2022-12-23T02:04:19.250 INFO:teuthology.orchestra.console:Power on smithi133 2022-12-23T02:04:23.524 INFO:teuthology.orchestra.console:Power on for smithi133 completed 2022-12-23T02:04:23.642 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2022-12-23T02:04:27.634 INFO:teuthology.orchestra.console:Power on for smithi148 completed 2022-12-23T02:04:27.735 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2022-12-23T02:08:13.159 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.133 2022-12-23T02:08:17.163 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148 2022-12-23T02:08:22.215 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.133 2022-12-23T02:08:26.215 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148 2022-12-23T02:08:31.271 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.133 2022-12-23T02:08:35.271 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148 2022-12-23T02:08:40.327 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.133 2022-12-23T02:08:44.327 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148 2022-12-23T02:08:49.387 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.133 2022-12-23T02:08:53.387 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148 2022-12-23T02:08:58.475 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.133 2022-12-23T02:09:02.439 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148 2022-12-23T02:09:37.561 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-23T02:09:58.770 INFO:teuthology.provision.fog.smithi133:Node is ready 2022-12-23T02:09:58.778 INFO:teuthology.orchestra.run.smithi133.stdout:smithi129 2022-12-23T02:09:58.784 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.129 smithi129 smithi129 2022-12-23T02:09:58.959 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2022-12-23T02:10:08.455 WARNING:teuthology.provision.fog:timed out 2022-12-23T02:10:14.676 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-23T02:10:15.226 INFO:teuthology.provision.fog.smithi148:Node is ready 2022-12-23T02:10:15.274 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2022-12-23T02:10:15.286 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2022-12-23T02:10:15.502 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2022-12-23T02:10:15.825 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2022-12-23T02:10:15.825 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2022-12-23T02:10:15.828 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2022-12-23T02:10:15.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-12-23T02:10:16.100 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2022-12-23T02:10:16.106 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2022-12-23T02:10:16.107 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-12-23T02:10:16.107 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2022-12-23T02:10:16.107 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2022-12-23T02:10:16.107 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-12-23T02:10:16.108 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2022-12-23T02:10:16.108 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2022-12-23T02:10:16.108 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-12-23T02:10:16.108 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-12-23T02:10:16.108 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-12-23T02:10:16.108 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2022-12-23T02:10:16.109 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2022-12-23T02:10:16.110 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-12-23T02:10:16.140 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2022-12-23T02:10:16.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2022-12-23T02:10:16.324 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2022-12-23T02:10:16.352 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2022-12-23T02:10:16.352 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-12-23T02:10:16.352 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2022-12-23T02:10:16.352 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2022-12-23T02:10:16.352 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-12-23T02:10:16.352 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="20.04" 2022-12-23T02:10:16.352 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2022-12-23T02:10:16.353 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-12-23T02:10:16.353 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-12-23T02:10:16.353 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-12-23T02:10:16.353 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=focal 2022-12-23T02:10:16.353 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=focal 2022-12-23T02:10:16.353 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2022-12-23T02:10:16.490 INFO:teuthology.dispatcher.supervisor:Running job 7125276 2022-12-23T02:10:16.491 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2022-12-22_17:58:01-rados-wip-ksirivad-testing-pacific-distro-default-smithi/7125276 --name ksirivad-2022-12-22_17:58:01-rados-wip-ksirivad-testing-pacific-distro-default-smithi --description rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/pool-create-delete} -- /home/teuthworker/archive/ksirivad-2022-12-22_17:58:01-rados-wip-ksirivad-testing-pacific-distro-default-smithi/7125276/orig.config.yaml 2022-12-23T02:10:16.498 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2022-12-22_17:58:01-rados-wip-ksirivad-testing-pacific-distro-default-smithi/7125276 2022-12-23T02:10:16.498 INFO:teuthology.dispatcher.supervisor:Job PID: 17602 2022-12-23T02:10:16.499 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-12-23T14:11:08.776 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-12-23T14:11:08.896 INFO:teuthology.kill:Killing Pids: {17602} 2022-12-23T14:11:09.639 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2022-12-23T14:11:09.639 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2022-12-23T14:11:09.640 INFO:teuthology.misc:Compressing logs... 2022-12-23T14:11:09.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-12-23T14:11:09.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2022-12-23T14:11:10.058 INFO:teuthology.misc:Compressing logs... 2022-12-23T14:11:10.180 INFO:teuthology.misc:Compressing logs... 2022-12-23T14:11:15.658 INFO:teuthology.kill:No teuthology processes running 2022-12-23T14:11:16.371 INFO:teuthology.kill:Nuking machines: ['smithi133', 'smithi148'] 2022-12-23T14:11:16.953 INFO:teuthology.kill:2022-12-23 14:11:16,953.953 INFO:teuthology.nuke:targets: 2022-12-23T14:11:16.954 INFO:teuthology.kill: smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= 2022-12-23T14:11:16.954 INFO:teuthology.kill: smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= 2022-12-23T14:11:16.954 INFO:teuthology.kill:2022-12-23 14:11:16,953.953 INFO:teuthology.nuke:Checking targets against current locks 2022-12-23T14:11:17.005 INFO:teuthology.kill:2022-12-23 14:11:17,005.005 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-12-23T14:11:17.033 INFO:teuthology.kill:2022-12-23 14:11:17,033.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-12-23T14:11:17.083 INFO:teuthology.kill:2022-12-23 14:11:17,083.083 INFO:teuthology.orchestra.console:Power off smithi133 2022-12-23T14:11:17.120 INFO:teuthology.kill:2022-12-23 14:11:17,120.120 INFO:teuthology.orchestra.console:Power off smithi148 2022-12-23T14:11:25.455 INFO:teuthology.kill:2022-12-23 14:11:25,455.455 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-12-23T14:11:25.602 INFO:teuthology.kill:2022-12-23 14:11:25,602.602 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2022-12-23T14:11:29.590 INFO:teuthology.kill:2022-12-23 14:11:29,590.590 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2022-12-23T14:11:29.736 INFO:teuthology.kill:2022-12-23 14:11:29,736.736 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2022-12-23T14:13:29.995 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15