2023-01-12T00:57:44.524 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-12T00:57:44.657 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-01-12T00:57:44.658 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-01-12T00:57:44.659 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-01-12T00:57:44.679 INFO:teuthology.lock.ops:Node 'smithi073.front.sepia.ceph.com' reimaging is complete 2023-01-12T00:57:44.679 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-01-12T00:57:44.680 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-01-12T00:57:44.680 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-01-12T00:57:44.695 INFO:teuthology.lock.ops:Node 'smithi110.front.sepia.ceph.com' reimaging is complete 2023-01-12T00:57:44.835 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of ubuntu 20.04 2023-01-12T00:57:44.849 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of ubuntu 20.04 2023-01-12T00:57:51.196 INFO:teuthology.orchestra.console:Power off smithi110 2023-01-12T00:57:51.211 INFO:teuthology.orchestra.console:Power off smithi073 2023-01-12T00:58:06.524 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-01-12T00:58:06.626 INFO:teuthology.orchestra.console:Power on smithi110 2023-01-12T00:58:31.253 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-01-12T00:58:31.354 INFO:teuthology.orchestra.console:Power on smithi073 2023-01-12T00:58:49.949 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2023-01-12T00:58:50.050 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-01-12T00:59:02.933 INFO:teuthology.orchestra.console:Power on for smithi110 completed 2023-01-12T00:59:03.035 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-01-12T01:02:24.462 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-01-12T01:02:33.552 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-01-12T01:02:42.892 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-01-12T01:02:43.148 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-01-12T01:02:54.153 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-01-12T01:02:57.228 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-01-12T01:03:06.284 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-01-12T01:03:33.023 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-12T01:03:35.632 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-01-12T01:03:45.009 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-12T01:03:48.570 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-01-12T01:03:48.577 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-01-12T01:03:48.627 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-01-12T01:03:48.807 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-01-12T01:04:06.098 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-01-12T01:04:06.105 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2023-01-12T01:04:06.113 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2023-01-12T01:04:06.267 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-01-12T01:04:11.556 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2023-01-12T01:04:11.557 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-12T01:04:16.578 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-01-12T01:04:16.578 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-12T01:04:21.222 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2023-01-12T01:04:21.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-01-12T01:04:21.403 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-01-12T01:04:21.410 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2023-01-12T01:04:21.410 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-12T01:04:21.410 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2023-01-12T01:04:21.410 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2023-01-12T01:04:21.411 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-12T01:04:21.411 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="20.04" 2023-01-12T01:04:21.411 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-12T01:04:21.411 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-12T01:04:21.412 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-12T01:04:21.412 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-12T01:04:21.412 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=focal 2023-01-12T01:04:21.412 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=focal 2023-01-12T01:04:21.413 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-01-12T01:04:21.428 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-01-12T01:04:21.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-01-12T01:04:21.687 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-01-12T01:04:21.694 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2023-01-12T01:04:21.694 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-12T01:04:21.694 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2023-01-12T01:04:21.695 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2023-01-12T01:04:21.695 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-12T01:04:21.695 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="20.04" 2023-01-12T01:04:21.696 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-12T01:04:21.696 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-12T01:04:21.696 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-12T01:04:21.696 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-12T01:04:21.696 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=focal 2023-01-12T01:04:21.697 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=focal 2023-01-12T01:04:21.697 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-01-12T01:04:21.784 INFO:teuthology.dispatcher.supervisor:Running job 7133980 2023-01-12T01:04:21.784 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-01-11_21:27:51-rados-wip-yuri2-testing-2023-01-11-0819-distro-default-smithi/7133980 --name yuriw-2023-01-11_21:27:51-rados-wip-yuri2-testing-2023-01-11-0819-distro-default-smithi --description rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} -- /home/teuthworker/archive/yuriw-2023-01-11_21:27:51-rados-wip-yuri2-testing-2023-01-11-0819-distro-default-smithi/7133980/orig.config.yaml 2023-01-12T01:04:21.789 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-01-11_21:27:51-rados-wip-yuri2-testing-2023-01-11-0819-distro-default-smithi/7133980 2023-01-12T01:04:21.790 INFO:teuthology.dispatcher.supervisor:Job PID: 697 2023-01-12T01:04:21.790 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-01-12T13:06:02.048 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-01-12T13:06:02.218 INFO:teuthology.kill:Killing Pids: {697} 2023-01-12T13:06:03.321 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2023-01-12T13:06:03.322 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2023-01-12T13:06:03.323 INFO:teuthology.misc:Compressing logs... 2023-01-12T13:06:03.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-01-12T13:06:03.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-01-12T13:06:03.834 INFO:teuthology.misc:Compressing logs... 2023-01-12T13:06:03.991 INFO:teuthology.misc:Compressing logs... 2023-01-12T13:06:26.227 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/ceph-client.admin.31794.log: file size changed while zipping 2023-01-12T13:07:44.064 INFO:teuthology.kill:No teuthology processes running 2023-01-12T13:07:45.677 INFO:teuthology.kill:Nuking machines: ['smithi073', 'smithi110'] 2023-01-12T13:07:46.407 INFO:teuthology.kill:2023-01-12 13:07:46,407.407 INFO:teuthology.nuke:targets: 2023-01-12T13:07:46.408 INFO:teuthology.kill: smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= 2023-01-12T13:07:46.409 INFO:teuthology.kill: smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= 2023-01-12T13:07:46.409 INFO:teuthology.kill:2023-01-12 13:07:46,407.407 INFO:teuthology.nuke:Checking targets against current locks 2023-01-12T13:07:46.463 INFO:teuthology.kill:2023-01-12 13:07:46,463.463 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-12T13:07:46.492 INFO:teuthology.kill:2023-01-12 13:07:46,491.491 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-12T13:07:46.599 INFO:teuthology.kill:2023-01-12 13:07:46,598.598 INFO:teuthology.orchestra.console:Power off smithi110 2023-01-12T13:07:49.337 INFO:teuthology.kill:2023-01-12 13:07:49,337.337 INFO:teuthology.orchestra.console:Power off smithi073 2023-01-12T13:07:55.000 INFO:teuthology.kill:2023-01-12 13:07:54,999.999 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-01-12T13:07:55.149 INFO:teuthology.kill:2023-01-12 13:07:55,148.148 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2023-01-12T13:08:01.821 INFO:teuthology.kill:2023-01-12 13:08:01,820.820 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-01-12T13:08:01.983 INFO:teuthology.kill:2023-01-12 13:08:01,983.983 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2023-01-12T13:10:06.714 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15