2022-10-29T04:38:43.102 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-29T04:38:43.224 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2022-10-29T04:38:43.226 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2022-10-29T04:38:43.227 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-10-29T04:38:43.246 INFO:teuthology.lock.ops:Node 'smithi050.front.sepia.ceph.com' reimaging is complete 2022-10-29T04:38:43.247 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2022-10-29T04:38:43.247 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2022-10-29T04:38:43.247 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-10-29T04:38:43.266 INFO:teuthology.lock.ops:Node 'smithi107.front.sepia.ceph.com' reimaging is complete 2022-10-29T04:38:43.459 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of ubuntu 20.04 2022-10-29T04:38:43.502 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 20.04 2022-10-29T04:38:43.783 INFO:teuthology.orchestra.console:Power off smithi050 2022-10-29T04:38:43.823 INFO:teuthology.orchestra.console:Power off smithi107 2022-10-29T04:38:43.931 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-10-29T04:38:43.960 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-10-29T04:38:44.033 INFO:teuthology.orchestra.console:Power on smithi050 2022-10-29T04:38:44.061 INFO:teuthology.orchestra.console:Power on smithi107 2022-10-29T04:38:52.395 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2022-10-29T04:38:52.412 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2022-10-29T04:38:52.497 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2022-10-29T04:38:52.513 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2022-10-29T04:43:28.188 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-29T04:43:28.620 INFO:teuthology.provision.fog.smithi050:Node is ready 2022-10-29T04:43:28.626 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2022-10-29T04:43:28.634 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2022-10-29T04:43:28.806 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2022-10-29T04:43:59.945 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-29T04:44:00.395 INFO:teuthology.provision.fog.smithi107:Node is ready 2022-10-29T04:44:00.402 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2022-10-29T04:44:00.450 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2022-10-29T04:44:00.639 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2022-10-29T04:44:00.879 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2022-10-29T04:44:00.880 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-29T04:44:00.902 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2022-10-29T04:44:00.902 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-29T04:44:00.923 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2022-10-29T04:44:00.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-10-29T04:44:01.241 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2022-10-29T04:44:01.248 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2022-10-29T04:44:01.248 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-29T04:44:01.248 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2022-10-29T04:44:01.249 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2022-10-29T04:44:01.249 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-29T04:44:01.249 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="20.04" 2022-10-29T04:44:01.249 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-29T04:44:01.250 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-29T04:44:01.250 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-29T04:44:01.250 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-29T04:44:01.250 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=focal 2022-10-29T04:44:01.251 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=focal 2022-10-29T04:44:01.252 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-10-29T04:44:01.280 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2022-10-29T04:44:01.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-10-29T04:44:01.497 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2022-10-29T04:44:01.502 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2022-10-29T04:44:01.502 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-29T04:44:01.502 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2022-10-29T04:44:01.503 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2022-10-29T04:44:01.503 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-29T04:44:01.503 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="20.04" 2022-10-29T04:44:01.503 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-29T04:44:01.503 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-29T04:44:01.504 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-29T04:44:01.504 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-29T04:44:01.504 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=focal 2022-10-29T04:44:01.504 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=focal 2022-10-29T04:44:01.505 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-10-29T04:44:01.601 INFO:teuthology.dispatcher.supervisor:Running job 7081001 2022-10-29T04:44:01.601 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081001 --name dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi --description rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} -- /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081001/orig.config.yaml 2022-10-29T04:44:01.605 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081001 2022-10-29T04:44:01.606 INFO:teuthology.dispatcher.supervisor:Job PID: 9736 2022-10-29T04:44:01.607 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-10-29T16:44:45.545 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-10-29T16:44:46.249 INFO:teuthology.kill:Killing Pids: {9736} 2022-10-29T16:44:47.531 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2022-10-29T16:44:47.532 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2022-10-29T16:44:47.532 INFO:teuthology.misc:Compressing logs... 2022-10-29T16:44:47.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-10-29T16:44:47.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-10-29T16:44:48.171 INFO:teuthology.kill:No teuthology processes running 2022-10-29T16:44:49.385 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi107'] 2022-10-29T16:44:50.389 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-10-29T16:44:50.390 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-10-29T16:44:50.390 INFO:teuthology.kill:2022-10-29 16:44:50,389.389 INFO:teuthology.nuke:targets: 2022-10-29T16:44:50.391 INFO:teuthology.kill: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VHW3L2kA1vN8m746Xvv9olA9jF0lE1XYFyjUwhmirEDSddGFvLZPz+XEXxnCOtgn8KFRDNAVnT6gHctm5cbPnTvRimm6F1UEYt0nc73yVpcEpgmq+gpSaywjgOv2YHDBocu6QyH676ylozSL+kUKmD9ZgHJiXJXH05y8C2DQ7YV0nmU6J/stfwjn6u5U6zb6cTjPqfiGI3c9yfiNuQRz0YMu9pjQpBtCiteWMuJ4nVBKOu660kShtsq4jp1OYGaAKc3wtx8TbSDJxd3uDyoDZZEX9BuM9OayjC/+xDAdt8iOFssbt+5Y7Zgxmc4SRyaCfKDdTiCyXD2cQbJogX4Txch5rDWaL1fpPrL9UoEEbYW3UIc3GWoXQJ+hNFxLIUb1hBb9uvR9P9+g2xAK3Vu0rqfhZrMayQnZVP2K8Y9OUufp+rU7kIAz8I/wyv8RzarAYXKPEk91MvBYWf71Xfbm28RHIvVxrUjiNDd0PyE3wKKrNGHh6jVa42z9jCxGXos= 2022-10-29T16:44:50.391 INFO:teuthology.kill: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBALjz2/6TBm43zwkJ4SbenNi6sxCWqAw/lcGDK4LPIQb/aD4YTDZ/lmnnEW9bUlgHbjNJsLrPTjBRZknmuBpRzU= 2022-10-29T16:44:50.391 INFO:teuthology.kill:2022-10-29 16:44:50,389.389 INFO:teuthology.nuke:Checking targets against current locks 2022-10-29T16:44:50.438 INFO:teuthology.kill:2022-10-29 16:44:50,437.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-29T16:44:50.463 INFO:teuthology.kill:2022-10-29 16:44:50,463.463 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-29T16:44:50.508 INFO:teuthology.kill:2022-10-29 16:44:50,508.508 INFO:teuthology.orchestra.console:Power off smithi050 2022-10-29T16:44:50.544 INFO:teuthology.kill:2022-10-29 16:44:50,544.544 INFO:teuthology.orchestra.console:Power off smithi107 2022-10-29T16:44:58.879 INFO:teuthology.kill:2022-10-29 16:44:58,879.879 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-10-29T16:44:59.027 INFO:teuthology.kill:2022-10-29 16:44:59,026.026 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2022-10-29T16:45:03.015 INFO:teuthology.kill:2022-10-29 16:45:03,015.015 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-10-29T16:45:03.163 INFO:teuthology.kill:2022-10-29 16:45:03,163.163 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2022-10-29T16:47:03.400 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-10-29T16:47:03.506 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081042 2022-10-29T16:47:03.507 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi107 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/7081041