2022-09-04T01:17:39.990 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-04T01:17:40.160 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2022-09-04T01:17:40.161 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2022-09-04T01:17:40.162 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2022-09-04T01:17:40.186 INFO:teuthology.lock.ops:Node 'smithi040.front.sepia.ceph.com' reimaging is complete 2022-09-04T01:17:40.186 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2022-09-04T01:17:40.187 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2022-09-04T01:17:40.187 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2022-09-04T01:17:40.212 INFO:teuthology.lock.ops:Node 'smithi059.front.sepia.ceph.com' reimaging is complete 2022-09-04T01:17:40.415 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of ubuntu 20.04 2022-09-04T01:17:40.443 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of ubuntu 20.04 2022-09-04T01:17:40.764 INFO:teuthology.orchestra.console:Power off smithi040 2022-09-04T01:17:40.781 INFO:teuthology.orchestra.console:Power off smithi059 2022-09-04T01:17:49.143 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2022-09-04T01:17:49.245 INFO:teuthology.orchestra.console:Power on smithi040 2022-09-04T01:17:53.261 INFO:teuthology.orchestra.console:Power off for smithi059 completed 2022-09-04T01:17:53.362 INFO:teuthology.orchestra.console:Power on smithi059 2022-09-04T01:17:57.617 INFO:teuthology.orchestra.console:Power on for smithi040 completed 2022-09-04T01:17:57.718 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2022-09-04T01:18:01.736 INFO:teuthology.orchestra.console:Power on for smithi059 completed 2022-09-04T01:18:01.838 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2022-09-04T01:22:35.432 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-04T01:22:36.056 INFO:teuthology.provision.fog.smithi040:Node is ready 2022-09-04T01:22:36.064 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2022-09-04T01:22:36.073 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2022-09-04T01:22:36.263 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2022-09-04T01:22:39.362 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-04T01:22:39.921 INFO:teuthology.provision.fog.smithi059:Node is ready 2022-09-04T01:22:39.974 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2022-09-04T01:22:39.981 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2022-09-04T01:22:40.171 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2022-09-04T01:22:40.450 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2022-09-04T01:22:40.451 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-04T01:22:40.477 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2022-09-04T01:22:40.477 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-04T01:22:40.498 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2022-09-04T01:22:40.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2022-09-04T01:22:40.738 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2022-09-04T01:22:40.787 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2022-09-04T01:22:40.787 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-09-04T01:22:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2022-09-04T01:22:40.789 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2022-09-04T01:22:40.789 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-09-04T01:22:40.790 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="20.04" 2022-09-04T01:22:40.791 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2022-09-04T01:22:40.791 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-09-04T01:22:40.792 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-09-04T01:22:40.792 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-09-04T01:22:40.793 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=focal 2022-09-04T01:22:40.793 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=focal 2022-09-04T01:22:40.796 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2022-09-04T01:22:40.818 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2022-09-04T01:22:40.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-09-04T01:22:41.083 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2022-09-04T01:22:41.089 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2022-09-04T01:22:41.090 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-09-04T01:22:41.090 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2022-09-04T01:22:41.091 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2022-09-04T01:22:41.091 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-09-04T01:22:41.092 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="20.04" 2022-09-04T01:22:41.092 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2022-09-04T01:22:41.093 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-09-04T01:22:41.095 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-09-04T01:22:41.096 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-09-04T01:22:41.096 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=focal 2022-09-04T01:22:41.096 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=focal 2022-09-04T01:22:41.097 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2022-09-04T01:22:41.213 INFO:teuthology.dispatcher.supervisor:Running job 7004449 2022-09-04T01:22:41.214 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004449 --name benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} -- /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004449/orig.config.yaml 2022-09-04T01:22:41.218 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004449 2022-09-04T01:22:41.220 INFO:teuthology.dispatcher.supervisor:Job PID: 4780 2022-09-04T01:22:41.220 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-04T13:23:39.443 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-04T13:23:39.601 INFO:teuthology.kill:Killing Pids: {4780} 2022-09-04T13:23:41.027 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-09-04T13:23:41.028 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-09-04T13:23:41.029 INFO:teuthology.misc:Compressing logs... 2022-09-04T13:23:41.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2022-09-04T13:23:41.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-09-04T13:23:41.878 INFO:teuthology.misc:Compressing logs... 2022-09-04T13:26:21.265 INFO:teuthology.misc:Compressing logs... 2022-09-04T13:26:28.750 INFO:teuthology.kill:No teuthology processes running 2022-09-04T13:26:30.144 INFO:teuthology.kill:Nuking machines: ['smithi040', 'smithi059'] 2022-09-04T13:26:31.341 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-04T13:26:31.342 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-04T13:26:31.342 INFO:teuthology.kill:2022-09-04 13:26:31,341.341 INFO:teuthology.nuke:targets: 2022-09-04T13:26:31.342 INFO:teuthology.kill: smithi040.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDymsjqNhWNUcZqNvyGuZefNwWNaX0VdoSpNvS/WQwGqGCRFUIJ4oATpAIUxS4r66dO1lvSAGKyNBkjMeTXPbD/v51if0OM/VXSFVkRGOe7plk/rz+QwgjIsZvoEf+K8KnYSMKcPX6EJn6tyVvTIZPMoSCXI6P/oXNOtIg2Nc4OIncDxPMLL388f4iuzRL2Qsc9eFQWfzXK0ei7ognclQX8c73KytwMExIM9KBrS1Bu152FiHBn/YKvZ0n7LSvBCLA5edP60/nz319HZJWeRGdbGlqBnyDrLJhS+kJ4zw4rD2few0DQccC4zhdafIo8qI76nMi0WNITFhzvgqn9ZwnO1vzx7Gxqj8lpsnlkPlqI2PV08hE1oj8ihu3Dxln+21s6MDVNZ0ZGAwG0cRilu6OW8l2IoAwPPRj8tlk60g3Osbk1Y1QURu7PRV1L/qrcGXZyHDGQo7cr17jAK3h4lXbtu9nWVvcGXNVxfJ16D3ngF3GUgp4cmu+81aUoIkOFSLE= 2022-09-04T13:26:31.343 INFO:teuthology.kill: smithi059.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwEOUXUcbSYqjh/wUUvmPzQdw9pmkece3J4n/T+yzAtXpJxU9AKAFJGe6KaqLez6gG/x1VWAshPraBoBRGBhyfe+QOkPf+VyRVztuWuz1QDuXuqEQ64c/KZXaapn1G7v44v84+wfY2PDLyJpxTEIu37l26dfhZnmdjSPrxfNCMbdciDcBmMJUpYCJUWt1jfDY42BxZp/Fwq6sXduoTFg2o+d+I3z5QdTOmAaZ0clVNJAA7I4p9RQjxcod6cju3EJryYE0mCHwLmRT/dgnXU7qcO/BpDAgxt7H8k0PkCNydLdJEBuDuxCKgAdPhrZGxaiTmJ82RWtLABIATiAYffbt+3z/WcBqJBUg5WBsACm3gmcnem55j2Jx2NfPuDampeG+WwVVvNNBBHREwEeDwiM+r36envjZVco5A9N8T3RqnZn+FJxur4DsZGEQVz56OVmqewLYy4F0Nn5el5nJudwzKl/ZAcIBXh1w1Z9EfIXDjsW2WpFa61GE+3n+TwEJvHwc= 2022-09-04T13:26:31.343 INFO:teuthology.kill:2022-09-04 13:26:31,341.341 INFO:teuthology.nuke:Checking targets against current locks 2022-09-04T13:26:31.395 INFO:teuthology.kill:2022-09-04 13:26:31,395.395 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-04T13:26:31.424 INFO:teuthology.kill:2022-09-04 13:26:31,424.424 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-04T13:26:31.496 INFO:teuthology.kill:2022-09-04 13:26:31,496.496 INFO:teuthology.orchestra.console:Power off smithi040 2022-09-04T13:26:31.535 INFO:teuthology.kill:2022-09-04 13:26:31,535.535 INFO:teuthology.orchestra.console:Power off smithi059 2022-09-04T13:26:39.893 INFO:teuthology.kill:2022-09-04 13:26:39,892.892 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2022-09-04T13:26:40.046 INFO:teuthology.kill:2022-09-04 13:26:40,045.045 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2022-09-04T13:26:44.013 INFO:teuthology.kill:2022-09-04 13:26:44,012.012 INFO:teuthology.orchestra.console:Power off for smithi059 completed 2022-09-04T13:26:44.171 INFO:teuthology.kill:2022-09-04 13:26:44,170.170 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2022-09-04T13:28:44.548 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-04T13:28:44.681 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi059 but it was locked by another job: /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004623