2022-09-06T04:55:54.520 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-06T04:55:54.664 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2022-09-06T04:55:54.665 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2022-09-06T04:55:54.665 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-09-06T04:55:54.685 INFO:teuthology.lock.ops:Node 'smithi107.front.sepia.ceph.com' reimaging is complete 2022-09-06T04:55:54.685 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2022-09-06T04:55:54.686 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2022-09-06T04:55:54.686 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2022-09-06T04:55:54.709 INFO:teuthology.lock.ops:Node 'smithi187.front.sepia.ceph.com' reimaging is complete 2022-09-06T04:55:54.905 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 20.04 2022-09-06T04:55:54.995 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of ubuntu 20.04 2022-09-06T04:55:55.341 INFO:teuthology.orchestra.console:Power off smithi107 2022-09-06T04:55:55.356 INFO:teuthology.orchestra.console:Power off smithi187 2022-09-06T04:56:07.827 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-09-06T04:56:07.833 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2022-09-06T04:56:07.929 INFO:teuthology.orchestra.console:Power on smithi107 2022-09-06T04:56:07.938 INFO:teuthology.orchestra.console:Power on smithi187 2022-09-06T04:56:12.184 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2022-09-06T04:56:12.188 INFO:teuthology.orchestra.console:Power on for smithi187 completed 2022-09-06T04:56:12.285 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2022-09-06T04:56:12.289 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2022-09-06T05:01:12.879 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-06T05:01:13.384 INFO:teuthology.provision.fog.smithi187:Node is ready 2022-09-06T05:01:13.392 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2022-09-06T05:01:13.400 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2022-09-06T05:01:13.630 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2022-09-06T05:01:30.889 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-06T05:01:31.407 INFO:teuthology.provision.fog.smithi107:Node is ready 2022-09-06T05:01:31.454 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2022-09-06T05:01:31.462 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2022-09-06T05:01:31.612 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2022-09-06T05:01:31.879 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2022-09-06T05:01:31.880 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-06T05:01:31.906 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2022-09-06T05:01:31.906 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-06T05:01:31.927 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2022-09-06T05:01:31.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-09-06T05:01:32.202 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2022-09-06T05:01:32.209 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2022-09-06T05:01:32.209 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-09-06T05:01:32.210 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2022-09-06T05:01:32.210 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2022-09-06T05:01:32.210 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-09-06T05:01:32.210 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="20.04" 2022-09-06T05:01:32.211 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2022-09-06T05:01:32.211 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-09-06T05:01:32.211 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-09-06T05:01:32.211 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-09-06T05:01:32.211 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=focal 2022-09-06T05:01:32.212 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=focal 2022-09-06T05:01:32.213 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-09-06T05:01:32.236 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2022-09-06T05:01:32.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2022-09-06T05:01:32.512 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2022-09-06T05:01:32.519 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2022-09-06T05:01:32.519 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-09-06T05:01:32.520 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2022-09-06T05:01:32.520 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2022-09-06T05:01:32.520 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-09-06T05:01:32.520 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="20.04" 2022-09-06T05:01:32.521 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2022-09-06T05:01:32.521 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-09-06T05:01:32.521 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-09-06T05:01:32.521 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-09-06T05:01:32.522 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=focal 2022-09-06T05:01:32.522 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=focal 2022-09-06T05:01:32.523 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2022-09-06T05:01:32.644 INFO:teuthology.dispatcher.supervisor:Running job 7011161 2022-09-06T05:01:32.644 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-09-04_20:55:20-rados-WIP_GBH_snap_mapper_one_wayX1-distro-default-smithi/7011161 --name benhanokh-2022-09-04_20:55:20-rados-WIP_GBH_snap_mapper_one_wayX1-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/benhanokh-2022-09-04_20:55:20-rados-WIP_GBH_snap_mapper_one_wayX1-distro-default-smithi/7011161/orig.config.yaml 2022-09-06T05:01:32.653 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-09-04_20:55:20-rados-WIP_GBH_snap_mapper_one_wayX1-distro-default-smithi/7011161 2022-09-06T05:01:32.654 INFO:teuthology.dispatcher.supervisor:Job PID: 10549 2022-09-06T05:01:32.654 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-06T17:01:55.469 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-06T17:01:55.668 INFO:teuthology.kill:Killing Pids: {10549} 2022-09-06T17:01:57.347 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-09-06T17:01:57.348 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-09-06T17:01:57.349 INFO:teuthology.misc:Compressing logs... 2022-09-06T17:01:57.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-09-06T17:01:57.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2022-09-06T17:01:58.176 INFO:teuthology.misc:Compressing logs... 2022-09-06T17:07:19.227 INFO:teuthology.misc:Compressing logs... 2022-09-06T17:07:23.489 INFO:teuthology.kill:No teuthology processes running 2022-09-06T17:07:24.862 INFO:teuthology.kill:Nuking machines: ['smithi107', 'smithi187'] 2022-09-06T17:07:26.035 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-06T17:07:26.036 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-06T17:07:26.037 INFO:teuthology.kill:2022-09-06 17:07:26,035.035 INFO:teuthology.nuke:targets: 2022-09-06T17:07:26.037 INFO:teuthology.kill: smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDV+Wo856N8J4aN9cKGFaLnbQZiA20wgT2VA+ehE9X0j1wX6aqrS6l7Ag7S3N1MtCk2zzYdE14rGEoPpnVo0ec6fUWeRASQlpSkOg7sbCxXpfBL2D9/t9jf71FMYDSOjFXbklPsSwz2SnHnRwFuzfjBXzF24fTGE6T1S6oxVRleG8HEowztaRbuXi4gVz/zQodj14zaM1/enOhHQSyzk6p5oALOsPeiGohZ1XEANeX8tbRArw6hyNz51Zi1zPa4W8lR1fCj0i3z6oid1hHVY/5CvokqByK673rVGCjaTrvT7iUkl5lmZFtROXCYCh6YoFNePMs53SoLum4GheASkdZf89ARnkk/iczzypZ1hi/X+B3UXBimSf/xGaiBntNSXiHaFc3jGIuhukr4c8Srm3YS5P94CdnInuVVYdSPJk1Yc34ZYNmRmlQyNBKXh0TZG0sa+CRPw2+h/rHGwK45CdvCgZUTbXcQMF2cIa8faEIVHhiTPP/NSBl97y7lFet5bZ8= 2022-09-06T17:07:26.037 INFO:teuthology.kill: smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiLMQIaCZWYEIPdv45QaKEjrT7ylkgH4jKNWdmGGnGzp6AajC4uI7/Lr5IKXivkOog6pNIxkFh0fMH+bQxetPuB/jHiwM6UNm60OCnOJgPPBKk9fLpB4YkeAElVJe1oEFlWy9XtyDdlGKJfs+6ayVGMcHJaG0ISlq83c31CovG0TqSora/0/+4wbnSX27Wl1fPpyqsoCy08wtjBY0NcK0V+hfAW1FtSAVWqFuuuQJcs9DponTVrEBEeLQCRGH5+8bAnQIXKViWzAUO0cFBxx5t+w8h1ztqP9SfScFQwpz3+GuvbA4OglOtZtfJA+fFwOmg+B2baumvSCQeTcG5Fcb8lZvfvCg8F57cqxiwEccSuctldovdgKNryz4WzH1UblDijo5TmnnOtWhvdakszRj6+9vsY0ZjJLoV0U1vxZDnS4CUYpN9gog4bDNgfC5hNB8sI5ORc0wyPdezwyYLAbvGisY2D6V2rRUTV3jzgm5c8im3NDFeQQD9paHWVp2mxtU= 2022-09-06T17:07:26.038 INFO:teuthology.kill:2022-09-06 17:07:26,035.035 INFO:teuthology.nuke:Checking targets against current locks 2022-09-06T17:07:26.090 INFO:teuthology.kill:2022-09-06 17:07:26,090.090 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-06T17:07:26.114 INFO:teuthology.kill:2022-09-06 17:07:26,113.113 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-06T17:07:26.171 INFO:teuthology.kill:2022-09-06 17:07:26,171.171 INFO:teuthology.orchestra.console:Power off smithi107 2022-09-06T17:07:26.209 INFO:teuthology.kill:2022-09-06 17:07:26,209.209 INFO:teuthology.orchestra.console:Power off smithi187 2022-09-06T17:07:34.547 INFO:teuthology.kill:2022-09-06 17:07:34,546.546 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-09-06T17:07:34.708 INFO:teuthology.kill:2022-09-06 17:07:34,707.707 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2022-09-06T17:07:38.690 INFO:teuthology.kill:2022-09-06 17:07:38,690.690 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2022-09-06T17:07:38.850 INFO:teuthology.kill:2022-09-06 17:07:38,850.850 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com 2022-09-06T17:09:39.230 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-06T17:09:39.341 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi107 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-09-06_14:56:45-fs:workload-wip-pdonnell-testing-20220901.192929-distro-default-smithi/7014319 2022-09-06T17:09:39.341 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi187 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-09-06_14:56:45-fs:workload-wip-pdonnell-testing-20220901.192929-distro-default-smithi/7014320