2022-08-26T17:52:28.305 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1 2022-08-26T17:52:28.457 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2022-08-26T17:52:28.460 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2022-08-26T17:52:28.461 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2022-08-26T17:52:28.492 INFO:teuthology.lock.ops:Node 'smithi033.front.sepia.ceph.com' reimaging is complete 2022-08-26T17:52:28.493 INFO:teuthology.lock.ops:Start node 'smithi197.front.sepia.ceph.com' reimaging 2022-08-26T17:52:28.493 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: reset os type and version on server 2022-08-26T17:52:28.494 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2022-08-26T17:52:28.522 INFO:teuthology.lock.ops:Node 'smithi197.front.sepia.ceph.com' reimaging is complete 2022-08-26T17:52:28.713 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 20.04 2022-08-26T17:52:28.746 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of ubuntu 20.04 2022-08-26T17:52:29.065 INFO:teuthology.orchestra.console:Power off smithi197 2022-08-26T17:52:29.084 INFO:teuthology.orchestra.console:Power off smithi033 2022-08-26T17:52:37.454 INFO:teuthology.orchestra.console:Power off for smithi197 completed 2022-08-26T17:52:37.556 INFO:teuthology.orchestra.console:Power on smithi197 2022-08-26T17:52:41.591 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2022-08-26T17:52:41.693 INFO:teuthology.orchestra.console:Power on smithi033 2022-08-26T17:52:45.964 INFO:teuthology.orchestra.console:Power on for smithi197 completed 2022-08-26T17:52:46.065 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish 2022-08-26T17:52:50.092 INFO:teuthology.orchestra.console:Power on for smithi033 completed 2022-08-26T17:52:50.193 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2022-08-26T17:57:28.097 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-26T17:57:28.763 INFO:teuthology.provision.fog.smithi033:Node is ready 2022-08-26T17:57:28.770 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2022-08-26T17:57:28.818 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2022-08-26T17:57:29.000 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2022-08-26T17:57:46.608 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-26T17:57:47.115 INFO:teuthology.provision.fog.smithi197:Node is ready 2022-08-26T17:57:47.123 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com 2022-08-26T17:57:47.172 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197 2022-08-26T17:57:47.330 INFO:teuthology.provision.fog.smithi197:Deploy complete! 2022-08-26T17:57:47.589 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2022-08-26T17:57:47.590 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-26T17:57:47.618 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com 2022-08-26T17:57:47.618 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-26T17:57:47.643 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2022-08-26T17:57:47.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-08-26T17:57:47.958 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2022-08-26T17:57:47.965 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2022-08-26T17:57:47.965 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-08-26T17:57:47.965 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2022-08-26T17:57:47.966 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2022-08-26T17:57:47.966 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-08-26T17:57:47.966 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="20.04" 2022-08-26T17:57:47.966 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2022-08-26T17:57:47.967 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-08-26T17:57:47.967 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-08-26T17:57:47.967 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-08-26T17:57:47.967 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=focal 2022-08-26T17:57:47.968 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=focal 2022-08-26T17:57:47.969 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2022-08-26T17:57:47.991 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server 2022-08-26T17:57:47.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com' 2022-08-26T17:57:48.214 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64 2022-08-26T17:57:48.221 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="Ubuntu" 2022-08-26T17:57:48.221 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-08-26T17:57:48.222 INFO:teuthology.orchestra.run.smithi197.stdout:ID=ubuntu 2022-08-26T17:57:48.222 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE=debian 2022-08-26T17:57:48.222 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-08-26T17:57:48.222 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="20.04" 2022-08-26T17:57:48.223 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.ubuntu.com/" 2022-08-26T17:57:48.223 INFO:teuthology.orchestra.run.smithi197.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-08-26T17:57:48.223 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-08-26T17:57:48.223 INFO:teuthology.orchestra.run.smithi197.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-08-26T17:57:48.223 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_CODENAME=focal 2022-08-26T17:57:48.224 INFO:teuthology.orchestra.run.smithi197.stdout:UBUNTU_CODENAME=focal 2022-08-26T17:57:48.224 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2022-08-26T17:57:48.351 INFO:teuthology.dispatcher.supervisor:Running job 6993077 2022-08-26T17:57:48.352 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-08-25_18:36:20-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/6993077 --name benhanokh-2022-08-25_18:36:20-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} -- /home/teuthworker/archive/benhanokh-2022-08-25_18:36:20-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/6993077/orig.config.yaml 2022-08-26T17:57:48.356 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-08-25_18:36:20-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/6993077 2022-08-26T17:57:48.358 INFO:teuthology.dispatcher.supervisor:Job PID: 13854 2022-08-26T17:57:48.358 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-08-27T05:58:48.932 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-08-27T05:58:49.596 INFO:teuthology.kill:Killing Pids: {13854} 2022-08-27T05:58:55.470 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-08-27T05:58:55.471 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-08-27T05:58:55.472 INFO:teuthology.misc:Compressing logs... 2022-08-27T05:58:55.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-08-27T05:58:56.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com' 2022-08-27T05:58:56.952 INFO:teuthology.misc:Compressing logs... 2022-08-27T05:59:55.695 INFO:teuthology.misc:Compressing logs... 2022-08-27T06:00:05.444 INFO:teuthology.kill:No teuthology processes running 2022-08-27T06:00:10.880 INFO:teuthology.kill:Nuking machines: ['smithi033', 'smithi197'] 2022-08-27T06:00:17.041 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-08-27T06:00:17.058 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-08-27T06:00:17.058 INFO:teuthology.kill:2022-08-27 06:00:17,040.040 INFO:teuthology.nuke:targets: 2022-08-27T06:00:17.059 INFO:teuthology.kill: smithi033.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCX389jOHoo5dTUf5xL97SSx3S/muxmvgqnoPhKRzH/HqyTVQG4BFjSv8o9UIcAygIoDUN6N1lDcdqucFinBafRZDUgi/6WsNBjYYUdDffEyMSNLqFxoMsSmTfuLduOIkg119Tq7VRAtjl2XT6mSfIUA5ytUlEbQMxcbiRsTgiAafyU4yHrJVHnMeBq71jcRedCt+h+TA0Nca/oQh2F1vIOGKsVRDhpq0l4cPalDTZrMC9scfC5jFOb+WtttDUS0nmcAHoYLcayUvrhwYNqUt2pJnudDxx7iSZOLUxUT4bfz4/oO/HlAU8lik6WADwncZTtFXlMffZM/wKJ1KIIHpL52cpuT2cYQvBTw/T3HD0FJP+i+2YbJBkKc39qAjqzIWp/Qh7f5E0tieR9r+n1L4xR6jzzw4JzUg9w5gyB0EfMDIO7gjLrDQSmiChIWsF10jK21pH813qoYxb7mU3l0cwJG+FLCWRLFK2IL4tav4uYf6zZATYGVjf4Ne9CGsBcBN8= 2022-08-27T06:00:17.059 INFO:teuthology.kill: smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC24tbPFeSNeZBofEhBcnimiw6HGlFmUsnX+ZRewlw3sRw7791vn00GOl/5zLvSDLPEWg12o0hQMnsCfqNPSmDMKslsuCXQwZHLMcgk+OIxxCUVw6YunbU3ifMGyv/XkSxgXPQv7r7J/zxB60V656e0UGJfZ+zMJ9ChdhiTj69Tcphjh3jCScRtcWrpupnOB6LLa2pfb0d2MQx8c4eTUsLi2TX/YupAYR1jK5XsAt9pv2yE36Mz3Xkxcyau5bvw5SRTKg6mJPrl3/U5f1upHuy6Y+FORazRNe/fAotKhkeiQ7IixzER8+OI0Gg7ztyt9xN06NGvW0ZseAPC/r99uVA1rSbemITotpDv5xjDxNa1ebRd8+XvvhQpnUHZKUB2lLA3jm5XvzFNIA7R0bj5eTMqeCNesTIDeXra2CC7nPRQmLAaD2inkP7RzGTAoQacciwMJ+rNSgp129jrOFDj/ssg+OhUcZiRWMw2LAPQsZPONbA8xNOdizOtldEGAK2tg08= 2022-08-27T06:00:17.060 INFO:teuthology.kill:2022-08-27 06:00:17,041.041 INFO:teuthology.nuke:Checking targets against current locks 2022-08-27T06:00:17.155 INFO:teuthology.kill:2022-08-27 06:00:17,150.150 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-27T06:00:17.232 INFO:teuthology.kill:2022-08-27 06:00:17,228.228 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-27T06:00:17.322 INFO:teuthology.kill:2022-08-27 06:00:17,316.316 INFO:teuthology.orchestra.console:Power off smithi033 2022-08-27T06:00:17.454 INFO:teuthology.kill:2022-08-27 06:00:17,451.451 INFO:teuthology.orchestra.console:Power off smithi197 2022-08-27T06:00:25.864 INFO:teuthology.kill:2022-08-27 06:00:25,855.855 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2022-08-27T06:00:26.066 INFO:teuthology.kill:2022-08-27 06:00:26,053.053 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2022-08-27T06:00:30.160 INFO:teuthology.kill:2022-08-27 06:00:30,159.159 INFO:teuthology.orchestra.console:Power off for smithi197 completed 2022-08-27T06:00:30.366 INFO:teuthology.kill:2022-08-27 06:00:30,363.363 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com 2022-08-27T06:02:31.413 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-08-27T06:02:31.698 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi033 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-08-22_02:01:03-rbd-quincy-distro-default-smithi/6984566 2022-08-27T06:02:31.699 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi197 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-08-22_02:01:03-rbd-quincy-distro-default-smithi/6984566