2022-09-04T01:56:47.251 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-04T01:56:47.421 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2022-09-04T01:56:47.423 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2022-09-04T01:56:47.423 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2022-09-04T01:56:47.447 INFO:teuthology.lock.ops:Node 'smithi155.front.sepia.ceph.com' reimaging is complete 2022-09-04T01:56:47.448 INFO:teuthology.lock.ops:Start node 'smithi182.front.sepia.ceph.com' reimaging 2022-09-04T01:56:47.449 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: reset os type and version on server 2022-09-04T01:56:47.449 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2022-09-04T01:56:47.475 INFO:teuthology.lock.ops:Node 'smithi182.front.sepia.ceph.com' reimaging is complete 2022-09-04T01:56:47.672 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of ubuntu 20.04 2022-09-04T01:56:47.686 INFO:teuthology.provision.fog.smithi182:Scheduling deploy of ubuntu 20.04 2022-09-04T01:56:48.049 INFO:teuthology.orchestra.console:Power off smithi155 2022-09-04T01:56:48.069 INFO:teuthology.orchestra.console:Power off smithi182 2022-09-04T01:56:56.438 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2022-09-04T01:56:56.540 INFO:teuthology.orchestra.console:Power on smithi155 2022-09-04T01:57:00.554 INFO:teuthology.orchestra.console:Power off for smithi182 completed 2022-09-04T01:57:00.656 INFO:teuthology.orchestra.console:Power on smithi182 2022-09-04T01:57:04.914 INFO:teuthology.orchestra.console:Power on for smithi155 completed 2022-09-04T01:57:04.925 INFO:teuthology.orchestra.console:Power on for smithi182 completed 2022-09-04T01:57:05.017 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2022-09-04T01:57:05.026 INFO:teuthology.provision.fog.smithi182:Waiting for deploy to finish 2022-09-04T02:02:02.631 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-04T02:02:03.159 INFO:teuthology.provision.fog.smithi182:Node is ready 2022-09-04T02:02:03.167 INFO:teuthology.orchestra.run.smithi182.stdout:smithi182.front.sepia.ceph.com 2022-09-04T02:02:03.217 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.15.182 smithi182.front.sepia.ceph.com smithi182 2022-09-04T02:02:03.393 INFO:teuthology.provision.fog.smithi182:Deploy complete! 2022-09-04T02:02:20.875 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-04T02:02:21.425 INFO:teuthology.provision.fog.smithi155:Node is ready 2022-09-04T02:02:21.432 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2022-09-04T02:02:21.440 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2022-09-04T02:02:21.701 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2022-09-04T02:02:21.995 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2022-09-04T02:02:21.996 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-04T02:02:22.025 INFO:teuthology.lock.ops:Checking smithi182.front.sepia.ceph.com 2022-09-04T02:02:22.025 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-04T02:02:22.048 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2022-09-04T02:02:22.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2022-09-04T02:02:22.295 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2022-09-04T02:02:22.303 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2022-09-04T02:02:22.303 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-09-04T02:02:22.303 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2022-09-04T02:02:22.304 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2022-09-04T02:02:22.304 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-09-04T02:02:22.304 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="20.04" 2022-09-04T02:02:22.304 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2022-09-04T02:02:22.305 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-09-04T02:02:22.305 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-09-04T02:02:22.306 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-09-04T02:02:22.308 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=focal 2022-09-04T02:02:22.308 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=focal 2022-09-04T02:02:22.310 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2022-09-04T02:02:22.344 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: set os type and version on server 2022-09-04T02:02:22.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2022-09-04T02:02:22.583 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2022-09-04T02:02:22.592 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="Ubuntu" 2022-09-04T02:02:22.593 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-09-04T02:02:22.593 INFO:teuthology.orchestra.run.smithi182.stdout:ID=ubuntu 2022-09-04T02:02:22.594 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE=debian 2022-09-04T02:02:22.594 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-09-04T02:02:22.595 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="20.04" 2022-09-04T02:02:22.595 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.ubuntu.com/" 2022-09-04T02:02:22.596 INFO:teuthology.orchestra.run.smithi182.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-09-04T02:02:22.596 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-09-04T02:02:22.597 INFO:teuthology.orchestra.run.smithi182.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-09-04T02:02:22.597 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_CODENAME=focal 2022-09-04T02:02:22.597 INFO:teuthology.orchestra.run.smithi182.stdout:UBUNTU_CODENAME=focal 2022-09-04T02:02:22.599 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2022-09-04T02:02:22.772 INFO:teuthology.dispatcher.supervisor:Running job 7004497 2022-09-04T02:02:22.772 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004497 --name benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} -- /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004497/orig.config.yaml 2022-09-04T02:02:22.782 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004497 2022-09-04T02:02:22.783 INFO:teuthology.dispatcher.supervisor:Job PID: 7467 2022-09-04T02:02:22.784 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-04T14:02:46.341 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-04T14:02:46.548 INFO:teuthology.kill:Killing Pids: {7467} 2022-09-04T14:02:48.190 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-09-04T14:02:48.191 INFO:teuthology.task.internal:roles: ubuntu@smithi182.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-09-04T14:02:48.191 INFO:teuthology.misc:Compressing logs... 2022-09-04T14:02:48.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2022-09-04T14:02:48.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2022-09-04T14:02:48.867 INFO:teuthology.misc:Compressing logs... 2022-09-04T14:03:58.232 INFO:teuthology.misc:Compressing logs... 2022-09-04T14:04:01.324 INFO:teuthology.kill:No teuthology processes running 2022-09-04T14:04:02.983 INFO:teuthology.kill:Nuking machines: ['smithi155', 'smithi182'] 2022-09-04T14:04:04.229 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-04T14:04:04.230 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-04T14:04:04.230 INFO:teuthology.kill:2022-09-04 14:04:04,228.228 INFO:teuthology.nuke:targets: 2022-09-04T14:04:04.230 INFO:teuthology.kill: smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCcNTH5qKoqhQ4XtAOWct1OseY/EfQVi6v6gOGVHU1EDQ6qubgyedldQjvC0fykO78mFcv1Uexlq/Wm83gFq+iJcqMFYi0ypUPCNgl03vXZ75PqY2+olNEC5cjMx5yziIC1n6wL6Kb2sAKsDADoXcTH05ShS4Sl14PrF/N8xBfq6wMWJVsqJiQvrEh6FYSYvxfEQodlobgFKncB3oM7ZKrnSW0le79IbStRMo9cTxbKy0d8uq2gJFBM/+aHrC/BxDbvOxD3npELHXiG3ax6gp+LpMrbXgl6rdEVRWXprXXTWjUewPzirTYXxFQ6nlv/Gem2hsf0UYlCtGuYNgAv8rxKIy3ZdoRB1lqRKPxLYZ340YjBfeCVeTC4cKSQ7aznQYlFXjCg9gbOL4akNxq3exB0FrwV3fiKZ/LT9m9MilWO04FmSI8r8FWsFkcc25louR1ATHLhbCYk9v6DoS2y7Zep+0QbfB0xqjatuWduYpCIqmHGTvYEHBv7bRpJsVkX7hM= 2022-09-04T14:04:04.231 INFO:teuthology.kill: smithi182.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDv9FqUcJkL3tIrUn7nHn6A1zUBycynAWCpFqXfulCnBEbvSHJq68gJgBuF/ismrZUk8szHsHpQyHYCZX1wpHAv06A2dVNrjMTTER40SBd9hTs+Wyj2JZ/jOStpq0k8TErCtPgEqiHUGCzT8LeimKzbheO+LXfVfybwoXLNYc9JeEZcOeH5foG7jbVQsRa+U5RiauaX2fCq6SZ/AhcyrSuwL+5TL5mkuch2LSpgcSJN0W0Pf/pN4Mudcn2IqsA8LS3fN4cEzA7e8D4vfKieun+4a2iIadU56pxBdTr2pdOmFepjbOUKZTuba+zdCVcw8A4qei1bNmbPKOAk0Ku4xGTcv0A5ZjZyCkGVa224EB6su3s3WVvQm5fgAmp00oSXmVuUCFZ6Wc3Agthpj45f+1ceRmvwxAp2fv/1sbPCEV1HG2ymUzVR2Xf/fXDCvT7J6UDw8M1z+YNYQFuDNyFfYJjvuWc69HKey5iE9ltpOLQJtOL8EzcET0HGNgwXyM06/yc= 2022-09-04T14:04:04.231 INFO:teuthology.kill:2022-09-04 14:04:04,229.229 INFO:teuthology.nuke:Checking targets against current locks 2022-09-04T14:04:04.294 INFO:teuthology.kill:2022-09-04 14:04:04,294.294 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-04T14:04:04.331 INFO:teuthology.kill:2022-09-04 14:04:04,331.331 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-04T14:04:04.393 INFO:teuthology.kill:2022-09-04 14:04:04,393.393 INFO:teuthology.orchestra.console:Power off smithi155 2022-09-04T14:04:04.443 INFO:teuthology.kill:2022-09-04 14:04:04,442.442 INFO:teuthology.orchestra.console:Power off smithi182 2022-09-04T14:04:12.791 INFO:teuthology.kill:2022-09-04 14:04:12,790.790 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2022-09-04T14:04:12.947 INFO:teuthology.kill:2022-09-04 14:04:12,946.946 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2022-09-04T14:04:16.943 INFO:teuthology.kill:2022-09-04 14:04:16,943.943 INFO:teuthology.orchestra.console:Power off for smithi182 completed 2022-09-04T14:04:17.099 INFO:teuthology.kill:2022-09-04 14:04:17,099.099 INFO:teuthology.lock.ops:unlocked: smithi182.front.sepia.ceph.com 2022-09-04T14:06:17.519 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-04T14:06:17.634 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi155 but it was locked by another job: /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004656 2022-09-04T14:06:17.635 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi182 but it was locked by another job: /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004655