2023-03-25T09:09:22.985 INFO:root:teuthology version: 0.0.1.dev1+ge372916
2023-03-25T09:09:23.128 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging
2023-03-25T09:09:23.130 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server
2023-03-25T09:09:23.130 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2023-03-25T09:09:23.187 INFO:teuthology.lock.ops:Node 'smithi135.front.sepia.ceph.com' reimaging is complete
2023-03-25T09:09:23.187 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging
2023-03-25T09:09:23.187 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server
2023-03-25T09:09:23.188 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-03-25T09:09:23.216 INFO:teuthology.lock.ops:Node 'smithi155.front.sepia.ceph.com' reimaging is complete
2023-03-25T09:09:23.361 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 8.stream
2023-03-25T09:09:23.371 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.stream
2023-03-25T09:09:23.565 INFO:teuthology.orchestra.console:Power off smithi135
2023-03-25T09:09:23.586 INFO:teuthology.orchestra.console:Power off smithi155
2023-03-25T09:09:23.723 INFO:teuthology.orchestra.console:Power off for smithi135 completed
2023-03-25T09:09:23.730 INFO:teuthology.orchestra.console:Power off for smithi155 completed
2023-03-25T09:09:23.825 INFO:teuthology.orchestra.console:Power on smithi135
2023-03-25T09:09:23.834 INFO:teuthology.orchestra.console:Power on smithi155
2023-03-25T09:09:28.093 INFO:teuthology.orchestra.console:Power on for smithi155 completed
2023-03-25T09:09:28.194 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2023-03-25T09:09:32.197 INFO:teuthology.orchestra.console:Power on for smithi135 completed
2023-03-25T09:09:32.299 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish
2023-03-25T09:12:20.997 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.135
2023-03-25T09:12:30.053 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.135
2023-03-25T09:12:39.109 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.135
2023-03-25T09:12:44.231 ERROR:teuthology.orchestra.connection:Error authenticating with smithi155.front.sepia.ceph.com: Authentication timeout.
2023-03-25T09:12:48.165 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.135
2023-03-25T09:12:57.221 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.135
2023-03-25T09:13:03.749 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-03-25T09:13:06.277 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.135
2023-03-25T09:13:12.805 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-03-25T09:14:12.281 WARNING:teuthology.provision.fog:timed out
2023-03-25T09:14:18.530 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-25T09:14:18.808 WARNING:teuthology.provision.fog:timed out
2023-03-25T09:14:18.817 INFO:teuthology.provision.fog.smithi135:Node is ready
2023-03-25T09:14:18.875 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com
2023-03-25T09:14:18.933 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135
2023-03-25T09:14:19.303 INFO:teuthology.provision.fog.smithi135:Deploy complete!
2023-03-25T09:14:25.156 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-25T09:14:25.432 INFO:teuthology.provision.fog.smithi155:Node is ready
2023-03-25T09:14:25.451 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2023-03-25T09:14:25.509 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2023-03-25T09:14:25.863 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2023-03-25T09:14:26.032 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com
2023-03-25T09:14:26.033 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-25T09:14:26.054 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2023-03-25T09:14:26.055 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-25T09:14:26.080 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server
2023-03-25T09:14:26.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com'
2023-03-25T09:14:26.230 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64
2023-03-25T09:14:26.286 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream"
2023-03-25T09:14:26.287 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8"
2023-03-25T09:14:26.287 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos"
2023-03-25T09:14:26.287 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora"
2023-03-25T09:14:26.287 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8"
2023-03-25T09:14:26.287 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8"
2023-03-25T09:14:26.288 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-25T09:14:26.288 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31"
2023-03-25T09:14:26.288 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-25T09:14:26.288 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/"
2023-03-25T09:14:26.288 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-25T09:14:26.288 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-25T09:14:26.289 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-25T09:14:26.290 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2023-03-25T09:14:26.345 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2023-03-25T09:14:26.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-03-25T09:14:26.535 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2023-03-25T09:14:26.592 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2023-03-25T09:14:26.592 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8"
2023-03-25T09:14:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2023-03-25T09:14:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2023-03-25T09:14:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8"
2023-03-25T09:14:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2023-03-25T09:14:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-25T09:14:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2023-03-25T09:14:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-25T09:14:26.594 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2023-03-25T09:14:26.594 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-25T09:14:26.594 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-25T09:14:26.594 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-25T09:14:26.595 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-03-25T09:14:26.718 INFO:teuthology.dispatcher.supervisor:Running job 7211010
2023-03-25T09:14:26.719 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_main/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2023-03-16_20:57:19-rados-WIP_GBH_snap_mapper_5-distro-default-smithi/7211010 --name benhanokh-2023-03-16_20:57:19-rados-WIP_GBH_snap_mapper_5-distro-default-smithi --description rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} -- /home/teuthworker/archive/benhanokh-2023-03-16_20:57:19-rados-WIP_GBH_snap_mapper_5-distro-default-smithi/7211010/orig.config.yaml
2023-03-25T09:14:26.723 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2023-03-16_20:57:19-rados-WIP_GBH_snap_mapper_5-distro-default-smithi/7211010
2023-03-25T09:14:26.724 INFO:teuthology.dispatcher.supervisor:Job PID: 6238
2023-03-25T09:14:26.725 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-25T09:14:44.613 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-03-25T21:15:24.487 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-25T21:15:24.636 INFO:teuthology.kill:Killing Pids: {6238}
2023-03-25T21:15:25.597 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2023-03-25T21:15:25.597 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2023-03-25T21:15:25.598 INFO:teuthology.misc:Compressing logs...
2023-03-25T21:15:25.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com'
2023-03-25T21:15:25.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-03-25T21:15:26.210 INFO:teuthology.misc:Compressing logs...
2023-03-25T21:15:27.149 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-25T21:15:27.150 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-25T21:16:17.882 INFO:teuthology.misc:Compressing logs...
2023-03-25T21:16:21.852 INFO:teuthology.kill:No teuthology processes running
2023-03-25T21:16:22.697 INFO:teuthology.kill:Nuking machines: ['smithi135', 'smithi155']
2023-03-25T21:16:23.317 INFO:teuthology.kill:2023-03-25 21:16:23,317.317 INFO:teuthology.nuke:targets:
2023-03-25T21:16:23.318 INFO:teuthology.kill:  smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLnYwxw1sw9agNRVrzv51pZyIqUBDrXGhYHAiH08tawl9PgFP43+yKMv5CbfJ12D2ZHTBmA1MjUMtt6RCf5K2eg=
2023-03-25T21:16:23.318 INFO:teuthology.kill:  smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF9qoqhzsM1VkSuppDJvlVZlVSCOVWb+9wsUHZaSqh2ABLPHJq4OpNAREniMzej+7x3xHkevACYThMpKy2Wi24A=
2023-03-25T21:16:23.318 INFO:teuthology.kill:2023-03-25 21:16:23,317.317 INFO:teuthology.nuke:Checking targets against current locks
2023-03-25T21:16:23.372 INFO:teuthology.kill:2023-03-25 21:16:23,372.372 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-25T21:16:23.403 INFO:teuthology.kill:2023-03-25 21:16:23,403.403 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-25T21:16:23.442 INFO:teuthology.kill:2023-03-25 21:16:23,442.442 INFO:teuthology.orchestra.console:Power off smithi135
2023-03-25T21:16:23.485 INFO:teuthology.kill:2023-03-25 21:16:23,484.484 INFO:teuthology.orchestra.console:Power off smithi155
2023-03-25T21:16:35.939 INFO:teuthology.kill:2023-03-25 21:16:35,938.938 INFO:teuthology.orchestra.console:Power off for smithi135 completed
2023-03-25T21:16:35.962 INFO:teuthology.kill:2023-03-25 21:16:35,962.962 INFO:teuthology.orchestra.console:Power off for smithi155 completed
2023-03-25T21:16:36.101 INFO:teuthology.kill:2023-03-25 21:16:36,101.101 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com
2023-03-25T21:16:36.117 INFO:teuthology.kill:2023-03-25 21:16:36,117.117 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com
2023-03-25T21:18:36.493 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-03-25T21:18:36.607 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi135 but it was locked by another job: /home/teuthworker/archive/vshankar-2023-03-18_05:01:47-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7213612
2023-03-25T21:18:36.608 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi155 but it was locked by another job: /home/teuthworker/archive/vshankar-2023-03-18_05:01:47-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7213612