2022-02-07T15:05:50.977 INFO:root:teuthology version: 1.1.0-3094160c
2022-02-07T15:05:51.110 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging
2022-02-07T15:05:51.111 INFO:teuthology.lock.ops:Updating [ubuntu@smithi023.front.sepia.ceph.com]: reset os type and version on server
2022-02-07T15:05:51.111 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2022-02-07T15:05:51.131 INFO:teuthology.lock.ops:Node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging is complete
2022-02-07T15:05:51.131 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi178.front.sepia.ceph.com' reimaging
2022-02-07T15:05:51.132 INFO:teuthology.lock.ops:Updating [ubuntu@smithi178.front.sepia.ceph.com]: reset os type and version on server
2022-02-07T15:05:51.132 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2022-02-07T15:05:51.156 INFO:teuthology.lock.ops:Node 'ubuntu@smithi178.front.sepia.ceph.com' reimaging is complete
2022-02-07T15:05:51.360 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of rhel 8.4
2022-02-07T15:05:51.364 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.4
2022-02-07T15:05:51.702 INFO:teuthology.orchestra.console:Power off smithi178
2022-02-07T15:05:51.727 INFO:teuthology.orchestra.console:Power off smithi023
2022-02-07T15:05:51.860 INFO:teuthology.orchestra.console:Power off for smithi178 completed
2022-02-07T15:05:51.871 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2022-02-07T15:05:51.962 INFO:teuthology.orchestra.console:Power on smithi178
2022-02-07T15:05:51.973 INFO:teuthology.orchestra.console:Power on smithi023
2022-02-07T15:05:56.230 INFO:teuthology.orchestra.console:Power on for smithi023 completed
2022-02-07T15:05:56.331 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2022-02-07T15:06:00.334 INFO:teuthology.orchestra.console:Power on for smithi178 completed
2022-02-07T15:06:00.436 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2022-02-07T15:11:05.610 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-07T15:11:05.840 INFO:teuthology.provision.fog.smithi178:Node is ready
2022-02-07T15:11:05.897 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2022-02-07T15:11:05.954 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2022-02-07T15:11:06.270 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2022-02-07T15:11:25.562 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-07T15:11:25.778 INFO:teuthology.provision.fog.smithi023:Node is ready
2022-02-07T15:11:25.835 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com
2022-02-07T15:11:25.892 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023
2022-02-07T15:11:26.238 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2022-02-07T15:11:26.393 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com
2022-02-07T15:11:26.395 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-07T15:11:26.418 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2022-02-07T15:11:26.419 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-07T15:11:26.444 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server
2022-02-07T15:11:26.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2022-02-07T15:11:26.633 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64
2022-02-07T15:11:26.690 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Red Hat Enterprise Linux"
2022-02-07T15:11:26.690 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8.4 (Ootpa)"
2022-02-07T15:11:26.691 INFO:teuthology.orchestra.run.smithi023.stdout:ID="rhel"
2022-02-07T15:11:26.691 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="fedora"
2022-02-07T15:11:26.691 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8.4"
2022-02-07T15:11:26.692 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2022-02-07T15:11:26.692 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-07T15:11:26.692 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2022-02-07T15:11:26.692 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-07T15:11:26.693 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.redhat.com/"
2022-02-07T15:11:26.693 INFO:teuthology.orchestra.run.smithi023.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-07T15:11:26.693 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-07T15:11:26.693 INFO:teuthology.orchestra.run.smithi023.stdout:
2022-02-07T15:11:26.694 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-07T15:11:26.694 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-07T15:11:26.695 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-07T15:11:26.695 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-07T15:11:26.697 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2022-02-07T15:11:26.717 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2022-02-07T15:11:26.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2022-02-07T15:11:26.955 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2022-02-07T15:11:27.011 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux"
2022-02-07T15:11:27.011 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.4 (Ootpa)"
2022-02-07T15:11:27.012 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel"
2022-02-07T15:11:27.012 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora"
2022-02-07T15:11:27.012 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.4"
2022-02-07T15:11:27.013 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2022-02-07T15:11:27.013 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-07T15:11:27.013 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2022-02-07T15:11:27.014 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-07T15:11:27.014 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/"
2022-02-07T15:11:27.014 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-07T15:11:27.014 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-07T15:11:27.015 INFO:teuthology.orchestra.run.smithi178.stdout:
2022-02-07T15:11:27.015 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-07T15:11:27.015 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-07T15:11:27.015 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-07T15:11:27.015 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-07T15:11:27.016 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2022-02-07T15:11:27.117 INFO:teuthology.dispatcher.supervisor:Running job 6666501
2022-02-07T15:11:27.118 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3094160cc590b786a43d55faaf7c99d5de71ce56/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666501 --name benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} -- /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666501/orig.config.yaml
2022-02-07T15:11:27.122 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666501
2022-02-07T15:11:27.123 INFO:teuthology.dispatcher.supervisor:Job PID: 11717
2022-02-07T15:11:27.124 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-07T21:41:37.807 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-07T21:41:37.986 INFO:teuthology.kill:Killing Pids: {11717}
2022-02-07T21:41:39.170 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-07T21:41:39.171 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-07T21:41:39.171 INFO:teuthology.misc:Compressing logs...
2022-02-07T21:41:39.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2022-02-07T21:41:39.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2022-02-07T21:41:39.704 INFO:teuthology.misc:Compressing logs...
2022-02-07T21:41:40.251 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-07T21:41:40.424 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-07T21:41:40.798 INFO:teuthology.misc:Compressing logs...
2022-02-07T21:42:02.628 INFO:teuthology.kill:No teuthology processes running
2022-02-07T21:42:03.761 INFO:teuthology.kill:Nuking machines: ['smithi023', 'smithi178']
2022-02-07T21:42:04.719 INFO:teuthology.kill:2022-02-07 21:42:04,718.718 INFO:teuthology.nuke:targets:
2022-02-07T21:42:04.719 INFO:teuthology.kill:  smithi023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9nAa0c1TGj5zrwNtQ+txU/3ObcxiD2Lv/aRJqyGj1xB52V/Q7l4xEFQohHJmHiburaHbpqZCZT2Szf6LXDdzdYqKi6xO405Nl+oRRpYYnyIavL6dx7bJMo/QtIofyK+DQBchmKP26iMUrwo5+NfY+FNBXItQrR26zyWGFqvmly8Phiyoe6LAGdkbcJEI5bk4oVQ6SGTsx9pU6RwnYdvQ+iWndimBzBKs6nLHhjMy/4b8Yrwr7JitNQq0iv0xff/k7SqO6k0R/+1GlrBA92Mdk5tPIJ7dSC2UUYVJEs+Kh4JSHzGoIxzXEw6dB/WvIaJ+V1q3eEmWoYytzjzxus4PdVKpLkHGwgORVFelyLuk2Ik5BVDA6KAQNlt9xp3yUXAhghySjByf5TB2leYe5h6FjEsKbYCvhlIlw9/Ba5D+C1Xwk/BwcWEZNYolcHUDg2622q6q0aOjHYITjm6o5T1FllIOxP+lSSOtAnwTdYP8j7FS6YPEkkP/kvM8xHc1hwCc=
2022-02-07T21:42:04.720 INFO:teuthology.kill:  smithi178.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC86TfDqaljRBbf2F4em/QMubknrcRe1I+/AQpuunxehrrvQ7b+eDWP3KLSN+Kj+LtzypSQpO5thimVl/F4axVLhiyTzouPD0Fru5yB+5vqx5gcnN4NiUnogIKWwsCF+d/HQiTLiuRYfvrbyemoBmOg+O+qh/53RGzGLw1KoJ7F6MLM8JFp/4YevEEu7kSNtMBj0ncbv4mw5KqArYaR9qNy6IlhhY7hfPIkSIdWsOGgdQzIvNysKm8UCS6y6y1L6LMDkcvDV96aSmPMdaSdIi7plnuvxQTzt97Hf2eibtRc1qgvZCv5v5Ei4x506FNR7ogLpl5VdXGhgRgrJXaIoSeNIuGqUjlmur4z+P4xgWg0Si7HLafx8xEP9kINYxGMgQpABRmAXwByxzhjk41FehzcxyuQO+4PVKary4K+d18g1k884OoyYm/mwzmrFTjmEcuWHYKFrd7pbmbkeR+IufoIsfFlJJ4jSf4p15xUNwY+rAA0ukV6wk7bDYfT0nQNwLk=
2022-02-07T21:42:04.745 INFO:teuthology.kill:2022-02-07 21:42:04,745.745 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-07T21:42:04.748 INFO:teuthology.kill:2022-02-07 21:42:04,748.748 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-07T21:42:04.823 INFO:teuthology.kill:2022-02-07 21:42:04,822.822 INFO:teuthology.orchestra.console:Power off smithi178
2022-02-07T21:42:04.837 INFO:teuthology.kill:2022-02-07 21:42:04,837.837 INFO:teuthology.orchestra.console:Power off smithi023
2022-02-07T21:42:13.194 INFO:teuthology.kill:2022-02-07 21:42:13,193.193 INFO:teuthology.orchestra.console:Power off for smithi178 completed
2022-02-07T21:42:13.199 INFO:teuthology.kill:2022-02-07 21:42:13,199.199 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2022-02-07T21:42:13.345 INFO:teuthology.kill:2022-02-07 21:42:13,344.344 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com
2022-02-07T21:42:13.349 INFO:teuthology.kill:2022-02-07 21:42:13,349.349 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com
2022-02-07T21:44:13.677 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-07T21:44:13.784 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi023 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-07_20:08:36-rados-wip-yuri4-testing-2022-02-07-1051-octopus-distro-default-smithi/6666881
2022-02-07T21:44:13.784 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi178 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-07_20:08:36-rados-wip-yuri4-testing-2022-02-07-1051-octopus-distro-default-smithi/6666881