2022-02-07T15:11:55.989 INFO:root:teuthology version: 1.1.0-3094160c
2022-02-07T15:11:56.117 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi047.front.sepia.ceph.com' reimaging
2022-02-07T15:11:56.119 INFO:teuthology.lock.ops:Updating [ubuntu@smithi047.front.sepia.ceph.com]: reset os type and version on server
2022-02-07T15:11:56.119 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2022-02-07T15:11:56.138 INFO:teuthology.lock.ops:Node 'ubuntu@smithi047.front.sepia.ceph.com' reimaging is complete
2022-02-07T15:11:56.138 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi189.front.sepia.ceph.com' reimaging
2022-02-07T15:11:56.139 INFO:teuthology.lock.ops:Updating [ubuntu@smithi189.front.sepia.ceph.com]: reset os type and version on server
2022-02-07T15:11:56.139 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server
2022-02-07T15:11:56.158 INFO:teuthology.lock.ops:Node 'ubuntu@smithi189.front.sepia.ceph.com' reimaging is complete
2022-02-07T15:11:56.356 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of centos 8.stream
2022-02-07T15:11:56.374 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 8.stream
2022-02-07T15:11:56.822 INFO:teuthology.orchestra.console:Power off smithi189
2022-02-07T15:11:56.838 INFO:teuthology.orchestra.console:Power off smithi047
2022-02-07T15:12:05.202 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2022-02-07T15:12:05.304 INFO:teuthology.orchestra.console:Power on smithi047
2022-02-07T15:12:09.313 INFO:teuthology.orchestra.console:Power off for smithi189 completed
2022-02-07T15:12:09.416 INFO:teuthology.orchestra.console:Power on smithi189
2022-02-07T15:12:13.679 INFO:teuthology.orchestra.console:Power on for smithi047 completed
2022-02-07T15:12:13.780 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish
2022-02-07T15:12:17.787 INFO:teuthology.orchestra.console:Power on for smithi189 completed
2022-02-07T15:12:17.888 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish
2022-02-07T15:16:28.006 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-07T15:16:28.271 INFO:teuthology.provision.fog.smithi047:Node is ready
2022-02-07T15:16:28.289 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com
2022-02-07T15:16:28.348 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047
2022-02-07T15:16:28.700 INFO:teuthology.provision.fog.smithi047:Deploy complete!
2022-02-07T15:16:59.166 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-07T15:16:59.401 INFO:teuthology.provision.fog.smithi189:Node is ready
2022-02-07T15:16:59.420 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com
2022-02-07T15:16:59.478 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189
2022-02-07T15:16:59.810 INFO:teuthology.provision.fog.smithi189:Deploy complete!
2022-02-07T15:16:59.961 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com
2022-02-07T15:16:59.963 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-07T15:16:59.984 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com
2022-02-07T15:16:59.984 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-07T15:17:00.003 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server
2022-02-07T15:17:00.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2022-02-07T15:17:00.260 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64
2022-02-07T15:17:00.320 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream"
2022-02-07T15:17:00.320 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8"
2022-02-07T15:17:00.320 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos"
2022-02-07T15:17:00.320 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora"
2022-02-07T15:17:00.321 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8"
2022-02-07T15:17:00.321 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8"
2022-02-07T15:17:00.321 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-07T15:17:00.321 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31"
2022-02-07T15:17:00.322 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-07T15:17:00.322 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/"
2022-02-07T15:17:00.323 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-07T15:17:00.323 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-07T15:17:00.323 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-07T15:17:00.324 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2022-02-07T15:17:00.343 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server
2022-02-07T15:17:00.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com'
2022-02-07T15:17:00.576 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64
2022-02-07T15:17:00.632 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream"
2022-02-07T15:17:00.633 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="8"
2022-02-07T15:17:00.633 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos"
2022-02-07T15:17:00.633 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora"
2022-02-07T15:17:00.634 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="8"
2022-02-07T15:17:00.634 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el8"
2022-02-07T15:17:00.634 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-07T15:17:00.634 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31"
2022-02-07T15:17:00.635 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-07T15:17:00.635 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/"
2022-02-07T15:17:00.635 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-07T15:17:00.635 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-07T15:17:00.635 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-07T15:17:00.636 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server
2022-02-07T15:17:00.741 INFO:teuthology.dispatcher.supervisor:Running job 6666513
2022-02-07T15:17:00.742 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3094160cc590b786a43d55faaf7c99d5de71ce56/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666513 --name benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666513/orig.config.yaml
2022-02-07T15:17:00.746 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666513
2022-02-07T15:17:00.747 INFO:teuthology.dispatcher.supervisor:Job PID: 16388
2022-02-07T15:17:00.747 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-07T21:47:30.005 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-07T21:47:30.216 INFO:teuthology.kill:Killing Pids: {16388}
2022-02-07T21:47:31.434 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-07T21:47:31.435 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-07T21:47:31.435 INFO:teuthology.misc:Compressing logs...
2022-02-07T21:47:31.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2022-02-07T21:47:31.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com'
2022-02-07T21:47:31.999 INFO:teuthology.misc:Compressing logs...
2022-02-07T21:47:32.571 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-07T21:47:32.712 INFO:teuthology.orchestra.run.smithi189.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-07T21:47:33.106 INFO:teuthology.misc:Compressing logs...
2022-02-07T21:47:36.129 INFO:teuthology.kill:No teuthology processes running
2022-02-07T21:47:37.277 INFO:teuthology.kill:Nuking machines: ['smithi047', 'smithi189']
2022-02-07T21:47:38.276 INFO:teuthology.kill:2022-02-07 21:47:38,275.275 INFO:teuthology.nuke:targets:
2022-02-07T21:47:38.277 INFO:teuthology.kill:  smithi047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChe/UpBACSU5npf93A5oFYVBin1R/2j1oS+IiwIfSr112ATVefhstTvGhLeI6wF6xSWFmTAtspCfiWTeWMe1Q2wnUT0u8OncPbof413mc0izCeaI+RZWoibdWHI5buV8c2pZWlEOXPgSwnr3319cMB6dhSofxJA3m/txyUJMyDJlBf+LTpSWM9k4SEx5i6CU1ywhge+MthNJRol7TXGUY0RRkmbflAinkNYZsidYNdKhU6PhGln30QDr8P7Vna2BXwrRNdUzEzEVxez4q0+KmHlMDV2GRW3PBh79ayCva0Lu3OmUyra8UmRIl91wPlNvcswTzXrFRz8jg9iP2JjAikjwfc8zdIIkXwaVu9N4+cUVlYR//YKoVZa5Rfu6viYehd1AGMsmjbr23g0fHaYAMao92MDvshhWTgeSuSDXa9EsN54yJOCh9YU3ZRWY18cCrtuRnpResfUCiDIoixA4pcl2nNfiSI88is9wR9OjhUaqOkA6xn+ilRw77dJiEdeIs=
2022-02-07T21:47:38.277 INFO:teuthology.kill:  smithi189.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSTSoFj/cQo65kT0DwKuNjVm5/JsvgEigL0lN3ByiyAnRXAqwxDBL1EBiPWwKLKfEVOLH6Y8ydPI/tsAEzEIdgPl9YSn2ZbEN/Wxdp6VDwYBYvonrt5Hm+jeTuPBwFAMvFgGtpBO+5mpMvjYq6pPB3ZqD/gCnVIWFmSdDWTljoMt6MMpH5i9ooRmth6Gcyr6xd6ozefjEwYP4kvEjEaUnVjP64b3P6X0eeJnNKjE1ZwHRqCPrgr4sltNwob7uBubeOjSZ/ytzCc/8pqihFvki+5jceV3O2J8PvU3NsjAHEPfH7V88aOSG43/7FroyrjPv6scJTSUl1IuzXdKbBN/1SIx3x68qAe59LbChPsBlC3cpcyq7yGePlux2T3U5rVc+z7AI/uMBZpcIRctm9tg04us5YPf7r6wlh2tunJwTKwXcgzFtLtKUYLUjOcUQ/98kzEH38hSvRmCjzqE8+6JCqmrxK9iviYGtZESKHCGrcAITDCho9Ppns6FXULH/U2sc=
2022-02-07T21:47:38.303 INFO:teuthology.kill:2022-02-07 21:47:38,303.303 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-07T21:47:38.307 INFO:teuthology.kill:2022-02-07 21:47:38,307.307 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-07T21:47:38.385 INFO:teuthology.kill:2022-02-07 21:47:38,385.385 INFO:teuthology.orchestra.console:Power off smithi047
2022-02-07T21:47:38.400 INFO:teuthology.kill:2022-02-07 21:47:38,399.399 INFO:teuthology.orchestra.console:Power off smithi189
2022-02-07T21:47:46.758 INFO:teuthology.kill:2022-02-07 21:47:46,757.757 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2022-02-07T21:47:46.905 INFO:teuthology.kill:2022-02-07 21:47:46,904.904 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com
2022-02-07T21:47:50.876 INFO:teuthology.kill:2022-02-07 21:47:50,876.876 INFO:teuthology.orchestra.console:Power off for smithi189 completed
2022-02-07T21:47:51.021 INFO:teuthology.kill:2022-02-07 21:47:51,020.020 INFO:teuthology.lock.ops:unlocked: smithi189.front.sepia.ceph.com
2022-02-07T21:49:51.327 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-07T21:49:51.429 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi047 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-07_20:08:36-rados-wip-yuri4-testing-2022-02-07-1051-octopus-distro-default-smithi/6666921
2022-02-07T21:49:51.430 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi189 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-07_20:08:36-rados-wip-yuri4-testing-2022-02-07-1051-octopus-distro-default-smithi/6666918