2023-03-17T07:21:37.744 INFO:root:teuthology version: 0.0.1.dev59+g7f7f7c3 2023-03-17T07:21:39.229 INFO:teuthology.lock.ops:Start node 'smithi035.front.sepia.ceph.com' reimaging 2023-03-17T07:21:42.060 INFO:teuthology.lock.ops:Updating [smithi035.front.sepia.ceph.com]: reset os type and version on server 2023-03-17T07:21:43.229 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2023-03-17T07:21:43.257 INFO:teuthology.lock.ops:Node 'smithi035.front.sepia.ceph.com' reimaging is complete 2023-03-17T07:21:45.210 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2023-03-17T07:21:45.210 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2023-03-17T07:21:45.210 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-03-17T07:21:45.240 INFO:teuthology.lock.ops:Node 'smithi078.front.sepia.ceph.com' reimaging is complete 2023-03-17T07:21:46.726 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2023-03-17T07:21:46.726 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2023-03-17T07:21:46.726 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-03-17T07:21:46.748 INFO:teuthology.lock.ops:Node 'smithi082.front.sepia.ceph.com' reimaging is complete 2023-03-17T07:21:50.105 INFO:teuthology.provision.fog.smithi035:Scheduling deploy of rhel 8.6 2023-03-17T07:21:52.468 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.6 2023-03-17T07:21:55.170 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of rhel 8.6 2023-03-17T07:21:57.644 INFO:teuthology.orchestra.console:Power off smithi078 2023-03-17T07:21:59.323 INFO:teuthology.orchestra.console:Power off smithi035 2023-03-17T07:22:00.352 INFO:teuthology.orchestra.console:Power off smithi082 2023-03-17T07:22:02.944 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2023-03-17T07:22:04.909 INFO:teuthology.orchestra.console:Power off for smithi035 completed 2023-03-17T07:22:05.009 INFO:teuthology.orchestra.console:Power on smithi078 2023-03-17T07:22:08.569 INFO:teuthology.orchestra.console:Power on smithi035 2023-03-17T07:22:09.990 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2023-03-17T07:22:11.242 INFO:teuthology.orchestra.console:Power on smithi082 2023-03-17T07:22:15.372 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2023-03-17T07:22:17.490 INFO:teuthology.orchestra.console:Power on for smithi035 completed 2023-03-17T07:22:17.591 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2023-03-17T07:22:19.207 INFO:teuthology.provision.fog.smithi035:Waiting for deploy to finish 2023-03-17T07:22:19.313 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2023-03-17T07:22:21.120 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2023-03-17T07:24:52.933 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T07:24:58.085 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-03-17T07:25:04.037 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T07:25:09.509 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-03-17T07:25:12.390 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-03-17T07:25:15.525 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T07:25:21.445 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-03-17T07:25:21.965 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-03-17T07:25:26.501 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T07:25:31.045 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-03-17T07:25:33.789 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-03-17T07:25:42.853 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-03-17T07:25:43.655 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-03-17T07:25:52.741 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-03-17T07:26:05.568 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-17T07:26:07.228 INFO:teuthology.provision.fog.smithi035:Node is ready 2023-03-17T07:26:08.843 INFO:teuthology.orchestra.run.smithi035.stdout:smithi035.front.sepia.ceph.com 2023-03-17T07:26:10.962 INFO:teuthology.orchestra.run.smithi035.stdout:172.21.15.35 smithi035.front.sepia.ceph.com smithi035 2023-03-17T07:26:12.614 INFO:teuthology.provision.fog.smithi035:Deploy complete! 2023-03-17T07:26:49.692 WARNING:teuthology.provision.fog:timed out 2023-03-17T07:26:57.476 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-17T07:26:58.297 INFO:teuthology.provision.fog.smithi078:Node is ready 2023-03-17T07:26:59.076 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2023-03-17T07:27:00.205 WARNING:teuthology.provision.fog:timed out 2023-03-17T07:27:00.224 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2023-03-17T07:27:02.360 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2023-03-17T07:27:06.529 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-17T07:27:08.440 INFO:teuthology.provision.fog.smithi082:Node is ready 2023-03-17T07:27:10.420 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2023-03-17T07:27:12.220 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2023-03-17T07:27:14.160 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2023-03-17T07:27:15.875 INFO:teuthology.lock.ops:Checking smithi035.front.sepia.ceph.com 2023-03-17T07:27:18.164 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2023-03-17T07:27:18.165 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2023-03-17T07:27:18.165 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-17T07:27:18.196 INFO:teuthology.lock.ops:Updating [smithi035.front.sepia.ceph.com]: set os type and version on server 2023-03-17T07:27:21.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T07:27:21.481 INFO:teuthology.orchestra.run.smithi035.stdout:x86_64 2023-03-17T07:27:23.463 INFO:teuthology.orchestra.run.smithi035.stdout:NAME="Red Hat Enterprise Linux" 2023-03-17T07:27:24.527 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION="8.6 (Ootpa)" 2023-03-17T07:27:24.950 INFO:teuthology.orchestra.run.smithi035.stdout:ID="rhel" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout:ID_LIKE="fedora" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION_ID="8.6" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout:PLATFORM_ID="platform:el8" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout:ANSI_COLOR="0;31" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout:HOME_URL="https://www.redhat.com/" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-17T07:27:25.927 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:27:26.293 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-17T07:27:26.293 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-17T07:27:26.293 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-17T07:27:26.293 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-17T07:27:26.294 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2023-03-17T07:27:26.318 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2023-03-17T07:27:27.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-03-17T07:27:27.447 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-03-17T07:27:28.742 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-03-17T07:27:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-03-17T07:27:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-03-17T07:27:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-03-17T07:27:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-03-17T07:27:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-03-17T07:27:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-17T07:27:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-03-17T07:27:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-17T07:27:29.514 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-03-17T07:27:29.515 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-17T07:27:29.515 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-17T07:27:29.515 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:27:29.515 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-17T07:27:29.515 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-17T07:27:29.515 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-17T07:27:29.515 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-17T07:27:29.515 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-03-17T07:27:29.542 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2023-03-17T07:27:30.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-03-17T07:27:30.502 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-03-17T07:27:31.558 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-03-17T07:27:32.570 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.6 (Ootpa)" 2023-03-17T07:27:32.570 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-03-17T07:27:32.570 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-03-17T07:27:32.570 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.6" 2023-03-17T07:27:32.570 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-03-17T07:27:32.570 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-17T07:27:32.570 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-03-17T07:27:32.571 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-17T07:27:32.571 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-03-17T07:27:33.901 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-17T07:27:33.901 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-17T07:27:33.901 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:27:33.901 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-17T07:27:33.902 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-17T07:27:33.902 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-17T07:27:33.902 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-17T07:27:33.902 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-03-17T07:27:34.009 INFO:teuthology.dispatcher.supervisor:Running job 7211223 2023-03-17T07:27:35.138 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223 --name pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223/orig.config.yaml 2023-03-17T07:27:35.921 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223 2023-03-17T07:27:37.265 INFO:teuthology.dispatcher.supervisor:Job PID: 18295 2023-03-17T07:27:37.265 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-03-17T12:51:59.397 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1