2023-09-19T10:27:56.473 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-19T10:27:56.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:27:56.610 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa29903b670>, signals=[15]) 2023-09-19T10:27:56.612 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging 2023-09-19T10:27:56.612 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server 2023-09-19T10:27:56.612 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2023-09-19T10:27:56.639 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-09-19T10:27:56.639 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-09-19T10:27:56.640 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-09-19T10:27:56.641 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /host {"name": "smithi044"} 2023-09-19T10:27:56.664 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-09-19T10:27:57.123 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-19T10:27:57.164 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-19T10:27:57.181 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-19T10:27:57.181 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 5} 2023-09-19T10:27:57.198 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-19T10:27:57.198 DEBUG:teuthology.provision.fog.smithi044:FOG request: PUT /host/149 {"imageID": 5} 2023-09-19T10:27:57.250 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of rhel 8.6 2023-09-19T10:27:57.250 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:27:57.253 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6 2023-09-19T10:27:57.254 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:27:57.294 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /tasktype {"name": "deploy"} 2023-09-19T10:27:57.308 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-09-19T10:27:57.327 DEBUG:teuthology.provision.fog.smithi044:FOG request: POST /host/149/task {"taskTypeID": 1} 2023-09-19T10:27:57.343 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-09-19T10:27:57.429 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:27:57.441 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:27:57.510 INFO:teuthology.orchestra.console.smithi044:Power off 2023-09-19T10:27:57.511 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-19T10:27:57.531 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2023-09-19T10:27:57.531 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-19T10:27:57.548 INFO:teuthology.orchestra.console.smithi172:Power off 2023-09-19T10:27:57.549 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-19T10:27:57.557 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-09-19T10:27:57.570 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-09-19T10:27:57.570 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-19T10:27:57.590 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-09-19T10:27:57.659 INFO:teuthology.orchestra.console.smithi044:Power off completed 2023-09-19T10:27:57.692 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-09-19T10:27:57.760 INFO:teuthology.orchestra.console.smithi044:Power on 2023-09-19T10:27:57.761 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-19T10:27:57.781 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On 2023-09-19T10:27:57.782 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-19T10:27:57.792 INFO:teuthology.orchestra.console.smithi172:Power on 2023-09-19T10:27:57.793 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-19T10:27:57.804 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-09-19T10:27:57.813 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2023-09-19T10:27:57.814 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-19T10:27:57.833 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-09-19T10:28:01.809 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-19T10:28:01.835 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-19T10:28:01.918 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-09-19T10:28:01.943 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-09-19T10:28:02.019 INFO:teuthology.orchestra.console.smithi044:Power on completed 2023-09-19T10:28:02.120 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish 2023-09-19T10:28:02.120 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:28:05.946 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-19T10:28:06.102 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-09-19T10:28:06.203 INFO:teuthology.orchestra.console.smithi172:Power on completed 2023-09-19T10:28:06.304 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-09-19T10:28:06.304 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:28:17.189 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:28:21.358 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:28:32.260 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:28:36.414 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:28:47.328 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:28:51.470 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:29:02.387 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:29:06.526 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:29:17.464 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:29:21.582 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:29:32.537 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:29:36.646 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:29:47.611 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:29:51.704 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:30:02.677 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:30:06.758 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:30:17.749 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:30:21.828 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:30:32.823 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-19T10:30:32.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:30:36.886 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:30:51.290 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2023-09-19T10:30:51.946 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-19T10:30:52.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:30:57.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:31:00.346 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2023-09-19T10:31:06.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:31:09.434 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2023-09-19T10:31:10.490 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-19T10:31:15.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:31:16.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:31:18.522 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2023-09-19T10:31:19.546 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-19T10:31:24.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:31:25.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:31:28.602 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-19T10:31:34.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:31:37.690 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-19T10:31:43.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:31:46.778 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-19T10:31:52.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:31:55.871 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-19T10:32:01.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:32:20.378 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-19T10:32:24.536 WARNING:teuthology.provision.fog.smithi044:timed out 2023-09-19T10:32:26.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:32:29.434 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-19T10:32:30.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:32:30.868 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-19T10:32:30.868 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-19T10:32:31.134 INFO:teuthology.provision.fog.smithi044:Node is ready 2023-09-19T10:32:31.135 DEBUG:teuthology.orchestra.run.smithi044:> hostname 2023-09-19T10:32:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com 2023-09-19T10:32:31.153 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts 2023-09-19T10:32:31.211 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044 2023-09-19T10:32:31.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2023-09-19T10:32:31.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts 2023-09-19T10:32:31.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts 2023-09-19T10:32:31.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname 2023-09-19T10:32:31.495 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2023-09-19T10:32:31.563 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2023-09-19T10:32:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Red Hat Enterprise Linux" 2023-09-19T10:32:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="8.6 (Ootpa)" 2023-09-19T10:32:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ID="rhel" 2023-09-19T10:32:31.620 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="fedora" 2023-09-19T10:32:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="8.6" 2023-09-19T10:32:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el8" 2023-09-19T10:32:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-19T10:32:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2023-09-19T10:32:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-19T10:32:31.621 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.redhat.com/" 2023-09-19T10:32:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-19T10:32:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-19T10:32:31.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-09-19T10:32:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-19T10:32:31.622 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-19T10:32:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-19T10:32:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-19T10:32:31.623 INFO:teuthology.provision.fog.smithi044:Deploy complete! 2023-09-19T10:32:31.625 DEBUG:teuthology.parallel:result is None 2023-09-19T10:32:35.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:32:36.967 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-19T10:32:36.968 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-19T10:32:37.226 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-09-19T10:32:37.227 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-09-19T10:32:37.242 INFO:teuthology.orchestra.run.smithi172.stdout:smithi022 2023-09-19T10:32:37.242 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi022 /etc/hosts 2023-09-19T10:32:37.299 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-19T10:32:37.299 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-09-19T10:32:37.444 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi022/smithi172/g' /etc/hosts 2023-09-19T10:32:37.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.22/172.21.15.172/g' /etc/hosts 2023-09-19T10:32:37.538 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi022/smithi172/g' /etc/hostname 2023-09-19T10:32:37.605 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-09-19T10:32:37.671 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-09-19T10:32:37.727 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-09-19T10:32:37.728 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-09-19T10:32:37.728 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-09-19T10:32:37.728 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-09-19T10:32:37.728 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-09-19T10:32:37.728 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-09-19T10:32:37.729 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-19T10:32:37.729 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-09-19T10:32:37.729 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-19T10:32:37.729 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-09-19T10:32:37.729 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-19T10:32:37.729 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-19T10:32:37.730 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-09-19T10:32:37.730 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-19T10:32:37.730 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-19T10:32:37.730 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-19T10:32:37.730 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-19T10:32:37.731 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-09-19T10:32:37.731 DEBUG:teuthology.parallel:result is None 2023-09-19T10:32:37.879 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com 2023-09-19T10:32:37.880 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-19T10:32:37.902 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-09-19T10:32:37.902 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-19T10:32:37.919 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server 2023-09-19T10:32:37.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-09-19T10:32:37.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:32:37.987 DEBUG:teuthology.orchestra.run.smithi044:> true 2023-09-19T10:32:38.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-09-19T10:32:38.059 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2023-09-19T10:32:38.119 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2023-09-19T10:32:38.119 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2023-09-19T10:32:38.179 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Red Hat Enterprise Linux" 2023-09-19T10:32:38.180 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="8.6 (Ootpa)" 2023-09-19T10:32:38.180 INFO:teuthology.orchestra.run.smithi044.stdout:ID="rhel" 2023-09-19T10:32:38.180 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="fedora" 2023-09-19T10:32:38.180 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="8.6" 2023-09-19T10:32:38.180 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el8" 2023-09-19T10:32:38.181 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-19T10:32:38.181 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2023-09-19T10:32:38.181 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-19T10:32:38.181 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.redhat.com/" 2023-09-19T10:32:38.181 INFO:teuthology.orchestra.run.smithi044.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-19T10:32:38.181 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-19T10:32:38.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-09-19T10:32:38.182 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-19T10:32:38.182 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-19T10:32:38.182 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-19T10:32:38.182 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-19T10:32:38.183 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2023-09-19T10:32:38.202 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-09-19T10:32:38.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-09-19T10:32:38.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-19T10:32:38.269 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-09-19T10:32:38.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-09-19T10:32:38.339 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-09-19T10:32:38.395 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-09-19T10:32:38.395 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-09-19T10:32:38.452 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-09-19T10:32:38.452 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-09-19T10:32:38.452 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-09-19T10:32:38.452 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-09-19T10:32:38.453 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-09-19T10:32:38.453 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-09-19T10:32:38.453 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-19T10:32:38.453 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-09-19T10:32:38.453 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-19T10:32:38.453 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-09-19T10:32:38.454 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-19T10:32:38.454 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-19T10:32:38.454 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-09-19T10:32:38.454 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-19T10:32:38.454 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-19T10:32:38.455 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-19T10:32:38.455 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-19T10:32:38.455 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-09-19T10:32:38.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:32:38.557 INFO:teuthology.dispatcher.supervisor:Running job 7397957 2023-09-19T10:32:38.557 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-09-19_10:27:43-fs:volumes-wip-mchangir-testing-20230908.140927-testing-default-smithi/7397957 --name rishabh-2023-09-19_10:27:43-fs:volumes-wip-mchangir-testing-20230908.140927-testing-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/rishabh-2023-09-19_10:27:43-fs:volumes-wip-mchangir-testing-20230908.140927-testing-default-smithi/7397957/orig.config.yaml 2023-09-19T10:32:38.560 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-09-19_10:27:43-fs:volumes-wip-mchangir-testing-20230908.140927-testing-default-smithi/7397957 2023-09-19T10:32:38.560 INFO:teuthology.dispatcher.supervisor:Job PID: 2864279 2023-09-19T10:32:38.561 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-19T10:34:38.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:36:38.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:38:38.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:40:39.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:42:39.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:44:39.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:46:39.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:48:39.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:50:39.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:52:39.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:54:40.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:56:40.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T10:58:40.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:00:40.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:02:40.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:04:40.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:06:40.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:08:41.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:10:41.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:12:41.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:14:41.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:16:41.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:18:41.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:20:42.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:22:42.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:24:42.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:26:42.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:28:42.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:30:42.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:32:43.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:34:43.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:36:43.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:38:43.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:40:43.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:42:43.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:44:44.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:46:44.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:48:44.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:50:44.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:52:44.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:54:44.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:56:45.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-19T11:56:45.211 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-19T11:56:45.321 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-19T11:56:45.322 INFO:teuthology.nuke:Checking targets against current locks 2023-09-19T11:56:45.369 DEBUG:teuthology.nuke:shortname: smithi044 2023-09-19T11:56:45.369 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-19T11:56:45.391 DEBUG:teuthology.nuke:shortname: smithi172 2023-09-19T11:56:45.391 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-19T11:56:45.395 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-19_10:27:43-fs:volumes-wip-mchangir-testing-20230908.140927-testing-default-smithi/7397957', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-19 10:27:55.680870', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-19T11:56:45.415 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-19_10:27:43-fs:volumes-wip-mchangir-testing-20230908.140927-testing-default-smithi/7397957', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-19 10:27:55.682845', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-19T11:56:45.438 INFO:teuthology.orchestra.console.smithi044:Power off 2023-09-19T11:56:45.439 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-19T11:56:45.459 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2023-09-19T11:56:45.460 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-19T11:56:45.476 INFO:teuthology.orchestra.console.smithi172:Power off 2023-09-19T11:56:45.477 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-19T11:56:45.485 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-09-19T11:56:45.496 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-09-19T11:56:45.496 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-19T11:56:45.516 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-09-19T11:56:45.586 INFO:teuthology.orchestra.console.smithi044:Power off completed 2023-09-19T11:56:45.618 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-09-19T11:56:45.749 INFO:teuthology.lock.ops:unlocked: smithi044.front.sepia.ceph.com 2023-09-19T11:56:45.765 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com