2023-08-23T02:29:13.351 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-23T02:29:13.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:29:13.501 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9e99543ca0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9e9a7b5310>, signals=[15])
2023-08-23T02:29:13.503 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging
2023-08-23T02:29:13.503 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server
2023-08-23T02:29:13.503 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2023-08-23T02:29:13.520 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging
2023-08-23T02:29:13.520 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server
2023-08-23T02:29:13.521 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2023-08-23T02:29:13.522 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"}
2023-08-23T02:29:13.544 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"}
2023-08-23T02:29:13.591 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-23T02:29:13.611 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-23T02:29:13.628 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_8.stream (ID 3)
2023-08-23T02:29:13.629 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 3}
2023-08-23T02:29:13.654 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_8.stream (ID 3)
2023-08-23T02:29:13.655 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 3}
2023-08-23T02:29:13.675 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.stream
2023-08-23T02:29:13.675 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:29:13.693 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream
2023-08-23T02:29:13.693 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:29:13.745 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"}
2023-08-23T02:29:13.751 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"}
2023-08-23T02:29:13.782 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1}
2023-08-23T02:29:13.792 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1}
2023-08-23T02:29:13.828 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:29:13.855 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:29:13.943 INFO:teuthology.orchestra.console.smithi049:Power off
2023-08-23T02:29:13.944 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-23T02:29:13.957 INFO:teuthology.orchestra.console.smithi181:Power off
2023-08-23T02:29:13.958 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-23T02:29:13.966 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2023-08-23T02:29:13.967 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:13.981 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2023-08-23T02:29:13.982 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:13.991 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-08-23T02:29:14.005 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2023-08-23T02:29:17.996 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:18.006 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:18.107 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-08-23T02:29:18.116 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2023-08-23T02:29:22.112 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:22.119 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:22.222 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-08-23T02:29:22.231 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2023-08-23T02:29:22.323 INFO:teuthology.orchestra.console.smithi049:Power off completed
2023-08-23T02:29:22.424 INFO:teuthology.orchestra.console.smithi049:Power on
2023-08-23T02:29:22.425 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-23T02:29:22.448 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On
2023-08-23T02:29:22.448 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:22.471 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-08-23T02:29:26.232 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:26.343 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-08-23T02:29:26.444 INFO:teuthology.orchestra.console.smithi181:Power off completed
2023-08-23T02:29:26.472 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:26.546 INFO:teuthology.orchestra.console.smithi181:Power on
2023-08-23T02:29:26.546 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-23T02:29:26.566 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On
2023-08-23T02:29:26.567 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:26.582 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-08-23T02:29:26.586 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-08-23T02:29:30.588 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:30.595 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:30.698 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2023-08-23T02:29:30.704 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-08-23T02:29:30.799 INFO:teuthology.orchestra.console.smithi049:Power on completed
2023-08-23T02:29:30.900 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2023-08-23T02:29:30.900 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:29:34.708 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T02:29:34.818 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2023-08-23T02:29:34.919 INFO:teuthology.orchestra.console.smithi181:Power on completed
2023-08-23T02:29:35.020 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2023-08-23T02:29:35.021 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:29:45.980 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:29:50.109 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:30:01.060 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:30:05.184 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:30:16.142 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:30:20.258 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:30:31.236 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:30:35.330 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:30:46.320 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:30:50.412 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:31:01.416 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:31:05.496 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:31:16.520 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:31:20.603 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:31:31.639 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:31:35.700 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:31:46.752 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:31:50.816 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:32:01.850 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:32:05.922 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:32:16.964 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:32:21.020 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-08-23T02:32:21.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:32:24.176 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-08-23T02:32:30.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:32:32.052 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:32:33.236 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-08-23T02:32:39.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:32:42.324 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-08-23T02:32:47.153 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None
2023-08-23T02:32:47.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:32:48.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:32:50.292 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:32:51.380 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-08-23T02:32:56.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:32:57.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:32:59.376 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:33:00.437 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-08-23T02:33:05.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:33:06.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:33:08.432 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:33:09.524 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-08-23T02:33:14.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:33:15.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:33:17.492 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:33:23.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:33:26.580 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:33:32.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:33:35.668 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:33:41.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:33:44.756 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:33:50.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:33:53.840 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:33:59.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:34:02.896 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:34:08.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:34:11.956 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:34:15.532 WARNING:teuthology.provision.fog.smithi181:timed out
2023-08-23T02:34:17.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:34:21.044 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2023-08-23T02:34:21.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:34:21.770 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-23T02:34:21.771 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-23T02:34:22.040 INFO:teuthology.provision.fog.smithi181:Node is ready
2023-08-23T02:34:22.040 DEBUG:teuthology.orchestra.run.smithi181:> hostname
2023-08-23T02:34:22.060 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2023-08-23T02:34:22.061 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts
2023-08-23T02:34:22.119 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2023-08-23T02:34:22.120 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2023-08-23T02:34:22.207 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts
2023-08-23T02:34:22.237 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts
2023-08-23T02:34:22.306 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname
2023-08-23T02:34:22.374 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2023-08-23T02:34:22.441 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2023-08-23T02:34:22.499 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream"
2023-08-23T02:34:22.499 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8"
2023-08-23T02:34:22.499 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos"
2023-08-23T02:34:22.499 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora"
2023-08-23T02:34:22.500 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8"
2023-08-23T02:34:22.500 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8"
2023-08-23T02:34:22.500 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-23T02:34:22.500 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2023-08-23T02:34:22.500 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-23T02:34:22.500 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/"
2023-08-23T02:34:22.501 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-23T02:34:22.501 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-23T02:34:22.501 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-23T02:34:22.502 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2023-08-23T02:34:22.504 DEBUG:teuthology.parallel:result is None
2023-08-23T02:34:27.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:35:27.108 WARNING:teuthology.provision.fog.smithi049:timed out
2023-08-23T02:35:33.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:35:33.379 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-23T02:35:33.379 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-23T02:35:33.630 INFO:teuthology.provision.fog.smithi049:Node is ready
2023-08-23T02:35:33.631 DEBUG:teuthology.orchestra.run.smithi049:> hostname
2023-08-23T02:35:33.652 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2023-08-23T02:35:33.653 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts
2023-08-23T02:35:33.713 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2023-08-23T02:35:33.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2023-08-23T02:35:33.809 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts
2023-08-23T02:35:33.840 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts
2023-08-23T02:35:33.910 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname
2023-08-23T02:35:33.980 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2023-08-23T02:35:34.048 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2023-08-23T02:35:34.106 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2023-08-23T02:35:34.106 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2023-08-23T02:35:34.106 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2023-08-23T02:35:34.107 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2023-08-23T02:35:34.107 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2023-08-23T02:35:34.107 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2023-08-23T02:35:34.107 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-23T02:35:34.107 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2023-08-23T02:35:34.107 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-23T02:35:34.108 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2023-08-23T02:35:34.108 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-23T02:35:34.108 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-23T02:35:34.108 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-23T02:35:34.109 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2023-08-23T02:35:34.110 DEBUG:teuthology.parallel:result is None
2023-08-23T02:35:34.251 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2023-08-23T02:35:34.252 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-23T02:35:34.277 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2023-08-23T02:35:34.278 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-23T02:35:34.295 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2023-08-23T02:35:34.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2023-08-23T02:35:34.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:35:34.365 DEBUG:teuthology.orchestra.run.smithi049:> true
2023-08-23T02:35:34.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com'
2023-08-23T02:35:34.435 DEBUG:teuthology.orchestra.run.smithi049:> uname -m
2023-08-23T02:35:34.493 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2023-08-23T02:35:34.494 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2023-08-23T02:35:34.552 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2023-08-23T02:35:34.552 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2023-08-23T02:35:34.552 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2023-08-23T02:35:34.552 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2023-08-23T02:35:34.553 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2023-08-23T02:35:34.553 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2023-08-23T02:35:34.553 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-23T02:35:34.553 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2023-08-23T02:35:34.553 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-23T02:35:34.553 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2023-08-23T02:35:34.553 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-23T02:35:34.554 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-23T02:35:34.554 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-23T02:35:34.554 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2023-08-23T02:35:34.569 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2023-08-23T02:35:34.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2023-08-23T02:35:34.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T02:35:34.637 DEBUG:teuthology.orchestra.run.smithi181:> true
2023-08-23T02:35:34.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com'
2023-08-23T02:35:34.772 DEBUG:teuthology.orchestra.run.smithi181:> uname -m
2023-08-23T02:35:34.830 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2023-08-23T02:35:34.830 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2023-08-23T02:35:34.888 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream"
2023-08-23T02:35:34.889 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8"
2023-08-23T02:35:34.889 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos"
2023-08-23T02:35:34.889 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora"
2023-08-23T02:35:34.889 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8"
2023-08-23T02:35:34.889 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8"
2023-08-23T02:35:34.889 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-23T02:35:34.890 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2023-08-23T02:35:34.890 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-23T02:35:34.890 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/"
2023-08-23T02:35:34.890 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-23T02:35:34.890 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-23T02:35:34.890 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-23T02:35:34.891 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2023-08-23T02:35:34.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:35:34.994 INFO:teuthology.dispatcher.supervisor:Running job 7376142
2023-08-23T02:35:34.994 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376142 --name mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376142/orig.config.yaml
2023-08-23T02:35:34.998 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376142
2023-08-23T02:35:34.999 INFO:teuthology.dispatcher.supervisor:Job PID: 21215
2023-08-23T02:35:34.999 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-23T02:37:35.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:39:35.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:41:35.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:43:35.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:45:35.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:47:35.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:49:36.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:51:36.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:53:36.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:55:36.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:57:36.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T02:59:36.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T03:01:37.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T03:03:37.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T03:05:37.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T03:07:37.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T03:09:37.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T03:11:37.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T03:13:38.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T03:15:38.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T03:15:38.377 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-23T03:15:38.585 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-23T03:15:38.586 INFO:teuthology.nuke:Checking targets against current locks
2023-08-23T03:15:38.638 DEBUG:teuthology.nuke:shortname: smithi049
2023-08-23T03:15:38.638 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-23T03:15:38.659 DEBUG:teuthology.nuke:shortname: smithi181
2023-08-23T03:15:38.659 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-23T03:15:38.662 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 02:29:12.546986', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsciaFpBnK3/rGRE6rZ7ptNOIC8lDU+8bLyKTdPkQPVJoQSPpi/go6wTwaU/lGAfWdXELCLm9ZZg5dyJW1SmwQYKjECh+aCGpuyQ+XHr5qUHwylfuvTOdXMgu/80QrXYRSSxiOjSsV4nfaCCXXMT9JVeToplHviA/nVyq7JlGn2/IeOfdBzM3i9/ffCf2jtyK8f3/1fMqQJHBMxDR0FYbXZAtYpgnzJVNQBgZtOBG2erW3Fju4T1ZsiCvqZcC9SA9W9j6LaaJ/z0RVwf+4CcLJ5Ue9lXffEiwewyEBTOcG7awkvVGP4ysIATZknKvnKWSH1kriUAfWJWyl5CZJMxuavGWdOj8L4u+dQ425wjKWhxD1SkyisIoqf0yLlMrwQlmewxdrPPH8LdSjrmPNoDMi99pfzsjopeX7mt9I7qfB6wmHlhyF8Y1GxX0nhbrfTVIKPpQ/1JVzzYzlukJlNfAKTN/RVOsOEUMQrQSOyMcOzeM7Z25M9xOp3UDXXaw51cs='}
2023-08-23T03:15:38.681 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 02:29:12.545921', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkQt5K/WBNIympHwskoGER2MB+h+CKBTWcy+9Oc9qZ5ia+K8vKumdAO9wD6G1sLfkWgmGj5895vbLaMG2abAXl81cDGHe5QkMynKe9OsainVfT9SgfQqA8x5f0VemviXi7jSrlPZSf04fa2AcASCFcsYrc+WVnA73erLo9iCYFjhfYgoy8ex47UO4GKyGtLAXW5/TsCPUb2ft7N6zBRDUWtgl7cvQokCUCbFiysAZ7fgTiZmEY/hIpXMtE8AlwNm/LC6p3oKZFl9eyNVII9ZwOfxLzd2HD2tFAuWrlv1+PSO8bMfww6tP3bQQbp3iCnGxZobvgzYOH4pr6gVHkubg7mnu/osWDJS/Lhzs3u1zqpjQd/wajKBwXrVMyYkpX8dQvhCX/2BVZJK3RlPylXkjKxoS2k3KWpLzeY18mDJt93fs59NlicrdKIkwDtZ5JRwfnAVjFVEjFjUERTHu7GIkXwASvapT+s3wPS/J4WIF4VjiovhZg+vWUzrMkVLVe60k='}
2023-08-23T03:15:38.725 INFO:teuthology.orchestra.console.smithi049:Power off
2023-08-23T03:15:38.726 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-23T03:15:38.743 INFO:teuthology.orchestra.console.smithi181:Power off
2023-08-23T03:15:38.744 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-23T03:15:38.756 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2023-08-23T03:15:38.757 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T03:15:38.772 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2023-08-23T03:15:38.772 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T03:15:38.782 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2023-08-23T03:15:38.797 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-08-23T03:15:38.884 INFO:teuthology.orchestra.console.smithi049:Power off completed
2023-08-23T03:15:38.899 INFO:teuthology.orchestra.console.smithi181:Power off completed
2023-08-23T03:15:39.042 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2023-08-23T03:15:39.051 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com