2023-10-13T13:41:40.280 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-13T13:41:40.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T13:41:40.436 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7b78ed0670>, signals=[15]) 2023-10-13T13:41:40.438 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-10-13T13:41:40.438 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-10-13T13:41:40.438 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-10-13T13:41:40.463 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-10-13T13:41:40.463 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-10-13T13:41:40.464 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-13T13:41:40.465 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-10-13T13:41:40.488 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-10-13T13:41:40.538 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-13T13:41:40.551 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-13T13:41:40.582 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_9.stream (ID 10) 2023-10-13T13:41:40.583 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 10} 2023-10-13T13:41:40.588 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10) 2023-10-13T13:41:40.588 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 10} 2023-10-13T13:41:40.629 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream 2023-10-13T13:41:40.629 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:41:40.632 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 9.stream 2023-10-13T13:41:40.633 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:41:40.686 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-10-13T13:41:40.690 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-10-13T13:41:40.725 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-10-13T13:41:40.729 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-10-13T13:41:40.786 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:41:40.789 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:41:40.903 INFO:teuthology.orchestra.console.smithi167:Power off 2023-10-13T13:41:40.904 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-13T13:41:40.913 INFO:teuthology.orchestra.console.smithi192:Power off 2023-10-13T13:41:40.914 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-13T13:41:40.934 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-10-13T13:41:40.935 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:40.941 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-10-13T13:41:40.942 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:40.956 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-13T13:41:40.962 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-13T13:41:44.960 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:44.967 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:45.069 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-13T13:41:45.074 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-13T13:41:49.075 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:49.082 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:49.184 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-13T13:41:49.189 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-13T13:41:53.190 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:53.196 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:53.298 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-13T13:41:53.305 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-13T13:41:53.399 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-10-13T13:41:53.406 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-10-13T13:41:53.501 INFO:teuthology.orchestra.console.smithi192:Power on 2023-10-13T13:41:53.501 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-13T13:41:53.507 INFO:teuthology.orchestra.console.smithi167:Power on 2023-10-13T13:41:53.508 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-13T13:41:53.521 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-10-13T13:41:53.521 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:53.529 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-10-13T13:41:53.529 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:53.542 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-13T13:41:53.550 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-13T13:41:57.547 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:57.553 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:41:57.655 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-13T13:41:57.662 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-13T13:41:57.757 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-10-13T13:41:57.858 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-10-13T13:41:57.858 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:42:01.667 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T13:42:01.775 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-13T13:42:01.875 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-10-13T13:42:01.976 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-10-13T13:42:01.977 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:42:12.936 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:42:17.052 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:42:28.007 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:42:32.117 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:42:43.082 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:42:47.189 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:42:58.158 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:43:02.258 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:43:13.235 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:43:17.338 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:43:28.310 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:43:32.414 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:43:43.389 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:43:47.511 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:43:58.473 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:44:02.606 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:44:13.550 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:44:17.711 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:44:28.639 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-10-13T13:44:28.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:44:32.790 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:44:47.238 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-13T13:44:47.857 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-13T13:44:47.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:44:53.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:44:56.314 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-13T13:45:02.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:45:05.406 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-13T13:45:06.426 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-13T13:45:11.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:45:12.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:45:14.490 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-13T13:45:15.482 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-13T13:45:20.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:45:21.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:45:23.578 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-13T13:45:24.538 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-13T13:45:29.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:45:30.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:45:33.598 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-13T13:45:39.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:45:42.682 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-13T13:45:48.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:46:29.593 WARNING:teuthology.provision.fog.smithi192:timed out 2023-10-13T13:46:35.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:46:35.833 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-13T13:46:35.834 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-13T13:46:36.155 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-10-13T13:46:36.156 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-10-13T13:46:36.171 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-10-13T13:46:36.171 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-10-13T13:46:36.226 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-10-13T13:46:36.227 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-10-13T13:46:36.331 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-10-13T13:46:36.359 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-10-13T13:46:36.427 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-10-13T13:46:36.495 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-10-13T13:46:36.562 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-13T13:46:36.615 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-10-13T13:46:36.616 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2023-10-13T13:46:36.616 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-10-13T13:46:36.616 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-10-13T13:46:36.616 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2023-10-13T13:46:36.616 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2023-10-13T13:46:36.617 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-13T13:46:36.617 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-10-13T13:46:36.617 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2023-10-13T13:46:36.617 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-13T13:46:36.617 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-10-13T13:46:36.618 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-13T13:46:36.618 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-13T13:46:36.618 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-13T13:46:36.619 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-10-13T13:46:36.621 DEBUG:teuthology.parallel:result is None 2023-10-13T13:46:48.696 WARNING:teuthology.provision.fog.smithi167:timed out 2023-10-13T13:46:54.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:46:54.902 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-13T13:46:54.903 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-13T13:46:55.237 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-10-13T13:46:55.237 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-10-13T13:46:55.252 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-10-13T13:46:55.252 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2023-10-13T13:46:55.307 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-10-13T13:46:55.307 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-10-13T13:46:55.419 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2023-10-13T13:46:55.447 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-10-13T13:46:55.514 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2023-10-13T13:46:55.580 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-10-13T13:46:55.647 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-10-13T13:46:55.701 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-10-13T13:46:55.701 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2023-10-13T13:46:55.701 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-10-13T13:46:55.701 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-10-13T13:46:55.702 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2023-10-13T13:46:55.702 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2023-10-13T13:46:55.702 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-13T13:46:55.702 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-10-13T13:46:55.703 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2023-10-13T13:46:55.703 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-13T13:46:55.703 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-10-13T13:46:55.703 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-13T13:46:55.703 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-13T13:46:55.703 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-13T13:46:55.704 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-10-13T13:46:55.704 DEBUG:teuthology.parallel:result is None 2023-10-13T13:46:55.864 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-10-13T13:46:55.865 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-13T13:46:55.888 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-10-13T13:46:55.889 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-13T13:46:55.914 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-10-13T13:46:55.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-13T13:46:55.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:46:55.999 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-10-13T13:46:56.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-13T13:46:56.065 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-10-13T13:46:56.119 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-10-13T13:46:56.119 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-10-13T13:46:56.173 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-10-13T13:46:56.173 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2023-10-13T13:46:56.173 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-10-13T13:46:56.173 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-10-13T13:46:56.174 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2023-10-13T13:46:56.174 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2023-10-13T13:46:56.174 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-13T13:46:56.174 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-10-13T13:46:56.174 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2023-10-13T13:46:56.175 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-13T13:46:56.175 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-10-13T13:46:56.175 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-13T13:46:56.175 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-13T13:46:56.175 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-13T13:46:56.176 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-10-13T13:46:56.197 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-10-13T13:46:56.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-13T13:46:56.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T13:46:56.279 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-13T13:46:56.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-13T13:46:56.444 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-10-13T13:46:56.499 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-10-13T13:46:56.499 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-13T13:46:56.553 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-10-13T13:46:56.554 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2023-10-13T13:46:56.554 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-10-13T13:46:56.554 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-10-13T13:46:56.554 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2023-10-13T13:46:56.555 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2023-10-13T13:46:56.555 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-13T13:46:56.555 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-10-13T13:46:56.555 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2023-10-13T13:46:56.555 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-13T13:46:56.555 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-10-13T13:46:56.556 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-13T13:46:56.556 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-13T13:46:56.556 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-13T13:46:56.556 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-13T13:46:56.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T13:46:56.666 INFO:teuthology.dispatcher.supervisor:Running job 7424228 2023-10-13T13:46:56.667 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424228 --name mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424228/orig.config.yaml 2023-10-13T13:46:56.670 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424228 2023-10-13T13:46:56.671 INFO:teuthology.dispatcher.supervisor:Job PID: 955811 2023-10-13T13:46:56.671 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-13T13:48:56.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T13:50:56.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T13:52:57.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T13:54:57.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T13:56:57.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T13:58:57.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:00:57.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:02:57.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:04:57.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:06:58.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:08:58.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:10:58.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:12:58.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:14:58.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:16:58.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:18:59.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:20:59.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:22:59.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:24:59.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:26:59.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:28:59.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:30:59.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:32:59.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:35:00.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:37:00.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:39:00.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:41:00.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:43:00.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:45:00.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:47:00.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:49:01.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:51:01.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:53:01.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:55:01.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:57:01.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T14:59:01.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:01:02.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:03:02.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:05:02.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:07:02.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:09:02.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:11:02.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:13:02.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:15:03.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:17:03.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:19:03.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:21:03.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:23:03.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:25:03.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:27:04.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:29:04.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:31:04.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:33:04.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:35:04.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:37:04.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:39:05.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:41:05.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:43:05.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:45:05.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T15:45:05.564 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-13T15:45:05.681 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-13T15:45:05.681 INFO:teuthology.nuke:Checking targets against current locks 2023-10-13T15:45:05.734 DEBUG:teuthology.nuke:shortname: smithi167 2023-10-13T15:45:05.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-13T15:45:05.747 DEBUG:teuthology.nuke:shortname: smithi192 2023-10-13T15:45:05.747 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-13T15:45:05.754 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-13 13:41:39.488413', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM0t8OzwNRy1cLD18sA0rwqebvSgHY7yZc8CNkHk5m0HsHDQIcHILlQM8x+bZbzhIQLm9rA/mmD8kjBVzsomaA0='} 2023-10-13T15:45:05.767 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-13 13:41:39.490162', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4gMV5rl1yx5kuMT3z0Pp8ljEaWXpM5w03hC1fxYkmH+uyQV5gagYz3t6aCA39hPFNEeNgMiaofM4+JrM/4HpA='} 2023-10-13T15:45:05.801 INFO:teuthology.orchestra.console.smithi167:Power off 2023-10-13T15:45:05.802 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-13T15:45:05.814 INFO:teuthology.orchestra.console.smithi192:Power off 2023-10-13T15:45:05.815 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-13T15:45:05.822 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-10-13T15:45:05.823 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T15:45:05.834 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-10-13T15:45:05.835 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-13T15:45:05.842 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-13T15:45:05.855 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-13T15:45:05.943 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-10-13T15:45:05.956 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-10-13T15:45:06.096 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com 2023-10-13T15:45:06.106 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com