2023-08-22T02:53:22.888 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-22T02:53:22.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T02:53:23.023 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f031d35fcd0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f031cc81f70>, signals=[15])
2023-08-22T02:53:23.029 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging
2023-08-22T02:53:23.030 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server
2023-08-22T02:53:23.030 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2023-08-22T02:53:23.059 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging
2023-08-22T02:53:23.059 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server
2023-08-22T02:53:23.059 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2023-08-22T02:53:23.061 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /host {"name": "smithi094"}
2023-08-22T02:53:23.076 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"}
2023-08-22T02:53:23.135 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-22T02:53:23.139 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-22T02:53:23.182 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_9.stream (ID 10)
2023-08-22T02:53:23.182 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 10}
2023-08-22T02:53:23.189 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_9.stream (ID 10)
2023-08-22T02:53:23.189 DEBUG:teuthology.provision.fog.smithi094:FOG request: PUT /host/199 {"imageID": 10}
2023-08-22T02:53:23.233 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 9.stream
2023-08-22T02:53:23.233 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:53:23.236 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 9.stream
2023-08-22T02:53:23.236 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:53:23.292 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"}
2023-08-22T02:53:23.299 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /tasktype {"name": "deploy"}
2023-08-22T02:53:23.344 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1}
2023-08-22T02:53:23.347 DEBUG:teuthology.provision.fog.smithi094:FOG request: POST /host/199/task {"taskTypeID": 1}
2023-08-22T02:53:23.395 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:53:23.406 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:53:23.476 INFO:teuthology.orchestra.console.smithi094:Power off
2023-08-22T02:53:23.477 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-22T02:53:23.494 INFO:teuthology.orchestra.console.smithi125:Power off
2023-08-22T02:53:23.495 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-22T02:53:23.505 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2023-08-22T02:53:23.507 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:23.520 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2023-08-22T02:53:23.520 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:23.530 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2023-08-22T02:53:23.543 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-08-22T02:53:23.643 INFO:teuthology.orchestra.console.smithi125:Power off completed
2023-08-22T02:53:23.744 INFO:teuthology.orchestra.console.smithi125:Power on
2023-08-22T02:53:23.745 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-22T02:53:23.774 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On
2023-08-22T02:53:23.775 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:23.800 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-08-22T02:53:27.532 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:27.642 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2023-08-22T02:53:27.801 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:27.911 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-08-22T02:53:31.644 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:31.753 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-08-22T02:53:31.854 INFO:teuthology.orchestra.console.smithi094:Power off completed
2023-08-22T02:53:31.913 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:31.955 INFO:teuthology.orchestra.console.smithi094:Power on
2023-08-22T02:53:31.956 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-22T02:53:31.977 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On
2023-08-22T02:53:31.978 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:31.999 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-08-22T02:53:32.023 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2023-08-22T02:53:32.123 INFO:teuthology.orchestra.console.smithi125:Power on completed
2023-08-22T02:53:32.224 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2023-08-22T02:53:32.225 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:53:36.004 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:36.113 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-08-22T02:53:40.118 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T02:53:40.228 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2023-08-22T02:53:40.329 INFO:teuthology.orchestra.console.smithi094:Power on completed
2023-08-22T02:53:40.430 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish
2023-08-22T02:53:40.430 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:53:47.300 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:53:55.500 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:54:02.368 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:54:10.580 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:54:17.443 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:54:25.656 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:54:32.505 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:54:40.726 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:54:47.576 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:54:55.804 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:55:02.645 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:55:10.876 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:55:17.712 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:55:25.952 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:55:32.784 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:55:41.016 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:55:47.858 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:55:56.084 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:56:02.932 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None
2023-08-22T02:56:03.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:06.068 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-08-22T02:56:11.164 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:56:12.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:15.156 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-08-22T02:56:21.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:24.244 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-08-22T02:56:26.248 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-08-22T02:56:26.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:29.396 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-08-22T02:56:30.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:33.296 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-08-22T02:56:35.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:38.484 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-08-22T02:56:39.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:42.352 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-08-22T02:56:44.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:47.568 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-08-22T02:56:48.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:51.408 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-08-22T02:56:53.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:56:56.624 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-08-22T02:56:57.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:57:02.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:57:05.680 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-08-22T02:57:11.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:57:57.456 WARNING:teuthology.provision.fog.smithi125:timed out
2023-08-22T02:58:03.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:58:03.668 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-22T02:58:03.669 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-22T02:58:04.011 INFO:teuthology.provision.fog.smithi125:Node is ready
2023-08-22T02:58:04.011 DEBUG:teuthology.orchestra.run.smithi125:> hostname
2023-08-22T02:58:04.028 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2023-08-22T02:58:04.029 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts
2023-08-22T02:58:04.085 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2023-08-22T02:58:04.085 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2023-08-22T02:58:04.209 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts
2023-08-22T02:58:04.241 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts
2023-08-22T02:58:04.313 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname
2023-08-22T02:58:04.385 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2023-08-22T02:58:04.465 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2023-08-22T02:58:04.522 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2023-08-22T02:58:04.522 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9"
2023-08-22T02:58:04.523 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2023-08-22T02:58:04.523 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2023-08-22T02:58:04.523 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9"
2023-08-22T02:58:04.523 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9"
2023-08-22T02:58:04.523 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-22T02:58:04.523 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2023-08-22T02:58:04.524 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon"
2023-08-22T02:58:04.524 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-22T02:58:04.524 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2023-08-22T02:58:04.524 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-22T02:58:04.524 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-22T02:58:04.524 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-22T02:58:04.525 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2023-08-22T02:58:04.526 DEBUG:teuthology.parallel:result is None
2023-08-22T02:58:11.692 WARNING:teuthology.provision.fog.smithi094:timed out
2023-08-22T02:58:17.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:58:17.890 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-22T02:58:17.891 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-22T02:58:18.225 INFO:teuthology.provision.fog.smithi094:Node is ready
2023-08-22T02:58:18.225 DEBUG:teuthology.orchestra.run.smithi094:> hostname
2023-08-22T02:58:18.239 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com
2023-08-22T02:58:18.240 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts
2023-08-22T02:58:18.295 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094
2023-08-22T02:58:18.296 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2023-08-22T02:58:18.424 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts
2023-08-22T02:58:18.453 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts
2023-08-22T02:58:18.521 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname
2023-08-22T02:58:18.589 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2023-08-22T02:58:18.656 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2023-08-22T02:58:18.710 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream"
2023-08-22T02:58:18.711 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9"
2023-08-22T02:58:18.711 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos"
2023-08-22T02:58:18.711 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora"
2023-08-22T02:58:18.711 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9"
2023-08-22T02:58:18.711 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9"
2023-08-22T02:58:18.711 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-22T02:58:18.712 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2023-08-22T02:58:18.712 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon"
2023-08-22T02:58:18.712 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-22T02:58:18.712 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/"
2023-08-22T02:58:18.713 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-22T02:58:18.713 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-22T02:58:18.713 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-22T02:58:18.714 INFO:teuthology.provision.fog.smithi094:Deploy complete!
2023-08-22T02:58:18.714 DEBUG:teuthology.parallel:result is None
2023-08-22T02:58:18.891 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com
2023-08-22T02:58:18.892 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-22T02:58:18.917 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2023-08-22T02:58:18.918 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-22T02:58:18.944 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server
2023-08-22T02:58:18.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com'
2023-08-22T02:58:18.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:58:19.024 DEBUG:teuthology.orchestra.run.smithi094:> true
2023-08-22T02:58:19.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com'
2023-08-22T02:58:19.090 DEBUG:teuthology.orchestra.run.smithi094:> uname -m
2023-08-22T02:58:19.143 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64
2023-08-22T02:58:19.143 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2023-08-22T02:58:19.197 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream"
2023-08-22T02:58:19.197 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9"
2023-08-22T02:58:19.197 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos"
2023-08-22T02:58:19.197 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora"
2023-08-22T02:58:19.197 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9"
2023-08-22T02:58:19.198 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9"
2023-08-22T02:58:19.198 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-22T02:58:19.198 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2023-08-22T02:58:19.198 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon"
2023-08-22T02:58:19.198 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-22T02:58:19.198 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/"
2023-08-22T02:58:19.198 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-22T02:58:19.198 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-22T02:58:19.199 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-22T02:58:19.199 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2023-08-22T02:58:19.217 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2023-08-22T02:58:19.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2023-08-22T02:58:19.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-22T02:58:19.297 DEBUG:teuthology.orchestra.run.smithi125:> true
2023-08-22T02:58:19.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com'
2023-08-22T02:58:19.466 DEBUG:teuthology.orchestra.run.smithi125:> uname -m
2023-08-22T02:58:19.519 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2023-08-22T02:58:19.520 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2023-08-22T02:58:19.573 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2023-08-22T02:58:19.574 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9"
2023-08-22T02:58:19.574 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2023-08-22T02:58:19.574 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2023-08-22T02:58:19.574 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9"
2023-08-22T02:58:19.574 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9"
2023-08-22T02:58:19.574 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-22T02:58:19.575 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2023-08-22T02:58:19.575 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon"
2023-08-22T02:58:19.575 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-22T02:58:19.575 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2023-08-22T02:58:19.575 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-22T02:58:19.575 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-22T02:58:19.575 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-22T02:58:19.576 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2023-08-22T02:58:19.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T02:58:19.698 INFO:teuthology.dispatcher.supervisor:Running job 7375654
2023-08-22T02:58:19.699 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-08-22_02:51:02-fs-wip-mchangir-mgr-snap_schedule-add-support-for-monthly-snapshots-distro-default-smithi/7375654 --name mchangir-2023-08-22_02:51:02-fs-wip-mchangir-mgr-snap_schedule-add-support-for-monthly-snapshots-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-08-22_02:51:02-fs-wip-mchangir-mgr-snap_schedule-add-support-for-monthly-snapshots-distro-default-smithi/7375654/orig.config.yaml
2023-08-22T02:58:19.703 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-08-22_02:51:02-fs-wip-mchangir-mgr-snap_schedule-add-support-for-monthly-snapshots-distro-default-smithi/7375654
2023-08-22T02:58:19.704 INFO:teuthology.dispatcher.supervisor:Job PID: 28053
2023-08-22T02:58:19.704 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-22T03:00:19.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:02:19.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:04:20.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:06:20.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:08:20.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:10:20.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:12:20.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:14:20.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:16:21.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:18:21.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:20:21.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:22:21.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:24:21.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:26:21.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:28:22.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:30:22.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:32:22.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-22T03:32:22.564 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-22T03:32:22.679 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-22T03:32:22.679 INFO:teuthology.nuke:Checking targets against current locks
2023-08-22T03:32:22.727 DEBUG:teuthology.nuke:shortname: smithi094
2023-08-22T03:32:22.727 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-22T03:32:22.745 DEBUG:teuthology.nuke:shortname: smithi125
2023-08-22T03:32:22.746 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-22T03:32:22.748 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-08-22_02:51:02-fs-wip-mchangir-mgr-snap_schedule-add-support-for-monthly-snapshots-distro-default-smithi/7375654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-22 02:53:22.046378', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBL0boDLRYyaNHHlnuyApIiyl7chNlvN2hnuFJPeApzZTJ1CfdgD2iteOjks35dkF+ERQudwpA7ouTcvq5etXz4='}
2023-08-22T03:32:22.768 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-08-22_02:51:02-fs-wip-mchangir-mgr-snap_schedule-add-support-for-monthly-snapshots-distro-default-smithi/7375654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-22 02:53:22.048223', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHdRgvpA8UPHt+FUnEuGDPFBOahkWdwswCdfC243IEuwlHvUjPK7FD9FR1HJwGRJ4Z7GLEy6iFC3O7H+JcKnA1Q='}
2023-08-22T03:32:22.794 INFO:teuthology.orchestra.console.smithi094:Power off
2023-08-22T03:32:22.795 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-22T03:32:22.819 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2023-08-22T03:32:22.820 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T03:32:22.836 INFO:teuthology.orchestra.console.smithi125:Power off
2023-08-22T03:32:22.836 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-22T03:32:22.845 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-08-22T03:32:22.856 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2023-08-22T03:32:22.856 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-22T03:32:22.876 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-08-22T03:32:22.946 INFO:teuthology.orchestra.console.smithi094:Power off completed
2023-08-22T03:32:22.978 INFO:teuthology.orchestra.console.smithi125:Power off completed
2023-08-22T03:32:23.105 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com
2023-08-22T03:32:23.121 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com