2023-11-17T03:32:21.726 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-17T03:32:21.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:32:21.890 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff9b3a81940>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff9b4578670>, signals=[15])
2023-11-17T03:32:21.890 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging
2023-11-17T03:32:21.890 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server
2023-11-17T03:32:21.890 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-11-17T03:32:21.918 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2023-11-17T03:32:21.919 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2023-11-17T03:32:21.919 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-11-17T03:32:21.920 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"}
2023-11-17T03:32:21.943 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"}
2023-11-17T03:32:22.006 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-17T03:32:22.010 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-17T03:32:22.054 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_8.stream (ID 3)
2023-11-17T03:32:22.054 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 3}
2023-11-17T03:32:22.057 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_8.stream (ID 3)
2023-11-17T03:32:22.057 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 3}
2023-11-17T03:32:22.104 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.stream
2023-11-17T03:32:22.104 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:32:22.109 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 8.stream
2023-11-17T03:32:22.109 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:32:22.151 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"}
2023-11-17T03:32:22.156 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"}
2023-11-17T03:32:22.198 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1}
2023-11-17T03:32:22.202 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1}
2023-11-17T03:32:22.255 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:32:22.259 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:32:22.337 INFO:teuthology.orchestra.console.smithi112:Power off
2023-11-17T03:32:22.337 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-17T03:32:22.369 INFO:teuthology.orchestra.console.smithi092:Power off
2023-11-17T03:32:22.369 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-17T03:32:22.464 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2023-11-17T03:32:22.465 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:22.482 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off
2023-11-17T03:32:22.482 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:22.506 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-11-17T03:32:22.524 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on
2023-11-17T03:32:26.510 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:26.525 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:26.623 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-11-17T03:32:26.633 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on
2023-11-17T03:32:30.626 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:30.634 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:30.735 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-11-17T03:32:30.742 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-11-17T03:32:30.843 INFO:teuthology.orchestra.console.smithi092:Power off completed
2023-11-17T03:32:30.943 INFO:teuthology.orchestra.console.smithi092:Power on
2023-11-17T03:32:30.943 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-17T03:32:30.975 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On
2023-11-17T03:32:30.976 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:31.002 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-11-17T03:32:34.738 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:34.848 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-11-17T03:32:34.949 INFO:teuthology.orchestra.console.smithi112:Power off completed
2023-11-17T03:32:35.003 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:35.050 INFO:teuthology.orchestra.console.smithi112:Power on
2023-11-17T03:32:35.050 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-17T03:32:35.077 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2023-11-17T03:32:35.078 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:35.114 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-11-17T03:32:35.116 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-11-17T03:32:39.118 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:39.125 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:39.227 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on
2023-11-17T03:32:39.233 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-11-17T03:32:39.328 INFO:teuthology.orchestra.console.smithi092:Power on completed
2023-11-17T03:32:39.429 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish
2023-11-17T03:32:39.429 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:32:43.234 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T03:32:43.343 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-11-17T03:32:43.474 INFO:teuthology.orchestra.console.smithi112:Power on completed
2023-11-17T03:32:43.575 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2023-11-17T03:32:43.575 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:32:54.497 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:33:21.851 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:33:36.914 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:33:36.916 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:33:51.982 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:33:51.984 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:34:07.050 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:34:07.054 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:34:22.118 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:34:22.120 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:34:37.182 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:34:37.183 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:34:52.247 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:34:52.248 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:35:07.310 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:35:07.312 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:35:22.377 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-11-17T03:35:22.378 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-11-17T03:35:22.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:35:22.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:35:25.498 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-11-17T03:35:31.326 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-11-17T03:35:37.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:35:37.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:35:40.410 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-11-17T03:35:40.411 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-11-17T03:35:46.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:35:46.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:35:49.498 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-11-17T03:35:49.499 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-11-17T03:35:55.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:36:25.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:36:28.446 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-11-17T03:36:34.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:36:37.534 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-11-17T03:36:43.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:36:45.919 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-17T03:36:45.919 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-17T03:37:11.324 INFO:teuthology.provision.fog.smithi092:Node is ready
2023-11-17T03:37:11.324 DEBUG:teuthology.orchestra.run.smithi092:> hostname
2023-11-17T03:37:11.353 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com
2023-11-17T03:37:11.353 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts
2023-11-17T03:37:11.414 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092
2023-11-17T03:37:11.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-11-17T03:37:11.540 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts
2023-11-17T03:37:11.573 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts
2023-11-17T03:37:11.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname
2023-11-17T03:37:11.713 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-11-17T03:37:11.779 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-11-17T03:37:11.837 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream"
2023-11-17T03:37:11.837 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8"
2023-11-17T03:37:11.837 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos"
2023-11-17T03:37:11.837 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora"
2023-11-17T03:37:11.837 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8"
2023-11-17T03:37:11.838 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2023-11-17T03:37:11.838 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-17T03:37:11.838 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-11-17T03:37:11.838 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-17T03:37:11.838 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/"
2023-11-17T03:37:11.838 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-17T03:37:11.838 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-17T03:37:11.838 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-17T03:37:11.839 INFO:teuthology.provision.fog.smithi092:Deploy complete!
2023-11-17T03:37:11.840 DEBUG:teuthology.parallel:result is None
2023-11-17T03:37:25.402 WARNING:teuthology.provision.fog.smithi112:timed out
2023-11-17T03:37:31.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:37:31.658 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-17T03:37:31.659 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-17T03:37:31.917 INFO:teuthology.provision.fog.smithi112:Node is ready
2023-11-17T03:37:31.917 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2023-11-17T03:37:31.936 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2023-11-17T03:37:31.936 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2023-11-17T03:37:31.995 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2023-11-17T03:37:31.996 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-11-17T03:37:32.085 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2023-11-17T03:37:32.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2023-11-17T03:37:32.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2023-11-17T03:37:32.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-11-17T03:37:32.319 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2023-11-17T03:37:32.377 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream"
2023-11-17T03:37:32.377 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8"
2023-11-17T03:37:32.377 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos"
2023-11-17T03:37:32.377 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora"
2023-11-17T03:37:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8"
2023-11-17T03:37:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2023-11-17T03:37:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-17T03:37:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2023-11-17T03:37:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-17T03:37:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/"
2023-11-17T03:37:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-17T03:37:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-17T03:37:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-17T03:37:32.378 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2023-11-17T03:37:32.379 DEBUG:teuthology.parallel:result is None
2023-11-17T03:37:32.535 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com
2023-11-17T03:37:32.535 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-17T03:37:32.572 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com
2023-11-17T03:37:32.572 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-17T03:37:32.590 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server
2023-11-17T03:37:32.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2023-11-17T03:37:32.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:37:32.664 DEBUG:teuthology.orchestra.run.smithi092:> true
2023-11-17T03:37:32.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com'
2023-11-17T03:37:32.803 DEBUG:teuthology.orchestra.run.smithi092:> uname -m
2023-11-17T03:37:32.865 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64
2023-11-17T03:37:32.866 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-11-17T03:37:32.927 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-17T03:37:32.929 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-11-17T03:37:32.955 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server
2023-11-17T03:37:32.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-11-17T03:37:32.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-17T03:37:33.025 DEBUG:teuthology.orchestra.run.smithi112:> true
2023-11-17T03:37:33.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-11-17T03:37:33.094 DEBUG:teuthology.orchestra.run.smithi112:> uname -m
2023-11-17T03:37:33.153 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64
2023-11-17T03:37:33.153 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-17T03:37:33.215 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-17T03:37:33.216 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-17T03:37:33.216 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-11-17T03:37:33.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:37:33.325 INFO:teuthology.dispatcher.supervisor:Running job 7461258
2023-11-17T03:37:33.325 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461258 --name yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi --description rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/dashboard} -- /home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461258/orig.config.yaml
2023-11-17T03:37:33.328 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461258
2023-11-17T03:37:33.328 INFO:teuthology.dispatcher.supervisor:Job PID: 3938685
2023-11-17T03:37:33.329 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-17T03:39:33.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:41:33.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:43:33.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:45:33.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:47:56.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:49:56.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:51:56.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:53:56.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:55:56.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T03:58:07.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:00:07.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:02:15.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:04:15.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:06:21.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:08:22.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:10:22.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:12:22.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:14:22.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:16:22.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:18:48.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:20:48.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:22:57.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:25:30.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:27:30.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:29:31.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:31:31.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:33:58.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:35:58.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:37:59.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:41:27.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:43:28.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:45:28.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:47:28.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:49:28.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:51:28.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:54:14.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:56:14.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T04:58:18.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:00:18.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:02:18.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:05:03.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:07:04.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:09:04.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:11:04.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:13:37.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:15:42.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:17:43.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:20:03.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:22:03.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:24:03.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:26:03.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:29:24.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-17T05:29:24.314 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-17T05:29:24.495 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-17T05:29:24.496 INFO:teuthology.nuke:Checking targets against current locks
2023-11-17T05:29:24.541 DEBUG:teuthology.nuke:shortname: smithi092
2023-11-17T05:29:24.542 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-17T05:29:24.560 DEBUG:teuthology.nuke:shortname: smithi112
2023-11-17T05:29:24.561 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-17T05:29:24.563 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461258', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 03:32:20.789582', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9+gKpypyNS6uixKSJTax8D5TnTa4crpd+qYRobDXPaE2tVp/D8dGFJcfVEARWnVQcO5ZTFiCz8rl64OA9gJ3E='}
2023-11-17T05:29:24.583 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-16_22:29:26-rados-wip-yuri3-testing-2023-11-14-1227-pacific-distro-default-smithi/7461258', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 03:32:20.791414', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8mtectVNY8S84iVB++bcgjCKkuU9+/PXHoFCW8H0Y0OYkPuI1SHzuV0ZPufRXhLZlzgUTrQx/9f5ibNW7X+fs='}
2023-11-17T05:29:24.611 INFO:teuthology.orchestra.console.smithi092:Power off
2023-11-17T05:29:24.612 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-17T05:29:24.634 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off
2023-11-17T05:29:24.634 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:29:24.647 INFO:teuthology.orchestra.console.smithi112:Power off
2023-11-17T05:29:24.648 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-17T05:29:24.659 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off
2023-11-17T05:29:24.668 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2023-11-17T05:29:24.669 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-17T05:29:24.689 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-11-17T05:29:24.760 INFO:teuthology.orchestra.console.smithi092:Power off completed
2023-11-17T05:29:24.791 INFO:teuthology.orchestra.console.smithi112:Power off completed
2023-11-17T05:29:24.932 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com
2023-11-17T05:29:25.035 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com