2023-08-08T02:00:37.301 INFO:root:teuthology version: 0.0.1.dev181+g7fda959
2023-08-08T02:00:37.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:00:37.447 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fafa541ce20>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fafa46c2ee0>, signals=[15])
2023-08-08T02:00:37.449 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging
2023-08-08T02:00:37.450 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server
2023-08-08T02:00:37.450 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2023-08-08T02:00:37.467 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2023-08-08T02:00:37.468 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2023-08-08T02:00:37.468 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-08-08T02:00:37.469 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /host {"name": "smithi066"}
2023-08-08T02:00:37.492 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"}
2023-08-08T02:00:37.545 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-08T02:00:37.559 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-08T02:00:37.588 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10)
2023-08-08T02:00:37.588 DEBUG:teuthology.provision.fog.smithi066:FOG request: PUT /host/171 {"imageID": 10}
2023-08-08T02:00:37.606 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_9.stream (ID 10)
2023-08-08T02:00:37.606 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 10}
2023-08-08T02:00:37.630 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream
2023-08-08T02:00:37.631 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:00:37.655 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 9.stream
2023-08-08T02:00:37.655 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:00:37.685 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /tasktype {"name": "deploy"}
2023-08-08T02:00:37.702 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"}
2023-08-08T02:00:37.720 DEBUG:teuthology.provision.fog.smithi066:FOG request: POST /host/171/task {"taskTypeID": 1}
2023-08-08T02:00:37.744 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1}
2023-08-08T02:00:37.773 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:00:37.793 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:00:37.867 INFO:teuthology.orchestra.console.smithi066:Power off
2023-08-08T02:00:37.868 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-08T02:00:37.884 INFO:teuthology.orchestra.console.smithi102:Power off
2023-08-08T02:00:37.885 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-08T02:00:37.895 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2023-08-08T02:00:37.896 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:37.908 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2023-08-08T02:00:37.909 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:37.918 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2023-08-08T02:00:37.933 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-08-08T02:00:41.923 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:41.934 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:42.034 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2023-08-08T02:00:42.044 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-08-08T02:00:46.038 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:46.046 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:46.148 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2023-08-08T02:00:46.157 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-08-08T02:00:46.257 INFO:teuthology.orchestra.console.smithi102:Power off completed
2023-08-08T02:00:46.358 INFO:teuthology.orchestra.console.smithi102:Power on
2023-08-08T02:00:46.359 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-08T02:00:46.379 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2023-08-08T02:00:46.379 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:46.399 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-08-08T02:00:50.152 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:50.263 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-08-08T02:00:50.364 INFO:teuthology.orchestra.console.smithi066:Power off completed
2023-08-08T02:00:50.400 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:50.465 INFO:teuthology.orchestra.console.smithi066:Power on
2023-08-08T02:00:50.466 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-08T02:00:50.487 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On
2023-08-08T02:00:50.487 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:50.509 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-08-08T02:00:50.511 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-08-08T02:00:54.512 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:54.521 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:54.623 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-08-08T02:00:54.631 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-08-08T02:00:54.732 INFO:teuthology.orchestra.console.smithi102:Power on completed
2023-08-08T02:00:54.834 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2023-08-08T02:00:54.835 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:00:58.625 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:00:58.734 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2023-08-08T02:00:58.836 INFO:teuthology.orchestra.console.smithi066:Power on completed
2023-08-08T02:00:58.937 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2023-08-08T02:00:58.937 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:01:09.907 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:01:14.008 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:01:24.972 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:01:29.064 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:01:40.040 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:01:44.120 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:01:55.102 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:01:59.176 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:02:10.172 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:02:14.236 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:02:25.248 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:02:29.304 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:02:40.327 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:02:44.376 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:02:55.396 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:02:59.452 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:03:10.472 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:03:14.521 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:03:25.548 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-08-08T02:03:25.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:03:28.688 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-08-08T02:03:29.590 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:03:34.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:03:37.744 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-08-08T02:03:43.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:03:44.659 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:03:46.800 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-08-08T02:03:52.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:03:55.892 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-08-08T02:03:59.728 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:04:01.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:04:04.976 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-08-08T02:04:10.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:04:14.032 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-08-08T02:04:14.812 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-08-08T02:04:14.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:04:17.936 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:04:20.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:04:23.088 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-08-08T02:04:23.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:04:26.992 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:04:29.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:04:32.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:04:36.048 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:04:42.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:04:45.104 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:04:51.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:04:54.160 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:05:00.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:05:03.216 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:05:09.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:05:12.276 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:05:18.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:05:21.364 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:05:27.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:05:29.095 WARNING:teuthology.provision.fog.smithi102:timed out
2023-08-08T02:05:30.452 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:05:35.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:05:35.366 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-08T02:05:35.367 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-08T02:05:35.645 INFO:teuthology.provision.fog.smithi102:Node is ready
2023-08-08T02:05:35.645 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2023-08-08T02:05:35.660 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2023-08-08T02:05:35.661 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2023-08-08T02:05:35.715 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2023-08-08T02:05:35.716 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2023-08-08T02:05:35.818 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2023-08-08T02:05:35.846 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2023-08-08T02:05:35.913 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2023-08-08T02:05:35.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2023-08-08T02:05:36.047 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2023-08-08T02:05:36.101 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2023-08-08T02:05:36.101 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2023-08-08T02:05:36.101 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2023-08-08T02:05:36.101 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2023-08-08T02:05:36.101 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2023-08-08T02:05:36.102 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2023-08-08T02:05:36.102 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-08T02:05:36.102 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2023-08-08T02:05:36.102 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2023-08-08T02:05:36.102 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-08T02:05:36.102 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2023-08-08T02:05:36.103 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-08T02:05:36.103 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-08T02:05:36.103 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-08T02:05:36.104 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2023-08-08T02:05:36.105 DEBUG:teuthology.parallel:result is None
2023-08-08T02:05:36.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:05:39.504 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-08-08T02:05:45.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:06:45.568 WARNING:teuthology.provision.fog.smithi066:timed out
2023-08-08T02:06:51.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:06:51.793 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-08T02:06:51.794 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-08T02:06:52.168 INFO:teuthology.provision.fog.smithi066:Node is ready
2023-08-08T02:06:52.168 DEBUG:teuthology.orchestra.run.smithi066:> hostname
2023-08-08T02:06:52.183 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com
2023-08-08T02:06:52.184 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts
2023-08-08T02:06:52.238 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2023-08-08T02:06:52.239 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2023-08-08T02:06:52.380 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts
2023-08-08T02:06:52.412 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts
2023-08-08T02:06:52.484 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname
2023-08-08T02:06:52.555 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2023-08-08T02:06:52.626 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2023-08-08T02:06:52.680 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2023-08-08T02:06:52.681 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2023-08-08T02:06:52.681 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2023-08-08T02:06:52.681 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2023-08-08T02:06:52.681 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2023-08-08T02:06:52.681 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2023-08-08T02:06:52.681 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-08T02:06:52.681 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2023-08-08T02:06:52.682 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2023-08-08T02:06:52.682 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-08T02:06:52.682 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2023-08-08T02:06:52.682 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-08T02:06:52.682 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-08T02:06:52.682 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-08T02:06:52.683 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2023-08-08T02:06:52.683 DEBUG:teuthology.parallel:result is None
2023-08-08T02:06:52.832 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2023-08-08T02:06:52.833 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-08T02:06:52.852 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2023-08-08T02:06:52.853 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-08T02:06:52.890 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2023-08-08T02:06:52.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2023-08-08T02:06:52.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:06:52.985 DEBUG:teuthology.orchestra.run.smithi066:> true
2023-08-08T02:06:53.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com'
2023-08-08T02:06:53.051 DEBUG:teuthology.orchestra.run.smithi066:> uname -m
2023-08-08T02:06:53.105 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2023-08-08T02:06:53.105 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2023-08-08T02:06:53.158 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2023-08-08T02:06:53.159 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2023-08-08T02:06:53.159 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2023-08-08T02:06:53.159 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2023-08-08T02:06:53.159 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2023-08-08T02:06:53.159 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2023-08-08T02:06:53.159 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-08T02:06:53.160 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2023-08-08T02:06:53.160 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2023-08-08T02:06:53.160 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-08T02:06:53.160 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2023-08-08T02:06:53.160 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-08T02:06:53.160 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-08T02:06:53.160 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-08T02:06:53.161 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2023-08-08T02:06:53.177 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2023-08-08T02:06:53.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-08-08T02:06:53.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T02:06:53.261 DEBUG:teuthology.orchestra.run.smithi102:> true
2023-08-08T02:06:53.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-08-08T02:06:53.443 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2023-08-08T02:06:53.498 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2023-08-08T02:06:53.499 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2023-08-08T02:06:53.553 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2023-08-08T02:06:53.554 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2023-08-08T02:06:53.554 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2023-08-08T02:06:53.554 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2023-08-08T02:06:53.554 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2023-08-08T02:06:53.554 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2023-08-08T02:06:53.555 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-08T02:06:53.555 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2023-08-08T02:06:53.555 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2023-08-08T02:06:53.555 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-08T02:06:53.555 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2023-08-08T02:06:53.555 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-08T02:06:53.555 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-08T02:06:53.555 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-08T02:06:53.556 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-08-08T02:06:53.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:06:53.667 INFO:teuthology.dispatcher.supervisor:Running job 7361222
2023-08-08T02:06:53.668 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361222 --name rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} -- /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361222/orig.config.yaml
2023-08-08T02:06:53.671 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361222
2023-08-08T02:06:53.671 INFO:teuthology.dispatcher.supervisor:Job PID: 28229
2023-08-08T02:06:53.672 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-08T02:08:53.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:10:53.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:12:54.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:14:54.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:16:54.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:18:54.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:20:54.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:22:54.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:24:55.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:26:55.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:28:55.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:30:55.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:32:55.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T02:32:55.737 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-08T02:32:55.880 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-08T02:32:55.880 INFO:teuthology.nuke:Checking targets against current locks
2023-08-08T02:32:55.925 DEBUG:teuthology.nuke:shortname: smithi066
2023-08-08T02:32:55.926 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-08T02:32:55.950 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361222', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 02:00:36.411748', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPalx0Cxu8Gfq56siaqnhBDVIkPyTWmaLaDI4crRng3UDD/NwVe0uNYu8ZF3zRPz0CPizs5jXmnpgNAO4+eGq58='}
2023-08-08T02:32:55.955 DEBUG:teuthology.nuke:shortname: smithi102
2023-08-08T02:32:55.957 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-08T02:32:55.978 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361222', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 02:00:36.413165', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDDpKnkFrEJQ/ABBGsYb+rz8l4BXzdOj5WNS02nnSq1pYpXnvmVLkeVh4tNKigHU6eUVAg7LKWc7IHIf/8deYzg='}
2023-08-08T02:32:56.008 INFO:teuthology.orchestra.console.smithi066:Power off
2023-08-08T02:32:56.009 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-08T02:32:56.032 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2023-08-08T02:32:56.033 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:32:56.053 INFO:teuthology.orchestra.console.smithi102:Power off
2023-08-08T02:32:56.053 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-08T02:32:56.064 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-08-08T02:32:56.076 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2023-08-08T02:32:56.076 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T02:32:56.097 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-08-08T02:32:56.166 INFO:teuthology.orchestra.console.smithi066:Power off completed
2023-08-08T02:32:56.199 INFO:teuthology.orchestra.console.smithi102:Power off completed
2023-08-08T02:32:56.319 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com
2023-08-08T02:32:56.354 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com