2024-01-30T17:21:01.022 INFO:root:teuthology version: 0.0.1.dev253+g6128cc3
2024-01-30T17:21:01.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:21:01.122 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f96a8647f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f96a95ebc10>, signals=[15])
2024-01-30T17:21:01.123 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging
2024-01-30T17:21:01.123 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server
2024-01-30T17:21:01.123 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2024-01-30T17:21:01.261 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_centos_9.stream (ID 10)
2024-01-30T17:21:01.305 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 9.stream
2024-01-30T17:21:01.648 INFO:teuthology.orchestra.console.smithi096:Power off
2024-01-30T17:21:01.648 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-30T17:21:01.669 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off
2024-01-30T17:21:01.669 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-30T17:21:01.691 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on
2024-01-30T17:21:05.692 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-30T17:21:05.801 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on
2024-01-30T17:21:09.804 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-30T17:21:09.913 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on
2024-01-30T17:21:13.918 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-30T17:21:14.027 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off
2024-01-30T17:21:14.128 INFO:teuthology.orchestra.console.smithi096:Power off completed
2024-01-30T17:21:14.228 INFO:teuthology.orchestra.console.smithi096:Power on
2024-01-30T17:21:14.229 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-30T17:21:14.250 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On
2024-01-30T17:21:14.250 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-30T17:21:14.270 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off
2024-01-30T17:21:18.274 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-30T17:21:18.382 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off
2024-01-30T17:21:22.384 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-30T17:21:22.492 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on
2024-01-30T17:21:22.592 INFO:teuthology.orchestra.console.smithi096:Power on completed
2024-01-30T17:21:22.693 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish
2024-01-30T17:24:39.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:24:42.588 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2024-01-30T17:24:48.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:24:51.676 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2024-01-30T17:24:57.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:25:00.764 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2024-01-30T17:25:06.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:25:09.824 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2024-01-30T17:25:15.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:25:18.912 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2024-01-30T17:25:24.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:25:27.996 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2024-01-30T17:25:34.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:25:37.084 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2024-01-30T17:25:43.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:26:43.141 WARNING:teuthology.provision.fog.smithi096:timed out
2024-01-30T17:26:49.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:26:49.426 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-30T17:26:49.426 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-30T17:26:49.736 INFO:teuthology.provision.fog.smithi096:Node is ready
2024-01-30T17:26:49.737 DEBUG:teuthology.orchestra.run.smithi096:> hostname
2024-01-30T17:26:49.751 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com
2024-01-30T17:26:49.752 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts
2024-01-30T17:26:49.806 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096
2024-01-30T17:26:49.806 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096
2024-01-30T17:26:49.921 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts
2024-01-30T17:26:49.949 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts
2024-01-30T17:26:50.016 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname
2024-01-30T17:26:50.083 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096
2024-01-30T17:26:50.149 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release
2024-01-30T17:26:50.203 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-30T17:26:50.204 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-30T17:26:50.205 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-30T17:26:50.207 INFO:teuthology.provision.fog.smithi096:Deploy complete!
2024-01-30T17:26:50.209 DEBUG:teuthology.parallel:result is None
2024-01-30T17:26:50.329 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com
2024-01-30T17:26:50.329 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-30T17:26:50.353 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server
2024-01-30T17:26:50.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2024-01-30T17:26:50.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-30T17:26:50.437 DEBUG:teuthology.orchestra.run.smithi096:> true
2024-01-30T17:26:50.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com'
2024-01-30T17:26:50.501 DEBUG:teuthology.orchestra.run.smithi096:> uname -m
2024-01-30T17:26:50.555 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64
2024-01-30T17:26:50.555 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-30T17:26:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/"
2024-01-30T17:26:50.610 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-30T17:26:50.610 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-30T17:26:50.610 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-30T17:26:50.610 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2024-01-30T17:26:50.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:26:50.717 INFO:teuthology.dispatcher.supervisor:Running job 7537969
2024-01-30T17:26:50.717 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2024-01-30_11:36:13-crimson-rados-wip-crimson-pg-snapmapper-obj-rebased-distro-crimson-smithi/7537969 --name matan-2024-01-30_11:36:13-crimson-rados-wip-crimson-pg-snapmapper-obj-rebased-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4M_rand_rw} -- /home/teuthworker/archive/matan-2024-01-30_11:36:13-crimson-rados-wip-crimson-pg-snapmapper-obj-rebased-distro-crimson-smithi/7537969/orig.config.yaml
2024-01-30T17:26:50.720 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2024-01-30_11:36:13-crimson-rados-wip-crimson-pg-snapmapper-obj-rebased-distro-crimson-smithi/7537969
2024-01-30T17:26:50.720 INFO:teuthology.dispatcher.supervisor:Job PID: 3181856
2024-01-30T17:26:50.720 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-30T17:28:50.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:30:50.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:32:51.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:34:51.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:36:51.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:38:51.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:40:51.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:42:51.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:44:52.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:46:52.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:48:52.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:50:52.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:52:52.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-30T17:52:52.931 INFO:teuthology.dispatcher.supervisor:Success!
2024-01-30T17:52:53.182 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2024-01-30T17:52:53.229 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com