2023-12-16T03:19:22.570 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T03:19:22.570 DEBUG:teuthology.run:Teuthology command: teuthology --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} --name sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi --verbose --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341 -- /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341/orig.config.yaml 2023-12-16T03:19:22.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:19:22.686 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341 branch: wip-sjust-crimson-testing-2023-12-15 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: null first_in_suite: false job_id: '7494341' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-sjust-crimson-testing-2023-12-15 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson seastar smp: 3 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: ac5f0a00b675c1157dbca443e10f2f8ddb2e351a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: ac5f0a00b675c1157dbca443e10f2f8ddb2e351a workunit: branch: wip-sjust-crimson-testing-2023-12-15 env: CRIMSON_COMPAT: '1' sha1: ac5f0a00b675c1157dbca443e10f2f8ddb2e351a owner: scheduled_sjust@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 6914 sha1: ac5f0a00b675c1157dbca443e10f2f8ddb2e351a sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-sjust-crimson-testing-2023-12-15 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ac5f0a00b675c1157dbca443e10f2f8ddb2e351a targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDGX+YyyAuE3WVWAKT+FLO57OmYnFf3xkwyITAUpsA6lV1J3EjwxdvcBQWMXzTvB/coMSd9+APSk728Oozcl85M= smithi124.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNO919USKbDzxfzmiSSbynE/I9bLnlkX8NCromj3T062RN+dTrQuqfZBFQ2/UQ6vbSoCsxiHxpFDC0AAPFhmn9Y= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-16_03:12:47 tube: smithi user: sjust verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-16T03:19:22.686 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa; will attempt to use it 2023-12-16T03:19:22.687 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks 2023-12-16T03:19:22.687 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-16T03:19:22.688 INFO:teuthology.task.internal:Checking packages... 2023-12-16T03:19:22.713 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a' 2023-12-16T03:19:22.714 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T03:19:22.714 INFO:teuthology.packaging:ref: None 2023-12-16T03:19:22.714 INFO:teuthology.packaging:tag: None 2023-12-16T03:19:22.714 INFO:teuthology.packaging:branch: wip-sjust-crimson-testing-2023-12-15 2023-12-16T03:19:22.714 INFO:teuthology.packaging:sha1: ac5f0a00b675c1157dbca443e10f2f8ddb2e351a 2023-12-16T03:19:22.714 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-sjust-crimson-testing-2023-12-15 2023-12-16T03:19:22.874 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-201.gac5f0a00 2023-12-16T03:19:22.876 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-16T03:19:22.893 INFO:teuthology.task.internal:no buildpackages task found 2023-12-16T03:19:22.893 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-16T03:19:22.899 INFO:teuthology.task.internal:Saving configuration 2023-12-16T03:19:22.911 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-16T03:19:22.917 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T03:19:22.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 03:14:26.299744', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDGX+YyyAuE3WVWAKT+FLO57OmYnFf3xkwyITAUpsA6lV1J3EjwxdvcBQWMXzTvB/coMSd9+APSk728Oozcl85M='} 2023-12-16T03:19:22.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 03:14:26.298354', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNO919USKbDzxfzmiSSbynE/I9bLnlkX8NCromj3T062RN+dTrQuqfZBFQ2/UQ6vbSoCsxiHxpFDC0AAPFhmn9Y='} 2023-12-16T03:19:22.962 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-16T03:19:22.969 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2023-12-16T03:19:22.970 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-12-16T03:19:22.970 INFO:teuthology.run_tasks:Running task console_log... 2023-12-16T03:19:23.040 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fda117e2dc0>, signals=[15]) 2023-12-16T03:19:23.041 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-16T03:19:23.047 INFO:teuthology.task.internal:Opening connections... 2023-12-16T03:19:23.048 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-12-16T03:19:23.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:19:23.152 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi124.front.sepia.ceph.com 2023-12-16T03:19:23.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:19:23.235 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-16T03:19:23.241 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-12-16T03:19:23.259 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-12-16T03:19:23.259 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-12-16T03:19:23.316 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T03:19:23.317 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T03:19:23.318 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-12-16T03:19:23.340 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-12-16T03:19:23.358 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-12-16T03:19:23.358 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-12-16T03:19:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-12-16T03:19:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9" 2023-12-16T03:19:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-12-16T03:19:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-12-16T03:19:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9" 2023-12-16T03:19:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9" 2023-12-16T03:19:23.414 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T03:19:23.415 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-12-16T03:19:23.415 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon" 2023-12-16T03:19:23.415 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T03:19:23.415 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-12-16T03:19:23.415 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T03:19:23.415 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T03:19:23.415 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T03:19:23.415 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-12-16T03:19:23.458 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-16T03:19:23.466 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-16T03:19:23.472 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-16T03:19:23.473 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-12-16T03:19:23.476 DEBUG:teuthology.orchestra.run.smithi124:> test '!' -e /home/ubuntu/cephtest 2023-12-16T03:19:23.491 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-16T03:19:23.497 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-16T03:19:23.497 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-12-16T03:19:23.534 DEBUG:teuthology.orchestra.run.smithi124:> test -z $(ls -A /var/lib/ceph) 2023-12-16T03:19:23.633 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-16T03:19:23.689 INFO:teuthology.run_tasks:Running task kernel... 2023-12-16T03:19:23.706 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-16T03:19:23.706 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-16T03:19:23.706 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T03:19:23.707 DEBUG:teuthology.orchestra.run.smithi124:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T03:19:23.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:19:23.723 DEBUG:teuthology.orchestra.run.smithi124:> uname -r 2023-12-16T03:19:23.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:19:23.724 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-12-16T03:19:23.780 INFO:teuthology.orchestra.run.smithi124.stdout:5.14.0-361.el9.x86_64 2023-12-16T03:19:23.780 INFO:teuthology.task.kernel:Running kernel on smithi124: 5.14.0-361.el9.x86_64 2023-12-16T03:19:23.780 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum install -y kernel 2023-12-16T03:19:23.783 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-361.el9.x86_64 2023-12-16T03:19:23.783 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.14.0-361.el9.x86_64 2023-12-16T03:19:23.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2023-12-16T03:19:25.822 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-16T03:19:25.839 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-16T03:19:27.173 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.0 MB 00:00 2023-12-16T03:19:27.231 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2023-12-16T03:19:28.014 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 7.9 MB 00:00 2023-12-16T03:19:28.355 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-12-16T03:19:31.607 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 18 MB 00:02 2023-12-16T03:19:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 3.4 MB/s | 18 MB 00:05 2023-12-16T03:19:35.333 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 9 - CRB 15 MB/s | 5.8 MB 00:00 2023-12-16T03:19:36.883 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2023-12-16T03:19:38.338 INFO:teuthology.orchestra.run.smithi124.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2023-12-16T03:19:39.006 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.8 MB 00:00 2023-12-16T03:19:40.666 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2023-12-16T03:19:41.609 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2023-12-16T03:19:43.160 INFO:teuthology.orchestra.run.smithi124.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-16T03:19:45.325 INFO:teuthology.orchestra.run.smithi124.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-16T03:19:45.326 INFO:teuthology.orchestra.run.smithi124.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-16T03:19:45.423 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:19:45.432 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:19:45.432 INFO:teuthology.orchestra.run.smithi124.stdout: Package Architecture Version Repository Size 2023-12-16T03:19:45.432 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:19:45.432 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:19:45.432 INFO:teuthology.orchestra.run.smithi124.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-16T03:19:45.432 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-12-16T03:19:45.432 INFO:teuthology.orchestra.run.smithi124.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-16T03:19:45.433 INFO:teuthology.orchestra.run.smithi124.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-16T03:19:45.433 INFO:teuthology.orchestra.run.smithi124.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-16T03:19:45.433 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:19:45.433 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:19:45.433 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:19:45.433 INFO:teuthology.orchestra.run.smithi124.stdout:Install 4 Packages 2023-12-16T03:19:45.433 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:19:45.434 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 96 M 2023-12-16T03:19:45.434 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 121 M 2023-12-16T03:19:45.434 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:19:45.820 INFO:teuthology.orchestra.run.smithi124.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 20 MB/s | 5.6 MB 00:00 2023-12-16T03:19:46.162 INFO:teuthology.orchestra.run.smithi124.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 33 MB/s | 20 MB 00:00 2023-12-16T03:19:46.500 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2023-12-16T03:19:46.554 INFO:teuthology.orchestra.run.smithi124.stdout:(3/4): kernel-modules-core-5.14.0-391.el9.x86_6 44 MB/s | 32 MB 00:00 2023-12-16T03:19:47.013 INFO:teuthology.orchestra.run.smithi124.stdout:(4/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 26 MB/s | 38 MB 00:01 2023-12-16T03:19:47.013 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:19:47.013 INFO:teuthology.orchestra.run.smithi124.stdout:Total 61 MB/s | 96 MB 00:01 2023-12-16T03:19:47.867 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:19:48.227 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:19:48.227 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:19:48.749 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-16T03:19:48.749 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-16T03:19:48.846 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:19:48.853 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:19:48.853 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-12-16T03:19:48.853 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:19:48.853 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:19:48.853 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-16T03:19:48.853 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-16T03:19:48.853 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-16T03:19:48.853 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-16T03:19:48.854 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-16T03:19:48.854 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:19:48.854 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:19:48.854 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:19:48.854 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2023-12-16T03:19:48.854 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:19:48.854 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 96 M 2023-12-16T03:19:48.854 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 121 M 2023-12-16T03:19:48.854 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:19:49.530 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:19:49.530 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:19:50.002 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 6.4 MB/s | 5.6 MB 00:00 2023-12-16T03:19:52.150 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:19:52.554 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 11 MB/s | 38 MB 00:03 2023-12-16T03:19:52.773 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-16T03:19:52.852 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): kernel-modules-core-5.14.0-391.el9.x86_6 11 MB/s | 32 MB 00:02 2023-12-16T03:19:52.899 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T03:19:54.652 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): kernel-core-5.14.0-391.el9.x86_64.rpm 3.7 MB/s | 20 MB 00:05 2023-12-16T03:19:54.652 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:19:54.652 INFO:teuthology.orchestra.run.smithi050.stdout:Total 17 MB/s | 96 MB 00:05 2023-12-16T03:19:55.544 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:19:55.665 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T03:19:55.866 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T03:19:55.968 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:19:55.968 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:19:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:19:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:20:00.117 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:20:00.522 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T03:20:00.649 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:00.789 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-16T03:20:00.928 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T03:20:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T03:20:03.991 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T03:20:05.315 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:08.954 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T03:20:09.075 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:14.073 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:34.358 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:34.401 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:34.791 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:34.791 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-16T03:20:34.791 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T03:20:34.791 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T03:20:35.177 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:35.177 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:20:35.177 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:20:35.177 INFO:teuthology.orchestra.run.smithi124.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-16T03:20:35.177 INFO:teuthology.orchestra.run.smithi124.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-16T03:20:35.177 INFO:teuthology.orchestra.run.smithi124.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-16T03:20:35.177 INFO:teuthology.orchestra.run.smithi124.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-16T03:20:35.177 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:20:35.177 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:20:35.664 DEBUG:teuthology.orchestra.run.smithi124:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T03:20:35.813 INFO:teuthology.orchestra.run.smithi124.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T03:20:35.814 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T03:20:35.814 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-16T03:20:35.814 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T03:20:35.814 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T03:20:35.814 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-12-16T03:20:35.814 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi124.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T03:20:35.814 DEBUG:teuthology.orchestra.run.smithi124:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T03:20:35.932 INFO:teuthology.orchestra.run.smithi124.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T03:20:35.932 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T03:20:35.932 DEBUG:teuthology.orchestra.run.smithi124:> sudo rpm -qi grub2-tools 2023-12-16T03:20:35.977 INFO:teuthology.orchestra.run.smithi124.stdout:Name : grub2-tools 2023-12-16T03:20:35.978 INFO:teuthology.orchestra.run.smithi124.stdout:Epoch : 1 2023-12-16T03:20:35.978 INFO:teuthology.orchestra.run.smithi124.stdout:Version : 2.06 2023-12-16T03:20:35.978 INFO:teuthology.orchestra.run.smithi124.stdout:Release : 68.el9 2023-12-16T03:20:35.978 INFO:teuthology.orchestra.run.smithi124.stdout:Architecture: x86_64 2023-12-16T03:20:35.978 INFO:teuthology.orchestra.run.smithi124.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-16T03:20:35.978 INFO:teuthology.orchestra.run.smithi124.stdout:Group : Unspecified 2023-12-16T03:20:35.979 INFO:teuthology.orchestra.run.smithi124.stdout:Size : 8264254 2023-12-16T03:20:35.979 INFO:teuthology.orchestra.run.smithi124.stdout:License : GPLv3+ 2023-12-16T03:20:35.979 INFO:teuthology.orchestra.run.smithi124.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-16T03:20:35.979 INFO:teuthology.orchestra.run.smithi124.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-16T03:20:35.979 INFO:teuthology.orchestra.run.smithi124.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-16T03:20:35.979 INFO:teuthology.orchestra.run.smithi124.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-16T03:20:35.979 INFO:teuthology.orchestra.run.smithi124.stdout:Packager : builder@centos.org 2023-12-16T03:20:35.979 INFO:teuthology.orchestra.run.smithi124.stdout:Vendor : CentOS 2023-12-16T03:20:35.980 INFO:teuthology.orchestra.run.smithi124.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T03:20:35.980 INFO:teuthology.orchestra.run.smithi124.stdout:Summary : Support tools for GRUB. 2023-12-16T03:20:35.980 INFO:teuthology.orchestra.run.smithi124.stdout:Description : 2023-12-16T03:20:35.980 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:20:35.980 INFO:teuthology.orchestra.run.smithi124.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T03:20:35.980 INFO:teuthology.orchestra.run.smithi124.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T03:20:35.980 INFO:teuthology.orchestra.run.smithi124.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T03:20:35.980 INFO:teuthology.orchestra.run.smithi124.stdout:hardware devices. 2023-12-16T03:20:35.981 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:20:35.981 INFO:teuthology.orchestra.run.smithi124.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T03:20:35.982 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T03:20:35.982 INFO:teuthology.task.kernel:Updating grub on smithi124 to boot 5.14.0-391.el9.x86_64 2023-12-16T03:20:35.983 DEBUG:teuthology.orchestra.run.smithi124:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T03:20:36.570 INFO:teuthology.orchestra.run.smithi124.stderr:Generating grub configuration file ... 2023-12-16T03:20:37.898 INFO:teuthology.orchestra.run.smithi124.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-16T03:20:37.928 INFO:teuthology.orchestra.run.smithi124.stderr:done 2023-12-16T03:20:37.931 DEBUG:teuthology.orchestra.run.smithi124:> mktemp 2023-12-16T03:20:37.945 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.CQmMi5U9S8 2023-12-16T03:20:37.946 DEBUG:teuthology.orchestra.run.smithi124:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CQmMi5U9S8 2023-12-16T03:20:38.014 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0666 /tmp/tmp.CQmMi5U9S8 2023-12-16T03:20:38.153 DEBUG:teuthology.orchestra.remote:smithi124:/tmp/tmp.CQmMi5U9S8 is 6KB 2023-12-16T03:20:38.201 DEBUG:teuthology.orchestra.run.smithi124:> rm -fr /tmp/tmp.CQmMi5U9S8 2023-12-16T03:20:38.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T03:20:38.280 INFO:teuthology.orchestra.run.smithi124.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-16T03:20:38.280 INFO:teuthology.orchestra.run.smithi124.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-16T03:20:38.280 INFO:teuthology.orchestra.run.smithi124.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-16T03:20:38.281 INFO:teuthology.orchestra.run.smithi124.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-16T03:20:38.282 DEBUG:teuthology.orchestra.run.smithi124:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-16T03:20:38.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo shutdown -r now 2023-12-16T03:20:44.610 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:44.654 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:45.058 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:45.058 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-16T03:20:45.058 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T03:20:45.058 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T03:20:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T03:20:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:20:45.484 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:20:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-16T03:20:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-16T03:20:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-16T03:20:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-16T03:20:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:20:45.484 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:20:45.988 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T03:20:46.176 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T03:20:46.176 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T03:20:46.177 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-16T03:20:46.177 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T03:20:46.177 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T03:20:46.177 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-16T03:20:46.177 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T03:20:46.177 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T03:20:46.300 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T03:20:46.301 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T03:20:46.301 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 68.el9 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8264254 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-16T03:20:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:20:46.339 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T03:20:46.340 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T03:20:46.340 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 5.14.0-391.el9.x86_64 2023-12-16T03:20:46.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T03:20:46.914 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-12-16T03:20:48.233 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-16T03:20:48.286 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-12-16T03:20:48.287 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-12-16T03:20:48.303 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.3vIOtj2ca7 2023-12-16T03:20:48.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3vIOtj2ca7 2023-12-16T03:20:48.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.3vIOtj2ca7 2023-12-16T03:20:48.524 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.3vIOtj2ca7 is 6KB 2023-12-16T03:20:48.571 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.3vIOtj2ca7 2023-12-16T03:20:48.586 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T03:20:48.654 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-16T03:20:48.654 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-16T03:20:48.654 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-16T03:20:48.654 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-16T03:20:48.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-16T03:20:48.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2023-12-16T03:21:08.441 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-12-16T03:21:08.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-16T03:21:08.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:21:18.826 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-16T03:21:18.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-16T03:21:18.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:21:37.297 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-12-16T03:21:46.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-16T03:21:46.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:22:08.465 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T03:22:17.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-16T03:22:17.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:22:17.832 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-12-16T03:22:18.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-16T03:22:18.228 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-391.el9.x86_64"... 2023-12-16T03:22:18.228 DEBUG:teuthology.orchestra.run.smithi124:> uname -r 2023-12-16T03:22:18.242 INFO:teuthology.orchestra.run.smithi124.stdout:5.14.0-391.el9.x86_64 2023-12-16T03:22:18.242 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-16T03:22:18.242 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T03:22:18.242 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T03:22:19.243 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-12-16T03:22:19.244 DEBUG:teuthology.orchestra.run.smithi124:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T03:22:19.305 INFO:teuthology.orchestra.run.smithi124.stdout:ttyS1 2023-12-16T03:22:19.378 DEBUG:teuthology.parallel:result is None 2023-12-16T03:22:46.309 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T03:22:58.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-16T03:22:58.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:22:58.649 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-12-16T03:22:59.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-16T03:22:59.013 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-391.el9.x86_64"... 2023-12-16T03:22:59.014 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-12-16T03:22:59.028 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-391.el9.x86_64 2023-12-16T03:22:59.029 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-16T03:22:59.029 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T03:22:59.029 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T03:23:00.030 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-16T03:23:00.030 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T03:23:00.108 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2023-12-16T03:23:00.143 DEBUG:teuthology.parallel:result is None 2023-12-16T03:23:00.143 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-16T03:23:00.153 INFO:teuthology.task.internal:Creating test directory... 2023-12-16T03:23:00.153 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T03:23:00.155 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T03:23:00.173 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-16T03:23:00.185 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-16T03:23:00.198 INFO:teuthology.task.internal:Creating archive directory... 2023-12-16T03:23:00.199 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T03:23:00.213 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T03:23:00.311 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-16T03:23:00.322 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-16T03:23:00.322 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T03:23:00.325 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T03:23:00.360 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T03:23:00.367 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T03:23:00.374 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T03:23:00.385 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T03:23:00.387 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-16T03:23:00.398 INFO:teuthology.task.internal:Configuring sudo... 2023-12-16T03:23:00.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T03:23:00.401 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T03:23:00.445 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-16T03:23:00.454 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-16T03:23:00.455 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T03:23:00.475 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T03:23:00.501 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T03:23:00.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T03:23:00.627 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T03:23:00.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T03:23:00.758 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:23:00.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T03:23:00.830 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T03:23:00.875 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T03:23:00.928 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T03:23:01.013 DEBUG:teuthology.orchestra.run.smithi124:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T03:23:01.057 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:23:01.058 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T03:23:01.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-12-16T03:23:01.129 DEBUG:teuthology.orchestra.run.smithi124:> sudo service rsyslog restart 2023-12-16T03:23:01.179 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T03:23:01.235 INFO:teuthology.orchestra.run.smithi124.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T03:23:01.679 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-16T03:23:01.688 INFO:teuthology.task.internal:Starting timer... 2023-12-16T03:23:01.688 INFO:teuthology.run_tasks:Running task pcp... 2023-12-16T03:23:01.701 INFO:teuthology.run_tasks:Running task selinux... 2023-12-16T03:23:01.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2023-12-16T03:23:01.770 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2023-12-16T03:23:01.772 DEBUG:teuthology.orchestra.run.smithi124:> sudo service auditd rotate 2023-12-16T03:23:01.838 INFO:teuthology.orchestra.run.smithi124.stdout:Rotating logs: 2023-12-16T03:23:01.840 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-16T03:23:01.840 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2023-12-16T03:23:01.867 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2023-12-16T03:23:01.867 DEBUG:teuthology.orchestra.run.smithi124:> /usr/sbin/getenforce 2023-12-16T03:23:01.890 INFO:teuthology.orchestra.run.smithi124.stdout:Permissive 2023-12-16T03:23:01.891 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi124.front.sepia.ceph.com': 'permissive'} 2023-12-16T03:23:01.891 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T03:23:01.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:23:01.942 DEBUG:teuthology.orchestra.run.smithi124:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T03:23:01.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:23:01.970 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-16T03:23:01.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2023-12-16T03:23:02.028 DEBUG:teuthology.orchestra.run.smithi124:> sudo /usr/sbin/setenforce permissive 2023-12-16T03:23:02.060 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-16T03:23:02.069 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-16T03:23:02.074 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-16T03:23:02.204 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-16T03:23:02.219 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-16T03:23:02.220 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi124.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-16T03:28:39.401 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi124.front.sepia.ceph.com')] 2023-12-16T03:28:39.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-16T03:28:39.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:28:39.499 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-12-16T03:28:39.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-16T03:28:39.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-16T03:28:39.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:28:39.650 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-12-16T03:28:39.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-16T03:28:39.716 INFO:teuthology.run_tasks:Running task clock... 2023-12-16T03:28:39.726 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-16T03:28:39.726 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T03:28:39.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:28:39.729 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T03:28:39.729 DEBUG:teuthology.orchestra.run.smithi124:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:28:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T03:28:39.783 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T03:28:39.787 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T03:28:39.804 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T03:28:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2023-12-16T03:28:39.832 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: ntpd: command not found 2023-12-16T03:28:39.838 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2023-12-16T03:28:39.846 INFO:teuthology.orchestra.run.smithi124.stdout:506 Cannot talk to daemon 2023-12-16T03:28:39.859 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T03:28:39.862 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T03:28:39.879 INFO:teuthology.orchestra.run.smithi124.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T03:28:39.879 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T03:28:39.921 INFO:teuthology.orchestra.run.smithi124.stderr:bash: line 1: ntpq: command not found 2023-12-16T03:28:39.924 INFO:teuthology.orchestra.run.smithi124.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T03:28:39.924 INFO:teuthology.orchestra.run.smithi124.stdout:=============================================================================== 2023-12-16T03:28:39.924 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:28:39.925 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:28:39.925 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:28:39.925 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:28:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2023-12-16T03:28:39.931 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T03:28:39.931 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-12-16T03:28:39.931 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:28:39.931 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:28:39.931 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:28:39.931 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T03:28:39.932 INFO:teuthology.run_tasks:Running task install... 2023-12-16T03:28:39.943 DEBUG:teuthology.task.install:project ceph 2023-12-16T03:28:39.943 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a'}} 2023-12-16T03:28:39.943 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a'} 2023-12-16T03:28:39.944 INFO:teuthology.task.install:Using flavor: crimson 2023-12-16T03:28:39.949 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-16T03:28:39.950 INFO:teuthology.task.install:extra packages: [] 2023-12-16T03:28:39.950 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a', 'tag': None, 'wait_for_package': False} 2023-12-16T03:28:39.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=ac5f0a00b675c1157dbca443e10f2f8ddb2e351a 2023-12-16T03:28:39.952 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a', 'tag': None, 'wait_for_package': False} 2023-12-16T03:28:39.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=ac5f0a00b675c1157dbca443e10f2f8ddb2e351a 2023-12-16T03:28:40.118 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-sjust-crimson-testing-2023-12-15/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/centos/9/flavors/crimson/ 2023-12-16T03:28:40.118 INFO:teuthology.task.install.rpm:Package version is 19.0.0-201.gac5f0a00 2023-12-16T03:28:40.192 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-sjust-crimson-testing-2023-12-15/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/centos/9/flavors/crimson/ 2023-12-16T03:28:40.192 INFO:teuthology.task.install.rpm:Package version is 19.0.0-201.gac5f0a00 2023-12-16T03:28:40.232 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-sjust-crimson-testing-2023-12-15/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-sjust-crimson-testing-2023-12-15/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-sjust-crimson-testing-2023-12-15/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T03:28:40.232 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:28:40.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T03:28:40.266 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T03:28:40.266 DEBUG:teuthology.orchestra.run.smithi124:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T03:28:40.333 DEBUG:teuthology.orchestra.run.smithi124:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T03:28:40.372 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-sjust-crimson-testing-2023-12-15/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-sjust-crimson-testing-2023-12-15/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-sjust-crimson-testing-2023-12-15/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T03:28:40.373 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:28:40.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T03:28:40.404 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T03:28:40.405 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T03:28:40.412 DEBUG:teuthology.orchestra.run.smithi124:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T03:28:40.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T03:28:40.477 INFO:teuthology.orchestra.run.smithi124.stdout:check_obsoletes = 1 2023-12-16T03:28:40.479 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum clean all 2023-12-16T03:28:40.564 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T03:28:40.593 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2023-12-16T03:28:40.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2023-12-16T03:28:40.736 INFO:teuthology.orchestra.run.smithi124.stdout:73 files removed 2023-12-16T03:28:40.763 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-radosgw 2023-12-16T03:28:40.846 INFO:teuthology.orchestra.run.smithi050.stdout:73 files removed 2023-12-16T03:28:40.873 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw 2023-12-16T03:28:41.429 INFO:teuthology.orchestra.run.smithi124.stdout:ceph packages for x86_64 234 kB/s | 82 kB 00:00 2023-12-16T03:28:41.676 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 175 kB/s | 82 kB 00:00 2023-12-16T03:28:41.789 INFO:teuthology.orchestra.run.smithi124.stdout:ceph noarch packages 31 kB/s | 9.5 kB 00:00 2023-12-16T03:28:42.102 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-12-16T03:28:42.214 INFO:teuthology.orchestra.run.smithi124.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-12-16T03:28:42.477 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2023-12-16T03:28:42.591 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS-9 - AppStream 19 MB/s | 6.4 MB 00:00 2023-12-16T03:28:42.863 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-12-16T03:28:43.925 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2023-12-16T03:28:44.263 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2023-12-16T03:28:45.638 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 7.9 MB 00:01 2023-12-16T03:28:46.566 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 7.9 MB 00:02 2023-12-16T03:28:48.964 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 8.2 MB/s | 18 MB 00:02 2023-12-16T03:28:49.926 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 18 MB 00:02 2023-12-16T03:28:53.023 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-12-16T03:28:53.776 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.8 MB 00:00 2023-12-16T03:28:54.366 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 15 kB 00:00 2023-12-16T03:28:55.368 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2023-12-16T03:28:55.836 INFO:teuthology.orchestra.run.smithi124.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2023-12-16T03:29:00.226 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-12-16T03:29:02.815 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:29:02.830 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:29:02.830 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:29:02.830 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 8.3 M 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 3.1 M 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 3.0 M 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 6.6 M 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 17 M 2023-12-16T03:29:02.831 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 24 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 728 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 470 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 4.5 M 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-16T03:29:02.832 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 45 k 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 130 k 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 162 k 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 319 k 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 299 k 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 99 k 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:29:02.833 INFO:teuthology.orchestra.run.smithi050.stdout:Install 27 Packages 2023-12-16T03:29:02.834 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2023-12-16T03:29:02.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:29:02.834 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 54 M 2023-12-16T03:29:02.834 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:29:05.631 INFO:teuthology.orchestra.run.smithi050.stdout:(1/29): ceph-radosgw-19.0.0-201.gac5f0a00.el9.x 3.1 MB/s | 8.3 MB 00:02 2023-12-16T03:29:05.714 INFO:teuthology.orchestra.run.smithi050.stdout:(2/29): ceph-base-19.0.0-201.gac5f0a00.el9.x86_ 2.4 MB/s | 6.6 MB 00:02 2023-12-16T03:29:05.732 INFO:teuthology.orchestra.run.smithi050.stdout:(3/29): ceph-selinux-19.0.0-201.gac5f0a00.el9.x 240 kB/s | 24 kB 00:00 2023-12-16T03:29:05.831 INFO:teuthology.orchestra.run.smithi050.stdout:(4/29): libradosstriper1-19.0.0-201.gac5f0a00.e 4.6 MB/s | 470 kB 00:00 2023-12-16T03:29:05.873 INFO:teuthology.orchestra.run.smithi050.stdout:(5/29): libcephfs2-19.0.0-201.gac5f0a00.el9.x86 4.5 MB/s | 728 kB 00:00 2023-12-16T03:29:05.957 INFO:teuthology.orchestra.run.smithi050.stdout:(6/29): python3-ceph-argparse-19.0.0-201.gac5f0 542 kB/s | 45 kB 00:00 2023-12-16T03:29:06.040 INFO:teuthology.orchestra.run.smithi050.stdout:(7/29): python3-ceph-common-19.0.0-201.gac5f0a0 1.5 MB/s | 130 kB 00:00 2023-12-16T03:29:06.116 INFO:teuthology.orchestra.run.smithi050.stdout:(8/29): python3-cephfs-19.0.0-201.gac5f0a00.el9 2.1 MB/s | 162 kB 00:00 2023-12-16T03:29:06.208 INFO:teuthology.orchestra.run.smithi050.stdout:(9/29): python3-rados-19.0.0-201.gac5f0a00.el9. 3.4 MB/s | 319 kB 00:00 2023-12-16T03:29:06.300 INFO:teuthology.orchestra.run.smithi050.stdout:(10/29): python3-rbd-19.0.0-201.gac5f0a00.el9.x 3.2 MB/s | 299 kB 00:00 2023-12-16T03:29:06.375 INFO:teuthology.orchestra.run.smithi050.stdout:(11/29): python3-rgw-19.0.0-201.gac5f0a00.el9.x 1.3 MB/s | 99 kB 00:00 2023-12-16T03:29:06.443 INFO:teuthology.orchestra.run.smithi050.stdout:(12/29): librgw2-19.0.0-201.gac5f0a00.el9.x86_6 7.3 MB/s | 4.5 MB 00:00 2023-12-16T03:29:06.651 INFO:teuthology.orchestra.run.smithi050.stdout:(13/29): ceph-common-19.0.0-201.gac5f0a00.el9.x 4.6 MB/s | 17 MB 00:03 2023-12-16T03:29:06.718 INFO:teuthology.orchestra.run.smithi050.stdout:(14/29): boost-program-options-1.75.0-8.el9.x86 309 kB/s | 106 kB 00:00 2023-12-16T03:29:06.735 INFO:teuthology.orchestra.run.smithi050.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 44 kB 00:00 2023-12-16T03:29:06.769 INFO:teuthology.orchestra.run.smithi050.stdout:(16/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 528 kB/s | 159 kB 00:00 2023-12-16T03:29:06.835 INFO:teuthology.orchestra.run.smithi050.stdout:(17/29): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 661 kB 00:00 2023-12-16T03:29:06.869 INFO:teuthology.orchestra.run.smithi050.stdout:(18/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 282 kB 00:00 2023-12-16T03:29:06.886 INFO:teuthology.orchestra.run.smithi050.stdout:(19/29): python3-prettytable-0.7.2-27.el9.noarc 353 kB/s | 41 kB 00:00 2023-12-16T03:29:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2023-12-16T03:29:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:(21/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.4 MB/s | 309 kB 00:00 2023-12-16T03:29:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:(22/29): liboath-2.6.7-2.el9.x86_64.rpm 975 kB/s | 49 kB 00:00 2023-12-16T03:29:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2023-12-16T03:29:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:(24/29): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2023-12-16T03:29:07.179 INFO:teuthology.orchestra.run.smithi050.stdout:(25/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.1 MB/s | 838 kB 00:00 2023-12-16T03:29:07.204 INFO:teuthology.orchestra.run.smithi050.stdout:(26/29): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-12-16T03:29:07.246 INFO:teuthology.orchestra.run.smithi050.stdout:(27/29): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2023-12-16T03:29:07.513 INFO:teuthology.orchestra.run.smithi050.stdout:(28/29): librbd1-19.0.0-201.gac5f0a00.el9.x86_6 9.9 MB/s | 3.0 MB 00:00 2023-12-16T03:29:07.671 INFO:teuthology.orchestra.run.smithi050.stdout:(29/29): librados2-19.0.0-201.gac5f0a00.el9.x86 6.7 MB/s | 3.1 MB 00:00 2023-12-16T03:29:07.678 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:29:07.678 INFO:teuthology.orchestra.run.smithi050.stdout:Total 11 MB/s | 54 MB 00:04 2023-12-16T03:29:07.678 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:29:07.715 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:29:07.716 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:29:08.202 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:29:08.202 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:29:09.261 INFO:teuthology.orchestra.run.smithi124.stdout:Extra Packages for Enterprise Linux 1.5 MB/s | 20 MB 00:13 2023-12-16T03:29:09.719 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:29:10.061 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-16T03:29:10.124 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 2/31 2023-12-16T03:29:10.216 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 2/31 2023-12-16T03:29:10.316 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.0.0-201.gac5f0a00.el9.x86_64 3/31 2023-12-16T03:29:10.342 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 4/31 2023-12-16T03:29:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 4/31 2023-12-16T03:29:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/31 2023-12-16T03:29:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/31 2023-12-16T03:29:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/31 2023-12-16T03:29:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.0.0-201.gac5f0a00.el9.x 8/31 2023-12-16T03:29:10.637 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.0.0-201.gac5f0a00.el9.x86_64 9/31 2023-12-16T03:29:10.660 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.0.0-201.gac5f0a00.el9.x86_64 10/31 2023-12-16T03:29:10.748 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.0.0-201.gac5f0a00.el9.x86_64 10/31 2023-12-16T03:29:10.783 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/31 2023-12-16T03:29:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-16T03:29:10.925 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-16T03:29:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-16T03:29:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-16T03:29:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-16T03:29:11.061 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-16T03:29:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-16T03:29:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 19/31 2023-12-16T03:29:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 19/31 2023-12-16T03:29:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.0.0-201.gac5f0a00.el9.x86_64 20/31 2023-12-16T03:29:11.573 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-16T03:29:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-16T03:29:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.0.0-201.gac5f0a00.el9.x86_64 23/31 2023-12-16T03:29:12.106 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.0.0-201.gac5f0a00.el9.x86_64 23/31 2023-12-16T03:29:12.176 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.0.0-201.gac5f0a00.el9.x86_64 24/31 2023-12-16T03:29:12.212 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.0.0-201.gac5f0a00.el9.x86 25/31 2023-12-16T03:29:13.994 INFO:teuthology.orchestra.run.smithi124.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-12-16T03:29:14.355 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 26/31 2023-12-16T03:29:14.392 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 26/31 2023-12-16T03:29:15.170 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 26/31 2023-12-16T03:29:15.212 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 27/31 2023-12-16T03:29:15.290 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 27/31 2023-12-16T03:29:15.290 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-16T03:29:15.290 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-16T03:29:15.290 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:29:15.330 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.0.0-201.gac5f0a00.el9.x86_64 28/31 2023-12-16T03:29:16.535 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 8.3 M 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrading: 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout: librados2 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 3.1 M 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 3.0 M 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-12-16T03:29:16.592 INFO:teuthology.orchestra.run.smithi124.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 6.6 M 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 17 M 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 24 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 728 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 470 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2 x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 4.5 M 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-16T03:29:16.593 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 45 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-common x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 130 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cephfs x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 162 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 319 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rbd x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 299 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rgw x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 99 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout:Install 27 Packages 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout:Upgrade 2 Packages 2023-12-16T03:29:16.594 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:29:16.595 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 54 M 2023-12-16T03:29:16.595 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:29:17.971 INFO:teuthology.orchestra.run.smithi124.stdout:(1/29): ceph-radosgw-19.0.0-201.gac5f0a00.el9.x 6.7 MB/s | 8.3 MB 00:01 2023-12-16T03:29:18.054 INFO:teuthology.orchestra.run.smithi124.stdout:(2/29): ceph-base-19.0.0-201.gac5f0a00.el9.x86_ 4.9 MB/s | 6.6 MB 00:01 2023-12-16T03:29:18.071 INFO:teuthology.orchestra.run.smithi124.stdout:(3/29): ceph-selinux-19.0.0-201.gac5f0a00.el9.x 241 kB/s | 24 kB 00:00 2023-12-16T03:29:18.138 INFO:teuthology.orchestra.run.smithi124.stdout:(4/29): libradosstriper1-19.0.0-201.gac5f0a00.e 6.9 MB/s | 470 kB 00:00 2023-12-16T03:29:18.174 INFO:teuthology.orchestra.run.smithi124.stdout:(5/29): libcephfs2-19.0.0-201.gac5f0a00.el9.x86 6.0 MB/s | 728 kB 00:00 2023-12-16T03:29:18.341 INFO:teuthology.orchestra.run.smithi124.stdout:(6/29): ceph-common-19.0.0-201.gac5f0a00.el9.x8 11 MB/s | 17 MB 00:01 2023-12-16T03:29:18.366 INFO:teuthology.orchestra.run.smithi124.stdout:(7/29): python3-ceph-argparse-19.0.0-201.gac5f0 235 kB/s | 45 kB 00:00 2023-12-16T03:29:18.391 INFO:teuthology.orchestra.run.smithi124.stdout:(8/29): python3-ceph-common-19.0.0-201.gac5f0a0 2.5 MB/s | 130 kB 00:00 2023-12-16T03:29:18.426 INFO:teuthology.orchestra.run.smithi124.stdout:(9/29): python3-cephfs-19.0.0-201.gac5f0a00.el9 2.7 MB/s | 162 kB 00:00 2023-12-16T03:29:18.451 INFO:teuthology.orchestra.run.smithi124.stdout:(10/29): python3-rados-19.0.0-201.gac5f0a00.el9 5.3 MB/s | 319 kB 00:00 2023-12-16T03:29:18.493 INFO:teuthology.orchestra.run.smithi124.stdout:(11/29): python3-rbd-19.0.0-201.gac5f0a00.el9.x 4.4 MB/s | 299 kB 00:00 2023-12-16T03:29:18.518 INFO:teuthology.orchestra.run.smithi124.stdout:(12/29): python3-rgw-19.0.0-201.gac5f0a00.el9.x 1.4 MB/s | 99 kB 00:00 2023-12-16T03:29:18.585 INFO:teuthology.orchestra.run.smithi124.stdout:(13/29): librgw2-19.0.0-201.gac5f0a00.el9.x86_6 10 MB/s | 4.5 MB 00:00 2023-12-16T03:29:18.710 INFO:teuthology.orchestra.run.smithi124.stdout:(14/29): boost-program-options-1.75.0-8.el9.x86 487 kB/s | 106 kB 00:00 2023-12-16T03:29:18.736 INFO:teuthology.orchestra.run.smithi124.stdout:(15/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 733 kB/s | 159 kB 00:00 2023-12-16T03:29:18.761 INFO:teuthology.orchestra.run.smithi124.stdout:(16/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 347 kB/s | 44 kB 00:00 2023-12-16T03:29:18.786 INFO:teuthology.orchestra.run.smithi124.stdout:(17/29): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2023-12-16T03:29:18.811 INFO:teuthology.orchestra.run.smithi124.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 838 kB/s | 41 kB 00:00 2023-12-16T03:29:18.837 INFO:teuthology.orchestra.run.smithi124.stdout:(19/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-12-16T03:29:18.912 INFO:teuthology.orchestra.run.smithi124.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2023-12-16T03:29:18.945 INFO:teuthology.orchestra.run.smithi124.stdout:(21/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.9 MB/s | 309 kB 00:00 2023-12-16T03:29:18.971 INFO:teuthology.orchestra.run.smithi124.stdout:(22/29): liboath-2.6.7-2.el9.x86_64.rpm 829 kB/s | 49 kB 00:00 2023-12-16T03:29:18.996 INFO:teuthology.orchestra.run.smithi124.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-12-16T03:29:19.046 INFO:teuthology.orchestra.run.smithi124.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2023-12-16T03:29:19.105 INFO:teuthology.orchestra.run.smithi124.stdout:(25/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 838 kB 00:00 2023-12-16T03:29:19.180 INFO:teuthology.orchestra.run.smithi124.stdout:(26/29): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2023-12-16T03:29:19.222 INFO:teuthology.orchestra.run.smithi124.stdout:(27/29): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2023-12-16T03:29:19.456 INFO:teuthology.orchestra.run.smithi124.stdout:(28/29): librbd1-19.0.0-201.gac5f0a00.el9.x86_6 11 MB/s | 3.0 MB 00:00 2023-12-16T03:29:19.523 INFO:teuthology.orchestra.run.smithi124.stdout:(29/29): librados2-19.0.0-201.gac5f0a00.el9.x86 7.4 MB/s | 3.1 MB 00:00 2023-12-16T03:29:19.526 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:29:19.527 INFO:teuthology.orchestra.run.smithi124.stdout:Total 18 MB/s | 54 MB 00:02 2023-12-16T03:29:19.527 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:29:19.560 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:29:19.560 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:29:20.018 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:29:20.021 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:29:21.376 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:29:21.722 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-16T03:29:21.850 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 2/31 2023-12-16T03:29:21.967 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 2/31 2023-12-16T03:29:22.064 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rados-2:19.0.0-201.gac5f0a00.el9.x86_64 3/31 2023-12-16T03:29:22.093 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 4/31 2023-12-16T03:29:22.176 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 4/31 2023-12-16T03:29:22.225 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/31 2023-12-16T03:29:22.255 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/31 2023-12-16T03:29:22.285 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/31 2023-12-16T03:29:22.321 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-ceph-argparse-2:19.0.0-201.gac5f0a00.el9.x 8/31 2023-12-16T03:29:22.388 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cephfs-2:19.0.0-201.gac5f0a00.el9.x86_64 9/31 2023-12-16T03:29:22.416 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libradosstriper1-2:19.0.0-201.gac5f0a00.el9.x86_64 10/31 2023-12-16T03:29:22.502 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libradosstriper1-2:19.0.0-201.gac5f0a00.el9.x86_64 10/31 2023-12-16T03:29:22.547 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/31 2023-12-16T03:29:22.653 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-16T03:29:22.690 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-16T03:29:22.731 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-16T03:29:22.763 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-16T03:29:22.792 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-16T03:29:22.825 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-16T03:29:23.140 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-16T03:29:23.171 INFO:teuthology.orchestra.run.smithi124.stdout: Upgrading : librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 19/31 2023-12-16T03:29:23.261 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 19/31 2023-12-16T03:29:23.299 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rbd-2:19.0.0-201.gac5f0a00.el9.x86_64 20/31 2023-12-16T03:29:23.337 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-16T03:29:23.762 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-16T03:29:23.790 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librgw2-2:19.0.0-201.gac5f0a00.el9.x86_64 23/31 2023-12-16T03:29:23.861 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librgw2-2:19.0.0-201.gac5f0a00.el9.x86_64 23/31 2023-12-16T03:29:23.930 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rgw-2:19.0.0-201.gac5f0a00.el9.x86_64 24/31 2023-12-16T03:29:23.959 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-ceph-common-2:19.0.0-201.gac5f0a00.el9.x86 25/31 2023-12-16T03:29:25.599 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.0.0-201.gac5f0a00.el9.x86_64 28/31 2023-12-16T03:29:25.599 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2023-12-16T03:29:25.599 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2023-12-16T03:29:25.599 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2023-12-16T03:29:25.600 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2023-12-16T03:29:25.600 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2023-12-16T03:29:25.600 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2023-12-16T03:29:25.600 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2023-12-16T03:29:25.600 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:29:26.028 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 26/31 2023-12-16T03:29:26.064 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 26/31 2023-12-16T03:29:26.462 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.0.0-201.gac5f0a00.el9.x86_64 29/31 2023-12-16T03:29:26.494 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-201.gac5f0a00.el9.x86_64 29/31 2023-12-16T03:29:26.494 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:29:26.494 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-16T03:29:26.494 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T03:29:26.494 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T03:29:26.494 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:29:26.496 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-16T03:29:26.582 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-16T03:29:26.582 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-16T03:29:26.813 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 26/31 2023-12-16T03:29:26.866 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 27/31 2023-12-16T03:29:26.950 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 27/31 2023-12-16T03:29:26.950 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-16T03:29:26.950 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-16T03:29:26.950 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:29:26.993 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-selinux-2:19.0.0-201.gac5f0a00.el9.x86_64 28/31 2023-12-16T03:29:27.773 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-16T03:29:27.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 1/31 2023-12-16T03:29:27.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 2/31 2023-12-16T03:29:27.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.0.0-201.gac5f0a00.el9.x86_64 3/31 2023-12-16T03:29:27.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.0.0-201.gac5f0a00.el9.x86_64 4/31 2023-12-16T03:29:27.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 5/31 2023-12-16T03:29:27.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.0.0-201.gac5f0a00.el9.x86_64 6/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.0.0-201.gac5f0a00.el9.x86_64 7/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.0.0-201.gac5f0a00.el9.x 8/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.0.0-201.gac5f0a00.el9.x86 9/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.0.0-201.gac5f0a00.el9.x86_64 10/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.0.0-201.gac5f0a00.el9.x86_64 11/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.0.0-201.gac5f0a00.el9.x86_64 12/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.0.0-201.gac5f0a00.el9.x86_64 13/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-16T03:29:27.774 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 28/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-16T03:29:27.775 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 30/31 2023-12-16T03:29:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-16T03:29:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:29:28.880 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-12-16T03:29:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.880 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:29:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-16T03:29:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-3.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:29:28.882 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:29:29.228 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-test 2023-12-16T03:29:29.816 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:29 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:29:29.974 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:29:29.975 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:29:29.975 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:29:29.975 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:29:29.975 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:29:29.975 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 118 M 2023-12-16T03:29:29.975 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-16T03:29:29.975 INFO:teuthology.orchestra.run.smithi050.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-12-16T03:29:29.975 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 158 k 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout:Install 10 Packages 2023-12-16T03:29:29.976 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:29:29.977 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 120 M 2023-12-16T03:29:29.977 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 1.1 G 2023-12-16T03:29:29.977 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:29:30.211 INFO:teuthology.orchestra.run.smithi050.stdout:(1/10): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 186 kB 00:00 2023-12-16T03:29:30.261 INFO:teuthology.orchestra.run.smithi050.stdout:(2/10): libasan-11.4.1-2.3.el9.x86_64.rpm 8.4 MB/s | 418 kB 00:00 2023-12-16T03:29:30.295 INFO:teuthology.orchestra.run.smithi050.stdout:(3/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-12-16T03:29:30.337 INFO:teuthology.orchestra.run.smithi050.stdout:(4/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-12-16T03:29:30.379 INFO:teuthology.orchestra.run.smithi050.stdout:(5/10): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-12-16T03:29:30.412 INFO:teuthology.orchestra.run.smithi050.stdout:(6/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-16T03:29:30.479 INFO:teuthology.orchestra.run.smithi050.stdout:(7/10): libcephsqlite-19.0.0-201.gac5f0a00.el9. 378 kB/s | 158 kB 00:00 2023-12-16T03:29:30.613 INFO:teuthology.orchestra.run.smithi050.stdout:(8/10): cryptopp-8.6.0-1.el9.x86_64.rpm 6.3 MB/s | 1.3 MB 00:00 2023-12-16T03:29:30.638 INFO:teuthology.orchestra.run.smithi050.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 768 kB/s | 122 kB 00:00 2023-12-16T03:29:35.447 INFO:teuthology.orchestra.run.smithi050.stdout:(10/10): ceph-test-19.0.0-201.gac5f0a00.el9.x86 22 MB/s | 118 MB 00:05 2023-12-16T03:29:35.449 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:29:35.449 INFO:teuthology.orchestra.run.smithi050.stdout:Total 22 MB/s | 120 MB 00:05 2023-12-16T03:29:35.450 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:29:35.474 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:29:35.474 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:29:36.327 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:29:36.327 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:29:36.376 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-selinux-2:19.0.0-201.gac5f0a00.el9.x86_64 28/31 2023-12-16T03:29:36.376 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /sys 2023-12-16T03:29:36.376 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /proc 2023-12-16T03:29:36.376 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /mnt 2023-12-16T03:29:36.376 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /var/tmp 2023-12-16T03:29:36.377 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /home 2023-12-16T03:29:36.377 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /root 2023-12-16T03:29:36.377 INFO:teuthology.orchestra.run.smithi124.stdout:skipping the directory /tmp 2023-12-16T03:29:36.377 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:29:37.223 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-radosgw-2:19.0.0-201.gac5f0a00.el9.x86_64 29/31 2023-12-16T03:29:37.248 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-201.gac5f0a00.el9.x86_64 29/31 2023-12-16T03:29:37.248 INFO:teuthology.orchestra.run.smithi124.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:29:37.248 INFO:teuthology.orchestra.run.smithi124.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-16T03:29:37.248 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T03:29:37.248 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T03:29:37.248 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:29:37.249 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-16T03:29:37.334 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-16T03:29:37.335 INFO:teuthology.orchestra.run.smithi124.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-16T03:29:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:29:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-12-16T03:29:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-12-16T03:29:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-12-16T03:29:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-12-16T03:29:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-12-16T03:29:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.6-16.el9.x86_64 6/10 2023-12-16T03:29:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-12-16T03:29:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-12-16T03:29:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.0.0-201.gac5f0a00.el9.x86_64 9/10 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 1/31 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 2/31 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-radosgw-2:19.0.0-201.gac5f0a00.el9.x86_64 3/31 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-selinux-2:19.0.0-201.gac5f0a00.el9.x86_64 4/31 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 5/31 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libradosstriper1-2:19.0.0-201.gac5f0a00.el9.x86_64 6/31 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librgw2-2:19.0.0-201.gac5f0a00.el9.x86_64 7/31 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-ceph-argparse-2:19.0.0-201.gac5f0a00.el9.x 8/31 2023-12-16T03:29:38.541 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-ceph-common-2:19.0.0-201.gac5f0a00.el9.x86 9/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cephfs-2:19.0.0-201.gac5f0a00.el9.x86_64 10/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rados-2:19.0.0-201.gac5f0a00.el9.x86_64 11/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rbd-2:19.0.0-201.gac5f0a00.el9.x86_64 12/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rgw-2:19.0.0-201.gac5f0a00.el9.x86_64 13/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-16T03:29:38.542 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-16T03:29:38.543 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-16T03:29:38.543 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-16T03:29:38.543 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 28/31 2023-12-16T03:29:38.543 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-16T03:29:38.543 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 30/31 2023-12-16T03:29:39.479 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-16T03:29:39.479 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:29:39.479 INFO:teuthology.orchestra.run.smithi124.stdout:Upgraded: 2023-12-16T03:29:39.479 INFO:teuthology.orchestra.run.smithi124.stdout: librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.479 INFO:teuthology.orchestra.run.smithi124.stdout: librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.479 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-radosgw-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-selinux-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-16T03:29:39.480 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: librgw2-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-common-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cephfs-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rbd-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rgw-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: re2-1:20211101-3.el9.x86_64 2023-12-16T03:29:39.481 INFO:teuthology.orchestra.run.smithi124.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-16T03:29:39.482 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:29:39.482 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:29:39.807 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-test 2023-12-16T03:29:40.368 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:00:27 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:29:40.511 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:29:40.512 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:29:40.512 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:29:40.512 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 118 M 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: libcephsqlite x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 158 k 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-16T03:29:40.513 INFO:teuthology.orchestra.run.smithi124.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-12-16T03:29:40.514 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:29:40.514 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:29:40.514 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:29:40.514 INFO:teuthology.orchestra.run.smithi124.stdout:Install 10 Packages 2023-12-16T03:29:40.514 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:29:40.514 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 120 M 2023-12-16T03:29:40.514 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 1.1 G 2023-12-16T03:29:40.514 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:29:40.729 INFO:teuthology.orchestra.run.smithi124.stdout:(1/10): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 186 kB 00:00 2023-12-16T03:29:40.780 INFO:teuthology.orchestra.run.smithi124.stdout:(2/10): libasan-11.4.1-2.3.el9.x86_64.rpm 8.4 MB/s | 418 kB 00:00 2023-12-16T03:29:40.813 INFO:teuthology.orchestra.run.smithi124.stdout:(3/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-12-16T03:29:40.847 INFO:teuthology.orchestra.run.smithi124.stdout:(4/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2023-12-16T03:29:40.880 INFO:teuthology.orchestra.run.smithi124.stdout:(5/10): socat-1.7.4.1-5.el9.x86_64.rpm 8.8 MB/s | 300 kB 00:00 2023-12-16T03:29:40.914 INFO:teuthology.orchestra.run.smithi124.stdout:(6/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-16T03:29:40.981 INFO:teuthology.orchestra.run.smithi124.stdout:(7/10): libcephsqlite-19.0.0-201.gac5f0a00.el9. 383 kB/s | 158 kB 00:00 2023-12-16T03:29:41.281 INFO:teuthology.orchestra.run.smithi124.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 406 kB/s | 122 kB 00:00 2023-12-16T03:29:41.398 INFO:teuthology.orchestra.run.smithi124.stdout:(9/10): cryptopp-8.6.0-1.el9.x86_64.rpm 2.6 MB/s | 1.3 MB 00:00 2023-12-16T03:29:47.665 INFO:teuthology.orchestra.run.smithi124.stdout:(10/10): ceph-test-19.0.0-201.gac5f0a00.el9.x86 17 MB/s | 118 MB 00:07 2023-12-16T03:29:47.669 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:29:47.669 INFO:teuthology.orchestra.run.smithi124.stdout:Total 17 MB/s | 120 MB 00:07 2023-12-16T03:29:47.670 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:29:47.689 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:29:47.689 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:29:48.503 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:29:48.503 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:29:49.641 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:29:49.739 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-12-16T03:29:49.782 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-12-16T03:29:49.825 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-12-16T03:29:49.864 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-12-16T03:29:49.898 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-12-16T03:29:49.930 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : jq-1.6-16.el9.x86_64 6/10 2023-12-16T03:29:49.958 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-12-16T03:29:50.000 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-12-16T03:29:50.028 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephsqlite-2:19.0.0-201.gac5f0a00.el9.x86_64 9/10 2023-12-16T03:29:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.0.0-201.gac5f0a00.el9.x86_64 9/10 2023-12-16T03:29:55.160 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.0.0-201.gac5f0a00.el9.x86_64 10/10 2023-12-16T03:30:03.546 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-test-2:19.0.0-201.gac5f0a00.el9.x86_64 10/10 2023-12-16T03:30:03.546 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.0.0-201.gac5f0a00.el9.x86_64 1/10 2023-12-16T03:30:03.546 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.0.0-201.gac5f0a00.el9.x86_64 2/10 2023-12-16T03:30:03.546 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.6-16.el9.x86_64 3/10 2023-12-16T03:30:03.546 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 4/10 2023-12-16T03:30:03.546 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 5/10 2023-12-16T03:30:03.546 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/10 2023-12-16T03:30:03.547 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/10 2023-12-16T03:30:03.547 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/10 2023-12-16T03:30:03.547 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.6-16.el9.x86_64 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-12-16T03:30:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-16T03:30:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-16T03:30:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-16T03:30:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-12-16T03:30:03.970 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:03.970 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:30:04.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph 2023-12-16T03:30:04.865 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:04 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:30:05.024 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:30:05.026 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================== 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================== 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 6.5 k 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 2.0 M 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 1.4 M 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 243 k 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 8.9 M 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 118 M 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-16T03:30:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-16T03:30:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:30:05.029 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================== 2023-12-16T03:30:05.030 INFO:teuthology.orchestra.run.smithi050.stdout:Install 35 Packages 2023-12-16T03:30:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:05.030 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 134 M 2023-12-16T03:30:05.030 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 1.4 G 2023-12-16T03:30:05.030 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:30:05.567 INFO:teuthology.orchestra.run.smithi050.stdout:(1/35): ceph-19.0.0-201.gac5f0a00.el9.x86_64.rp 36 kB/s | 6.5 kB 00:00 2023-12-16T03:30:05.793 INFO:teuthology.orchestra.run.smithi050.stdout:(2/35): ceph-mds-19.0.0-201.gac5f0a00.el9.x86_6 4.9 MB/s | 2.0 MB 00:00 2023-12-16T03:30:06.126 INFO:teuthology.orchestra.run.smithi050.stdout:(3/35): ceph-mgr-19.0.0-201.gac5f0a00.el9.x86_6 2.0 MB/s | 1.4 MB 00:00 2023-12-16T03:30:06.243 INFO:teuthology.orchestra.run.smithi050.stdout:(4/35): ceph-mgr-modules-core-19.0.0-201.gac5f0 2.0 MB/s | 243 kB 00:00 2023-12-16T03:30:06.343 INFO:teuthology.orchestra.run.smithi050.stdout:(5/35): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-12-16T03:30:06.386 INFO:teuthology.orchestra.run.smithi050.stdout:(6/35): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-12-16T03:30:06.411 INFO:teuthology.orchestra.run.smithi050.stdout:(7/35): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2023-12-16T03:30:06.436 INFO:teuthology.orchestra.run.smithi050.stdout:(8/35): python3-pytz-2021.1-5.el9.noarch.rpm 1.8 MB/s | 47 kB 00:00 2023-12-16T03:30:06.461 INFO:teuthology.orchestra.run.smithi050.stdout:(9/35): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2023-12-16T03:30:06.475 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libcephsqlite-2:19.0.0-201.gac5f0a00.el9.x86_64 9/10 2023-12-16T03:30:06.503 INFO:teuthology.orchestra.run.smithi050.stdout:(10/35): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-12-16T03:30:06.550 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-test-2:19.0.0-201.gac5f0a00.el9.x86_64 10/10 2023-12-16T03:30:06.562 INFO:teuthology.orchestra.run.smithi050.stdout:(11/35): python3-cryptography-36.0.1-4.el9.x86_ 20 MB/s | 1.1 MB 00:00 2023-12-16T03:30:06.595 INFO:teuthology.orchestra.run.smithi050.stdout:(12/35): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-12-16T03:30:06.629 INFO:teuthology.orchestra.run.smithi050.stdout:(13/35): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-12-16T03:30:06.662 INFO:teuthology.orchestra.run.smithi050.stdout:(14/35): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-12-16T03:30:06.696 INFO:teuthology.orchestra.run.smithi050.stdout:(15/35): python3-urllib3-1.26.5-4.el9.noarch.rp 5.5 MB/s | 187 kB 00:00 2023-12-16T03:30:06.822 INFO:teuthology.orchestra.run.smithi050.stdout:(16/35): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2023-12-16T03:30:06.863 INFO:teuthology.orchestra.run.smithi050.stdout:(17/35): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2023-12-16T03:30:06.914 INFO:teuthology.orchestra.run.smithi050.stdout:(18/35): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2023-12-16T03:30:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:(19/35): ceph-mon-19.0.0-201.gac5f0a00.el9.x86_ 6.0 MB/s | 8.9 MB 00:01 2023-12-16T03:30:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:(20/35): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2023-12-16T03:30:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:(21/35): python3-jaraco-8.2.1-3.el9.noarch.rpm 257 kB/s | 11 kB 00:00 2023-12-16T03:30:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:(22/35): python3-jaraco-classes-3.2.1-5.el9.noa 527 kB/s | 18 kB 00:00 2023-12-16T03:30:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:(23/35): python3-jaraco-collections-3.0.0-8.el9 692 kB/s | 23 kB 00:00 2023-12-16T03:30:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:(24/35): python3-jaraco-functools-3.5.0-2.el9.n 579 kB/s | 19 kB 00:00 2023-12-16T03:30:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:(25/35): python3-jaraco-text-3.2.0-6.el9.noarch 588 kB/s | 20 kB 00:00 2023-12-16T03:30:07.166 INFO:teuthology.orchestra.run.smithi050.stdout:(26/35): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2023-12-16T03:30:07.191 INFO:teuthology.orchestra.run.smithi050.stdout:(27/35): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2023-12-16T03:30:07.217 INFO:teuthology.orchestra.run.smithi050.stdout:(28/35): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2023-12-16T03:30:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:(29/35): python3-portend-3.1.0-2.el9.noarch.rpm 332 kB/s | 16 kB 00:00 2023-12-16T03:30:07.267 INFO:teuthology.orchestra.run.smithi050.stdout:(30/35): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2023-12-16T03:30:07.293 INFO:teuthology.orchestra.run.smithi050.stdout:(31/35): python3-tempora-5.0.0-2.el9.noarch.rpm 707 kB/s | 36 kB 00:00 2023-12-16T03:30:07.318 INFO:teuthology.orchestra.run.smithi050.stdout:(32/35): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2023-12-16T03:30:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:(33/35): python3-werkzeug-2.0.3-3.el9.1.noarch. 8.4 MB/s | 427 kB 00:00 2023-12-16T03:30:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:(34/35): python3-zc-lockfile-2.0-10.el9.noarch. 404 kB/s | 20 kB 00:00 2023-12-16T03:30:11.544 INFO:teuthology.orchestra.run.smithi050.stdout:(35/35): ceph-osd-19.0.0-201.gac5f0a00.el9.x86_ 20 MB/s | 118 MB 00:05 2023-12-16T03:30:11.548 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:30:11.549 INFO:teuthology.orchestra.run.smithi050.stdout:Total 21 MB/s | 134 MB 00:06 2023-12-16T03:30:11.549 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:30:11.594 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:30:11.595 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:30:12.666 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:30:12.666 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:30:14.593 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:30:14.659 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-test-2:19.0.0-201.gac5f0a00.el9.x86_64 10/10 2023-12-16T03:30:14.659 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-test-2:19.0.0-201.gac5f0a00.el9.x86_64 1/10 2023-12-16T03:30:14.659 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephsqlite-2:19.0.0-201.gac5f0a00.el9.x86_64 2/10 2023-12-16T03:30:14.659 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : jq-1.6-16.el9.x86_64 3/10 2023-12-16T03:30:14.659 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 4/10 2023-12-16T03:30:14.660 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 5/10 2023-12-16T03:30:14.660 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/10 2023-12-16T03:30:14.660 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/10 2023-12-16T03:30:14.660 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/10 2023-12-16T03:30:14.660 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-12-16T03:30:14.671 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/35 2023-12-16T03:30:14.712 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/35 2023-12-16T03:30:14.745 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/35 2023-12-16T03:30:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/35 2023-12-16T03:30:14.918 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/35 2023-12-16T03:30:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/35 2023-12-16T03:30:15.038 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/35 2023-12-16T03:30:15.116 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/35 2023-12-16T03:30:15.142 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-12-16T03:30:15.142 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:15.142 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:30:15.142 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-test-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:15.142 INFO:teuthology.orchestra.run.smithi124.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-12-16T03:30:15.142 INFO:teuthology.orchestra.run.smithi124.stdout: jq-1.6-16.el9.x86_64 2023-12-16T03:30:15.142 INFO:teuthology.orchestra.run.smithi124.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-12-16T03:30:15.143 INFO:teuthology.orchestra.run.smithi124.stdout: libcephsqlite-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:15.143 INFO:teuthology.orchestra.run.smithi124.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-12-16T03:30:15.143 INFO:teuthology.orchestra.run.smithi124.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-16T03:30:15.143 INFO:teuthology.orchestra.run.smithi124.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-16T03:30:15.143 INFO:teuthology.orchestra.run.smithi124.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-16T03:30:15.143 INFO:teuthology.orchestra.run.smithi124.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-12-16T03:30:15.143 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:15.143 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:30:15.153 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/35 2023-12-16T03:30:15.197 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/35 2023-12-16T03:30:15.258 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/35 2023-12-16T03:30:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-16T03:30:15.495 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph 2023-12-16T03:30:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-16T03:30:15.538 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/35 2023-12-16T03:30:15.573 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/35 2023-12-16T03:30:15.594 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/35 2023-12-16T03:30:15.665 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/35 2023-12-16T03:30:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/35 2023-12-16T03:30:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/35 2023-12-16T03:30:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/35 2023-12-16T03:30:15.822 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/35 2023-12-16T03:30:15.856 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/35 2023-12-16T03:30:15.948 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/35 2023-12-16T03:30:15.988 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/35 2023-12-16T03:30:16.042 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:01:03 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:30:16.063 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/35 2023-12-16T03:30:16.188 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout:======================================================================================== 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout:======================================================================================== 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout: ceph x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 6.5 k 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 2.0 M 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 1.4 M 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 243 k 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 8.9 M 2023-12-16T03:30:16.191 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 118 M 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-16T03:30:16.192 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:16.193 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:30:16.194 INFO:teuthology.orchestra.run.smithi124.stdout:======================================================================================== 2023-12-16T03:30:16.194 INFO:teuthology.orchestra.run.smithi124.stdout:Install 35 Packages 2023-12-16T03:30:16.194 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:16.194 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 134 M 2023-12-16T03:30:16.194 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 1.4 G 2023-12-16T03:30:16.194 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:30:16.202 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/35 2023-12-16T03:30:16.336 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/35 2023-12-16T03:30:16.510 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-201.gac5f0a00.el9.n 28/35 2023-12-16T03:30:16.521 INFO:teuthology.orchestra.run.smithi124.stdout:(1/35): ceph-19.0.0-201.gac5f0a00.el9.x86_64.rp 36 kB/s | 6.5 kB 00:00 2023-12-16T03:30:16.542 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 29/35 2023-12-16T03:30:16.569 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 29/35 2023-12-16T03:30:16.569 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:30:16.569 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-16T03:30:16.569 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T03:30:16.569 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T03:30:16.569 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:16.662 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/35 2023-12-16T03:30:16.730 INFO:teuthology.orchestra.run.smithi124.stdout:(2/35): ceph-mgr-19.0.0-201.gac5f0a00.el9.x86_6 3.7 MB/s | 1.4 MB 00:00 2023-12-16T03:30:16.797 INFO:teuthology.orchestra.run.smithi124.stdout:(3/35): ceph-mds-19.0.0-201.gac5f0a00.el9.x86_6 4.4 MB/s | 2.0 MB 00:00 2023-12-16T03:30:16.864 INFO:teuthology.orchestra.run.smithi124.stdout:(4/35): ceph-mgr-modules-core-19.0.0-201.gac5f0 3.6 MB/s | 243 kB 00:00 2023-12-16T03:30:17.047 INFO:teuthology.orchestra.run.smithi124.stdout:(5/35): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-12-16T03:30:17.081 INFO:teuthology.orchestra.run.smithi124.stdout:(6/35): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-12-16T03:30:17.106 INFO:teuthology.orchestra.run.smithi124.stdout:(7/35): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2023-12-16T03:30:17.131 INFO:teuthology.orchestra.run.smithi124.stdout:(8/35): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2023-12-16T03:30:17.157 INFO:teuthology.orchestra.run.smithi124.stdout:(9/35): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2023-12-16T03:30:17.199 INFO:teuthology.orchestra.run.smithi124.stdout:(10/35): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2023-12-16T03:30:17.258 INFO:teuthology.orchestra.run.smithi124.stdout:(11/35): python3-cryptography-36.0.1-4.el9.x86_ 20 MB/s | 1.1 MB 00:00 2023-12-16T03:30:17.291 INFO:teuthology.orchestra.run.smithi124.stdout:(12/35): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-12-16T03:30:17.324 INFO:teuthology.orchestra.run.smithi124.stdout:(13/35): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-12-16T03:30:17.366 INFO:teuthology.orchestra.run.smithi124.stdout:(14/35): python3-requests-2.25.1-7.el9.noarch.r 2.6 MB/s | 113 kB 00:00 2023-12-16T03:30:17.400 INFO:teuthology.orchestra.run.smithi124.stdout:(15/35): python3-urllib3-1.26.5-4.el9.noarch.rp 5.5 MB/s | 187 kB 00:00 2023-12-16T03:30:17.517 INFO:teuthology.orchestra.run.smithi124.stdout:(16/35): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2023-12-16T03:30:17.559 INFO:teuthology.orchestra.run.smithi124.stdout:(17/35): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2023-12-16T03:30:17.609 INFO:teuthology.orchestra.run.smithi124.stdout:(18/35): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2023-12-16T03:30:17.668 INFO:teuthology.orchestra.run.smithi124.stdout:(19/35): python3-cherrypy-18.6.1-2.el9.noarch.r 6.0 MB/s | 358 kB 00:00 2023-12-16T03:30:17.710 INFO:teuthology.orchestra.run.smithi124.stdout:(20/35): python3-jaraco-8.2.1-3.el9.noarch.rpm 257 kB/s | 11 kB 00:00 2023-12-16T03:30:17.751 INFO:teuthology.orchestra.run.smithi124.stdout:(21/35): python3-jaraco-classes-3.2.1-5.el9.noa 426 kB/s | 18 kB 00:00 2023-12-16T03:30:17.793 INFO:teuthology.orchestra.run.smithi124.stdout:(22/35): python3-jaraco-collections-3.0.0-8.el9 558 kB/s | 23 kB 00:00 2023-12-16T03:30:17.835 INFO:teuthology.orchestra.run.smithi124.stdout:(23/35): python3-jaraco-functools-3.5.0-2.el9.n 466 kB/s | 19 kB 00:00 2023-12-16T03:30:17.877 INFO:teuthology.orchestra.run.smithi124.stdout:(24/35): python3-jaraco-text-3.2.0-6.el9.noarch 472 kB/s | 20 kB 00:00 2023-12-16T03:30:17.961 INFO:teuthology.orchestra.run.smithi124.stdout:(25/35): python3-logutils-0.3.5-21.el9.noarch.r 555 kB/s | 46 kB 00:00 2023-12-16T03:30:18.061 INFO:teuthology.orchestra.run.smithi124.stdout:(26/35): ceph-mon-19.0.0-201.gac5f0a00.el9.x86_ 5.8 MB/s | 8.9 MB 00:01 2023-12-16T03:30:18.111 INFO:teuthology.orchestra.run.smithi124.stdout:(27/35): python3-more-itertools-8.12.0-2.el9.no 525 kB/s | 79 kB 00:00 2023-12-16T03:30:18.220 INFO:teuthology.orchestra.run.smithi124.stdout:(28/35): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2023-12-16T03:30:18.262 INFO:teuthology.orchestra.run.smithi124.stdout:(29/35): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2023-12-16T03:30:18.287 INFO:teuthology.orchestra.run.smithi124.stdout:(30/35): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2023-12-16T03:30:18.313 INFO:teuthology.orchestra.run.smithi124.stdout:(31/35): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2023-12-16T03:30:18.338 INFO:teuthology.orchestra.run.smithi124.stdout:(32/35): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2023-12-16T03:30:18.371 INFO:teuthology.orchestra.run.smithi124.stdout:(33/35): python3-werkzeug-2.0.3-3.el9.1.noarch. 7.1 MB/s | 427 kB 00:00 2023-12-16T03:30:18.397 INFO:teuthology.orchestra.run.smithi124.stdout:(34/35): python3-zc-lockfile-2.0-10.el9.noarch. 342 kB/s | 20 kB 00:00 2023-12-16T03:30:22.047 INFO:teuthology.orchestra.run.smithi124.stdout:(35/35): ceph-osd-19.0.0-201.gac5f0a00.el9.x86_ 22 MB/s | 118 MB 00:05 2023-12-16T03:30:22.050 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:30:22.050 INFO:teuthology.orchestra.run.smithi124.stdout:Total 23 MB/s | 134 MB 00:05 2023-12-16T03:30:22.051 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:30:22.090 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:30:22.090 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:30:23.105 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:30:23.106 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:30:24.998 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:30:25.074 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/35 2023-12-16T03:30:25.106 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/35 2023-12-16T03:30:25.155 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/35 2023-12-16T03:30:25.246 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/35 2023-12-16T03:30:25.326 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/35 2023-12-16T03:30:25.367 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/35 2023-12-16T03:30:25.438 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/35 2023-12-16T03:30:25.492 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/35 2023-12-16T03:30:25.530 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/35 2023-12-16T03:30:25.579 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/35 2023-12-16T03:30:25.634 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/35 2023-12-16T03:30:25.818 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-16T03:30:25.877 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-16T03:30:25.906 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/35 2023-12-16T03:30:25.940 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/35 2023-12-16T03:30:25.987 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/35 2023-12-16T03:30:26.054 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/35 2023-12-16T03:30:26.090 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/35 2023-12-16T03:30:26.122 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/35 2023-12-16T03:30:26.162 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/35 2023-12-16T03:30:26.197 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/35 2023-12-16T03:30:26.224 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/35 2023-12-16T03:30:26.311 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/35 2023-12-16T03:30:26.354 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/35 2023-12-16T03:30:26.425 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/35 2023-12-16T03:30:26.561 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/35 2023-12-16T03:30:26.687 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/35 2023-12-16T03:30:26.854 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-201.gac5f0a00.el9.n 28/35 2023-12-16T03:30:26.884 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 29/35 2023-12-16T03:30:26.909 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 29/35 2023-12-16T03:30:26.909 INFO:teuthology.orchestra.run.smithi124.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:30:26.909 INFO:teuthology.orchestra.run.smithi124.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-16T03:30:26.909 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T03:30:26.909 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T03:30:26.910 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:26.991 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/35 2023-12-16T03:30:36.044 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-1.el9.noarch 31/35 2023-12-16T03:30:36.068 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.0.0-201.gac5f0a00.el9.x86_64 32/35 2023-12-16T03:30:36.095 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.0.0-201.gac5f0a00.el9.x86_64 32/35 2023-12-16T03:30:36.096 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:30:36.096 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-16T03:30:36.096 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T03:30:36.096 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T03:30:36.096 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.0.0-201.gac5f0a00.el9.x86_64 33/35 2023-12-16T03:30:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.0.0-201.gac5f0a00.el9.x86_64 33/35 2023-12-16T03:30:37.080 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:30:37.080 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-16T03:30:37.080 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T03:30:37.080 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T03:30:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.0.0-201.gac5f0a00.el9.x86_64 34/35 2023-12-16T03:30:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.0.0-201.gac5f0a00.el9.x86_64 34/35 2023-12-16T03:30:37.312 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:30:37.312 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-16T03:30:37.312 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T03:30:37.312 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T03:30:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.0.0-201.gac5f0a00.el9.x86_64 35/35 2023-12-16T03:30:45.319 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : luarocks-3.9.2-1.el9.noarch 31/35 2023-12-16T03:30:45.351 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-osd-2:19.0.0-201.gac5f0a00.el9.x86_64 32/35 2023-12-16T03:30:45.377 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-osd-2:19.0.0-201.gac5f0a00.el9.x86_64 32/35 2023-12-16T03:30:45.378 INFO:teuthology.orchestra.run.smithi124.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:30:45.378 INFO:teuthology.orchestra.run.smithi124.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-16T03:30:45.378 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T03:30:45.378 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T03:30:45.378 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:46.269 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mon-2:19.0.0-201.gac5f0a00.el9.x86_64 33/35 2023-12-16T03:30:46.291 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mon-2:19.0.0-201.gac5f0a00.el9.x86_64 33/35 2023-12-16T03:30:46.292 INFO:teuthology.orchestra.run.smithi124.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:30:46.292 INFO:teuthology.orchestra.run.smithi124.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-16T03:30:46.292 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T03:30:46.292 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T03:30:46.292 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:46.486 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mds-2:19.0.0-201.gac5f0a00.el9.x86_64 34/35 2023-12-16T03:30:46.509 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mds-2:19.0.0-201.gac5f0a00.el9.x86_64 34/35 2023-12-16T03:30:46.509 INFO:teuthology.orchestra.run.smithi124.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:30:46.509 INFO:teuthology.orchestra.run.smithi124.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-16T03:30:46.509 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T03:30:46.509 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T03:30:46.509 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:46.575 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-2:19.0.0-201.gac5f0a00.el9.x86_64 35/35 2023-12-16T03:30:47.501 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-2:19.0.0-201.gac5f0a00.el9.x86_64 35/35 2023-12-16T03:30:47.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.0.0-201.gac5f0a00.el9.x86_64 1/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.0.0-201.gac5f0a00.el9.x86_64 2/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 3/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.0.0-201.gac5f0a00.el9.x86_64 4/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.0.0-201.gac5f0a00.el9.x86_64 5/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-201.gac5f0a00.el9.n 6/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-16T03:30:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 18/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 19/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 20/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 21/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 22/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 23/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 24/35 2023-12-16T03:30:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 25/35 2023-12-16T03:30:47.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 26/35 2023-12-16T03:30:47.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 27/35 2023-12-16T03:30:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 28/35 2023-12-16T03:30:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 29/35 2023-12-16T03:30:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 30/35 2023-12-16T03:30:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 31/35 2023-12-16T03:30:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 32/35 2023-12-16T03:30:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 33/35 2023-12-16T03:30:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 34/35 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 35/35 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-16T03:30:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-16T03:30:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:48.509 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:30:48.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-base 2023-12-16T03:30:49.342 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:49 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:30:49.436 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:30:49.488 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:30:49.489 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-12-16T03:30:49.489 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:30:49.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install cephadm 2023-12-16T03:30:50.149 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:50 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:30:50.298 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 807 k 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 807 k 2023-12-16T03:30:50.299 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 822 k 2023-12-16T03:30:50.300 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:30:50.594 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm-19.0.0-201.gac5f0a00.el9.noarch.rpm 2.7 MB/s | 807 kB 00:00 2023-12-16T03:30:50.594 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:30:50.595 INFO:teuthology.orchestra.run.smithi050.stdout:Total 2.7 MB/s | 807 kB 00:00 2023-12-16T03:30:50.595 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:30:50.600 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:30:50.601 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:30:50.607 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:30:50.607 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:30:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:30:51.127 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:30:51.217 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:30:51.601 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:30:51.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:30:51.920 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:51.920 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:30:51.920 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:30:51.920 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:51.920 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:30:52.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T03:30:52.691 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:52 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:30:52.841 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:30:52.841 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:30:52.841 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2023-12-16T03:30:52.841 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 143 k 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 143 k 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 437 k 2023-12-16T03:30:52.842 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:30:53.191 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-immutable-object-cache-19.0.0-201.gac5f0a0 411 kB/s | 143 kB 00:00 2023-12-16T03:30:53.192 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:30:53.192 INFO:teuthology.orchestra.run.smithi050.stdout:Total 409 kB/s | 143 kB 00:00 2023-12-16T03:30:53.192 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:30:53.201 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:30:53.201 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:30:53.257 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:30:53.257 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:30:53.411 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:30:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-201.gac5f0a00.e 1/1 2023-12-16T03:30:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-201.gac5f0a00.e 1/1 2023-12-16T03:30:53.518 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:30:53.518 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-16T03:30:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-201.gac5f0a00.e 1/1 2023-12-16T03:30:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:54.452 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:30:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:54.453 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:30:54.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr 2023-12-16T03:30:55.245 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:55 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:30:55.342 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:30:55.394 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:30:55.395 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-12-16T03:30:55.395 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:30:55.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T03:30:56.047 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:56 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 1.8 M 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 28 k 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 15 k 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-16T03:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-16T03:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-16T03:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2023-12-16T03:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-16T03:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout:Install 7 Packages 2023-12-16T03:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 2.1 M 2023-12-16T03:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 8.7 M 2023-12-16T03:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:30:56.795 INFO:teuthology.orchestra.run.smithi050.stdout:(1/7): ceph-prometheus-alerts-19.0.0-201.gac5f0 62 kB/s | 15 kB 00:00 2023-12-16T03:30:56.812 INFO:teuthology.orchestra.run.smithi050.stdout:(2/7): ceph-grafana-dashboards-19.0.0-201.gac5f 108 kB/s | 28 kB 00:00 2023-12-16T03:30:56.832 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-2:19.0.0-201.gac5f0a00.el9.x86_64 35/35 2023-12-16T03:30:56.832 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-2:19.0.0-201.gac5f0a00.el9.x86_64 1/35 2023-12-16T03:30:56.832 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mds-2:19.0.0-201.gac5f0a00.el9.x86_64 2/35 2023-12-16T03:30:56.832 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 3/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mon-2:19.0.0-201.gac5f0a00.el9.x86_64 4/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-osd-2:19.0.0-201.gac5f0a00.el9.x86_64 5/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-201.gac5f0a00.el9.n 6/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/35 2023-12-16T03:30:56.833 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 18/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 19/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 20/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 21/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 22/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 23/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 24/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 25/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 26/35 2023-12-16T03:30:56.834 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 27/35 2023-12-16T03:30:56.835 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 28/35 2023-12-16T03:30:56.835 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 29/35 2023-12-16T03:30:56.835 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 30/35 2023-12-16T03:30:56.835 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 31/35 2023-12-16T03:30:56.835 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 32/35 2023-12-16T03:30:56.835 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 33/35 2023-12-16T03:30:56.835 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 34/35 2023-12-16T03:30:56.946 INFO:teuthology.orchestra.run.smithi050.stdout:(3/7): ceph-mgr-dashboard-19.0.0-201.gac5f0a00. 4.5 MB/s | 1.8 MB 00:00 2023-12-16T03:30:57.021 INFO:teuthology.orchestra.run.smithi050.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 40 kB/s | 9.0 kB 00:00 2023-12-16T03:30:57.054 INFO:teuthology.orchestra.run.smithi050.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 169 kB/s | 41 kB 00:00 2023-12-16T03:30:57.096 INFO:teuthology.orchestra.run.smithi050.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 206 kB/s | 31 kB 00:00 2023-12-16T03:30:57.280 INFO:teuthology.orchestra.run.smithi050.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 728 kB/s | 188 kB 00:00 2023-12-16T03:30:57.283 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:30:57.283 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.9 MB/s | 2.1 MB 00:01 2023-12-16T03:30:57.283 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:30:57.291 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:30:57.292 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:30:57.365 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:30:57.365 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:30:57.673 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:30:57.748 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-16T03:30:57.791 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-16T03:30:57.838 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-16T03:30:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-16T03:30:57.899 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-201.gac5f0a00.el9.no 5/7 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 35/35 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mds-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mon-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-osd-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:30:57.916 INFO:teuthology.orchestra.run.smithi124.stdout: lua-5.4.4-4.el9.x86_64 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-16T03:30:57.917 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ply-3.11-14.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-16T03:30:57.918 INFO:teuthology.orchestra.run.smithi124.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-16T03:30:57.919 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-16T03:30:57.919 INFO:teuthology.orchestra.run.smithi124.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-16T03:30:57.919 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:57.919 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:30:58.148 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-201.gac5f0a00.el9.n 6/7 2023-12-16T03:30:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-201.gac5f0a00.el9.noarch 7/7 2023-12-16T03:30:58.181 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-base 2023-12-16T03:30:58.731 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:01:45 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:30:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-201.gac5f0a00.el9.noarch 7/7 2023-12-16T03:30:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-201.gac5f0a00.el9.n 1/7 2023-12-16T03:30:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-201.gac5f0a00.el9.noarch 2/7 2023-12-16T03:30:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-201.gac5f0a00.el9.no 3/7 2023-12-16T03:30:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-16T03:30:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-16T03:30:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-16T03:30:58.823 INFO:teuthology.orchestra.run.smithi124.stdout:Package ceph-base-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:30:58.871 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:30:58.872 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-12-16T03:30:58.873 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:30:58.934 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install cephadm 2023-12-16T03:30:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-16T03:30:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:59.144 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:30:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:30:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:30:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:30:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-16T03:30:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-16T03:30:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-16T03:30:59.145 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-16T03:30:59.145 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:30:59.145 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:30:59.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T03:30:59.488 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:01:46 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:30:59.631 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout: cephadm noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 807 k 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 807 k 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 822 k 2023-12-16T03:30:59.632 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:30:59.941 INFO:teuthology.orchestra.run.smithi124.stdout:cephadm-19.0.0-201.gac5f0a00.el9.noarch.rpm 2.6 MB/s | 807 kB 00:00 2023-12-16T03:30:59.944 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:30:59.944 INFO:teuthology.orchestra.run.smithi124.stdout:Total 2.5 MB/s | 807 kB 00:00 2023-12-16T03:30:59.945 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:59 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:30:59.947 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:30:59.947 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:30:59.953 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:30:59.954 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:00.029 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:00.100 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:00.101 INFO:teuthology.orchestra.run.smithi050.stdout:=========================================================================================== 2023-12-16T03:31:00.101 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:31:00.101 INFO:teuthology.orchestra.run.smithi050.stdout:=========================================================================================== 2023-12-16T03:31:00.101 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 7.4 M 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:00.102 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:00.103 INFO:teuthology.orchestra.run.smithi050.stdout:=========================================================================================== 2023-12-16T03:31:00.103 INFO:teuthology.orchestra.run.smithi050.stdout:Install 12 Packages 2023-12-16T03:31:00.103 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:00.103 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 37 M 2023-12-16T03:31:00.103 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 209 M 2023-12-16T03:31:00.103 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:00.295 INFO:teuthology.orchestra.run.smithi050.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 253 kB/s | 32 kB 00:00 2023-12-16T03:31:00.329 INFO:teuthology.orchestra.run.smithi050.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 539 kB/s | 17 kB 00:00 2023-12-16T03:31:00.387 INFO:teuthology.orchestra.run.smithi050.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2023-12-16T03:31:00.413 INFO:teuthology.orchestra.run.smithi050.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 418 kB/s | 34 kB 00:00 2023-12-16T03:31:00.514 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:00.555 INFO:teuthology.orchestra.run.smithi050.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 28 MB/s | 4.7 MB 00:00 2023-12-16T03:31:00.605 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-12-16T03:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.5 MB/s | 217 kB 00:00 2023-12-16T03:31:00.697 INFO:teuthology.orchestra.run.smithi050.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 803 kB 00:00 2023-12-16T03:31:00.856 INFO:teuthology.orchestra.run.smithi050.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 65 MB/s | 16 MB 00:00 2023-12-16T03:31:00.881 INFO:teuthology.orchestra.run.smithi050.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2023-12-16T03:31:00.999 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:01.090 INFO:teuthology.orchestra.run.smithi050.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-2 8.0 MB/s | 7.4 MB 00:00 2023-12-16T03:31:01.115 INFO:teuthology.orchestra.run.smithi050.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 951 kB/s | 245 kB 00:00 2023-12-16T03:31:01.117 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:01.118 INFO:teuthology.orchestra.run.smithi050.stdout:Total 37 MB/s | 37 MB 00:01 2023-12-16T03:31:01.131 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:01.157 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:01.158 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:01.310 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:01.311 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:01.311 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:01.311 INFO:teuthology.orchestra.run.smithi124.stdout: cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:01.311 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:01.311 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:01.544 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T03:31:01.567 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:01.567 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:02.105 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:01:49 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:02.254 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:02.255 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:02.255 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repo Size 2023-12-16T03:31:02.255 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:02.255 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:02.255 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 143 k 2023-12-16T03:31:02.255 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:02.255 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:02.255 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:02.256 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2023-12-16T03:31:02.256 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:02.256 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 143 k 2023-12-16T03:31:02.256 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 437 k 2023-12-16T03:31:02.256 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:02.505 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-16T03:31:02.536 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-16T03:31:02.634 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-16T03:31:02.681 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-16T03:31:02.796 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-immutable-object-cache-19.0.0-201.gac5f0a0 265 kB/s | 143 kB 00:00 2023-12-16T03:31:02.796 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:02.797 INFO:teuthology.orchestra.run.smithi124.stdout:Total 264 kB/s | 143 kB 00:00 2023-12-16T03:31:02.797 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:02.805 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:02.805 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:02.857 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:02.857 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:02.872 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-16T03:31:02.905 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-16T03:31:02.984 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-16T03:31:02.998 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:03.072 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-201.gac5f0a00.e 1/1 2023-12-16T03:31:03.095 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-201.gac5f0a00.e 1/1 2023-12-16T03:31:03.095 INFO:teuthology.orchestra.run.smithi124.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:31:03.095 INFO:teuthology.orchestra.run.smithi124.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-16T03:31:03.096 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:03.683 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-16T03:31:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-16T03:31:04.103 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-201.gac5f0a00.e 1/1 2023-12-16T03:31:04.103 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:04.103 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:04.103 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-immutable-object-cache-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:04.103 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:04.103 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:04.307 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-mgr 2023-12-16T03:31:04.873 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:01:51 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:04.966 INFO:teuthology.orchestra.run.smithi124.stdout:Package ceph-mgr-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:05.017 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:05.018 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-12-16T03:31:05.018 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:05.084 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T03:31:05.156 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-16T03:31:05.633 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:01:52 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:05.776 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 1.8 M 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 28 k 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-prometheus-alerts noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 15 k 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-16T03:31:05.777 INFO:teuthology.orchestra.run.smithi124.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-16T03:31:05.778 INFO:teuthology.orchestra.run.smithi124.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-16T03:31:05.778 INFO:teuthology.orchestra.run.smithi124.stdout:Installing weak dependencies: 2023-12-16T03:31:05.778 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-16T03:31:05.778 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:05.778 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:05.778 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:05.778 INFO:teuthology.orchestra.run.smithi124.stdout:Install 7 Packages 2023-12-16T03:31:05.778 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:05.778 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 2.1 M 2023-12-16T03:31:05.779 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 8.7 M 2023-12-16T03:31:05.779 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:06.148 INFO:teuthology.orchestra.run.smithi124.stdout:(1/7): ceph-grafana-dashboards-19.0.0-201.gac5f 145 kB/s | 28 kB 00:00 2023-12-16T03:31:06.165 INFO:teuthology.orchestra.run.smithi124.stdout:(2/7): ceph-prometheus-alerts-19.0.0-201.gac5f0 72 kB/s | 15 kB 00:00 2023-12-16T03:31:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-16T03:31:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-201.gac5f0a 12/12 2023-12-16T03:31:06.349 INFO:teuthology.orchestra.run.smithi124.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 45 kB/s | 9.0 kB 00:00 2023-12-16T03:31:06.433 INFO:teuthology.orchestra.run.smithi124.stdout:(4/7): ceph-mgr-dashboard-19.0.0-201.gac5f0a00. 3.7 MB/s | 1.8 MB 00:00 2023-12-16T03:31:06.524 INFO:teuthology.orchestra.run.smithi124.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 114 kB/s | 41 kB 00:00 2023-12-16T03:31:06.550 INFO:teuthology.orchestra.run.smithi124.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 153 kB/s | 31 kB 00:00 2023-12-16T03:31:06.883 INFO:teuthology.orchestra.run.smithi124.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 419 kB/s | 188 kB 00:00 2023-12-16T03:31:06.885 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:06.885 INFO:teuthology.orchestra.run.smithi124.stdout:Total 1.9 MB/s | 2.1 MB 00:01 2023-12-16T03:31:06.885 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:06.893 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:06.893 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:06.958 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:06.959 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:07.269 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:07.334 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-16T03:31:07.368 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-16T03:31:07.414 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-16T03:31:07.447 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-16T03:31:07.477 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-201.gac5f0a00.el9.no 5/7 2023-12-16T03:31:07.712 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-201.gac5f0a00.el9.n 6/7 2023-12-16T03:31:07.745 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-201.gac5f0a00.el9.noarch 7/7 2023-12-16T03:31:08.310 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-201.gac5f0a00.el9.noarch 7/7 2023-12-16T03:31:08.311 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-201.gac5f0a00.el9.n 1/7 2023-12-16T03:31:08.311 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-201.gac5f0a00.el9.noarch 2/7 2023-12-16T03:31:08.311 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-201.gac5f0a00.el9.no 3/7 2023-12-16T03:31:08.311 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-16T03:31:08.311 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-16T03:31:08.311 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-16T03:31:08.620 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-16T03:31:08.620 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:08.620 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:08.620 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-grafana-dashboards-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:08.620 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:08.620 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-prometheus-alerts-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:08.620 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-16T03:31:08.621 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-16T03:31:08.621 INFO:teuthology.orchestra.run.smithi124.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-16T03:31:08.621 INFO:teuthology.orchestra.run.smithi124.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-16T03:31:08.621 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:08.621 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-201.gac5f0a 12/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-201.gac5f0a 1/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-16T03:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-16T03:31:08.844 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T03:31:09.229 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-16T03:31:09.229 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:09.229 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:09.229 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:09.229 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-16T03:31:09.229 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-16T03:31:09.229 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:09.230 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:09.390 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:01:56 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:09.534 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:09.535 INFO:teuthology.orchestra.run.smithi124.stdout:=========================================================================================== 2023-12-16T03:31:09.535 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout:=========================================================================================== 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 7.4 M 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-16T03:31:09.536 INFO:teuthology.orchestra.run.smithi124.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-16T03:31:09.537 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:09.537 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:09.537 INFO:teuthology.orchestra.run.smithi124.stdout:=========================================================================================== 2023-12-16T03:31:09.537 INFO:teuthology.orchestra.run.smithi124.stdout:Install 12 Packages 2023-12-16T03:31:09.537 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:09.537 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 37 M 2023-12-16T03:31:09.537 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 209 M 2023-12-16T03:31:09.537 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:09.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-rook 2023-12-16T03:31:09.714 INFO:teuthology.orchestra.run.smithi124.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 235 kB/s | 32 kB 00:00 2023-12-16T03:31:09.748 INFO:teuthology.orchestra.run.smithi124.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 524 kB/s | 17 kB 00:00 2023-12-16T03:31:09.807 INFO:teuthology.orchestra.run.smithi124.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-12-16T03:31:09.824 INFO:teuthology.orchestra.run.smithi124.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 466 kB/s | 34 kB 00:00 2023-12-16T03:31:09.957 INFO:teuthology.orchestra.run.smithi124.stdout:(5/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-16T03:31:10.016 INFO:teuthology.orchestra.run.smithi124.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 23 MB/s | 4.7 MB 00:00 2023-12-16T03:31:10.041 INFO:teuthology.orchestra.run.smithi124.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.6 MB/s | 217 kB 00:00 2023-12-16T03:31:10.099 INFO:teuthology.orchestra.run.smithi124.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 803 kB 00:00 2023-12-16T03:31:10.160 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:10 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:10.258 INFO:teuthology.orchestra.run.smithi124.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 65 MB/s | 16 MB 00:00 2023-12-16T03:31:10.283 INFO:teuthology.orchestra.run.smithi124.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2023-12-16T03:31:10.312 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:10.313 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2023-12-16T03:31:10.313 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 50 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-16T03:31:10.314 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-16T03:31:10.315 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-16T03:31:10.315 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:10.315 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:10.315 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2023-12-16T03:31:10.315 INFO:teuthology.orchestra.run.smithi050.stdout:Install 13 Packages 2023-12-16T03:31:10.315 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:10.315 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 2.0 M 2023-12-16T03:31:10.315 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 26 M 2023-12-16T03:31:10.316 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:10.591 INFO:teuthology.orchestra.run.smithi050.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 193 kB/s | 24 kB 00:00 2023-12-16T03:31:10.616 INFO:teuthology.orchestra.run.smithi050.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 119 kB/s | 18 kB 00:00 2023-12-16T03:31:10.658 INFO:teuthology.orchestra.run.smithi050.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-12-16T03:31:10.684 INFO:teuthology.orchestra.run.smithi050.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-12-16T03:31:10.709 INFO:teuthology.orchestra.run.smithi050.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-16T03:31:10.734 INFO:teuthology.orchestra.run.smithi050.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 857 kB/s | 43 kB 00:00 2023-12-16T03:31:10.859 INFO:teuthology.orchestra.run.smithi050.stdout:(7/13): ceph-mgr-rook-19.0.0-201.gac5f0a00.el9. 127 kB/s | 50 kB 00:00 2023-12-16T03:31:11.035 INFO:teuthology.orchestra.run.smithi050.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 99 kB/s | 32 kB 00:00 2023-12-16T03:31:11.060 INFO:teuthology.orchestra.run.smithi050.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 46 kB/s | 15 kB 00:00 2023-12-16T03:31:11.108 INFO:teuthology.orchestra.run.smithi124.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 289 kB/s | 245 kB 00:00 2023-12-16T03:31:11.352 INFO:teuthology.orchestra.run.smithi050.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 203 kB/s | 59 kB 00:00 2023-12-16T03:31:11.536 INFO:teuthology.orchestra.run.smithi050.stdout:(11/13): python3-google-auth-2.23.4-1.el9.noarc 292 kB/s | 197 kB 00:00 2023-12-16T03:31:11.653 INFO:teuthology.orchestra.run.smithi050.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 299 kB/s | 90 kB 00:00 2023-12-16T03:31:12.328 INFO:teuthology.orchestra.run.smithi050.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 809 kB/s | 1.0 MB 00:01 2023-12-16T03:31:12.330 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:12.330 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.0 MB/s | 2.0 MB 00:02 2023-12-16T03:31:12.331 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:12.346 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:12.346 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:12.460 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:12.461 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:12.994 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-16T03:31:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-16T03:31:13.225 INFO:teuthology.orchestra.run.smithi124.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 2.0 MB/s | 7.4 MB 00:03 2023-12-16T03:31:13.228 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:13.228 INFO:teuthology.orchestra.run.smithi124.stdout:Total 10 MB/s | 37 MB 00:03 2023-12-16T03:31:13.242 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:13.268 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:13.269 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-16T03:31:13.313 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-16T03:31:13.356 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-16T03:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-16T03:31:13.571 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-16T03:31:13.632 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-16T03:31:13.633 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:13.633 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:14.331 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:14.393 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-16T03:31:14.406 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-16T03:31:14.438 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-16T03:31:14.453 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-16T03:31:14.479 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-16T03:31:14.519 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-16T03:31:14.533 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-16T03:31:14.540 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.0.0-201.gac5f0a00.el9.noarch 13/13 2023-12-16T03:31:14.566 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-16T03:31:14.747 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-16T03:31:14.781 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-16T03:31:14.866 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-16T03:31:15.352 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-201.gac5f0a00.el9.noarch 13/13 2023-12-16T03:31:15.352 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.0.0-201.gac5f0a00.el9.noarch 1/13 2023-12-16T03:31:15.352 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-16T03:31:15.352 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-16T03:31:15.352 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-16T03:31:15.352 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-16T03:31:15.352 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-16T03:31:15.352 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-16T03:31:15.353 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-16T03:31:15.353 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-16T03:31:15.353 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-16T03:31:15.353 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-16T03:31:15.353 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-16T03:31:15.519 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-16T03:31:15.626 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-16T03:31:15.869 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-16T03:31:15.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-16T03:31:15.870 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:15.871 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:16.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T03:31:16.837 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:16 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:16.876 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-16T03:31:16.989 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 133 k 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-16T03:31:16.990 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:16.991 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:16.991 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2023-12-16T03:31:16.991 INFO:teuthology.orchestra.run.smithi050.stdout:Install 6 Packages 2023-12-16T03:31:16.991 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:16.991 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 6.8 M 2023-12-16T03:31:16.991 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 33 M 2023-12-16T03:31:16.991 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:17.205 INFO:teuthology.orchestra.run.smithi050.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.4 MB/s | 228 kB 00:00 2023-12-16T03:31:17.347 INFO:teuthology.orchestra.run.smithi050.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2023-12-16T03:31:17.372 INFO:teuthology.orchestra.run.smithi050.stdout:(3/6): ceph-mgr-cephadm-19.0.0-201.gac5f0a00.el 406 kB/s | 133 kB 00:00 2023-12-16T03:31:17.539 INFO:teuthology.orchestra.run.smithi050.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 300 kB/s | 58 kB 00:00 2023-12-16T03:31:17.556 INFO:teuthology.orchestra.run.smithi050.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 277 kB/s | 51 kB 00:00 2023-12-16T03:31:17.909 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-16T03:31:17.938 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-201.gac5f0a 12/12 2023-12-16T03:31:17.939 INFO:teuthology.orchestra.run.smithi050.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 747 kB/s | 548 kB 00:00 2023-12-16T03:31:17.941 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:17.942 INFO:teuthology.orchestra.run.smithi050.stdout:Total 7.1 MB/s | 6.8 MB 00:00 2023-12-16T03:31:17.942 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:17.952 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:17.952 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:18.052 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:18.052 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:18.646 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-16T03:31:18.693 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-16T03:31:19.250 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-16T03:31:19.347 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-16T03:31:19.415 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-16T03:31:19.445 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 6/6 2023-12-16T03:31:20.271 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 6/6 2023-12-16T03:31:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/6 2023-12-16T03:31:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-16T03:31:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-16T03:31:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-16T03:31:20.272 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-16T03:31:20.549 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-201.gac5f0a 12/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-201.gac5f0a 1/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-16T03:31:20.550 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:20.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-fuse 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-diskprediction-local-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-16T03:31:21.022 INFO:teuthology.orchestra.run.smithi124.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-16T03:31:21.023 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-16T03:31:21.023 INFO:teuthology.orchestra.run.smithi124.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-16T03:31:21.023 INFO:teuthology.orchestra.run.smithi124.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-16T03:31:21.023 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:21.023 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:21.376 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-mgr-rook 2023-12-16T03:31:21.435 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:21 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:21.587 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:21.587 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:21.587 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:31:21.587 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:21.587 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:21.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 833 k 2023-12-16T03:31:21.587 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-16T03:31:21.587 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-16T03:31:21.587 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:21.588 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:21.588 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:21.588 INFO:teuthology.orchestra.run.smithi050.stdout:Install 2 Packages 2023-12-16T03:31:21.588 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:21.588 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 911 k 2023-12-16T03:31:21.588 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 3.0 M 2023-12-16T03:31:21.588 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:21.750 INFO:teuthology.orchestra.run.smithi050.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 488 kB/s | 79 kB 00:00 2023-12-16T03:31:21.938 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:08 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:21.950 INFO:teuthology.orchestra.run.smithi050.stdout:(2/2): ceph-fuse-19.0.0-201.gac5f0a00.el9.x86_6 2.3 MB/s | 833 kB 00:00 2023-12-16T03:31:21.952 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:21.952 INFO:teuthology.orchestra.run.smithi050.stdout:Total 2.4 MB/s | 911 kB 00:00 2023-12-16T03:31:21.952 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:21.973 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:21.974 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:22.053 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:22.053 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:22.082 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout:======================================================================================= 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout:======================================================================================= 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 50 k 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-16T03:31:22.084 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:22.085 INFO:teuthology.orchestra.run.smithi124.stdout:======================================================================================= 2023-12-16T03:31:22.086 INFO:teuthology.orchestra.run.smithi124.stdout:Install 13 Packages 2023-12-16T03:31:22.086 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:22.086 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 2.0 M 2023-12-16T03:31:22.086 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 26 M 2023-12-16T03:31:22.087 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:22.348 INFO:teuthology.orchestra.run.smithi124.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 194 kB/s | 24 kB 00:00 2023-12-16T03:31:22.373 INFO:teuthology.orchestra.run.smithi124.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 120 kB/s | 18 kB 00:00 2023-12-16T03:31:22.387 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-16T03:31:22.415 INFO:teuthology.orchestra.run.smithi124.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-12-16T03:31:22.440 INFO:teuthology.orchestra.run.smithi124.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-12-16T03:31:22.452 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 2/2 2023-12-16T03:31:22.465 INFO:teuthology.orchestra.run.smithi124.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-16T03:31:22.491 INFO:teuthology.orchestra.run.smithi124.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 860 kB/s | 43 kB 00:00 2023-12-16T03:31:22.517 INFO:teuthology.orchestra.run.smithi124.stdout:(7/13): ceph-mgr-rook-19.0.0-201.gac5f0a00.el9. 171 kB/s | 50 kB 00:00 2023-12-16T03:31:22.817 INFO:teuthology.orchestra.run.smithi124.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 92 kB/s | 32 kB 00:00 2023-12-16T03:31:22.842 INFO:teuthology.orchestra.run.smithi124.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 43 kB/s | 15 kB 00:00 2023-12-16T03:31:23.100 INFO:teuthology.orchestra.run.smithi124.stdout:(10/13): python3-google-auth-2.23.4-1.el9.noarc 338 kB/s | 197 kB 00:00 2023-12-16T03:31:23.134 INFO:teuthology.orchestra.run.smithi124.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 202 kB/s | 59 kB 00:00 2023-12-16T03:31:23.226 INFO:teuthology.orchestra.run.smithi124.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 718 kB/s | 90 kB 00:00 2023-12-16T03:31:23.276 INFO:teuthology.orchestra.run.smithi124.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.2 MB/s | 1.0 MB 00:00 2023-12-16T03:31:23.278 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:23.278 INFO:teuthology.orchestra.run.smithi124.stdout:Total 1.7 MB/s | 2.0 MB 00:01 2023-12-16T03:31:23.278 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:23.292 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:23.292 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:23.341 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 2/2 2023-12-16T03:31:23.342 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 1/2 2023-12-16T03:31:23.394 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:23.394 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:23.693 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-16T03:31:23.693 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:23.693 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:23.693 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-16T03:31:23.693 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:23.693 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:23.906 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:23.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-volume 2023-12-16T03:31:24.078 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-16T03:31:24.134 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-16T03:31:24.189 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-16T03:31:24.219 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-16T03:31:24.260 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-16T03:31:24.352 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-16T03:31:24.461 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-16T03:31:24.519 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-16T03:31:24.546 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:24 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:24.697 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 262 k 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 262 k 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 1.2 M 2023-12-16T03:31:24.698 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:25.047 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-volume-19.0.0-201.gac5f0a00.el9.noarch.rpm 753 kB/s | 262 kB 00:00 2023-12-16T03:31:25.047 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:25.048 INFO:teuthology.orchestra.run.smithi050.stdout:Total 750 kB/s | 262 kB 00:00 2023-12-16T03:31:25.048 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:25.057 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:25.057 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:25.097 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:25.098 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:25.238 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-16T03:31:25.292 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-16T03:31:25.322 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:25.325 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-16T03:31:25.381 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-16T03:31:25.399 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:25.404 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-rook-2:19.0.0-201.gac5f0a00.el9.noarch 13/13 2023-12-16T03:31:25.416 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:25.416 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:31:25.416 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-16T03:31:25.416 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:26.232 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-201.gac5f0a00.el9.noarch 13/13 2023-12-16T03:31:26.232 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-rook-2:19.0.0-201.gac5f0a00.el9.noarch 1/13 2023-12-16T03:31:26.232 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-16T03:31:26.233 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-16T03:31:26.533 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:26.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:26.534 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:26.534 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:26.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:26.534 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:26.600 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-16T03:31:26.600 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-rook-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-16T03:31:26.601 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-16T03:31:26.602 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:26.602 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:26.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados-devel 2023-12-16T03:31:26.847 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T03:31:27.402 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:14 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:27.439 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:27 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:27.547 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout:======================================================================================= 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout:======================================================================================= 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-cephadm noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 133 k 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-16T03:31:27.548 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:27.549 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:27.549 INFO:teuthology.orchestra.run.smithi124.stdout:======================================================================================= 2023-12-16T03:31:27.549 INFO:teuthology.orchestra.run.smithi124.stdout:Install 6 Packages 2023-12-16T03:31:27.549 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:27.549 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 6.8 M 2023-12-16T03:31:27.549 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 33 M 2023-12-16T03:31:27.549 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:27.590 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 127 k 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 127 k 2023-12-16T03:31:27.591 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 456 k 2023-12-16T03:31:27.592 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:27.819 INFO:teuthology.orchestra.run.smithi050.stdout:librados-devel-19.0.0-201.gac5f0a00.el9.x86_64. 558 kB/s | 127 kB 00:00 2023-12-16T03:31:27.820 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:27.820 INFO:teuthology.orchestra.run.smithi050.stdout:Total 554 kB/s | 127 kB 00:00 2023-12-16T03:31:27.820 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:27.826 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:27.853 INFO:teuthology.orchestra.run.smithi124.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.4 MB/s | 228 kB 00:00 2023-12-16T03:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:27.977 INFO:teuthology.orchestra.run.smithi124.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-12-16T03:31:28.028 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:28.093 INFO:teuthology.orchestra.run.smithi124.stdout:(3/6): ceph-mgr-cephadm-19.0.0-201.gac5f0a00.el 333 kB/s | 133 kB 00:00 2023-12-16T03:31:28.137 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:28.327 INFO:teuthology.orchestra.run.smithi124.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 165 kB/s | 58 kB 00:00 2023-12-16T03:31:28.444 INFO:teuthology.orchestra.run.smithi124.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 146 kB/s | 51 kB 00:00 2023-12-16T03:31:28.477 INFO:teuthology.orchestra.run.smithi124.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 878 kB/s | 548 kB 00:00 2023-12-16T03:31:28.479 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:28.479 INFO:teuthology.orchestra.run.smithi124.stdout:Total 7.3 MB/s | 6.8 MB 00:00 2023-12-16T03:31:28.480 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:28.489 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:28.489 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:28.576 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:28.577 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:28.665 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:28.881 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:29.035 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:29.035 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:29.051 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-16T03:31:29.104 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-16T03:31:29.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs2 2023-12-16T03:31:29.614 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-16T03:31:29.698 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-16T03:31:29.758 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-16T03:31:29.783 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 6/6 2023-12-16T03:31:29.870 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:29 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:29.966 INFO:teuthology.orchestra.run.smithi050.stdout:Package libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:30.019 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:30.020 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-12-16T03:31:30.021 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:30.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs-devel 2023-12-16T03:31:30.685 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:30 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:30.688 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 6/6 2023-12-16T03:31:30.689 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 1/6 2023-12-16T03:31:30.689 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-16T03:31:30.689 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-16T03:31:30.689 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-16T03:31:30.689 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-16T03:31:30.838 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:30.838 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 31 k 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 31 k 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 140 k 2023-12-16T03:31:30.839 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:30.990 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-16T03:31:30.990 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:30.990 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:30.990 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-cephadm-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:30.990 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-16T03:31:30.991 INFO:teuthology.orchestra.run.smithi124.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-16T03:31:30.991 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-16T03:31:30.991 INFO:teuthology.orchestra.run.smithi124.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-16T03:31:30.991 INFO:teuthology.orchestra.run.smithi124.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-16T03:31:30.991 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:30.991 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:31.081 INFO:teuthology.orchestra.run.smithi050.stdout:libcephfs-devel-19.0.0-201.gac5f0a00.el9.x86_64 129 kB/s | 31 kB 00:00 2023-12-16T03:31:31.081 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:31.082 INFO:teuthology.orchestra.run.smithi050.stdout:Total 128 kB/s | 31 kB 00:00 2023-12-16T03:31:31.082 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:31.085 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:31.085 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:31.113 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:31.113 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:31.232 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-fuse 2023-12-16T03:31:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:31.785 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:18 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:31.818 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:31.929 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 833 k 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout:Installing dependencies: 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:31.930 INFO:teuthology.orchestra.run.smithi124.stdout:Install 2 Packages 2023-12-16T03:31:31.931 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:31.931 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 911 k 2023-12-16T03:31:31.931 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 3.0 M 2023-12-16T03:31:31.931 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:32.054 INFO:teuthology.orchestra.run.smithi124.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 644 kB/s | 79 kB 00:00 2023-12-16T03:31:32.156 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:32.156 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:32.156 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:32.156 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:32.156 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:32.156 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:32.338 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados2 2023-12-16T03:31:32.495 INFO:teuthology.orchestra.run.smithi124.stdout:(2/2): ceph-fuse-19.0.0-201.gac5f0a00.el9.x86_6 1.4 MB/s | 833 kB 00:00 2023-12-16T03:31:32.497 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:32.497 INFO:teuthology.orchestra.run.smithi124.stdout:Total 1.6 MB/s | 911 kB 00:00 2023-12-16T03:31:32.497 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:32.518 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:32.519 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:32.594 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:32.594 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:32.778 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:32.920 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-16T03:31:32.927 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:32 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:32.989 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 2/2 2023-12-16T03:31:33.024 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:33.081 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:33.082 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-12-16T03:31:33.082 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:33.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librbd1 2023-12-16T03:31:33.682 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 2/2 2023-12-16T03:31:33.682 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 1/2 2023-12-16T03:31:33.747 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:33 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:33.846 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:33.899 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:33.900 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-12-16T03:31:33.900 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:33.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rados 2023-12-16T03:31:33.981 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-16T03:31:33.981 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:33.982 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:33.982 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-16T03:31:33.982 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:33.982 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:34.229 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install ceph-volume 2023-12-16T03:31:34.568 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:34 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:34.665 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rados-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:34.718 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:34.719 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-12-16T03:31:34.719 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:34.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rgw 2023-12-16T03:31:34.799 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:21 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:34.946 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repository Size 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-volume noarch 2:19.0.0-201.gac5f0a00.el9 ceph-noarch 262 k 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:34.947 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 262 k 2023-12-16T03:31:34.948 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 1.2 M 2023-12-16T03:31:34.948 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:35.324 INFO:teuthology.orchestra.run.smithi124.stdout:ceph-volume-19.0.0-201.gac5f0a00.el9.noarch.rpm 697 kB/s | 262 kB 00:00 2023-12-16T03:31:35.324 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:35.325 INFO:teuthology.orchestra.run.smithi124.stdout:Total 694 kB/s | 262 kB 00:00 2023-12-16T03:31:35.325 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:35.333 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:35.333 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:35.370 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:35.370 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:35.378 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:35 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:35.474 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rgw-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:35.528 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:35.529 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-12-16T03:31:35.529 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:35.589 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:35.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-cephfs 2023-12-16T03:31:35.651 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : ceph-volume-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:35.666 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: ceph-volume-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:35.666 INFO:teuthology.orchestra.run.smithi124.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:31:35.667 INFO:teuthology.orchestra.run.smithi124.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-16T03:31:35.667 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:36.192 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:36 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:36.294 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-cephfs-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:36.349 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:36.349 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-12-16T03:31:36.350 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:36.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rbd 2023-12-16T03:31:36.673 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : ceph-volume-2:19.0.0-201.gac5f0a00.el9.noarch 1/1 2023-12-16T03:31:36.674 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:36.674 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:36.674 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-volume-2:19.0.0-201.gac5f0a00.el9.noarch 2023-12-16T03:31:36.674 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:36.674 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:36.977 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install librados-devel 2023-12-16T03:31:37.014 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:37 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:37.112 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rbd-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:37.167 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:37.168 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-12-16T03:31:37.169 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:37.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-fuse 2023-12-16T03:31:37.543 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:24 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:37.686 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:37.687 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:37.687 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repo Size 2023-12-16T03:31:37.687 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:37.687 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:37.688 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 127 k 2023-12-16T03:31:37.688 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:37.688 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:37.688 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:37.688 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2023-12-16T03:31:37.688 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:37.688 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 127 k 2023-12-16T03:31:37.688 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 456 k 2023-12-16T03:31:37.688 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:37.827 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:37 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:37.978 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:37.978 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-12-16T03:31:37.978 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:37.978 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 85 k 2023-12-16T03:31:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:37.979 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:37.979 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:37.979 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-12-16T03:31:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:37.979 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 85 k 2023-12-16T03:31:37.979 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 256 k 2023-12-16T03:31:37.979 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:38.079 INFO:teuthology.orchestra.run.smithi124.stdout:librados-devel-19.0.0-201.gac5f0a00.el9.x86_64. 324 kB/s | 127 kB 00:00 2023-12-16T03:31:38.079 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:38.079 INFO:teuthology.orchestra.run.smithi124.stdout:Total 323 kB/s | 127 kB 00:00 2023-12-16T03:31:38.080 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:38.085 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:38.085 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:38.140 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:38.141 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:38.299 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:38.393 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-fuse-19.0.0-201.gac5f0a00.el9.x86_64.rpm 207 kB/s | 85 kB 00:00 2023-12-16T03:31:38.394 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:38.394 INFO:teuthology.orchestra.run.smithi050.stdout:Total 206 kB/s | 85 kB 00:00 2023-12-16T03:31:38.394 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:38.401 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : librados-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:38.401 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:38.401 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:38.459 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:38.869 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: librados-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:39.182 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : librados-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:39.182 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:39.182 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:39.182 INFO:teuthology.orchestra.run.smithi124.stdout: librados-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:39.183 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:39.183 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:39.436 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install libcephfs2 2023-12-16T03:31:39.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:39.508 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:39.508 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:39.508 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:39.508 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:39.508 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:39.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-mirror 2023-12-16T03:31:39.998 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:26 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:40.096 INFO:teuthology.orchestra.run.smithi124.stdout:Package libcephfs2-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:40.148 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:40.149 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-12-16T03:31:40.149 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:40.213 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install libcephfs-devel 2023-12-16T03:31:40.334 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:40 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:40.486 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:40.487 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:40.487 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2023-12-16T03:31:40.487 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:40.487 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:40.487 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 3.0 M 2023-12-16T03:31:40.487 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:40.487 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:40.487 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:40.488 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-12-16T03:31:40.488 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:40.488 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 3.0 M 2023-12-16T03:31:40.488 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 13 M 2023-12-16T03:31:40.488 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:40.771 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:27 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:40.888 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-mirror-19.0.0-201.gac5f0a00.el9.x86_64.rpm 7.5 MB/s | 3.0 MB 00:00 2023-12-16T03:31:40.889 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:40.889 INFO:teuthology.orchestra.run.smithi050.stdout:Total 7.4 MB/s | 3.0 MB 00:00 2023-12-16T03:31:40.890 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:40.899 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:40.899 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:40.916 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:40.917 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:40.917 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repo Size 2023-12-16T03:31:40.917 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:40.917 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:40.917 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 31 k 2023-12-16T03:31:40.917 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:40.917 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:40.917 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:40.917 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2023-12-16T03:31:40.918 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:40.918 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 31 k 2023-12-16T03:31:40.918 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 140 k 2023-12-16T03:31:40.918 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:40.975 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:40.976 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:41.073 INFO:teuthology.orchestra.run.smithi124.stdout:libcephfs-devel-19.0.0-201.gac5f0a00.el9.x86_64 201 kB/s | 31 kB 00:00 2023-12-16T03:31:41.073 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:41.074 INFO:teuthology.orchestra.run.smithi124.stdout:Total 199 kB/s | 31 kB 00:00 2023-12-16T03:31:41.074 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:41.077 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:41.077 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:41.106 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:41.106 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:41.199 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:41.313 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : libcephfs-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:41.422 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:41.489 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:41.515 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:41.515 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:31:41.515 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-16T03:31:41.515 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T03:31:41.515 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T03:31:41.515 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:41.697 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:41.963 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : libcephfs-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:41.964 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:41.964 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:41.964 INFO:teuthology.orchestra.run.smithi124.stdout: libcephfs-devel-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:41.964 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:41.964 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:42.146 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install librados2 2023-12-16T03:31:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:42.689 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:42.689 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:42.690 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:42.701 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:29 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:42.794 INFO:teuthology.orchestra.run.smithi124.stdout:Package librados2-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:42.845 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:42.846 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-12-16T03:31:42.846 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:42.914 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install librbd1 2023-12-16T03:31:42.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-nbd 2023-12-16T03:31:43.471 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:30 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:43.522 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:43 ago on Sat 16 Dec 2023 03:29:00 AM UTC. 2023-12-16T03:31:43.569 INFO:teuthology.orchestra.run.smithi124.stdout:Package librbd1-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:43.619 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:43.621 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-12-16T03:31:43.621 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:43.674 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-16T03:31:43.674 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:43.674 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-12-16T03:31:43.674 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:43.674 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-16T03:31:43.674 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 169 k 2023-12-16T03:31:43.674 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:43.675 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-16T03:31:43.675 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-16T03:31:43.675 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-12-16T03:31:43.675 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:43.675 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 169 k 2023-12-16T03:31:43.675 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 536 k 2023-12-16T03:31:43.675 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-16T03:31:43.684 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install python3-rados 2023-12-16T03:31:44.109 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-nbd-19.0.0-201.gac5f0a00.el9.x86_64.rpm 390 kB/s | 169 kB 00:00 2023-12-16T03:31:44.109 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:44.110 INFO:teuthology.orchestra.run.smithi050.stdout:Total 389 kB/s | 169 kB 00:00 2023-12-16T03:31:44.110 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-16T03:31:44.118 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-16T03:31:44.118 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-16T03:31:44.177 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-16T03:31:44.177 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-16T03:31:44.231 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:31 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:44.324 INFO:teuthology.orchestra.run.smithi124.stdout:Package python3-rados-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-16T03:31:44.374 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:44.375 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-12-16T03:31:44.375 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:44.443 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install python3-rgw 2023-12-16T03:31:44.444 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-nbd-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:44.996 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:31 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:45.089 INFO:teuthology.orchestra.run.smithi124.stdout:Package python3-rgw-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:45.139 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:45.139 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-12-16T03:31:45.140 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:45.213 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install python3-cephfs 2023-12-16T03:31:45.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:45.223 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:45.223 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-16T03:31:45.223 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:45.223 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:45.223 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-16T03:31:45.491 DEBUG:teuthology.parallel:result is None 2023-12-16T03:31:45.771 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:32 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:45.865 INFO:teuthology.orchestra.run.smithi124.stdout:Package python3-cephfs-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:45.915 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:45.916 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-12-16T03:31:45.916 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:45.981 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install python3-rbd 2023-12-16T03:31:46.534 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:33 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:46.628 INFO:teuthology.orchestra.run.smithi124.stdout:Package python3-rbd-2:19.0.0-201.gac5f0a00.el9.x86_64 is already installed. 2023-12-16T03:31:46.678 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:46.679 INFO:teuthology.orchestra.run.smithi124.stdout:Nothing to do. 2023-12-16T03:31:46.679 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:46.735 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install rbd-fuse 2023-12-16T03:31:47.290 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:34 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:47.435 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:47.436 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:47.436 INFO:teuthology.orchestra.run.smithi124.stdout: Package Architecture Version Repository Size 2023-12-16T03:31:47.436 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:47.436 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:47.436 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 85 k 2023-12-16T03:31:47.437 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:47.437 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:47.437 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:47.437 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2023-12-16T03:31:47.437 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:47.437 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 85 k 2023-12-16T03:31:47.437 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 256 k 2023-12-16T03:31:47.437 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:47.751 INFO:teuthology.orchestra.run.smithi124.stdout:rbd-fuse-19.0.0-201.gac5f0a00.el9.x86_64.rpm 273 kB/s | 85 kB 00:00 2023-12-16T03:31:47.751 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:47.751 INFO:teuthology.orchestra.run.smithi124.stdout:Total 272 kB/s | 85 kB 00:00 2023-12-16T03:31:47.751 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:47.758 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:47.758 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:47.812 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:47.812 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:47.952 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:48.048 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:48.490 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: rbd-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:48.816 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:48.816 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:48.816 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:48.816 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-fuse-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:48.816 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:48.816 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:49.068 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install rbd-mirror 2023-12-16T03:31:49.649 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:36 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:49.796 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:49.797 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:49.797 INFO:teuthology.orchestra.run.smithi124.stdout: Package Arch Version Repo Size 2023-12-16T03:31:49.797 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:49.797 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:49.798 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 3.0 M 2023-12-16T03:31:49.798 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:49.798 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:49.798 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:49.798 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2023-12-16T03:31:49.798 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:49.798 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 3.0 M 2023-12-16T03:31:49.798 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 13 M 2023-12-16T03:31:49.798 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:50.179 INFO:teuthology.orchestra.run.smithi124.stdout:rbd-mirror-19.0.0-201.gac5f0a00.el9.x86_64.rpm 7.8 MB/s | 3.0 MB 00:00 2023-12-16T03:31:50.179 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:50.180 INFO:teuthology.orchestra.run.smithi124.stdout:Total 7.8 MB/s | 3.0 MB 00:00 2023-12-16T03:31:50.180 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:50.188 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:50.189 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:50.260 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:50.260 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:50.687 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:50.738 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-mirror-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:50.763 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: rbd-mirror-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:50.763 INFO:teuthology.orchestra.run.smithi124.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T03:31:50.763 INFO:teuthology.orchestra.run.smithi124.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-16T03:31:50.764 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T03:31:50.764 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T03:31:50.764 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:51.937 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-mirror-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:51.938 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:51.938 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-mirror-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:51.938 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:52.165 DEBUG:teuthology.orchestra.run.smithi124:> sudo yum -y install rbd-nbd 2023-12-16T03:31:52.733 INFO:teuthology.orchestra.run.smithi124.stdout:Last metadata expiration check: 0:02:39 ago on Sat 16 Dec 2023 03:29:13 AM UTC. 2023-12-16T03:31:52.875 INFO:teuthology.orchestra.run.smithi124.stdout:Dependencies resolved. 2023-12-16T03:31:52.876 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:52.876 INFO:teuthology.orchestra.run.smithi124.stdout: Package Architecture Version Repository Size 2023-12-16T03:31:52.876 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:52.876 INFO:teuthology.orchestra.run.smithi124.stdout:Installing: 2023-12-16T03:31:52.876 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd x86_64 2:19.0.0-201.gac5f0a00.el9 ceph 169 k 2023-12-16T03:31:52.877 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:52.877 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction Summary 2023-12-16T03:31:52.877 INFO:teuthology.orchestra.run.smithi124.stdout:================================================================================ 2023-12-16T03:31:52.877 INFO:teuthology.orchestra.run.smithi124.stdout:Install 1 Package 2023-12-16T03:31:52.877 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:52.877 INFO:teuthology.orchestra.run.smithi124.stdout:Total download size: 169 k 2023-12-16T03:31:52.877 INFO:teuthology.orchestra.run.smithi124.stdout:Installed size: 536 k 2023-12-16T03:31:52.877 INFO:teuthology.orchestra.run.smithi124.stdout:Downloading Packages: 2023-12-16T03:31:53.439 INFO:teuthology.orchestra.run.smithi124.stdout:rbd-nbd-19.0.0-201.gac5f0a00.el9.x86_64.rpm 300 kB/s | 169 kB 00:00 2023-12-16T03:31:53.440 INFO:teuthology.orchestra.run.smithi124.stdout:-------------------------------------------------------------------------------- 2023-12-16T03:31:53.440 INFO:teuthology.orchestra.run.smithi124.stdout:Total 300 kB/s | 169 kB 00:00 2023-12-16T03:31:53.440 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction check 2023-12-16T03:31:53.448 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction check succeeded. 2023-12-16T03:31:53.448 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction test 2023-12-16T03:31:53.503 INFO:teuthology.orchestra.run.smithi124.stdout:Transaction test succeeded. 2023-12-16T03:31:53.503 INFO:teuthology.orchestra.run.smithi124.stdout:Running transaction 2023-12-16T03:31:53.667 INFO:teuthology.orchestra.run.smithi124.stdout: Preparing : 1/1 2023-12-16T03:31:53.771 INFO:teuthology.orchestra.run.smithi124.stdout: Installing : rbd-nbd-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:54.185 INFO:teuthology.orchestra.run.smithi124.stdout: Running scriptlet: rbd-nbd-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:54.463 INFO:teuthology.orchestra.run.smithi124.stdout: Verifying : rbd-nbd-2:19.0.0-201.gac5f0a00.el9.x86_64 1/1 2023-12-16T03:31:54.463 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:54.463 INFO:teuthology.orchestra.run.smithi124.stdout:Installed: 2023-12-16T03:31:54.463 INFO:teuthology.orchestra.run.smithi124.stdout: rbd-nbd-2:19.0.0-201.gac5f0a00.el9.x86_64 2023-12-16T03:31:54.463 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:54.463 INFO:teuthology.orchestra.run.smithi124.stdout:Complete! 2023-12-16T03:31:54.714 DEBUG:teuthology.parallel:result is None 2023-12-16T03:31:54.715 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=ac5f0a00b675c1157dbca443e10f2f8ddb2e351a 2023-12-16T03:31:54.934 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T03:31:54.959 INFO:teuthology.orchestra.run.smithi050.stdout:19.0.0-201.gac5f0a00.el9 2023-12-16T03:31:54.959 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-201.gac5f0a00.el9 2023-12-16T03:31:54.960 INFO:teuthology.task.install:The correct ceph version 19.0.0-201.gac5f0a00 is installed. 2023-12-16T03:31:54.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=ac5f0a00b675c1157dbca443e10f2f8ddb2e351a 2023-12-16T03:31:55.098 DEBUG:teuthology.orchestra.run.smithi124:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T03:31:55.119 INFO:teuthology.orchestra.run.smithi124.stdout:19.0.0-201.gac5f0a00.el9 2023-12-16T03:31:55.119 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-201.gac5f0a00.el9 2023-12-16T03:31:55.120 INFO:teuthology.task.install:The correct ceph version 19.0.0-201.gac5f0a00 is installed. 2023-12-16T03:31:55.124 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-16T03:31:55.125 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:55.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T03:31:55.162 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:31:55.162 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T03:31:55.189 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-16T03:31:55.189 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:55.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T03:31:55.237 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T03:31:55.312 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:31:55.312 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T03:31:55.338 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T03:31:55.405 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-16T03:31:55.405 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:55.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T03:31:55.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T03:31:55.512 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:31:55.512 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T03:31:55.538 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T03:31:55.605 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-16T03:31:55.605 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:55.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T03:31:55.637 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T03:31:55.709 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:31:55.709 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T03:31:55.737 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T03:31:55.804 INFO:teuthology.run_tasks:Running task ceph... 2023-12-16T03:31:55.869 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-16T03:31:55.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2023-12-16T03:31:55.872 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 777 /var/log/ceph 2023-12-16T03:31:55.902 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-16T03:31:55.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-16T03:31:55.944 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-16T03:31:55.974 INFO:tasks.ceph:Creating extra log directories... 2023-12-16T03:31:55.974 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-16T03:31:56.016 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-16T03:31:56.055 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-16T03:31:56.055 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-16T03:31:56.055 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341', 'branch': 'wip-sjust-crimson-testing-2023-12-15', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7494341', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-sjust-crimson-testing-2023-12-15'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a'}}, 'workunit': {'branch': 'wip-sjust-crimson-testing-2023-12-15', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a'}}, 'owner': 'scheduled_sjust@teuthology', 'priority': 51, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6914, 'sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'wip-sjust-crimson-testing-2023-12-15', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a', 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDGX+YyyAuE3WVWAKT+FLO57OmYnFf3xkwyITAUpsA6lV1J3EjwxdvcBQWMXzTvB/coMSd9+APSk728Oozcl85M=', 'smithi124.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNO919USKbDzxfzmiSSbynE/I9bLnlkX8NCromj3T062RN+dTrQuqfZBFQ2/UQ6vbSoCsxiHxpFDC0AAPFhmn9Y='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-16_03:12:47', 'tube': 'smithi', 'user': 'sjust', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-16T03:31:56.055 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-16T03:31:56.089 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-16T03:31:56.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2023-12-16T03:31:56.146 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/run/ceph 2023-12-16T03:31:56.175 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:56.175 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T03:31:56.231 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T03:31:56.231 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-12-16T03:31:56.286 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T03:31:56.287 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:31:56.287 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-12-16T03:31:56.287 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:31:56.287 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:31:56.287 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-16 03:31:41.746159735 +0000 2023-12-16T03:31:56.287 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-16 03:28:11.392908599 +0000 2023-12-16T03:31:56.287 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-16 03:28:11.392908599 +0000 2023-12-16T03:31:56.287 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-12-16 03:28:11.392908599 +0000 2023-12-16T03:31:56.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T03:31:56.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-16T03:31:56.356 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-16T03:31:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.84e-05 s, 5.2 MB/s 2023-12-16T03:31:56.358 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T03:31:56.414 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-12-16T03:31:56.469 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T03:31:56.470 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:31:56.470 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-16T03:31:56.470 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:31:56.470 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:31:56.470 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-16 03:31:41.746159735 +0000 2023-12-16T03:31:56.470 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-16 03:28:11.877896371 +0000 2023-12-16T03:31:56.471 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-16 03:28:11.877896371 +0000 2023-12-16T03:31:56.471 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-12-16 03:28:11.877896371 +0000 2023-12-16T03:31:56.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T03:31:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-16T03:31:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-16T03:31:56.539 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 8.7618e-05 s, 5.8 MB/s 2023-12-16T03:31:56.540 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T03:31:56.596 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-12-16T03:31:56.651 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T03:31:56.651 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:31:56.651 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-16T03:31:56.651 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:31:56.651 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:31:56.651 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-16 03:31:41.746159735 +0000 2023-12-16T03:31:56.651 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-16 03:28:12.384883589 +0000 2023-12-16T03:31:56.651 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-16 03:28:12.384883589 +0000 2023-12-16T03:31:56.651 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-12-16 03:28:12.384883589 +0000 2023-12-16T03:31:56.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T03:31:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-16T03:31:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-16T03:31:56.720 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.2982e-05 s, 5.5 MB/s 2023-12-16T03:31:56.721 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T03:31:56.778 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-12-16T03:31:56.833 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T03:31:56.833 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:31:56.833 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-12-16T03:31:56.833 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:31:56.833 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:31:56.833 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-16 03:31:41.747159710 +0000 2023-12-16T03:31:56.833 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-16 03:28:12.879871110 +0000 2023-12-16T03:31:56.833 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-16 03:28:12.879871110 +0000 2023-12-16T03:31:56.833 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-12-16 03:28:12.879871110 +0000 2023-12-16T03:31:56.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T03:31:56.901 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-16T03:31:56.902 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-16T03:31:56.902 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.6618e-05 s, 5.3 MB/s 2023-12-16T03:31:56.903 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T03:31:56.959 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-12-16T03:31:56.959 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:31:56.959 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T03:31:56.977 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T03:31:56.977 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_1 2023-12-16T03:31:57.034 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T03:31:57.034 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:31:57.034 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-16T03:31:57.034 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:31:57.034 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:31:57.035 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-12-16 03:31:51.016414196 +0000 2023-12-16T03:31:57.035 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-12-16 03:28:02.811772285 +0000 2023-12-16T03:31:57.035 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-12-16 03:28:02.811772285 +0000 2023-12-16T03:31:57.035 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2023-12-16 03:28:02.811772285 +0000 2023-12-16T03:31:57.035 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T03:31:57.102 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-12-16T03:31:57.102 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-12-16T03:31:57.102 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000209405 s, 2.4 MB/s 2023-12-16T03:31:57.103 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T03:31:57.160 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_2 2023-12-16T03:31:57.217 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T03:31:57.217 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:31:57.217 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-16T03:31:57.217 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:31:57.217 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:31:57.218 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-12-16 03:31:51.017414179 +0000 2023-12-16T03:31:57.218 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-12-16 03:28:03.339763017 +0000 2023-12-16T03:31:57.218 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-12-16 03:28:03.339763017 +0000 2023-12-16T03:31:57.218 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2023-12-16 03:28:03.339763017 +0000 2023-12-16T03:31:57.218 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T03:31:57.284 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-12-16T03:31:57.284 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-12-16T03:31:57.284 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000235863 s, 2.2 MB/s 2023-12-16T03:31:57.286 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T03:31:57.343 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_3 2023-12-16T03:31:57.399 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T03:31:57.399 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:31:57.399 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-16T03:31:57.399 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:31:57.399 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:31:57.399 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-12-16 03:31:51.017414179 +0000 2023-12-16T03:31:57.399 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-12-16 03:28:03.825754486 +0000 2023-12-16T03:31:57.399 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-12-16 03:28:03.825754486 +0000 2023-12-16T03:31:57.399 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2023-12-16 03:28:03.825754486 +0000 2023-12-16T03:31:57.400 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T03:31:57.466 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-12-16T03:31:57.466 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-12-16T03:31:57.466 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000193773 s, 2.6 MB/s 2023-12-16T03:31:57.467 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T03:31:57.523 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_4 2023-12-16T03:31:57.580 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T03:31:57.580 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:31:57.581 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-12-16T03:31:57.581 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:31:57.581 INFO:teuthology.orchestra.run.smithi124.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T03:31:57.581 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2023-12-16 03:31:51.017414179 +0000 2023-12-16T03:31:57.581 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2023-12-16 03:28:04.350745271 +0000 2023-12-16T03:31:57.581 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2023-12-16 03:28:04.350745271 +0000 2023-12-16T03:31:57.581 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: 2023-12-16 03:28:04.350745271 +0000 2023-12-16T03:31:57.581 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T03:31:57.647 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2023-12-16T03:31:57.647 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2023-12-16T03:31:57.647 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000203108 s, 2.5 MB/s 2023-12-16T03:31:57.648 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T03:31:57.704 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-12-16T03:31:57.704 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-12-16T03:31:57.704 INFO:tasks.ceph:Generating config... 2023-12-16T03:31:57.705 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-12-16T03:31:57.706 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-12-16T03:31:57.706 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-12-16T03:31:57.706 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-12-16T03:31:57.706 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-12-16T03:31:57.706 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-16T03:31:57.706 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-16T03:31:57.706 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-16T03:31:57.706 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2023-12-16T03:31:57.706 INFO:tasks.ceph:[mon] osd pool default crimson = True 2023-12-16T03:31:57.706 INFO:tasks.ceph:[osd] debug monc = 20 2023-12-16T03:31:57.706 INFO:tasks.ceph:[osd] crimson seastar smp = 3 2023-12-16T03:31:57.706 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-16T03:31:57.706 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-16T03:31:57.706 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-12-16T03:31:57.706 INFO:tasks.ceph:[osd] osd class default list = * 2023-12-16T03:31:57.707 INFO:tasks.ceph:[osd] osd class load list = * 2023-12-16T03:31:57.707 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-12-16T03:31:57.707 INFO:tasks.ceph:[client] debug ms = 1 2023-12-16T03:31:57.707 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2023-12-16T03:31:57.707 INFO:tasks.ceph:[global] ms client mode = crc 2023-12-16T03:31:57.707 INFO:tasks.ceph:[global] ms cluster mode = crc 2023-12-16T03:31:57.707 INFO:tasks.ceph:[global] ms mon client mode = crc 2023-12-16T03:31:57.707 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2023-12-16T03:31:57.707 INFO:tasks.ceph:[global] ms mon service mode = crc 2023-12-16T03:31:57.707 INFO:tasks.ceph:[global] ms service mode = crc 2023-12-16T03:31:57.707 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-16T03:31:57.707 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-16T03:31:57.707 INFO:tasks.ceph:Setting up mon.a... 2023-12-16T03:31:57.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-16T03:31:57.774 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2023-12-16T03:31:57.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-16T03:31:57.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T03:31:57.863 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50')] 2023-12-16T03:31:57.864 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}} 2023-12-16T03:31:57.865 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:57.865 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-16T03:31:57.920 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --print /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:31:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:31:58.002+0000 7f2da482ce80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:31:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:31:58.002+0000 7f2da482ce80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:31:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:31:58.002+0000 7f2da482ce80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:31:58.006 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:31:58.006 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:31:58.006 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = pacific 2023-12-16T03:31:58.006 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2023-12-16T03:31:58.007 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:31:58.007 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2023-12-16T03:31:58.004594+0000 2023-12-16T03:31:58.007 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-12-16T03:31:58.004594+0000 2023-12-16T03:31:58.007 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 16 (pacific) 2023-12-16T03:31:58.007 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2023-12-16T03:31:58.007 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2023-12-16T03:31:58.007 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-12-16T03:31:58.008 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-16T03:31:58.023 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 729b4ed4-c01a-4cd4-b8de-ed230cc4e269... 2023-12-16T03:31:58.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-16T03:31:58.065 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-16T03:31:58.118 INFO:teuthology.orchestra.run.smithi124.stdout:[global] 2023-12-16T03:31:58.118 INFO:teuthology.orchestra.run.smithi124.stdout: chdir = "" 2023-12-16T03:31:58.118 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-16T03:31:58.118 INFO:teuthology.orchestra.run.smithi124.stdout: auth supported = cephx 2023-12-16T03:31:58.118 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.118 INFO:teuthology.orchestra.run.smithi124.stdout: filestore xattr use omap = true 2023-12-16T03:31:58.118 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.118 INFO:teuthology.orchestra.run.smithi124.stdout: mon clock drift allowed = 1.000 2023-12-16T03:31:58.118 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: osd crush chooseleaf type = 0 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: auth debug = true 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on old message = true 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on bug = true 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: mon pg warn max object skew = 0 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: # disable pg_autoscaler by default for new pools 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default size = 2 2023-12-16T03:31:58.119 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow primary affinity = true 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow pg remap = true 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on legacy crush tunables = false 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on crush straw calc version zero = false 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on no sortbitwise = false 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on osd down out interval zero = false 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on too few osds = false 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: mon_allow_pool_size_one = true 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: osd default data pool replay window = 5 2023-12-16T03:31:58.120 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: mon allow pool delete = true 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: mon cluster log file level = debug 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: debug asserts on shutdown = true 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: mon health detail to clog = false 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: mon host = 172.21.15.50 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: ms client mode = crc 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: ms cluster mode = crc 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: ms mon client mode = crc 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: ms mon cluster mode = crc 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: ms mon service mode = crc 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: ms service mode = crc 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: fsid = 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:31:58.121 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout:[osd] 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd journal size = 100 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub load threshold = 5.0 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub max interval = 600 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd mclock profile = high_recovery_ops 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd recover clone overlap = true 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd recovery max chunk = 1048576 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug shutdown = true 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug op order = true 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug verify stray on activate = true 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug trim objects = true 2023-12-16T03:31:58.122 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: osd open classes on start = true 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug pg log writeout = true 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: osd deep scrub update digest min age = 30 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: osd map max advance = 10 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: journal zero on create = true 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: filestore ondisk finisher threads = 3 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: filestore apply finisher threads = 3 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: bdev debug aio = true 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug misdirected ops = true 2023-12-16T03:31:58.123 INFO:teuthology.orchestra.run.smithi124.stdout: debug monc = 20 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: crimson seastar smp = 3 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: debug osd = 20 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: osd blocked scrub grace period = 3600 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: osd class default list = * 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: osd class load list = * 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: osd shutdown pgref assert = True 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr] 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-12-16T03:31:58.124 INFO:teuthology.orchestra.run.smithi124.stdout: debug mgr = 20 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: mgr/telemetry/nag = false 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout:[mon] 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: debug paxos = 20 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: mon data avail warn = 5 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: mon mgr mkfs grace = 240 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2023-12-16T03:31:58.125 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd reporter subtree level = osd 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd prime pg temp = true 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: auth mon ticket ttl = 660 # 11m 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: auth service ticket ttl = 240 # 4m 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: # don't complain about insecure global_id in the test suite 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: # 1m isn't quite enough 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: mon_down_mkfs_grace = 2m 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.126 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_filestore_osds = false 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: mon min osdmap epochs = 50 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: mon osdmap full prune interval = 2 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: mon osdmap full prune min = 15 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: mon osdmap full prune txsize = 2 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: paxos service trim min = 10 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on pool no app = False 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default crimson = True 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout:[client] 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: rgw cache enabled = true 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable ops log = true 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable usage log = true 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2023-12-16T03:31:58.127 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.a] 2023-12-16T03:31:58.128 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-12-16T03:31:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2023-12-16T03:31:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-16T03:31:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2023-12-16T03:31:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2023-12-16T03:31:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2023-12-16T03:31:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = 172.21.15.50 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: ms client mode = crc 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: ms cluster mode = crc 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: ms mon client mode = crc 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: ms mon cluster mode = crc 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: ms mon service mode = crc 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: ms service mode = crc 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.131 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: debug monc = 20 2023-12-16T03:31:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: crimson seastar smp = 3 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: osd blocked scrub grace period = 3600 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: osd class default list = * 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: osd class load list = * 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: osd shutdown pgref assert = True 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-12-16T03:31:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2023-12-16T03:31:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: mon min osdmap epochs = 50 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: mon osdmap full prune interval = 2 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: mon osdmap full prune min = 15 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: mon osdmap full prune txsize = 2 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: paxos service trim min = 10 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2023-12-16T03:31:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default crimson = True 2023-12-16T03:31:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:31:58.137 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2023-12-16T03:31:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2023-12-16T03:31:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2023-12-16T03:31:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2023-12-16T03:31:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-16T03:31:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-16T03:31:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-16T03:31:58.137 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2023-12-16T03:31:58.141 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-16T03:31:58.141 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-16T03:31:58.247 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-16T03:31:58.247 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:58.247 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-16T03:31:58.262 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:58.262 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-16T03:31:58.317 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2023-12-16T03:31:58.317 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:58.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-16T03:31:58.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T03:31:58.404 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:31:58.404 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:31:58.459 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi124.front.sepia.ceph.com 2023-12-16T03:31:58.460 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:31:58.460 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-16T03:31:58.460 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T03:31:58.500 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:31:58.500 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:31:58.555 INFO:tasks.ceph:Setting up mon nodes... 2023-12-16T03:31:58.555 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-16T03:31:58.555 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-16T03:31:58.666 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-16T03:31:58.669 INFO:tasks.ceph:Setting up mds nodes... 2023-12-16T03:31:58.669 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-16T03:31:58.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-16T03:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-16T03:31:58.740 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-16T03:31:58.788 INFO:teuthology.orchestra.run.smithi124.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-16T03:31:58.803 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-16T03:31:58.804 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-12-16T03:31:58.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-16T03:31:58.834 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-12-16T03:31:58.834 INFO:tasks.ceph:role: osd.0 2023-12-16T03:31:58.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-16T03:31:58.835 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-16T03:31:58.905 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:31:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:31:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:31:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T03:31:58.906 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:31:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:31:58.906 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:31:58.906 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T03:31:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:31:58.906 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:31:58.938 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-12-16T03:31:58.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-16T03:31:58.940 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-16T03:31:59.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-16T03:31:59.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-16T03:31:59.163 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-12-16T03:31:59.164 INFO:tasks.ceph:role: osd.1 2023-12-16T03:31:59.164 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-16T03:31:59.164 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-16T03:31:59.234 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:31:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:31:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:31:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T03:31:59.234 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:31:59.234 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:31:59.234 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:31:59.234 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T03:31:59.235 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:31:59.235 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:31:59.266 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-12-16T03:31:59.269 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-16T03:31:59.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-16T03:31:59.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-16T03:31:59.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:32:00.000 INFO:teuthology.orchestra.run.smithi050.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-16T03:32:00.000 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:31:59,999 seastar - Reactor backend: linux-aio 2023-12-16T03:32:00.021 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,019 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-16T03:32:00.021 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,019 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-16T03:32:00.021 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,019 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-16T03:32:00.021 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,019 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-16T03:32:00.023 INFO:teuthology.orchestra.run.smithi050.stderr:==80342==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-16T03:32:00.029 INFO:teuthology.orchestra.run.smithi050.stderr:==80342==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffe20382000; bottom 0x7ff9bd925000; size: 0x000462a5d000 (18834903040) 2023-12-16T03:32:00.029 INFO:teuthology.orchestra.run.smithi050.stderr:False positive error reports may follow 2023-12-16T03:32:00.029 INFO:teuthology.orchestra.run.smithi050.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-16T03:32:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,065 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-12-16T03:32:00.067 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,065 [shard 0] osd - get_early_config: set --smp 3 2023-12-16T03:32:00.585 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-12-16T03:32:00.585 INFO:teuthology.orchestra.run.smithi050.stderr:Suppressions used: 2023-12-16T03:32:00.585 INFO:teuthology.orchestra.run.smithi050.stderr: count bytes template 2023-12-16T03:32:00.585 INFO:teuthology.orchestra.run.smithi050.stderr: 1 8 MallocExtension::Register 2023-12-16T03:32:00.586 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-12-16T03:32:00.586 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-16T03:32:00.642 INFO:teuthology.orchestra.run.smithi050.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-16T03:32:00.642 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,641 seastar - Reactor backend: linux-aio 2023-12-16T03:32:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,659 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-16T03:32:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,659 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-16T03:32:00.660 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,659 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-16T03:32:00.668 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:00,666 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-16T03:32:00.670 INFO:teuthology.orchestra.run.smithi050.stderr:==80330==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-16T03:32:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:==80330==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffe20382000; bottom 0x7ff9bb71e000; size: 0x000464c64000 (18870583296) 2023-12-16T03:32:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:False positive error reports may follow 2023-12-16T03:32:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-16T03:32:00.761 INFO:teuthology.orchestra.run.smithi050.stderr:Reactor stalled for 33 ms on shard 0. Backtrace: 0x45d5d 0x2cbad828 0x2cbaebd6 0x2cbb0124 0x2cbb04a8 0x2cbb05f2 0x2cbb0a48 0x54daf 0xce1ca 0x588c4 0xdb9f8 0x26710594 0x26712bdd 0x267149ee 0x26717253 0x26547c1b 0x1efad18c 0x1ef1eb99 0x1ef229da 0x2cf320ed 2023-12-16T03:32:00.761 INFO:teuthology.orchestra.run.smithi050.stderr:kernel callstack: 2023-12-16T03:32:04.311 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-12-16T03:32:04.312 INFO:teuthology.orchestra.run.smithi050.stderr:Suppressions used: 2023-12-16T03:32:04.312 INFO:teuthology.orchestra.run.smithi050.stderr: count bytes template 2023-12-16T03:32:04.312 INFO:teuthology.orchestra.run.smithi050.stderr: 1 8 MallocExtension::Register 2023-12-16T03:32:04.312 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-12-16T03:32:04.312 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-16T03:32:04.312 INFO:teuthology.orchestra.run.smithi050.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:32:04.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T03:32:04.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:32:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-16T03:32:04.943 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:04,942 seastar - Reactor backend: linux-aio 2023-12-16T03:32:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:04,959 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-16T03:32:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:04,959 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-16T03:32:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:04,959 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-16T03:32:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:04,959 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-16T03:32:04.963 INFO:teuthology.orchestra.run.smithi050.stderr:==81151==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-16T03:32:04.969 INFO:teuthology.orchestra.run.smithi050.stderr:==81151==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffcd4075000; bottom 0x7f6c0c656000; size: 0x0090c7a1f000 (621824569344) 2023-12-16T03:32:04.969 INFO:teuthology.orchestra.run.smithi050.stderr:False positive error reports may follow 2023-12-16T03:32:04.969 INFO:teuthology.orchestra.run.smithi050.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-16T03:32:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2cbad828 0x2cbaebd6 0x2cbb0124 0x2cbb04a8 0x2cbb05f2 0x2cbb0a48 0x54daf 0x4de35 0x2303bd88 0x2305d7d6 0x231ae4af 0x231b4125 0x22f9beea 0x22e5bbd5 0x24ea4f60 0x24eac716 0x24eaf064 0x24eb023d 0x229f738f 0x22a47fee 0x22a6bac9 0x2cb4fb43 0x2cbed950 0x2ce12479 0x2ce142c3 0x2c868920 0x2c86a829 0x1f077ea8 0x1f080c45 0x1eeef084 0x3feaf 0x3ff5f 0x1e998a44 2023-12-16T03:32:04.996 INFO:teuthology.orchestra.run.smithi050.stderr:kernel callstack: 2023-12-16T03:32:05.006 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:05,004 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-12-16T03:32:05.006 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:05,004 [shard 0] osd - get_early_config: set --smp 3 2023-12-16T03:32:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-12-16T03:32:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:Suppressions used: 2023-12-16T03:32:05.509 INFO:teuthology.orchestra.run.smithi050.stderr: count bytes template 2023-12-16T03:32:05.509 INFO:teuthology.orchestra.run.smithi050.stderr: 1 8 MallocExtension::Register 2023-12-16T03:32:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-12-16T03:32:05.509 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-16T03:32:05.562 INFO:teuthology.orchestra.run.smithi050.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-16T03:32:05.562 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:05,561 seastar - Reactor backend: linux-aio 2023-12-16T03:32:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:05,579 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-16T03:32:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:05,579 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-16T03:32:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:05,579 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-16T03:32:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:INFO 2023-12-16 03:32:05,586 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-16T03:32:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:==81149==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-16T03:32:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:==81149==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffcd4075000; bottom 0x7f6c0a44f000; size: 0x0090c9c26000 (621860249600) 2023-12-16T03:32:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:False positive error reports may follow 2023-12-16T03:32:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-16T03:32:05.681 INFO:teuthology.orchestra.run.smithi050.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2cbad828 0x2cbaebd6 0x2cbb0124 0x2cbb04a8 0x2cbb05f2 0x2cbb0a48 0x54daf 0xce1ca 0x588c4 0xdb9f8 0x26710594 0x26712bdd 0x267149ee 0x26717253 0x26547c1b 0x1efad18c 0x1ef1eb99 0x1ef229da 0x2cf320ed 2023-12-16T03:32:05.681 INFO:teuthology.orchestra.run.smithi050.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff96550836 0xffffffff965508ea 0xffffffff9706646c 0xffffffff972000ea 2023-12-16T03:32:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-12-16T03:32:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:Suppressions used: 2023-12-16T03:32:09.225 INFO:teuthology.orchestra.run.smithi050.stderr: count bytes template 2023-12-16T03:32:09.225 INFO:teuthology.orchestra.run.smithi050.stderr: 1 8 MallocExtension::Register 2023-12-16T03:32:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:----------------------------------------------------- 2023-12-16T03:32:09.225 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-16T03:32:09.226 INFO:teuthology.orchestra.run.smithi050.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:32:09.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T03:32:09.297 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-16T03:32:09.329 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-12-16T03:32:09.329 INFO:tasks.ceph:role: osd.2 2023-12-16T03:32:09.329 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com 2023-12-16T03:32:09.330 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-16T03:32:09.406 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:32:09.406 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:32:09.407 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:32:09.407 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T03:32:09.407 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:32:09.407 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:32:09.407 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:32:09.407 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T03:32:09.407 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:32:09.407 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:32:09.909 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-12-16T03:32:09.911 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-12-16T03:32:09.911 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-12-16T03:32:10.032 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-16T03:32:10.070 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-16T03:32:10.142 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-12-16T03:32:10.142 INFO:tasks.ceph:role: osd.3 2023-12-16T03:32:10.142 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com 2023-12-16T03:32:10.142 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-16T03:32:10.219 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:32:10.220 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:32:10.220 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:32:10.220 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T03:32:10.220 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:32:10.220 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:32:10.220 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:32:10.220 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T03:32:10.220 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:32:10.220 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:32:10.699 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2023-12-16T03:32:10.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2023-12-16T03:32:10.702 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2023-12-16T03:32:10.791 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-16T03:32:10.822 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:32:11.383 INFO:teuthology.orchestra.run.smithi124.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-16T03:32:11.384 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:11,382 seastar - Reactor backend: linux-aio 2023-12-16T03:32:11.409 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:11,408 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-16T03:32:11.410 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:11,408 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-16T03:32:11.410 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:11,408 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-16T03:32:11.410 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:11,408 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-16T03:32:11.413 INFO:teuthology.orchestra.run.smithi124.stderr:==80109==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-16T03:32:11.424 INFO:teuthology.orchestra.run.smithi124.stderr:==80109==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fffb03ba000; bottom 0x7f84154bb000; size: 0x007b9aeff000 (530880393216) 2023-12-16T03:32:11.424 INFO:teuthology.orchestra.run.smithi124.stderr:False positive error reports may follow 2023-12-16T03:32:11.424 INFO:teuthology.orchestra.run.smithi124.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-16T03:32:11.463 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:11,462 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-12-16T03:32:11.463 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:11,462 [shard 0] osd - get_early_config: set --smp 3 2023-12-16T03:32:11.946 INFO:teuthology.orchestra.run.smithi124.stderr:----------------------------------------------------- 2023-12-16T03:32:11.947 INFO:teuthology.orchestra.run.smithi124.stderr:Suppressions used: 2023-12-16T03:32:11.947 INFO:teuthology.orchestra.run.smithi124.stderr: count bytes template 2023-12-16T03:32:11.947 INFO:teuthology.orchestra.run.smithi124.stderr: 1 8 MallocExtension::Register 2023-12-16T03:32:11.947 INFO:teuthology.orchestra.run.smithi124.stderr:----------------------------------------------------- 2023-12-16T03:32:11.947 INFO:teuthology.orchestra.run.smithi124.stderr: 2023-12-16T03:32:12.009 INFO:teuthology.orchestra.run.smithi124.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-16T03:32:12.009 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:12,008 seastar - Reactor backend: linux-aio 2023-12-16T03:32:12.027 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:12,026 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-16T03:32:12.028 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:12,026 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-16T03:32:12.028 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:12,026 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-16T03:32:12.035 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:12,033 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-16T03:32:12.037 INFO:teuthology.orchestra.run.smithi124.stderr:==80107==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-16T03:32:12.043 INFO:teuthology.orchestra.run.smithi124.stderr:==80107==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fffb03ba000; bottom 0x7f84132b4000; size: 0x007b9d106000 (530916073472) 2023-12-16T03:32:12.043 INFO:teuthology.orchestra.run.smithi124.stderr:False positive error reports may follow 2023-12-16T03:32:12.043 INFO:teuthology.orchestra.run.smithi124.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-16T03:32:15.351 INFO:teuthology.orchestra.run.smithi124.stderr:----------------------------------------------------- 2023-12-16T03:32:15.351 INFO:teuthology.orchestra.run.smithi124.stderr:Suppressions used: 2023-12-16T03:32:15.351 INFO:teuthology.orchestra.run.smithi124.stderr: count bytes template 2023-12-16T03:32:15.351 INFO:teuthology.orchestra.run.smithi124.stderr: 1 8 MallocExtension::Register 2023-12-16T03:32:15.351 INFO:teuthology.orchestra.run.smithi124.stderr:----------------------------------------------------- 2023-12-16T03:32:15.351 INFO:teuthology.orchestra.run.smithi124.stderr: 2023-12-16T03:32:15.351 INFO:teuthology.orchestra.run.smithi124.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:32:15.390 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T03:32:15.418 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:32:15.925 INFO:teuthology.orchestra.run.smithi124.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-16T03:32:15.926 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:15,924 seastar - Reactor backend: linux-aio 2023-12-16T03:32:15.942 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:15,940 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-16T03:32:15.942 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:15,940 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-16T03:32:15.942 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:15,940 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-16T03:32:15.942 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:15,940 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-16T03:32:15.944 INFO:teuthology.orchestra.run.smithi124.stderr:==80918==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-16T03:32:15.950 INFO:teuthology.orchestra.run.smithi124.stderr:==80918==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fff0a6ac000; bottom 0x7f280d939000; size: 0x00d6fcd73000 (923364962304) 2023-12-16T03:32:15.950 INFO:teuthology.orchestra.run.smithi124.stderr:False positive error reports may follow 2023-12-16T03:32:15.950 INFO:teuthology.orchestra.run.smithi124.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-16T03:32:15.985 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:15,984 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-12-16T03:32:15.985 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:15,984 [shard 0] osd - get_early_config: set --smp 3 2023-12-16T03:32:16.465 INFO:teuthology.orchestra.run.smithi124.stderr:----------------------------------------------------- 2023-12-16T03:32:16.465 INFO:teuthology.orchestra.run.smithi124.stderr:Suppressions used: 2023-12-16T03:32:16.465 INFO:teuthology.orchestra.run.smithi124.stderr: count bytes template 2023-12-16T03:32:16.465 INFO:teuthology.orchestra.run.smithi124.stderr: 1 8 MallocExtension::Register 2023-12-16T03:32:16.466 INFO:teuthology.orchestra.run.smithi124.stderr:----------------------------------------------------- 2023-12-16T03:32:16.466 INFO:teuthology.orchestra.run.smithi124.stderr: 2023-12-16T03:32:16.516 INFO:teuthology.orchestra.run.smithi124.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-16T03:32:16.516 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:16,515 seastar - Reactor backend: linux-aio 2023-12-16T03:32:16.534 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:16,532 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-16T03:32:16.534 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:16,533 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-16T03:32:16.534 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:16,533 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-16T03:32:16.541 INFO:teuthology.orchestra.run.smithi124.stderr:INFO 2023-12-16 03:32:16,540 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-16T03:32:16.544 INFO:teuthology.orchestra.run.smithi124.stderr:==80916==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-16T03:32:16.550 INFO:teuthology.orchestra.run.smithi124.stderr:==80916==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fff0a6ac000; bottom 0x7f280b732000; size: 0x00d6fef7a000 (923400642560) 2023-12-16T03:32:16.550 INFO:teuthology.orchestra.run.smithi124.stderr:False positive error reports may follow 2023-12-16T03:32:16.550 INFO:teuthology.orchestra.run.smithi124.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-16T03:32:19.869 INFO:teuthology.orchestra.run.smithi124.stderr:----------------------------------------------------- 2023-12-16T03:32:19.870 INFO:teuthology.orchestra.run.smithi124.stderr:Suppressions used: 2023-12-16T03:32:19.870 INFO:teuthology.orchestra.run.smithi124.stderr: count bytes template 2023-12-16T03:32:19.870 INFO:teuthology.orchestra.run.smithi124.stderr: 1 8 MallocExtension::Register 2023-12-16T03:32:19.870 INFO:teuthology.orchestra.run.smithi124.stderr:----------------------------------------------------- 2023-12-16T03:32:19.870 INFO:teuthology.orchestra.run.smithi124.stderr: 2023-12-16T03:32:19.870 INFO:teuthology.orchestra.run.smithi124.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:32:19.909 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T03:32:19.935 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-16T03:32:19.935 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:32:19.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-16T03:32:19.972 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:32:19.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-16T03:32:20.048 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:32:20.048 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-16T03:32:20.075 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:32:20.075 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-16T03:32:20.142 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:32:20.142 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-16T03:32:20.209 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:32:20.209 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-16T03:32:20.228 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:32:20.228 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-16T03:32:20.263 INFO:tasks.ceph:Adding keys to all mons... 2023-12-16T03:32:20.264 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-16T03:32:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2023-12-16T03:32:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAwGn1lbr9TKxAA8JVvsC5/GDVnOVpn6XtKGA== 2023-12-16T03:32:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2023-12-16T03:32:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA1Gn1lgryJJhAAILPq9jcglwMTiY+luMprsg== 2023-12-16T03:32:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2023-12-16T03:32:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAuGn1lSlOiJxAAsufb96daWK8P0iYVLc5Q2g== 2023-12-16T03:32:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2023-12-16T03:32:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQA8Gn1lGf9qBRAAX97B51+O4rgxAbyJJl8FwA== 2023-12-16T03:32:20.302 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2023-12-16T03:32:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBAGn1l2IOeIxAATXpt5ATn3x3cBSlULoG4eQ== 2023-12-16T03:32:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-16T03:32:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAuGn1lIAT0KhAAkY/gPEwdIFrd4T9An40rRg== 2023-12-16T03:32:20.303 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-12-16T03:32:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAuGn1lyb7rLhAAWxOTOeKSt1X6sIhtE4U6yQ== 2023-12-16T03:32:20.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:32:20.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:32:20.478 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T03:32:20.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:32:20.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:32:20.665 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T03:32:20.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T03:32:20.795 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-16T03:32:20.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-16T03:32:20.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T03:32:20.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:20.925+0000 7ff1a860e980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:20.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:20.925+0000 7ff1a860e980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:20.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-16T03:32:20.974 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:32:21.029 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-16T03:32:21.029 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-16T03:32:21.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-16T03:32:21.071 INFO:tasks.ceph.mon.a:Started 2023-12-16T03:32:21.071 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-16T03:32:21.071 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-16T03:32:21.072 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-16T03:32:21.074 INFO:tasks.ceph.mgr.x:Started 2023-12-16T03:32:21.074 INFO:tasks.ceph:Setting crush tunables to default 2023-12-16T03:32:21.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2023-12-16T03:32:21.155 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-16T03:32:21.153+0000 7f6992a1f980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.155 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-16T03:32:21.153+0000 7f6992a1f980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.155 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-16T03:32:21.153+0000 7f6992a1f980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.160 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:21.158+0000 7f812a966f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.178+0000 7efc4722d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.184+0000 7efc4722d640 1 Processor -- start 2023-12-16T03:32:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.184+0000 7efc4722d640 1 -- start start 2023-12-16T03:32:21.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc4722d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc400a0fc0 0x7efc40133620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:21.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc4722d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4009deb0 con 0x7efc400a0bb0 2023-12-16T03:32:21.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc4722d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4009d2b0 con 0x7efc400a0fc0 2023-12-16T03:32:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc3ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc400a0fc0 0x7efc40133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc44fc9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efc400a0bb0 0x7efc40132f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39746/0 (socket says 172.21.15.50:39746) 2023-12-16T03:32:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc44fc9640 1 -- 172.21.15.50:0/3426440163 learned_addr learned my addr 172.21.15.50:0/3426440163 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc3ffff640 1 -- 172.21.15.50:0/3426440163 >> v2:172.21.15.50:3300/0 conn(0x7efc400a0fc0 msgr2=0x7efc40133620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T03:32:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc3ffff640 1 -- 172.21.15.50:0/3426440163 >> v2:172.21.15.50:3300/0 conn(0x7efc400a0fc0 msgr2=0x7efc40133620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:32:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc3ffff640 1 --2- 172.21.15.50:0/3426440163 >> v2:172.21.15.50:3300/0 conn(0x7efc400a0fc0 0x7efc40133620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:32:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.185+0000 7efc3ffff640 1 --2- 172.21.15.50:0/3426440163 >> v2:172.21.15.50:3300/0 conn(0x7efc400a0fc0 0x7efc40133620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:32:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511363977 0 0) 0x7efc4009deb0 con 0x7efc400a0bb0 2023-12-16T03:32:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc300034f0 con 0x7efc400a0bb0 2023-12-16T03:32:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1975124762 0 0) 0x7efc300034f0 con 0x7efc400a0bb0 2023-12-16T03:32:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 >> v2:172.21.15.50:3300/0 conn(0x7efc400a0fc0 msgr2=0x7efc40133620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T03:32:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 --2- 172.21.15.50:0/3426440163 >> v2:172.21.15.50:3300/0 conn(0x7efc400a0fc0 0x7efc40133620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:21.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc401302d0 con 0x7efc400a0bb0 2023-12-16T03:32:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2290794903 0 0) 0x7efc340015a0 con 0x7efc400a0bb0 2023-12-16T03:32:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 >> v1:172.21.15.50:6789/0 conn(0x7efc400a0bb0 legacy=0x7efc40132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 --2- 172.21.15.50:0/3426440163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc30003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.222+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4009d2b0 con 0x7efc30003970 2023-12-16T03:32:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.223+0000 7efc44fc9640 1 --2- 172.21.15.50:0/3426440163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc30003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.223+0000 7efc44fc9640 1 -- 172.21.15.50:0/3426440163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc300034f0 con 0x7efc30003970 2023-12-16T03:32:21.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.224+0000 7efc44fc9640 1 --2- 172.21.15.50:0/3426440163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc30003dc0 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64aa707bd0d565b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.224+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efc34007c10 con 0x7efc30003970 2023-12-16T03:32:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.224+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7efc340059d0 con 0x7efc30003970 2023-12-16T03:32:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.224+0000 7efc3f7fe640 1 -- 172.21.15.50:0/3426440163 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efc34005c70 con 0x7efc30003970 2023-12-16T03:32:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.225+0000 7efc4722d640 1 -- 172.21.15.50:0/3426440163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 msgr2=0x7efc30003dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.225+0000 7efc4722d640 1 --2- 172.21.15.50:0/3426440163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc30003dc0 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.225+0000 7efc4722d640 1 -- 172.21.15.50:0/3426440163 shutdown_connections 2023-12-16T03:32:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.225+0000 7efc4722d640 1 --2- 172.21.15.50:0/3426440163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc30003dc0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.225+0000 7efc4722d640 1 --2- 172.21.15.50:0/3426440163 >> v2:172.21.15.50:3300/0 conn(0x7efc400a0fc0 0x7efc40133620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.225+0000 7efc4722d640 1 -- 172.21.15.50:0/3426440163 >> 172.21.15.50:0/3426440163 conn(0x7efc4006c9a0 msgr2=0x7efc4006cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.225+0000 7efc4722d640 1 -- 172.21.15.50:0/3426440163 shutdown_connections 2023-12-16T03:32:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.225+0000 7efc4722d640 1 -- 172.21.15.50:0/3426440163 wait complete. 2023-12-16T03:32:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.225+0000 7efc4722d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.226+0000 7efc4722d640 1 Processor -- start 2023-12-16T03:32:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.226+0000 7efc4722d640 1 -- start start 2023-12-16T03:32:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.227+0000 7efc4722d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc401c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.227+0000 7efc4722d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4011f980 con 0x7efc30003970 2023-12-16T03:32:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.227+0000 7efc44fc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc401c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.227+0000 7efc44fc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc401c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55766/0 (socket says 172.21.15.50:55766) 2023-12-16T03:32:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.227+0000 7efc44fc9640 1 -- 172.21.15.50:0/3891208669 learned_addr learned my addr 172.21.15.50:0/3891208669 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.227+0000 7efc44fc9640 1 -- 172.21.15.50:0/3891208669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40120ed0 con 0x7efc30003970 2023-12-16T03:32:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.228+0000 7efc44fc9640 1 --2- 172.21.15.50:0/3891208669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc401c8010 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.228+0000 7efc3d7fa640 1 -- 172.21.15.50:0/3891208669 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efc34004e40 con 0x7efc30003970 2023-12-16T03:32:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.228+0000 7efc3d7fa640 1 -- 172.21.15.50:0/3891208669 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7efc34001430 con 0x7efc30003970 2023-12-16T03:32:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.228+0000 7efc4722d640 1 -- 172.21.15.50:0/3891208669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4012f750 con 0x7efc30003970 2023-12-16T03:32:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.228+0000 7efc3d7fa640 1 -- 172.21.15.50:0/3891208669 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efc34007040 con 0x7efc30003970 2023-12-16T03:32:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.228+0000 7efc4722d640 1 -- 172.21.15.50:0/3891208669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc40121bb0 con 0x7efc30003970 2023-12-16T03:32:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.228+0000 7efc3d7fa640 1 -- 172.21.15.50:0/3891208669 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7efc340071f0 con 0x7efc30003970 2023-12-16T03:32:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.228+0000 7efc3d7fa640 1 -- 172.21.15.50:0/3891208669 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (crc 0 0 0) 0x7efc340153b0 con 0x7efc30003970 2023-12-16T03:32:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.229+0000 7efc4722d640 1 -- 172.21.15.50:0/3891208669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4009f4f0 con 0x7efc30003970 2023-12-16T03:32:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.231+0000 7efc3d7fa640 1 -- 172.21.15.50:0/3891208669 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7efc34007680 con 0x7efc30003970 2023-12-16T03:32:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.297+0000 7efc4722d640 1 -- 172.21.15.50:0/3891208669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7efc40062350 con 0x7efc30003970 2023-12-16T03:32:21.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.298+0000 7efc3d7fa640 1 -- 172.21.15.50:0/3891208669 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (crc 0 0 0) 0x7efc34005040 con 0x7efc30003970 2023-12-16T03:32:21.300 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2023-12-16T03:32:21.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.299+0000 7efc4722d640 1 -- 172.21.15.50:0/3891208669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 msgr2=0x7efc401c8010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:21.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.299+0000 7efc4722d640 1 --2- 172.21.15.50:0/3891208669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc401c8010 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:21.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.299+0000 7efc4722d640 1 -- 172.21.15.50:0/3891208669 shutdown_connections 2023-12-16T03:32:21.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.299+0000 7efc4722d640 1 --2- 172.21.15.50:0/3891208669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc30003970 0x7efc401c8010 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:21.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.299+0000 7efc4722d640 1 -- 172.21.15.50:0/3891208669 >> 172.21.15.50:0/3891208669 conn(0x7efc4006c9a0 msgr2=0x7efc40132f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:21.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.299+0000 7efc4722d640 1 -- 172.21.15.50:0/3891208669 shutdown_connections 2023-12-16T03:32:21.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.299+0000 7efc4722d640 1 -- 172.21.15.50:0/3891208669 wait complete. 2023-12-16T03:32:21.311 INFO:tasks.ceph:check_enable_crimson: True 2023-12-16T03:32:21.311 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2023-12-16T03:32:21.311 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2023-12-16T03:32:21.365 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:21.363+0000 7f812a966f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.365 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:21.363+0000 7f812a966f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.415+0000 7faa39c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.420+0000 7faa39c6d640 1 Processor -- start 2023-12-16T03:32:21.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.420+0000 7faa39c6d640 1 -- start start 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.421+0000 7faa39c6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa3412ff00 0x7faa34130310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.421+0000 7faa39c6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3409af50 con 0x7faa3412c500 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.421+0000 7faa39c6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3412fa00 con 0x7faa3412ff00 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.421+0000 7faa337fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa3412ff00 0x7faa34130310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.421+0000 7faa32ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa3412c500 0x7faa3412c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39758/0 (socket says 172.21.15.50:39758) 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.421+0000 7faa337fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faa3412ff00 0x7faa34130310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55774/0 (socket says 172.21.15.50:55774) 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.421+0000 7faa32ffd640 1 -- 172.21.15.50:0/3804850599 learned_addr learned my addr 172.21.15.50:0/3804850599 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.421+0000 7faa337fe640 1 -- 172.21.15.50:0/3804850599 >> v1:172.21.15.50:6789/0 conn(0x7faa3412c500 legacy=0x7faa3412c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.421+0000 7faa337fe640 1 -- 172.21.15.50:0/3804850599 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3406e220 con 0x7faa3412ff00 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa337fe640 1 --2- 172.21.15.50:0/3804850599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412ff00 0x7faa34130310 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d96697bc5b3c34 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:21.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa327fc640 1 -- 172.21.15.50:0/3804850599 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7faa28009ce0 con 0x7faa3412ff00 2023-12-16T03:32:21.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa327fc640 1 -- 172.21.15.50:0/3804850599 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7faa28009e40 con 0x7faa3412ff00 2023-12-16T03:32:21.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa327fc640 1 -- 172.21.15.50:0/3804850599 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7faa2800e360 con 0x7faa3412ff00 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa39c6d640 1 -- 172.21.15.50:0/3804850599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412ff00 msgr2=0x7faa34130310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa39c6d640 1 --2- 172.21.15.50:0/3804850599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412ff00 0x7faa34130310 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa39c6d640 1 -- 172.21.15.50:0/3804850599 shutdown_connections 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa39c6d640 1 --2- 172.21.15.50:0/3804850599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412ff00 0x7faa34130310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa39c6d640 1 -- 172.21.15.50:0/3804850599 >> 172.21.15.50:0/3804850599 conn(0x7faa3409dff0 msgr2=0x7faa3409e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa39c6d640 1 -- 172.21.15.50:0/3804850599 shutdown_connections 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.422+0000 7faa39c6d640 1 -- 172.21.15.50:0/3804850599 wait complete. 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.423+0000 7faa39c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.424+0000 7faa39c6d640 1 Processor -- start 2023-12-16T03:32:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.424+0000 7faa39c6d640 1 -- start start 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.424+0000 7faa39c6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412c500 0x7faa341c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.424+0000 7faa39c6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa34070030 con 0x7faa3412c500 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.424+0000 7faa337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412c500 0x7faa341c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.424+0000 7faa337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412c500 0x7faa341c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55784/0 (socket says 172.21.15.50:55784) 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.424+0000 7faa337fe640 1 -- 172.21.15.50:0/1062025598 learned_addr learned my addr 172.21.15.50:0/1062025598 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.425+0000 7faa337fe640 1 -- 172.21.15.50:0/1062025598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3406e9a0 con 0x7faa3412c500 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.425+0000 7faa337fe640 1 --2- 172.21.15.50:0/1062025598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412c500 0x7faa341c7f10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.425+0000 7faa1bfff640 1 -- 172.21.15.50:0/1062025598 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7faa28014620 con 0x7faa3412c500 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.425+0000 7faa1bfff640 1 -- 172.21.15.50:0/1062025598 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7faa28014780 con 0x7faa3412c500 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.425+0000 7faa39c6d640 1 -- 172.21.15.50:0/1062025598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa34072150 con 0x7faa3412c500 2023-12-16T03:32:21.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.425+0000 7faa1bfff640 1 -- 172.21.15.50:0/1062025598 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7faa28014a20 con 0x7faa3412c500 2023-12-16T03:32:21.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.425+0000 7faa39c6d640 1 -- 172.21.15.50:0/1062025598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa340724f0 con 0x7faa3412c500 2023-12-16T03:32:21.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.425+0000 7faa1bfff640 1 -- 172.21.15.50:0/1062025598 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7faa28011380 con 0x7faa3412c500 2023-12-16T03:32:21.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.425+0000 7faa1bfff640 1 -- 172.21.15.50:0/1062025598 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (crc 0 0 0) 0x7faa28019040 con 0x7faa3412c500 2023-12-16T03:32:21.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.426+0000 7faa39c6d640 1 -- 172.21.15.50:0/1062025598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa34070500 con 0x7faa3412c500 2023-12-16T03:32:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.428+0000 7faa1bfff640 1 -- 172.21.15.50:0/1062025598 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7faa280118c0 con 0x7faa3412c500 2023-12-16T03:32:21.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:21.504+0000 7faa39c6d640 1 -- 172.21.15.50:0/1062025598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faa34062350 con 0x7faa3412c500 2023-12-16T03:32:21.506 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-16T03:32:21.504+0000 7f698a9f1640 -1 WARNING: experimental feature 'crimson' is enabled 2023-12-16T03:32:21.506 INFO:tasks.ceph.mon.a.smithi050.stderr:Please be aware that this feature is experimental, untested, 2023-12-16T03:32:21.506 INFO:tasks.ceph.mon.a.smithi050.stderr:unsupported, and may result in data corruption, data loss, 2023-12-16T03:32:21.507 INFO:tasks.ceph.mon.a.smithi050.stderr:and/or irreparable damage to your cluster. Do not use 2023-12-16T03:32:21.507 INFO:tasks.ceph.mon.a.smithi050.stderr:feature with important data. 2023-12-16T03:32:21.507 INFO:tasks.ceph.mon.a.smithi050.stderr: 2023-12-16T03:32:21.829 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:21.826+0000 7f812a966f00 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-16T03:32:21.879 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:21.877+0000 7f812a966f00 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-16T03:32:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:22.299+0000 7faa1bfff640 1 -- 172.21.15.50:0/1062025598 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) v1 ==== 99+0+0 (crc 0 0 0) 0x7faa28011b30 con 0x7faa3412c500 2023-12-16T03:32:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:22.300+0000 7faa39c6d640 1 -- 172.21.15.50:0/1062025598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412c500 msgr2=0x7faa341c7f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:22.300+0000 7faa39c6d640 1 --2- 172.21.15.50:0/1062025598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412c500 0x7faa341c7f10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:22.300+0000 7faa39c6d640 1 -- 172.21.15.50:0/1062025598 shutdown_connections 2023-12-16T03:32:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:22.300+0000 7faa39c6d640 1 --2- 172.21.15.50:0/1062025598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa3412c500 0x7faa341c7f10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:22.300+0000 7faa39c6d640 1 -- 172.21.15.50:0/1062025598 >> 172.21.15.50:0/1062025598 conn(0x7faa3409dff0 msgr2=0x7faa3412a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:22.300+0000 7faa39c6d640 1 -- 172.21.15.50:0/1062025598 shutdown_connections 2023-12-16T03:32:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:22.300+0000 7faa39c6d640 1 -- 172.21.15.50:0/1062025598 wait complete. 2023-12-16T03:32:22.316 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-16T03:32:22.317 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:32:22.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-16T03:32:22.352 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:32:22.352 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-16T03:32:22.409 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.407+0000 7f812a966f00 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-16T03:32:22.426 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:32:22.426 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-16T03:32:22.453 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2023-12-16T03:32:22.454 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-16T03:32:22.464 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.462+0000 7f812a966f00 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-16T03:32:22.490 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 45cfaef0-9a15-44c3-a207-62290b65ba02 0 2023-12-16T03:32:22.512 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.510+0000 7f812a966f00 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-16T03:32:22.569 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.567+0000 7f812a966f00 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-16T03:32:22.614 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.612+0000 7f812a966f00 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-16T03:32:22.617 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.609+0000 7f236311e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:22.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.615+0000 7f236311e640 1 Processor -- start 2023-12-16T03:32:22.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.615+0000 7f236311e640 1 -- start start 2023-12-16T03:32:22.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f236311e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f235c118180 0x7f235c111e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:22.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f236311e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c118800 con 0x7f235c112340 2023-12-16T03:32:22.618 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f236311e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c112750 con 0x7f235c118180 2023-12-16T03:32:22.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f2360eba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f235c118180 0x7f235c111e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:22.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f235bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f235c112340 0x7f235c11cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.124:56212/0 (socket says 172.21.15.124:56212) 2023-12-16T03:32:22.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f235bfff640 1 -- 172.21.15.124:0/964243304 learned_addr learned my addr 172.21.15.124:0/964243304 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-12-16T03:32:22.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f235b7fe640 1 -- 172.21.15.124:0/964243304 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191452542 0 0) 0x7f235c118800 con 0x7f235c112340 2023-12-16T03:32:22.619 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f235b7fe640 1 -- 172.21.15.124:0/964243304 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f234c0034f0 con 0x7f235c112340 2023-12-16T03:32:22.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f2360eba640 1 -- 172.21.15.124:0/964243304 >> v1:172.21.15.50:6789/0 conn(0x7f235c112340 legacy=0x7f235c11cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:22.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.616+0000 7f2360eba640 1 -- 172.21.15.124:0/964243304 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c1128c0 con 0x7f235c118180 2023-12-16T03:32:22.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.617+0000 7f2360eba640 1 --2- 172.21.15.124:0/964243304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c118180 0x7f235c111e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9766676d2aba0e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:22.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.617+0000 7f235b7fe640 1 -- 172.21.15.124:0/964243304 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2350009ce0 con 0x7f235c118180 2023-12-16T03:32:22.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.617+0000 7f235b7fe640 1 -- 172.21.15.124:0/964243304 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f2350009e40 con 0x7f235c118180 2023-12-16T03:32:22.620 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.617+0000 7f235b7fe640 1 -- 172.21.15.124:0/964243304 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f235000e360 con 0x7f235c118180 2023-12-16T03:32:22.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.617+0000 7f236311e640 1 -- 172.21.15.124:0/964243304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c118180 msgr2=0x7f235c111e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:22.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.617+0000 7f236311e640 1 --2- 172.21.15.124:0/964243304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c118180 0x7f235c111e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.617+0000 7f236311e640 1 -- 172.21.15.124:0/964243304 shutdown_connections 2023-12-16T03:32:22.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.617+0000 7f236311e640 1 --2- 172.21.15.124:0/964243304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c118180 0x7f235c111e00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.617+0000 7f236311e640 1 -- 172.21.15.124:0/964243304 >> 172.21.15.124:0/964243304 conn(0x7f235c10dd70 msgr2=0x7f235c110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:22.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.618+0000 7f236311e640 1 -- 172.21.15.124:0/964243304 shutdown_connections 2023-12-16T03:32:22.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.618+0000 7f236311e640 1 -- 172.21.15.124:0/964243304 wait complete. 2023-12-16T03:32:22.622 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.618+0000 7f236311e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.618+0000 7f236311e640 1 Processor -- start 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.618+0000 7f236311e640 1 -- start start 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.619+0000 7f236311e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c112340 0x7f235c1a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.619+0000 7f236311e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1a72f0 con 0x7f235c112340 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.619+0000 7f2360eba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c112340 0x7f235c1a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.619+0000 7f2360eba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c112340 0x7f235c1a6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.124:59538/0 (socket says 172.21.15.124:59538) 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.619+0000 7f2360eba640 1 -- 172.21.15.124:0/1369489097 learned_addr learned my addr 172.21.15.124:0/1369489097 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.619+0000 7f2360eba640 1 -- 172.21.15.124:0/1369489097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c1a7430 con 0x7f235c112340 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.619+0000 7f2360eba640 1 --2- 172.21.15.124:0/1369489097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c112340 0x7f235c1a6db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.619+0000 7f23597fa640 1 -- 172.21.15.124:0/1369489097 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2350014540 con 0x7f235c112340 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.620+0000 7f23597fa640 1 -- 172.21.15.124:0/1369489097 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f23500146a0 con 0x7f235c112340 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.620+0000 7f236311e640 1 -- 172.21.15.124:0/1369489097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c1a7680 con 0x7f235c112340 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.620+0000 7f23597fa640 1 -- 172.21.15.124:0/1369489097 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2350014940 con 0x7f235c112340 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.620+0000 7f236311e640 1 -- 172.21.15.124:0/1369489097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c1ab4b0 con 0x7f235c112340 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.620+0000 7f23597fa640 1 -- 172.21.15.124:0/1369489097 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f2350013400 con 0x7f235c112340 2023-12-16T03:32:22.623 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.620+0000 7f23597fa640 1 -- 172.21.15.124:0/1369489097 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 747+0+0 (crc 0 0 0) 0x7f2350014df0 con 0x7f235c112340 2023-12-16T03:32:22.624 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.620+0000 7f236311e640 1 -- 172.21.15.124:0/1369489097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c1a7810 con 0x7f235c112340 2023-12-16T03:32:22.625 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.623+0000 7f23597fa640 1 -- 172.21.15.124:0/1369489097 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f2350013990 con 0x7f235c112340 2023-12-16T03:32:22.697 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.694+0000 7f236311e640 1 -- 172.21.15.124:0/1369489097 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "45cfaef0-9a15-44c3-a207-62290b65ba02", "id": 0} v 0) v1 -- 0x7f235c112c30 con 0x7f235c112340 2023-12-16T03:32:22.698 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.696+0000 7f23597fa640 1 -- 172.21.15.124:0/1369489097 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45cfaef0-9a15-44c3-a207-62290b65ba02", "id": 0}]=0 v4) v1 ==== 112+0+2 (crc 0 0 0) 0x7f2350013c00 con 0x7f235c112340 2023-12-16T03:32:22.698 INFO:teuthology.orchestra.run.smithi124.stdout:0 2023-12-16T03:32:22.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.697+0000 7f236311e640 1 -- 172.21.15.124:0/1369489097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c112340 msgr2=0x7f235c1a6db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:22.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.697+0000 7f236311e640 1 --2- 172.21.15.124:0/1369489097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c112340 0x7f235c1a6db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.697+0000 7f236311e640 1 -- 172.21.15.124:0/1369489097 shutdown_connections 2023-12-16T03:32:22.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.697+0000 7f236311e640 1 --2- 172.21.15.124:0/1369489097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f235c112340 0x7f235c1a6db0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.697+0000 7f236311e640 1 -- 172.21.15.124:0/1369489097 >> 172.21.15.124:0/1369489097 conn(0x7f235c10dd70 msgr2=0x7f235c113e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:22.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.697+0000 7f236311e640 1 -- 172.21.15.124:0/1369489097 shutdown_connections 2023-12-16T03:32:22.700 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.697+0000 7f236311e640 1 -- 172.21.15.124:0/1369489097 wait complete. 2023-12-16T03:32:22.709 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new ca4e14a7-d942-4820-ad67-37ec19b0f048 1 2023-12-16T03:32:22.721 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.719+0000 7f812a966f00 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-16T03:32:22.795 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.793+0000 7f812a966f00 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-16T03:32:22.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.807+0000 7f0578606640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:22.815 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.813+0000 7f0578606640 1 Processor -- start 2023-12-16T03:32:22.816 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.813+0000 7f0578606640 1 -- start start 2023-12-16T03:32:22.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.813+0000 7f0578606640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0570112360 0x7f057011dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:22.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f0578606640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05701188a0 con 0x7f0570118220 2023-12-16T03:32:22.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f0578606640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0570112770 con 0x7f0570112360 2023-12-16T03:32:22.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f0575ba1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0570112360 0x7f057011dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:22.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f05763a2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0570118220 0x7f0570111c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.124:56220/0 (socket says 172.21.15.124:56220) 2023-12-16T03:32:22.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f05763a2640 1 -- 172.21.15.124:0/1692656424 learned_addr learned my addr 172.21.15.124:0/1692656424 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-12-16T03:32:22.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f05753a0640 1 -- 172.21.15.124:0/1692656424 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039491314 0 0) 0x7f05701188a0 con 0x7f0570118220 2023-12-16T03:32:22.817 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f05753a0640 1 -- 172.21.15.124:0/1692656424 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f055c0034f0 con 0x7f0570118220 2023-12-16T03:32:22.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f0575ba1640 1 -- 172.21.15.124:0/1692656424 >> v1:172.21.15.50:6789/0 conn(0x7f0570118220 legacy=0x7f0570111c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:22.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f0575ba1640 1 -- 172.21.15.124:0/1692656424 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05701128e0 con 0x7f0570112360 2023-12-16T03:32:22.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.814+0000 7f0575ba1640 1 --2- 172.21.15.124:0/1692656424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 0x7f057011dbc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b6dfb08556503f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:22.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f05753a0640 1 -- 172.21.15.124:0/1692656424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f056c009ce0 con 0x7f0570112360 2023-12-16T03:32:22.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f05753a0640 1 -- 172.21.15.124:0/1692656424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f056c009e40 con 0x7f0570112360 2023-12-16T03:32:22.818 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f05753a0640 1 -- 172.21.15.124:0/1692656424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f056c00e360 con 0x7f0570112360 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f0578606640 1 -- 172.21.15.124:0/1692656424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 msgr2=0x7f057011dbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f0578606640 1 --2- 172.21.15.124:0/1692656424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 0x7f057011dbc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f0578606640 1 -- 172.21.15.124:0/1692656424 shutdown_connections 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f0578606640 1 --2- 172.21.15.124:0/1692656424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 0x7f057011dbc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f0578606640 1 -- 172.21.15.124:0/1692656424 >> 172.21.15.124:0/1692656424 conn(0x7f057010dd70 msgr2=0x7f0570110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f0578606640 1 -- 172.21.15.124:0/1692656424 shutdown_connections 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.815+0000 7f0578606640 1 -- 172.21.15.124:0/1692656424 wait complete. 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.816+0000 7f0578606640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.816+0000 7f0578606640 1 Processor -- start 2023-12-16T03:32:22.820 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.816+0000 7f0578606640 1 -- start start 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.816+0000 7f0578606640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 0x7f05701a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.816+0000 7f0578606640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701a72a0 con 0x7f0570112360 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f05763a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 0x7f05701a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f05763a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 0x7f05701a6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.124:59556/0 (socket says 172.21.15.124:59556) 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f05763a2640 1 -- 172.21.15.124:0/2765814930 learned_addr learned my addr 172.21.15.124:0/2765814930 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f05763a2640 1 -- 172.21.15.124:0/2765814930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05701a73e0 con 0x7f0570112360 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f05763a2640 1 --2- 172.21.15.124:0/2765814930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 0x7f05701a6cd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f0566ffd640 1 -- 172.21.15.124:0/2765814930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f05600059d0 con 0x7f0570112360 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f0566ffd640 1 -- 172.21.15.124:0/2765814930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0560005b30 con 0x7f0570112360 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f0578606640 1 -- 172.21.15.124:0/2765814930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05701a7690 con 0x7f0570112360 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f0566ffd640 1 -- 172.21.15.124:0/2765814930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0560005dd0 con 0x7f0570112360 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.817+0000 7f0578606640 1 -- 172.21.15.124:0/2765814930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05701ab560 con 0x7f0570112360 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.818+0000 7f0566ffd640 1 -- 172.21.15.124:0/2765814930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f05600073b0 con 0x7f0570112360 2023-12-16T03:32:22.821 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.818+0000 7f0566ffd640 1 -- 172.21.15.124:0/2765814930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 862+0+0 (crc 0 0 0) 0x7f056000f5f0 con 0x7f0570112360 2023-12-16T03:32:22.822 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.818+0000 7f0578606640 1 -- 172.21.15.124:0/2765814930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05701a7880 con 0x7f0570112360 2023-12-16T03:32:22.823 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.821+0000 7f0566ffd640 1 -- 172.21.15.124:0/2765814930 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f056000c7c0 con 0x7f0570112360 2023-12-16T03:32:22.844 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.841+0000 7f812a966f00 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-16T03:32:22.895 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.892+0000 7f0578606640 1 -- 172.21.15.124:0/2765814930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca4e14a7-d942-4820-ad67-37ec19b0f048", "id": 1} v 0) v1 -- 0x7f0570062350 con 0x7f0570112360 2023-12-16T03:32:22.896 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.893+0000 7f0566ffd640 1 -- 172.21.15.124:0/2765814930 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca4e14a7-d942-4820-ad67-37ec19b0f048", "id": 1}]=0 v5) v1 ==== 112+0+2 (crc 0 0 0) 0x7f056000c960 con 0x7f0570112360 2023-12-16T03:32:22.896 INFO:teuthology.orchestra.run.smithi124.stdout:1 2023-12-16T03:32:22.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.894+0000 7f0578606640 1 -- 172.21.15.124:0/2765814930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 msgr2=0x7f05701a6cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:22.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.894+0000 7f0578606640 1 --2- 172.21.15.124:0/2765814930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 0x7f05701a6cd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.894+0000 7f0578606640 1 -- 172.21.15.124:0/2765814930 shutdown_connections 2023-12-16T03:32:22.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.894+0000 7f0578606640 1 --2- 172.21.15.124:0/2765814930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0570112360 0x7f05701a6cd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:22.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.894+0000 7f0578606640 1 -- 172.21.15.124:0/2765814930 >> 172.21.15.124:0/2765814930 conn(0x7f057010dd70 msgr2=0x7f0570118f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:22.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.894+0000 7f0578606640 1 -- 172.21.15.124:0/2765814930 shutdown_connections 2023-12-16T03:32:22.897 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:22.894+0000 7f0578606640 1 -- 172.21.15.124:0/2765814930 wait complete. 2023-12-16T03:32:22.898 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.895+0000 7f812a966f00 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-16T03:32:22.907 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 88e0fcc1-aa79-4fe7-90e7-b42c73046297 2 2023-12-16T03:32:22.946 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:22.944+0000 7f812a966f00 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-16T03:32:23.052 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.044+0000 7f386bcde640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:23.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.050+0000 7f386bcde640 1 Processor -- start 2023-12-16T03:32:23.053 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.050+0000 7f386bcde640 1 -- start start 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.050+0000 7f386bcde640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3864112510 0x7f386411db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.050+0000 7f386bcde640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3864118800 con 0x7f3864118180 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.050+0000 7f386bcde640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3864112920 con 0x7f3864112510 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3869279640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3864112510 0x7f386411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3869279640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3864112510 0x7f386411db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.124:59558/0 (socket says 172.21.15.124:59558) 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3869279640 1 -- 172.21.15.124:0/1444540829 learned_addr learned my addr 172.21.15.124:0/1444540829 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3869a7a640 1 --1- 172.21.15.124:0/1444540829 >> v1:172.21.15.50:6789/0 conn(0x7f3864118180 0x7f3864111e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.124:56226/0 (socket says 172.21.15.124:56226) 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3869279640 1 -- 172.21.15.124:0/1444540829 >> v1:172.21.15.50:6789/0 conn(0x7f3864118180 legacy=0x7f3864111e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3869279640 1 -- 172.21.15.124:0/1444540829 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3864112a90 con 0x7f3864112510 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3869279640 1 --2- 172.21.15.124:0/1444540829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 0x7f386411db60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced80c6ad8d1bc97 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3868a78640 1 -- 172.21.15.124:0/1444540829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3854009dd0 con 0x7f3864112510 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3868a78640 1 -- 172.21.15.124:0/1444540829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f385400e230 con 0x7f3864112510 2023-12-16T03:32:23.054 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.051+0000 7f3868a78640 1 -- 172.21.15.124:0/1444540829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f385400e4d0 con 0x7f3864112510 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.052+0000 7f386bcde640 1 -- 172.21.15.124:0/1444540829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 msgr2=0x7f386411db60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.052+0000 7f386bcde640 1 --2- 172.21.15.124:0/1444540829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 0x7f386411db60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.052+0000 7f386bcde640 1 -- 172.21.15.124:0/1444540829 shutdown_connections 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.052+0000 7f386bcde640 1 --2- 172.21.15.124:0/1444540829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 0x7f386411db60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.052+0000 7f386bcde640 1 -- 172.21.15.124:0/1444540829 >> 172.21.15.124:0/1444540829 conn(0x7f386410dd70 msgr2=0x7f3864110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.052+0000 7f386bcde640 1 -- 172.21.15.124:0/1444540829 shutdown_connections 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.052+0000 7f386bcde640 1 -- 172.21.15.124:0/1444540829 wait complete. 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.052+0000 7f386bcde640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.053+0000 7f386bcde640 1 Processor -- start 2023-12-16T03:32:23.057 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.053+0000 7f386bcde640 1 -- start start 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.053+0000 7f386bcde640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 0x7f38641a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.053+0000 7f386bcde640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38641a73c0 con 0x7f3864112510 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.053+0000 7f3869a7a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 0x7f38641a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.053+0000 7f3869a7a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 0x7f38641a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.124:59560/0 (socket says 172.21.15.124:59560) 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.053+0000 7f3869a7a640 1 -- 172.21.15.124:0/3433421159 learned_addr learned my addr 172.21.15.124:0/3433421159 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.054+0000 7f3869a7a640 1 -- 172.21.15.124:0/3433421159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38641a7500 con 0x7f3864112510 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.054+0000 7f3869a7a640 1 --2- 172.21.15.124:0/3433421159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 0x7f38641a6df0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.054+0000 7f385a7fc640 1 -- 172.21.15.124:0/3433421159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f38600071e0 con 0x7f3864112510 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.054+0000 7f385a7fc640 1 -- 172.21.15.124:0/3433421159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3860007340 con 0x7f3864112510 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.054+0000 7f386bcde640 1 -- 172.21.15.124:0/3433421159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38641a77b0 con 0x7f3864112510 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.054+0000 7f385a7fc640 1 -- 172.21.15.124:0/3433421159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f38600075e0 con 0x7f3864112510 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.054+0000 7f386bcde640 1 -- 172.21.15.124:0/3433421159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38641ab6f0 con 0x7f3864112510 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.054+0000 7f385a7fc640 1 -- 172.21.15.124:0/3433421159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f3860005ae0 con 0x7f3864112510 2023-12-16T03:32:23.058 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.054+0000 7f385a7fc640 1 -- 172.21.15.124:0/3433421159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 977+0+0 (crc 0 0 0) 0x7f3860005d90 con 0x7f3864112510 2023-12-16T03:32:23.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.055+0000 7f386bcde640 1 -- 172.21.15.124:0/3433421159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38641a79a0 con 0x7f3864112510 2023-12-16T03:32:23.059 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.057+0000 7f385a7fc640 1 -- 172.21.15.124:0/3433421159 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f386000c770 con 0x7f3864112510 2023-12-16T03:32:23.131 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.129+0000 7f386bcde640 1 -- 172.21.15.124:0/3433421159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88e0fcc1-aa79-4fe7-90e7-b42c73046297", "id": 2} v 0) v1 -- 0x7f3864062380 con 0x7f3864112510 2023-12-16T03:32:23.132 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.130+0000 7f385a7fc640 1 -- 172.21.15.124:0/3433421159 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88e0fcc1-aa79-4fe7-90e7-b42c73046297", "id": 2}]=0 v6) v1 ==== 112+0+2 (crc 0 0 0) 0x7f386000c910 con 0x7f3864112510 2023-12-16T03:32:23.132 INFO:teuthology.orchestra.run.smithi124.stdout:2 2023-12-16T03:32:23.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.131+0000 7f386bcde640 1 -- 172.21.15.124:0/3433421159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 msgr2=0x7f38641a6df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:23.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.131+0000 7f386bcde640 1 --2- 172.21.15.124:0/3433421159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 0x7f38641a6df0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.133 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.131+0000 7f386bcde640 1 -- 172.21.15.124:0/3433421159 shutdown_connections 2023-12-16T03:32:23.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.131+0000 7f386bcde640 1 --2- 172.21.15.124:0/3433421159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3864112510 0x7f38641a6df0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.131+0000 7f386bcde640 1 -- 172.21.15.124:0/3433421159 >> 172.21.15.124:0/3433421159 conn(0x7f386410dd70 msgr2=0x7f3864113ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:23.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.131+0000 7f386bcde640 1 -- 172.21.15.124:0/3433421159 shutdown_connections 2023-12-16T03:32:23.134 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.131+0000 7f386bcde640 1 -- 172.21.15.124:0/3433421159 wait complete. 2023-12-16T03:32:23.143 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new c0d220e3-ebc2-4e96-9856-42756a0081f6 3 2023-12-16T03:32:23.249 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.241+0000 7fc2c2d1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:23.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.247+0000 7fc2c2d1e640 1 Processor -- start 2023-12-16T03:32:23.250 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.247+0000 7fc2c2d1e640 1 -- start start 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.247+0000 7fc2c2d1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2bc112510 0x7fc2bc11db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.247+0000 7fc2c2d1e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2bc118800 con 0x7fc2bc118180 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.247+0000 7fc2c2d1e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2bc112920 con 0x7fc2bc112510 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.248+0000 7fc2bbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2bc112510 0x7fc2bc11db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.248+0000 7fc2c0aba640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc2bc118180 0x7fc2bc111e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.124:56242/0 (socket says 172.21.15.124:56242) 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.248+0000 7fc2bbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2bc112510 0x7fc2bc11db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.124:59566/0 (socket says 172.21.15.124:59566) 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.248+0000 7fc2c0aba640 1 -- 172.21.15.124:0/1434651802 learned_addr learned my addr 172.21.15.124:0/1434651802 (peer_addr_for_me v1:172.21.15.124:0/0) 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.248+0000 7fc2bbfff640 1 -- 172.21.15.124:0/1434651802 >> v1:172.21.15.50:6789/0 conn(0x7fc2bc118180 legacy=0x7fc2bc111e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.248+0000 7fc2bbfff640 1 -- 172.21.15.124:0/1434651802 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc112a90 con 0x7fc2bc112510 2023-12-16T03:32:23.251 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.248+0000 7fc2bbfff640 1 --2- 172.21.15.124:0/1434651802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 0x7fc2bc11db60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1b2893859e9a36 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.248+0000 7fc2bb7fe640 1 -- 172.21.15.124:0/1434651802 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc2a8009ce0 con 0x7fc2bc112510 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2bb7fe640 1 -- 172.21.15.124:0/1434651802 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc2a8009e40 con 0x7fc2bc112510 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2bb7fe640 1 -- 172.21.15.124:0/1434651802 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc2a800e360 con 0x7fc2bc112510 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/1434651802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 msgr2=0x7fc2bc11db60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2c2d1e640 1 --2- 172.21.15.124:0/1434651802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 0x7fc2bc11db60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/1434651802 shutdown_connections 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2c2d1e640 1 --2- 172.21.15.124:0/1434651802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 0x7fc2bc11db60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/1434651802 >> 172.21.15.124:0/1434651802 conn(0x7fc2bc10dd70 msgr2=0x7fc2bc110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/1434651802 shutdown_connections 2023-12-16T03:32:23.253 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/1434651802 wait complete. 2023-12-16T03:32:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.249+0000 7fc2c2d1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.250+0000 7fc2c2d1e640 1 Processor -- start 2023-12-16T03:32:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.250+0000 7fc2c2d1e640 1 -- start start 2023-12-16T03:32:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.250+0000 7fc2c2d1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 0x7fc2bc1a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.250+0000 7fc2c2d1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc1a73c0 con 0x7fc2bc112510 2023-12-16T03:32:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2c0aba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 0x7fc2bc1a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2c0aba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 0x7fc2bc1a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.124:59582/0 (socket says 172.21.15.124:59582) 2023-12-16T03:32:23.254 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2c0aba640 1 -- 172.21.15.124:0/2436096685 learned_addr learned my addr 172.21.15.124:0/2436096685 (peer_addr_for_me v2:172.21.15.124:0/0) 2023-12-16T03:32:23.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2c0aba640 1 -- 172.21.15.124:0/2436096685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc1a7500 con 0x7fc2bc112510 2023-12-16T03:32:23.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2c0aba640 1 --2- 172.21.15.124:0/2436096685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 0x7fc2bc1a6df0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:23.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2b97fa640 1 -- 172.21.15.124:0/2436096685 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc2b00059d0 con 0x7fc2bc112510 2023-12-16T03:32:23.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2b97fa640 1 -- 172.21.15.124:0/2436096685 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc2b0005b30 con 0x7fc2bc112510 2023-12-16T03:32:23.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/2436096685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2bc1a77b0 con 0x7fc2bc112510 2023-12-16T03:32:23.255 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2b97fa640 1 -- 172.21.15.124:0/2436096685 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc2b0005dd0 con 0x7fc2bc112510 2023-12-16T03:32:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.251+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/2436096685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2bc1ab6f0 con 0x7fc2bc112510 2023-12-16T03:32:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.252+0000 7fc2b97fa640 1 -- 172.21.15.124:0/2436096685 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7fc2b00073b0 con 0x7fc2bc112510 2023-12-16T03:32:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.252+0000 7fc2b97fa640 1 -- 172.21.15.124:0/2436096685 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1092+0+0 (crc 0 0 0) 0x7fc2b000f6e0 con 0x7fc2bc112510 2023-12-16T03:32:23.256 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.252+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/2436096685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2bc1a79a0 con 0x7fc2bc112510 2023-12-16T03:32:23.257 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.255+0000 7fc2b97fa640 1 -- 172.21.15.124:0/2436096685 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7fc2bc1a79a0 con 0x7fc2bc112510 2023-12-16T03:32:23.329 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.327+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/2436096685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0d220e3-ebc2-4e96-9856-42756a0081f6", "id": 3} v 0) v1 -- 0x7fc2bc1ac160 con 0x7fc2bc112510 2023-12-16T03:32:23.330 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.328+0000 7fc2b97fa640 1 -- 172.21.15.124:0/2436096685 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0d220e3-ebc2-4e96-9856-42756a0081f6", "id": 3}]=0 v7) v1 ==== 112+0+2 (crc 0 0 0) 0x7fc2b000f300 con 0x7fc2bc112510 2023-12-16T03:32:23.330 INFO:teuthology.orchestra.run.smithi124.stdout:3 2023-12-16T03:32:23.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.329+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/2436096685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 msgr2=0x7fc2bc1a6df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:23.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.329+0000 7fc2c2d1e640 1 --2- 172.21.15.124:0/2436096685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 0x7fc2bc1a6df0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.331 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.329+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/2436096685 shutdown_connections 2023-12-16T03:32:23.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.329+0000 7fc2c2d1e640 1 --2- 172.21.15.124:0/2436096685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2bc112510 0x7fc2bc1a6df0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.329+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/2436096685 >> 172.21.15.124:0/2436096685 conn(0x7fc2bc10dd70 msgr2=0x7fc2bc113ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:23.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.329+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/2436096685 shutdown_connections 2023-12-16T03:32:23.332 INFO:teuthology.orchestra.run.smithi124.stderr:2023-12-16T03:32:23.329+0000 7fc2c2d1e640 1 -- 172.21.15.124:0/2436096685 wait complete. 2023-12-16T03:32:23.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2023-12-16T03:32:23.351 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:23.349+0000 7f812a966f00 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-16T03:32:23.384 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-16T03:32:23.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2023-12-16T03:32:23.428 INFO:tasks.ceph.osd.0:Started 2023-12-16T03:32:23.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2023-12-16T03:32:23.468 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-16T03:32:23.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2023-12-16T03:32:23.476 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:23.474+0000 7f812a966f00 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-16T03:32:23.510 INFO:tasks.ceph.osd.1:Started 2023-12-16T03:32:23.511 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2023-12-16T03:32:23.542 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-16T03:32:23.543 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2023-12-16T03:32:23.584 INFO:tasks.ceph.osd.2:Started 2023-12-16T03:32:23.585 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2023-12-16T03:32:23.586 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:23.584+0000 7f812a966f00 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-16T03:32:23.616 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-16T03:32:23.616 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2023-12-16T03:32:23.635 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:23.633+0000 7f812a966f00 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-16T03:32:23.637 INFO:tasks.ceph.osd.3:Started 2023-12-16T03:32:23.637 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:32:23.747 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:23.745+0000 7f812a966f00 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-16T03:32:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.760+0000 7ffaba06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.766+0000 7ffaba06d640 1 Processor -- start 2023-12-16T03:32:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.766+0000 7ffaba06d640 1 -- start start 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.766+0000 7ffaba06d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffab40a1040 0x7ffab4132f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.767+0000 7ffaba06d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab40a1870 con 0x7ffab41334c0 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.767+0000 7ffaba06d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab409cb90 con 0x7ffab40a1040 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.767+0000 7ffab37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffab40a1040 0x7ffab4132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.767+0000 7ffab2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffab41334c0 0x7ffab41382c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39772/0 (socket says 172.21.15.50:39772) 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.767+0000 7ffab2ffd640 1 -- 172.21.15.50:0/1729735088 learned_addr learned my addr 172.21.15.50:0/1729735088 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.767+0000 7ffab37fe640 1 -- 172.21.15.50:0/1729735088 >> v1:172.21.15.50:6789/0 conn(0x7ffab41334c0 legacy=0x7ffab41382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.767+0000 7ffab37fe640 1 -- 172.21.15.50:0/1729735088 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab41300a0 con 0x7ffab40a1040 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.767+0000 7ffab37fe640 1 --2- 172.21.15.50:0/1729735088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 0x7ffab4132f80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcd12f079f9efc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.767+0000 7ffab27fc640 1 -- 172.21.15.50:0/1729735088 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffaa4009ce0 con 0x7ffab40a1040 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.768+0000 7ffab27fc640 1 -- 172.21.15.50:0/1729735088 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffaa4009e40 con 0x7ffab40a1040 2023-12-16T03:32:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.768+0000 7ffab27fc640 1 -- 172.21.15.50:0/1729735088 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffaa400e360 con 0x7ffab40a1040 2023-12-16T03:32:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.769+0000 7ffaba06d640 1 -- 172.21.15.50:0/1729735088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 msgr2=0x7ffab4132f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.769+0000 7ffaba06d640 1 --2- 172.21.15.50:0/1729735088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 0x7ffab4132f80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.769+0000 7ffaba06d640 1 -- 172.21.15.50:0/1729735088 shutdown_connections 2023-12-16T03:32:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.769+0000 7ffaba06d640 1 --2- 172.21.15.50:0/1729735088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 0x7ffab4132f80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.769+0000 7ffaba06d640 1 -- 172.21.15.50:0/1729735088 >> 172.21.15.50:0/1729735088 conn(0x7ffab406c9c0 msgr2=0x7ffab406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.769+0000 7ffaba06d640 1 -- 172.21.15.50:0/1729735088 shutdown_connections 2023-12-16T03:32:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.769+0000 7ffaba06d640 1 -- 172.21.15.50:0/1729735088 wait complete. 2023-12-16T03:32:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.770+0000 7ffaba06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.771+0000 7ffaba06d640 1 Processor -- start 2023-12-16T03:32:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.772+0000 7ffaba06d640 1 -- start start 2023-12-16T03:32:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.773+0000 7ffaba06d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 0x7ffab41c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.773+0000 7ffaba06d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab411da60 con 0x7ffab40a1040 2023-12-16T03:32:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.773+0000 7ffab37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 0x7ffab41c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.773+0000 7ffab37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 0x7ffab41c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55804/0 (socket says 172.21.15.50:55804) 2023-12-16T03:32:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.773+0000 7ffab37fe640 1 -- 172.21.15.50:0/1201054884 learned_addr learned my addr 172.21.15.50:0/1201054884 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.774+0000 7ffab37fe640 1 -- 172.21.15.50:0/1201054884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab411e4d0 con 0x7ffab40a1040 2023-12-16T03:32:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.774+0000 7ffab37fe640 1 --2- 172.21.15.50:0/1201054884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 0x7ffab41c8320 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.774+0000 7ffa9bfff640 1 -- 172.21.15.50:0/1201054884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffaa4014620 con 0x7ffab40a1040 2023-12-16T03:32:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.774+0000 7ffa9bfff640 1 -- 172.21.15.50:0/1201054884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffaa4014780 con 0x7ffab40a1040 2023-12-16T03:32:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.774+0000 7ffaba06d640 1 -- 172.21.15.50:0/1201054884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab411c310 con 0x7ffab40a1040 2023-12-16T03:32:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.774+0000 7ffa9bfff640 1 -- 172.21.15.50:0/1201054884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffaa4014a20 con 0x7ffab40a1040 2023-12-16T03:32:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.774+0000 7ffaba06d640 1 -- 172.21.15.50:0/1201054884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab411bfb0 con 0x7ffab40a1040 2023-12-16T03:32:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.774+0000 7ffa9bfff640 1 -- 172.21.15.50:0/1201054884 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7ffaa4011380 con 0x7ffab40a1040 2023-12-16T03:32:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.774+0000 7ffa9bfff640 1 -- 172.21.15.50:0/1201054884 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7ffaa4019040 con 0x7ffab40a1040 2023-12-16T03:32:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.775+0000 7ffaba06d640 1 -- 172.21.15.50:0/1201054884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab4067c60 con 0x7ffab40a1040 2023-12-16T03:32:23.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.778+0000 7ffa9bfff640 1 -- 172.21.15.50:0/1201054884 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7ffaa40103b0 con 0x7ffab40a1040 2023-12-16T03:32:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.841+0000 7ffaba06d640 1 -- 172.21.15.50:0/1201054884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffab4062350 con 0x7ffab40a1040 2023-12-16T03:32:23.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.841+0000 7ffa9bfff640 1 -- 172.21.15.50:0/1201054884 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7ffaa4010600 con 0x7ffab40a1040 2023-12-16T03:32:23.844 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:32:23.844 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"fsid":"729b4ed4-c01a-4cd4-b8de-ed230cc4e269","created":"2023-12-16T03:32:21.212434+0000","modified":"2023-12-16T03:32:23.328457+0000","last_up_change":"0.000000","last_in_change":"2023-12-16T03:32:23.328457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"45cfaef0-9a15-44c3-a207-62290b65ba02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca4e14a7-d942-4820-ad67-37ec19b0f048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"88e0fcc1-aa79-4fe7-90e7-b42c73046297","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0d220e3-ebc2-4e96-9856-42756a0081f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:32:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.842+0000 7ffaba06d640 1 -- 172.21.15.50:0/1201054884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 msgr2=0x7ffab41c8320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.842+0000 7ffaba06d640 1 --2- 172.21.15.50:0/1201054884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 0x7ffab41c8320 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.842+0000 7ffaba06d640 1 -- 172.21.15.50:0/1201054884 shutdown_connections 2023-12-16T03:32:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.842+0000 7ffaba06d640 1 --2- 172.21.15.50:0/1201054884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab40a1040 0x7ffab41c8320 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.842+0000 7ffaba06d640 1 -- 172.21.15.50:0/1201054884 >> 172.21.15.50:0/1201054884 conn(0x7ffab406c9c0 msgr2=0x7ffab409e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.842+0000 7ffaba06d640 1 -- 172.21.15.50:0/1201054884 shutdown_connections 2023-12-16T03:32:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:23.842+0000 7ffaba06d640 1 -- 172.21.15.50:0/1201054884 wait complete. 2023-12-16T03:32:23.857 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-16T03:32:23.857 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-16T03:32:23.860 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:23.857+0000 7f812a966f00 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-16T03:32:24.021 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:24.018+0000 7f812a966f00 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-16T03:32:24.068 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:24.066+0000 7f812a966f00 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-16T03:32:24.218 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:24.216+0000 7f812a966f00 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-16T03:32:24.260 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-16T03:32:24.361 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.355+0000 7f8c6671e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:24.361 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.359+0000 7f8c6671e640 1 Processor -- start 2023-12-16T03:32:24.362 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.360+0000 7f8c6671e640 1 -- start start 2023-12-16T03:32:24.363 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.360+0000 7f8c6671e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c6009ff20 0x7f8c600a0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:24.363 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.360+0000 7f8c6671e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6009d400 con 0x7f8c600a0870 2023-12-16T03:32:24.363 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.360+0000 7f8c6671e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6009f6f0 con 0x7f8c6009ff20 2023-12-16T03:32:24.363 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.360+0000 7f8c5ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c6009ff20 0x7f8c600a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:24.363 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.360+0000 7f8c5f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c600a0870 0x7f8c60137a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39784/0 (socket says 172.21.15.50:39784) 2023-12-16T03:32:24.363 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.360+0000 7f8c5f7fe640 1 -- 172.21.15.50:0/1013976189 learned_addr learned my addr 172.21.15.50:0/1013976189 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:24.363 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.361+0000 7f8c5ffff640 1 -- 172.21.15.50:0/1013976189 >> v1:172.21.15.50:6789/0 conn(0x7f8c600a0870 legacy=0x7f8c60137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:24.363 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.361+0000 7f8c5ffff640 1 -- 172.21.15.50:0/1013976189 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c600a1380 con 0x7f8c6009ff20 2023-12-16T03:32:24.363 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.361+0000 7f8c5ffff640 1 --2- 172.21.15.50:0/1013976189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 0x7f8c600a0330 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c2a96d64fbc30b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.361+0000 7f8c5effd640 1 -- 172.21.15.50:0/1013976189 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8c50009ce0 con 0x7f8c6009ff20 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.361+0000 7f8c5effd640 1 -- 172.21.15.50:0/1013976189 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8c50009e40 con 0x7f8c6009ff20 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.361+0000 7f8c5effd640 1 -- 172.21.15.50:0/1013976189 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8c5000e360 con 0x7f8c6009ff20 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.362+0000 7f8c6671e640 1 -- 172.21.15.50:0/1013976189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 msgr2=0x7f8c600a0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.362+0000 7f8c6671e640 1 --2- 172.21.15.50:0/1013976189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 0x7f8c600a0330 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.362+0000 7f8c6671e640 1 -- 172.21.15.50:0/1013976189 shutdown_connections 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.362+0000 7f8c6671e640 1 --2- 172.21.15.50:0/1013976189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 0x7f8c600a0330 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.362+0000 7f8c6671e640 1 -- 172.21.15.50:0/1013976189 >> 172.21.15.50:0/1013976189 conn(0x7f8c600a2280 msgr2=0x7f8c600a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.362+0000 7f8c6671e640 1 -- 172.21.15.50:0/1013976189 shutdown_connections 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.362+0000 7f8c6671e640 1 -- 172.21.15.50:0/1013976189 wait complete. 2023-12-16T03:32:24.365 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.362+0000 7f8c6671e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:24.366 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.363+0000 7f8c6671e640 1 Processor -- start 2023-12-16T03:32:24.366 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.364+0000 7f8c6671e640 1 -- start start 2023-12-16T03:32:24.367 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.364+0000 7f8c6671e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 0x7f8c601ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:24.367 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.364+0000 7f8c6671e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601a94a0 con 0x7f8c6009ff20 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.364+0000 7f8c5ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 0x7f8c601ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.364+0000 7f8c5ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 0x7f8c601ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55822/0 (socket says 172.21.15.50:55822) 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.364+0000 7f8c5ffff640 1 -- 172.21.15.50:0/497854537 learned_addr learned my addr 172.21.15.50:0/497854537 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.365+0000 7f8c5ffff640 1 -- 172.21.15.50:0/497854537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c601c4a30 con 0x7f8c6009ff20 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.365+0000 7f8c5ffff640 1 --2- 172.21.15.50:0/497854537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 0x7f8c601ab960 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.365+0000 7f8c5cff9640 1 -- 172.21.15.50:0/497854537 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8c50014620 con 0x7f8c6009ff20 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.365+0000 7f8c5cff9640 1 -- 172.21.15.50:0/497854537 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8c50014780 con 0x7f8c6009ff20 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.365+0000 7f8c6671e640 1 -- 172.21.15.50:0/497854537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c601a9b90 con 0x7f8c6009ff20 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.365+0000 7f8c5cff9640 1 -- 172.21.15.50:0/497854537 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8c50014a20 con 0x7f8c6009ff20 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.365+0000 7f8c6671e640 1 -- 172.21.15.50:0/497854537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c601ac080 con 0x7f8c6009ff20 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.365+0000 7f8c5cff9640 1 -- 172.21.15.50:0/497854537 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f8c50011380 con 0x7f8c6009ff20 2023-12-16T03:32:24.368 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.365+0000 7f8c5cff9640 1 -- 172.21.15.50:0/497854537 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7f8c50019040 con 0x7f8c6009ff20 2023-12-16T03:32:24.369 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.366+0000 7f8c6671e640 1 -- 172.21.15.50:0/497854537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60062350 con 0x7f8c6009ff20 2023-12-16T03:32:24.370 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.368+0000 7f8c5cff9640 1 -- 172.21.15.50:0/497854537 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f8c500103b0 con 0x7f8c6009ff20 2023-12-16T03:32:24.433 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.430+0000 7f8c6671e640 1 -- 172.21.15.50:0/497854537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c60066fc0 con 0x7f8c6009ff20 2023-12-16T03:32:24.433 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.431+0000 7f8c5cff9640 1 -- 172.21.15.50:0/497854537 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7f8c50010600 con 0x7f8c6009ff20 2023-12-16T03:32:24.433 INFO:teuthology.misc.health.smithi050.stdout: 2023-12-16T03:32:24.434 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":7,"fsid":"729b4ed4-c01a-4cd4-b8de-ed230cc4e269","created":"2023-12-16T03:32:21.212434+0000","modified":"2023-12-16T03:32:23.328457+0000","last_up_change":"0.000000","last_in_change":"2023-12-16T03:32:23.328457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"45cfaef0-9a15-44c3-a207-62290b65ba02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca4e14a7-d942-4820-ad67-37ec19b0f048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"88e0fcc1-aa79-4fe7-90e7-b42c73046297","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0d220e3-ebc2-4e96-9856-42756a0081f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:32:24.434 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.432+0000 7f8c6671e640 1 -- 172.21.15.50:0/497854537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 msgr2=0x7f8c601ab960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:24.434 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.432+0000 7f8c6671e640 1 --2- 172.21.15.50:0/497854537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 0x7f8c601ab960 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:24.435 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.432+0000 7f8c6671e640 1 -- 172.21.15.50:0/497854537 shutdown_connections 2023-12-16T03:32:24.435 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.432+0000 7f8c6671e640 1 --2- 172.21.15.50:0/497854537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c6009ff20 0x7f8c601ab960 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:24.435 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.432+0000 7f8c6671e640 1 -- 172.21.15.50:0/497854537 >> 172.21.15.50:0/497854537 conn(0x7f8c600a2280 msgr2=0x7f8c6009a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:24.435 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.432+0000 7f8c6671e640 1 -- 172.21.15.50:0/497854537 shutdown_connections 2023-12-16T03:32:24.435 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:24.432+0000 7f8c6671e640 1 -- 172.21.15.50:0/497854537 wait complete. 2023-12-16T03:32:24.444 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-12-16T03:32:25.079 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:25.077+0000 7f812a966f00 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-16T03:32:25.372 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:25.369+0000 7f812a966f00 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-16T03:32:25.428 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:25.426+0000 7f812a966f00 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-16T03:32:25.541 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:25.538+0000 7f812a966f00 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-16T03:32:26.562 INFO:tasks.ceph.mgr.x.smithi124.stderr:2023-12-16T03:32:26.559+0000 7f80ca5c2640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-12-16T03:32:30.848 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-16T03:32:30.954 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.948+0000 7f6df319e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:30.955 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.952+0000 7f6df319e640 1 Processor -- start 2023-12-16T03:32:30.955 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.952+0000 7f6df319e640 1 -- start start 2023-12-16T03:32:30.957 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.952+0000 7f6df319e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6dec09a160 0x7f6dec09a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:30.957 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.952+0000 7f6df319e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec06e920 con 0x7f6dec097110 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.952+0000 7f6df319e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec06d870 con 0x7f6dec09a160 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6df0f3a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6dec09a160 0x7f6dec09a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6debfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6dec097110 0x7f6dec097520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50756/0 (socket says 172.21.15.50:50756) 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6debfff640 1 -- 172.21.15.50:0/3967267525 learned_addr learned my addr 172.21.15.50:0/3967267525 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6df0f3a640 1 --2- 172.21.15.50:0/3967267525 >> v2:172.21.15.50:3300/0 conn(0x7f6dec09a160 0x7f6dec09a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40942/0 (socket says 172.21.15.50:40942) 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6df0f3a640 1 -- 172.21.15.50:0/3967267525 >> v1:172.21.15.50:6789/0 conn(0x7f6dec097110 legacy=0x7f6dec097520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6df0f3a640 1 -- 172.21.15.50:0/3967267525 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec09ade0 con 0x7f6dec09a160 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6df0f3a640 1 --2- 172.21.15.50:0/3967267525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec09a160 0x7f6dec09a570 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5a99c32ee2fff1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6deb7fe640 1 -- 172.21.15.50:0/3967267525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6ddc009ce0 con 0x7f6dec09a160 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6deb7fe640 1 -- 172.21.15.50:0/3967267525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6ddc009e40 con 0x7f6dec09a160 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.953+0000 7f6deb7fe640 1 -- 172.21.15.50:0/3967267525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6ddc00e360 con 0x7f6dec09a160 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.954+0000 7f6df319e640 1 -- 172.21.15.50:0/3967267525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec09a160 msgr2=0x7f6dec09a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:30.958 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.954+0000 7f6df319e640 1 --2- 172.21.15.50:0/3967267525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec09a160 0x7f6dec09a570 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:30.959 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.954+0000 7f6df319e640 1 -- 172.21.15.50:0/3967267525 shutdown_connections 2023-12-16T03:32:30.959 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.954+0000 7f6df319e640 1 --2- 172.21.15.50:0/3967267525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec09a160 0x7f6dec09a570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:30.959 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.954+0000 7f6df319e640 1 -- 172.21.15.50:0/3967267525 >> 172.21.15.50:0/3967267525 conn(0x7f6dec09ed30 msgr2=0x7f6dec09f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:30.959 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.954+0000 7f6df319e640 1 -- 172.21.15.50:0/3967267525 shutdown_connections 2023-12-16T03:32:30.959 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.954+0000 7f6df319e640 1 -- 172.21.15.50:0/3967267525 wait complete. 2023-12-16T03:32:30.959 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.954+0000 7f6df319e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:30.960 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.955+0000 7f6df319e640 1 Processor -- start 2023-12-16T03:32:30.960 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.955+0000 7f6df319e640 1 -- start start 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.956+0000 7f6df319e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec097110 0x7f6dec129f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.956+0000 7f6df319e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec12d070 con 0x7f6dec097110 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.956+0000 7f6df0f3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec097110 0x7f6dec129f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.956+0000 7f6df0f3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec097110 0x7f6dec129f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40954/0 (socket says 172.21.15.50:40954) 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.956+0000 7f6df0f3a640 1 -- 172.21.15.50:0/1374160470 learned_addr learned my addr 172.21.15.50:0/1374160470 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.957+0000 7f6df0f3a640 1 -- 172.21.15.50:0/1374160470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec12c180 con 0x7f6dec097110 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.957+0000 7f6df0f3a640 1 --2- 172.21.15.50:0/1374160470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec097110 0x7f6dec129f00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.957+0000 7f6de97fa640 1 -- 172.21.15.50:0/1374160470 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6ddc014620 con 0x7f6dec097110 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.957+0000 7f6de97fa640 1 -- 172.21.15.50:0/1374160470 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6ddc014780 con 0x7f6dec097110 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.957+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec12c370 con 0x7f6dec097110 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.957+0000 7f6de97fa640 1 -- 172.21.15.50:0/1374160470 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6ddc014a20 con 0x7f6dec097110 2023-12-16T03:32:30.961 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.957+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec12bb20 con 0x7f6dec097110 2023-12-16T03:32:30.962 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.958+0000 7f6de97fa640 1 -- 172.21.15.50:0/1374160470 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 44801+0+0 (crc 0 0 0) 0x7f6ddc014b80 con 0x7f6dec097110 2023-12-16T03:32:30.962 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.958+0000 7f6de97fa640 1 --2- 172.21.15.50:0/1374160470 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6dcc037780 0x7f6dcc039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:30.962 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.958+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dec12db90 con 0x7f6dec097110 2023-12-16T03:32:30.962 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.958+0000 7f6de97fa640 1 -- 172.21.15.50:0/1374160470 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f6ddc019040 con 0x7f6dec097110 2023-12-16T03:32:30.963 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.958+0000 7f6debfff640 1 --2- 172.21.15.50:0/1374160470 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6dcc037780 0x7f6dcc039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:30.963 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.959+0000 7f6debfff640 1 --2- 172.21.15.50:0/1374160470 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6dcc037780 0x7f6dcc039c90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:30.966 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:30.964+0000 7f6de97fa640 1 -- 172.21.15.50:0/1374160470 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f6dec12db90 con 0x7f6dec097110 2023-12-16T03:32:31.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.148+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6dec12db90 con 0x7f6dec097110 2023-12-16T03:32:31.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.148+0000 7f6de97fa640 1 -- 172.21.15.50:0/1374160470 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+6897 (crc 0 0 0) 0x7f6dec12db90 con 0x7f6dec097110 2023-12-16T03:32:31.152 INFO:teuthology.misc.health.smithi050.stdout: 2023-12-16T03:32:31.152 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":11,"fsid":"729b4ed4-c01a-4cd4-b8de-ed230cc4e269","created":"2023-12-16T03:32:21.212434+0000","modified":"2023-12-16T03:32:30.668027+0000","last_up_change":"2023-12-16T03:32:27.595846+0000","last_in_change":"2023-12-16T03:32:23.328457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:32:29.613500+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45cfaef0-9a15-44c3-a207-62290b65ba02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6801","nonce":2523453502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2523453502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":2523453502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2523453502}]},"public_addr":"172.21.15.50:6801/2523453502","cluster_addr":"172.21.15.50:6800/2523453502","heartbeat_back_addr":"172.21.15.50:6805/2523453502","heartbeat_front_addr":"172.21.15.50:6804/2523453502","state":["exists","up"]},{"osd":1,"uuid":"ca4e14a7-d942-4820-ad67-37ec19b0f048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":3140644339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3140644339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3140644339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":3140644339}]},"public_addr":"172.21.15.50:6803/3140644339","cluster_addr":"172.21.15.50:6802/3140644339","heartbeat_back_addr":"172.21.15.50:6806/3140644339","heartbeat_front_addr":"172.21.15.50:6807/3140644339","state":["exists","up"]},{"osd":2,"uuid":"88e0fcc1-aa79-4fe7-90e7-b42c73046297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":551945054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6803","nonce":551945054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":551945054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":551945054}]},"public_addr":"172.21.15.124:6802/551945054","cluster_addr":"172.21.15.124:6803/551945054","heartbeat_back_addr":"172.21.15.124:6806/551945054","heartbeat_front_addr":"172.21.15.124:6807/551945054","state":["exists","up"]},{"osd":3,"uuid":"c0d220e3-ebc2-4e96-9856-42756a0081f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":556257497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":556257497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":556257497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":556257497}]},"public_addr":"172.21.15.124:6804/556257497","cluster_addr":"172.21.15.124:6805/556257497","heartbeat_back_addr":"172.21.15.124:6809/556257497","heartbeat_front_addr":"172.21.15.124:6808/556257497","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:32:31.153 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6dcc037780 msgr2=0x7f6dcc039c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:31.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 --2- 172.21.15.50:0/1374160470 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6dcc037780 0x7f6dcc039c90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec097110 msgr2=0x7f6dec129f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:31.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 --2- 172.21.15.50:0/1374160470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec097110 0x7f6dec129f00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 shutdown_connections 2023-12-16T03:32:31.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 --2- 172.21.15.50:0/1374160470 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6dcc037780 0x7f6dcc039c90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 --2- 172.21.15.50:0/1374160470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dec097110 0x7f6dec129f00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 >> 172.21.15.50:0/1374160470 conn(0x7f6dec09ed30 msgr2=0x7f6dec1b8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:31.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 shutdown_connections 2023-12-16T03:32:31.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-16T03:32:31.150+0000 7f6df319e640 1 -- 172.21.15.50:0/1374160470 wait complete. 2023-12-16T03:32:31.163 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-12-16T03:32:31.163 INFO:tasks.ceph:Creating RBD pool 2023-12-16T03:32:31.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-16T03:32:31.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.265+0000 7f78b646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:31.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.273+0000 7f78b646d640 1 Processor -- start 2023-12-16T03:32:31.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.273+0000 7f78b646d640 1 -- start start 2023-12-16T03:32:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.273+0000 7f78b646d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78b0133590 0x7f78b01359b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.273+0000 7f78b646d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b0072920 con 0x7f78b009a480 2023-12-16T03:32:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.273+0000 7f78b646d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b00a0e40 con 0x7f78b0133590 2023-12-16T03:32:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.274+0000 7f78af7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78b0133590 0x7f78b01359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.274+0000 7f78affff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f78b009a480 0x7f78b009a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50766/0 (socket says 172.21.15.50:50766) 2023-12-16T03:32:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.274+0000 7f78affff640 1 -- 172.21.15.50:0/2837700504 learned_addr learned my addr 172.21.15.50:0/2837700504 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.274+0000 7f78af7fe640 1 -- 172.21.15.50:0/2837700504 >> v1:172.21.15.50:6789/0 conn(0x7f78b009a480 legacy=0x7f78b009a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.274+0000 7f78af7fe640 1 -- 172.21.15.50:0/2837700504 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00a0b30 con 0x7f78b0133590 2023-12-16T03:32:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.274+0000 7f78af7fe640 1 --2- 172.21.15.50:0/2837700504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b0133590 0x7f78b01359b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336504000c3fe004 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.402+0000 7f78aeffd640 1 -- 172.21.15.50:0/2837700504 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f78a4009ce0 con 0x7f78b0133590 2023-12-16T03:32:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.402+0000 7f78aeffd640 1 -- 172.21.15.50:0/2837700504 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f78a4009e40 con 0x7f78b0133590 2023-12-16T03:32:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.402+0000 7f78aeffd640 1 -- 172.21.15.50:0/2837700504 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f78a400e360 con 0x7f78b0133590 2023-12-16T03:32:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.402+0000 7f78b646d640 1 -- 172.21.15.50:0/2837700504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b0133590 msgr2=0x7f78b01359b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.402+0000 7f78b646d640 1 --2- 172.21.15.50:0/2837700504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b0133590 0x7f78b01359b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.403+0000 7f78b646d640 1 -- 172.21.15.50:0/2837700504 shutdown_connections 2023-12-16T03:32:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.403+0000 7f78b646d640 1 --2- 172.21.15.50:0/2837700504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b0133590 0x7f78b01359b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.403+0000 7f78b646d640 1 -- 172.21.15.50:0/2837700504 >> 172.21.15.50:0/2837700504 conn(0x7f78b009ee80 msgr2=0x7f78b009f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.403+0000 7f78b646d640 1 -- 172.21.15.50:0/2837700504 shutdown_connections 2023-12-16T03:32:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.403+0000 7f78b646d640 1 -- 172.21.15.50:0/2837700504 wait complete. 2023-12-16T03:32:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.403+0000 7f78b646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.404+0000 7f78b646d640 1 Processor -- start 2023-12-16T03:32:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.404+0000 7f78b646d640 1 -- start start 2023-12-16T03:32:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78b646d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b009a480 0x7f78b012fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78b646d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b009b4f0 con 0x7f78b009a480 2023-12-16T03:32:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b009a480 0x7f78b012fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78affff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b009a480 0x7f78b012fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40974/0 (socket says 172.21.15.50:40974) 2023-12-16T03:32:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78affff640 1 -- 172.21.15.50:0/84726112 learned_addr learned my addr 172.21.15.50:0/84726112 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78affff640 1 -- 172.21.15.50:0/84726112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0099240 con 0x7f78b009a480 2023-12-16T03:32:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78affff640 1 --2- 172.21.15.50:0/84726112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b009a480 0x7f78b012fba0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78acff9640 1 -- 172.21.15.50:0/84726112 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f78a00059d0 con 0x7f78b009a480 2023-12-16T03:32:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78acff9640 1 -- 172.21.15.50:0/84726112 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f78a0005b30 con 0x7f78b009a480 2023-12-16T03:32:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b0098f50 con 0x7f78b009a480 2023-12-16T03:32:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78acff9640 1 -- 172.21.15.50:0/84726112 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f78a0005dd0 con 0x7f78b009a480 2023-12-16T03:32:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.405+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b012af10 con 0x7f78b009a480 2023-12-16T03:32:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.406+0000 7f78acff9640 1 -- 172.21.15.50:0/84726112 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 44801+0+0 (crc 0 0 0) 0x7f78a00070b0 con 0x7f78b009a480 2023-12-16T03:32:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.407+0000 7f78acff9640 1 --2- 172.21.15.50:0/84726112 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f789c037780 0x7f789c039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.407+0000 7f78acff9640 1 -- 172.21.15.50:0/84726112 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f78a00469a0 con 0x7f78b009a480 2023-12-16T03:32:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.407+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b012ad70 con 0x7f78b009a480 2023-12-16T03:32:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.407+0000 7f78af7fe640 1 --2- 172.21.15.50:0/84726112 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f789c037780 0x7f789c039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.407+0000 7f78af7fe640 1 --2- 172.21.15.50:0/84726112 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f789c037780 0x7f789c039c90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.412+0000 7f78acff9640 1 -- 172.21.15.50:0/84726112 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f78b012ad70 con 0x7f78b009a480 2023-12-16T03:32:31.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.599+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f78b012ad70 con 0x7f78b009a480 2023-12-16T03:32:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.671+0000 7f78acff9640 1 -- 172.21.15.50:0/84726112 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) v1 ==== 109+0+0 (crc 0 0 0) 0x7f78b012ad70 con 0x7f78b009a480 2023-12-16T03:32:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'rbd' created 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f789c037780 msgr2=0x7f789c039c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 --2- 172.21.15.50:0/84726112 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f789c037780 0x7f789c039c90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b009a480 msgr2=0x7f78b012fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 --2- 172.21.15.50:0/84726112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b009a480 0x7f78b012fba0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 shutdown_connections 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 --2- 172.21.15.50:0/84726112 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f789c037780 0x7f789c039c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 --2- 172.21.15.50:0/84726112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b009a480 0x7f78b012fba0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 >> 172.21.15.50:0/84726112 conn(0x7f78b009ee80 msgr2=0x7f78b009b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 shutdown_connections 2023-12-16T03:32:31.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.673+0000 7f78b646d640 1 -- 172.21.15.50:0/84726112 wait complete. 2023-12-16T03:32:31.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-16T03:32:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.795+0000 7f929ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.805+0000 7f929ad11640 1 Processor -- start 2023-12-16T03:32:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.805+0000 7f929ad11640 1 -- start start 2023-12-16T03:32:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.805+0000 7f929ad11640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9294136220 0x7f9294138640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.805+0000 7f929ad11640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929412fa10 con 0x7f929412ff50 2023-12-16T03:32:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.805+0000 7f929ad11640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929409c780 con 0x7f9294136220 2023-12-16T03:32:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.805+0000 7f9293fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9294136220 0x7f9294138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.805+0000 7f9298aad640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f929412ff50 0x7f9294130360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50770/0 (socket says 172.21.15.50:50770) 2023-12-16T03:32:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.805+0000 7f9298aad640 1 -- 172.21.15.50:0/4042251560 learned_addr learned my addr 172.21.15.50:0/4042251560 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.806+0000 7f9293fff640 1 -- 172.21.15.50:0/4042251560 >> v1:172.21.15.50:6789/0 conn(0x7f929412ff50 legacy=0x7f9294130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.806+0000 7f9293fff640 1 -- 172.21.15.50:0/4042251560 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929412fc40 con 0x7f9294136220 2023-12-16T03:32:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.806+0000 7f9293fff640 1 --2- 172.21.15.50:0/4042251560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9294136220 0x7f9294138640 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c6b92c3235b084 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.806+0000 7f92937fe640 1 -- 172.21.15.50:0/4042251560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9280009ce0 con 0x7f9294136220 2023-12-16T03:32:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.806+0000 7f92937fe640 1 -- 172.21.15.50:0/4042251560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9280009e40 con 0x7f9294136220 2023-12-16T03:32:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.806+0000 7f92937fe640 1 -- 172.21.15.50:0/4042251560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f928000e360 con 0x7f9294136220 2023-12-16T03:32:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.807+0000 7f929ad11640 1 -- 172.21.15.50:0/4042251560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9294136220 msgr2=0x7f9294138640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.807+0000 7f929ad11640 1 --2- 172.21.15.50:0/4042251560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9294136220 0x7f9294138640 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.807+0000 7f929ad11640 1 -- 172.21.15.50:0/4042251560 shutdown_connections 2023-12-16T03:32:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.807+0000 7f929ad11640 1 --2- 172.21.15.50:0/4042251560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9294136220 0x7f9294138640 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.807+0000 7f929ad11640 1 -- 172.21.15.50:0/4042251560 >> 172.21.15.50:0/4042251560 conn(0x7f929406c9a0 msgr2=0x7f929406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.807+0000 7f929ad11640 1 -- 172.21.15.50:0/4042251560 shutdown_connections 2023-12-16T03:32:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.807+0000 7f929ad11640 1 -- 172.21.15.50:0/4042251560 wait complete. 2023-12-16T03:32:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.807+0000 7f929ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.808+0000 7f929ad11640 1 Processor -- start 2023-12-16T03:32:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.808+0000 7f929ad11640 1 -- start start 2023-12-16T03:32:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f929ad11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929412ff50 0x7f9294133260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f929ad11640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92941327f0 con 0x7f929412ff50 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f9298aad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929412ff50 0x7f9294133260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f9298aad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929412ff50 0x7f9294133260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40996/0 (socket says 172.21.15.50:40996) 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f9298aad640 1 -- 172.21.15.50:0/2357804833 learned_addr learned my addr 172.21.15.50:0/2357804833 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f9298aad640 1 -- 172.21.15.50:0/2357804833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294132da0 con 0x7f929412ff50 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f9298aad640 1 --2- 172.21.15.50:0/2357804833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929412ff50 0x7f9294133260 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f92917fa640 1 -- 172.21.15.50:0/2357804833 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f92880059d0 con 0x7f929412ff50 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f92917fa640 1 -- 172.21.15.50:0/2357804833 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9288005b30 con 0x7f929412ff50 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929411bc90 con 0x7f929412ff50 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.809+0000 7f92917fa640 1 -- 172.21.15.50:0/2357804833 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9288005dd0 con 0x7f929412ff50 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.810+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929411e160 con 0x7f929412ff50 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.810+0000 7f92917fa640 1 -- 172.21.15.50:0/2357804833 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 44801+0+0 (crc 0 0 0) 0x7f92880070b0 con 0x7f929412ff50 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.810+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9294075080 con 0x7f929412ff50 2023-12-16T03:32:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.810+0000 7f92917fa640 1 --2- 172.21.15.50:0/2357804833 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9278037780 0x7f9278039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.811+0000 7f92917fa640 1 -- 172.21.15.50:0/2357804833 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2661+0+0 (crc 0 0 0) 0x7f9288046b00 con 0x7f929412ff50 2023-12-16T03:32:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.811+0000 7f9293fff640 1 --2- 172.21.15.50:0/2357804833 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9278037780 0x7f9278039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.811+0000 7f9293fff640 1 --2- 172.21.15.50:0/2357804833 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9278037780 0x7f9278039c90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:31.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.815+0000 7f92917fa640 1 -- 172.21.15.50:0/2357804833 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f928800d330 con 0x7f929412ff50 2023-12-16T03:32:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:31.992+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9294066f90 con 0x7f929412ff50 2023-12-16T03:32:32.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.533+0000 7f92917fa640 1 -- 172.21.15.50:0/2357804833 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f928800c730 con 0x7f929412ff50 2023-12-16T03:32:32.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.678+0000 7f92917fa640 1 -- 172.21.15.50:0/2357804833 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v13) v1 ==== 173+0+0 (crc 0 0 0) 0x7f928800ab80 con 0x7f929412ff50 2023-12-16T03:32:32.682 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-16T03:32:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.681+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9278037780 msgr2=0x7f9278039c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.681+0000 7f929ad11640 1 --2- 172.21.15.50:0/2357804833 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9278037780 0x7f9278039c90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.681+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929412ff50 msgr2=0x7f9294133260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.681+0000 7f929ad11640 1 --2- 172.21.15.50:0/2357804833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929412ff50 0x7f9294133260 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.681+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 shutdown_connections 2023-12-16T03:32:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.681+0000 7f929ad11640 1 --2- 172.21.15.50:0/2357804833 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9278037780 0x7f9278039c90 crc :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.681+0000 7f929ad11640 1 --2- 172.21.15.50:0/2357804833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929412ff50 0x7f9294133260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.681+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 >> 172.21.15.50:0/2357804833 conn(0x7f929406c9a0 msgr2=0x7f9294136630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.682+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 shutdown_connections 2023-12-16T03:32:32.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.682+0000 7f929ad11640 1 -- 172.21.15.50:0/2357804833 wait complete. 2023-12-16T03:32:32.698 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-16T03:32:32.699 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-16T03:32:32.699 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-16T03:32:32.699 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-16T03:32:32.699 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-16T03:32:32.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.821+0000 7fcfd5c13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:32.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.825+0000 7fcfd5c13640 1 Processor -- start 2023-12-16T03:32:32.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.825+0000 7fcfd5c13640 1 -- start start 2023-12-16T03:32:32.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.826+0000 7fcfd5c13640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfd0097960 0x7fcfd012f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:32.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.826+0000 7fcfd5c13640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd0098960 con 0x7fcfd0097d70 2023-12-16T03:32:32.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.826+0000 7fcfd5c13640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd009a2a0 con 0x7fcfd0097960 2023-12-16T03:32:32.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.826+0000 7fcfcf7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfd0097960 0x7fcfd012f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:32.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.826+0000 7fcfceffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcfd0097d70 0x7fcfd012f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50776/0 (socket says 172.21.15.50:50776) 2023-12-16T03:32:32.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.826+0000 7fcfceffd640 1 -- 172.21.15.50:0/181893113 learned_addr learned my addr 172.21.15.50:0/181893113 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:32.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.826+0000 7fcfcf7fe640 1 -- 172.21.15.50:0/181893113 >> v1:172.21.15.50:6789/0 conn(0x7fcfd0097d70 legacy=0x7fcfd012f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:32.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.826+0000 7fcfcf7fe640 1 -- 172.21.15.50:0/181893113 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0072800 con 0x7fcfd0097960 2023-12-16T03:32:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.826+0000 7fcfce7fc640 1 -- 172.21.15.50:0/181893113 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848884149 0 0) 0x7fcfd0098960 con 0x7fcfd0097d70 2023-12-16T03:32:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.827+0000 7fcfcf7fe640 1 --2- 172.21.15.50:0/181893113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 0x7fcfd012f240 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2818650e12f0ab5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.827+0000 7fcfce7fc640 1 -- 172.21.15.50:0/181893113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcfc0009ce0 con 0x7fcfd0097960 2023-12-16T03:32:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.827+0000 7fcfce7fc640 1 -- 172.21.15.50:0/181893113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fcfc0009e40 con 0x7fcfd0097960 2023-12-16T03:32:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.827+0000 7fcfce7fc640 1 -- 172.21.15.50:0/181893113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcfc000e360 con 0x7fcfd0097960 2023-12-16T03:32:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.827+0000 7fcfd5c13640 1 -- 172.21.15.50:0/181893113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 msgr2=0x7fcfd012f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.827+0000 7fcfd5c13640 1 --2- 172.21.15.50:0/181893113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 0x7fcfd012f240 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.827+0000 7fcfd5c13640 1 -- 172.21.15.50:0/181893113 shutdown_connections 2023-12-16T03:32:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.827+0000 7fcfd5c13640 1 --2- 172.21.15.50:0/181893113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 0x7fcfd012f240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.828+0000 7fcfd5c13640 1 -- 172.21.15.50:0/181893113 >> 172.21.15.50:0/181893113 conn(0x7fcfd009dff0 msgr2=0x7fcfd009e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.828+0000 7fcfd5c13640 1 -- 172.21.15.50:0/181893113 shutdown_connections 2023-12-16T03:32:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.828+0000 7fcfd5c13640 1 -- 172.21.15.50:0/181893113 wait complete. 2023-12-16T03:32:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.828+0000 7fcfd5c13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.829+0000 7fcfd5c13640 1 Processor -- start 2023-12-16T03:32:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.829+0000 7fcfd5c13640 1 -- start start 2023-12-16T03:32:32.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfd5c13640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 0x7fcfd006ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:32.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfd5c13640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0130ed0 con 0x7fcfd0097960 2023-12-16T03:32:32.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfcf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 0x7fcfd006ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfcf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 0x7fcfd006ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41014/0 (socket says 172.21.15.50:41014) 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfcf7fe640 1 -- 172.21.15.50:0/3693222313 learned_addr learned my addr 172.21.15.50:0/3693222313 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfcf7fe640 1 -- 172.21.15.50:0/3693222313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0071990 con 0x7fcfd0097960 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfcf7fe640 1 --2- 172.21.15.50:0/3693222313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 0x7fcfd006ffa0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfb7fff640 1 -- 172.21.15.50:0/3693222313 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcfc0014620 con 0x7fcfd0097960 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfb7fff640 1 -- 172.21.15.50:0/3693222313 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fcfc0014780 con 0x7fcfd0097960 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd01371f0 con 0x7fcfd0097960 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfb7fff640 1 -- 172.21.15.50:0/3693222313 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcfc0014a20 con 0x7fcfd0097960 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.830+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd01316c0 con 0x7fcfd0097960 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.831+0000 7fcfb7fff640 1 -- 172.21.15.50:0/3693222313 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fcfc0014bd0 con 0x7fcfd0097960 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.831+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd01314a0 con 0x7fcfd0097960 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.831+0000 7fcfb7fff640 1 --2- 172.21.15.50:0/3693222313 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fcfbc037810 0x7fcfbc039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:32.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.831+0000 7fcfb7fff640 1 -- 172.21.15.50:0/3693222313 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fcfc0019040 con 0x7fcfd0097960 2023-12-16T03:32:32.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.832+0000 7fcfceffd640 1 --2- 172.21.15.50:0/3693222313 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fcfbc037810 0x7fcfbc039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:32.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.832+0000 7fcfceffd640 1 --2- 172.21.15.50:0/3693222313 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fcfbc037810 0x7fcfbc039d20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:32.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:32.836+0000 7fcfb7fff640 1 -- 172.21.15.50:0/3693222313 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fcfc000ee30 con 0x7fcfd0097960 2023-12-16T03:32:33.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.062+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fcfd0062350 con 0x7fcfd0097960 2023-12-16T03:32:33.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.064+0000 7fcfb7fff640 1 -- 172.21.15.50:0/3693222313 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86183 (crc 0 0 0) 0x7fcfc0019200 con 0x7fcfd0097960 2023-12-16T03:32:33.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fcfbc037810 msgr2=0x7fcfbc039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 --2- 172.21.15.50:0/3693222313 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fcfbc037810 0x7fcfbc039d20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 msgr2=0x7fcfd006ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 --2- 172.21.15.50:0/3693222313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 0x7fcfd006ffa0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 shutdown_connections 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 --2- 172.21.15.50:0/3693222313 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fcfbc037810 0x7fcfbc039d20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 --2- 172.21.15.50:0/3693222313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfd0097960 0x7fcfd006ffa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 >> 172.21.15.50:0/3693222313 conn(0x7fcfd009dff0 msgr2=0x7fcfd00958c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 shutdown_connections 2023-12-16T03:32:33.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.066+0000 7fcfd5c13640 1 -- 172.21.15.50:0/3693222313 wait complete. 2023-12-16T03:32:33.081 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":3615071509},{"type":"v1","addr":"172.21.15.124:6801","nonce":3615071509}]},"active_addr":"172.21.15.124:6801/3615071509","active_change":"2023-12-16T03:32:25.553165+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":1338675981}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":2036887515}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":845102721}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":1537376641}]}]} 2023-12-16T03:32:33.087 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-16T03:32:33.087 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-16T03:32:33.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:32:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.192+0000 7f359b79e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.196+0000 7f359b79e640 1 Processor -- start 2023-12-16T03:32:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.196+0000 7f359b79e640 1 -- start start 2023-12-16T03:32:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f359b79e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3594097d70 0x7f359412f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f359b79e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3594098960 con 0x7f3594097960 2023-12-16T03:32:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f359b79e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359409a2a0 con 0x7f3594097d70 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f3598d39640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3594097d70 0x7f359412f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f359953a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3594097960 0x7f359412f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50778/0 (socket says 172.21.15.50:50778) 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f359953a640 1 -- 172.21.15.50:0/3312980764 learned_addr learned my addr 172.21.15.50:0/3312980764 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f3598d39640 1 -- 172.21.15.50:0/3312980764 >> v1:172.21.15.50:6789/0 conn(0x7f3594097960 legacy=0x7f359412f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f358bfff640 1 -- 172.21.15.50:0/3312980764 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099099155 0 0) 0x7f3594098960 con 0x7f3594097960 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f3598d39640 1 -- 172.21.15.50:0/3312980764 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594072800 con 0x7f3594097d70 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f3598d39640 1 --2- 172.21.15.50:0/3312980764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097d70 0x7f359412f950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d464a5fae6161e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f358bfff640 1 -- 172.21.15.50:0/3312980764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3584009ce0 con 0x7f3594097d70 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f358bfff640 1 -- 172.21.15.50:0/3312980764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3584009e40 con 0x7f3594097d70 2023-12-16T03:32:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.197+0000 7f358bfff640 1 -- 172.21.15.50:0/3312980764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f358400e360 con 0x7f3594097d70 2023-12-16T03:32:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.198+0000 7f359b79e640 1 -- 172.21.15.50:0/3312980764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097d70 msgr2=0x7f359412f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.198+0000 7f359b79e640 1 --2- 172.21.15.50:0/3312980764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097d70 0x7f359412f950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.198+0000 7f359b79e640 1 -- 172.21.15.50:0/3312980764 shutdown_connections 2023-12-16T03:32:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.198+0000 7f359b79e640 1 --2- 172.21.15.50:0/3312980764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097d70 0x7f359412f950 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.198+0000 7f359b79e640 1 -- 172.21.15.50:0/3312980764 >> 172.21.15.50:0/3312980764 conn(0x7f359409dff0 msgr2=0x7f359409e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.198+0000 7f359b79e640 1 -- 172.21.15.50:0/3312980764 shutdown_connections 2023-12-16T03:32:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.198+0000 7f359b79e640 1 -- 172.21.15.50:0/3312980764 wait complete. 2023-12-16T03:32:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.198+0000 7f359b79e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.199+0000 7f359b79e640 1 Processor -- start 2023-12-16T03:32:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.199+0000 7f359b79e640 1 -- start start 2023-12-16T03:32:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.200+0000 7f359b79e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097960 0x7f359412b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.200+0000 7f359b79e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359412ca80 con 0x7f3594097960 2023-12-16T03:32:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.200+0000 7f359953a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097960 0x7f359412b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.200+0000 7f359953a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097960 0x7f359412b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41040/0 (socket says 172.21.15.50:41040) 2023-12-16T03:32:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.200+0000 7f359953a640 1 -- 172.21.15.50:0/1209730712 learned_addr learned my addr 172.21.15.50:0/1209730712 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.200+0000 7f359953a640 1 -- 172.21.15.50:0/1209730712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359406b9c0 con 0x7f3594097960 2023-12-16T03:32:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.200+0000 7f359953a640 1 --2- 172.21.15.50:0/1209730712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097960 0x7f359412b690 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.201+0000 7f3589ffb640 1 -- 172.21.15.50:0/1209730712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3590004af0 con 0x7f3594097960 2023-12-16T03:32:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.201+0000 7f3589ffb640 1 -- 172.21.15.50:0/1209730712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3590004c50 con 0x7f3594097960 2023-12-16T03:32:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.201+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35941371e0 con 0x7f3594097960 2023-12-16T03:32:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.201+0000 7f3589ffb640 1 -- 172.21.15.50:0/1209730712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3590007120 con 0x7f3594097960 2023-12-16T03:32:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.201+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359412f100 con 0x7f3594097960 2023-12-16T03:32:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.201+0000 7f3589ffb640 1 -- 172.21.15.50:0/1209730712 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f35900072d0 con 0x7f3594097960 2023-12-16T03:32:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.202+0000 7f3589ffb640 1 --2- 172.21.15.50:0/1209730712 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3578037810 0x7f3578039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.202+0000 7f3589ffb640 1 -- 172.21.15.50:0/1209730712 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f3590046d00 con 0x7f3594097960 2023-12-16T03:32:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.202+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594062350 con 0x7f3594097960 2023-12-16T03:32:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.202+0000 7f3598d39640 1 --2- 172.21.15.50:0/1209730712 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3578037810 0x7f3578039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.202+0000 7f3598d39640 1 --2- 172.21.15.50:0/1209730712 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3578037810 0x7f3578039d20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.207+0000 7f3589ffb640 1 -- 172.21.15.50:0/1209730712 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f359000f230 con 0x7f3594097960 2023-12-16T03:32:33.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.386+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35940670b0 con 0x7f3594097960 2023-12-16T03:32:33.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.387+0000 7f3589ffb640 1 -- 172.21.15.50:0/1209730712 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8656 (crc 0 0 0) 0x7f359000a530 con 0x7f3594097960 2023-12-16T03:32:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:32:33.390 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"fsid":"729b4ed4-c01a-4cd4-b8de-ed230cc4e269","created":"2023-12-16T03:32:21.212434+0000","modified":"2023-12-16T03:32:32.677029+0000","last_up_change":"2023-12-16T03:32:27.595846+0000","last_in_change":"2023-12-16T03:32:23.328457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:32:29.613500+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-16T03:32:31.631526+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45cfaef0-9a15-44c3-a207-62290b65ba02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6801","nonce":2523453502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2523453502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":2523453502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2523453502}]},"public_addr":"172.21.15.50:6801/2523453502","cluster_addr":"172.21.15.50:6800/2523453502","heartbeat_back_addr":"172.21.15.50:6805/2523453502","heartbeat_front_addr":"172.21.15.50:6804/2523453502","state":["exists","up"]},{"osd":1,"uuid":"ca4e14a7-d942-4820-ad67-37ec19b0f048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":3140644339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3140644339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3140644339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":3140644339}]},"public_addr":"172.21.15.50:6803/3140644339","cluster_addr":"172.21.15.50:6802/3140644339","heartbeat_back_addr":"172.21.15.50:6806/3140644339","heartbeat_front_addr":"172.21.15.50:6807/3140644339","state":["exists","up"]},{"osd":2,"uuid":"88e0fcc1-aa79-4fe7-90e7-b42c73046297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":551945054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6803","nonce":551945054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":551945054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":551945054}]},"public_addr":"172.21.15.124:6802/551945054","cluster_addr":"172.21.15.124:6803/551945054","heartbeat_back_addr":"172.21.15.124:6806/551945054","heartbeat_front_addr":"172.21.15.124:6807/551945054","state":["exists","up"]},{"osd":3,"uuid":"c0d220e3-ebc2-4e96-9856-42756a0081f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":556257497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":556257497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":556257497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":556257497}]},"public_addr":"172.21.15.124:6804/556257497","cluster_addr":"172.21.15.124:6805/556257497","heartbeat_back_addr":"172.21.15.124:6809/556257497","heartbeat_front_addr":"172.21.15.124:6808/556257497","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:32:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.388+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3578037810 msgr2=0x7f3578039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.388+0000 7f359b79e640 1 --2- 172.21.15.50:0/1209730712 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3578037810 0x7f3578039d20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.388+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097960 msgr2=0x7f359412b690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.388+0000 7f359b79e640 1 --2- 172.21.15.50:0/1209730712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097960 0x7f359412b690 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.389+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 shutdown_connections 2023-12-16T03:32:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.389+0000 7f359b79e640 1 --2- 172.21.15.50:0/1209730712 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3578037810 0x7f3578039d20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.389+0000 7f359b79e640 1 --2- 172.21.15.50:0/1209730712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3594097960 0x7f359412b690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.389+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 >> 172.21.15.50:0/1209730712 conn(0x7f359409dff0 msgr2=0x7f3594093250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.389+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 shutdown_connections 2023-12-16T03:32:33.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.389+0000 7f359b79e640 1 -- 172.21.15.50:0/1209730712 wait complete. 2023-12-16T03:32:33.402 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-16T03:32:33.402 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:32:33.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.507+0000 7fa20a99e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.511+0000 7fa20a99e640 1 Processor -- start 2023-12-16T03:32:33.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.511+0000 7fa20a99e640 1 -- start start 2023-12-16T03:32:33.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.512+0000 7fa20a99e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa204097960 0x7fa20412f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.512+0000 7fa20a99e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa204098960 con 0x7fa204097d70 2023-12-16T03:32:33.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.512+0000 7fa20a99e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20409a2a0 con 0x7fa204097960 2023-12-16T03:32:33.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.512+0000 7fa203fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa204097960 0x7fa20412f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.512+0000 7fa2037fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa204097d70 0x7fa20412f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50784/0 (socket says 172.21.15.50:50784) 2023-12-16T03:32:33.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.512+0000 7fa2037fe640 1 -- 172.21.15.50:0/2535861554 learned_addr learned my addr 172.21.15.50:0/2535861554 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.512+0000 7fa203fff640 1 -- 172.21.15.50:0/2535861554 >> v1:172.21.15.50:6789/0 conn(0x7fa204097d70 legacy=0x7fa20412f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa202ffd640 1 -- 172.21.15.50:0/2535861554 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812511282 0 0) 0x7fa204098960 con 0x7fa204097d70 2023-12-16T03:32:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa203fff640 1 -- 172.21.15.50:0/2535861554 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa204072800 con 0x7fa204097960 2023-12-16T03:32:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa203fff640 1 --2- 172.21.15.50:0/2535861554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 0x7fa20412f240 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd417251326e95f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa202ffd640 1 -- 172.21.15.50:0/2535861554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa1f8009ce0 con 0x7fa204097960 2023-12-16T03:32:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa202ffd640 1 -- 172.21.15.50:0/2535861554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa1f8009e40 con 0x7fa204097960 2023-12-16T03:32:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa202ffd640 1 -- 172.21.15.50:0/2535861554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa1f800e360 con 0x7fa204097960 2023-12-16T03:32:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa20a99e640 1 -- 172.21.15.50:0/2535861554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 msgr2=0x7fa20412f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa20a99e640 1 --2- 172.21.15.50:0/2535861554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 0x7fa20412f240 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa20a99e640 1 -- 172.21.15.50:0/2535861554 shutdown_connections 2023-12-16T03:32:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.513+0000 7fa20a99e640 1 --2- 172.21.15.50:0/2535861554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 0x7fa20412f240 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.514+0000 7fa20a99e640 1 -- 172.21.15.50:0/2535861554 >> 172.21.15.50:0/2535861554 conn(0x7fa20409dff0 msgr2=0x7fa20409e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.514+0000 7fa20a99e640 1 -- 172.21.15.50:0/2535861554 shutdown_connections 2023-12-16T03:32:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.514+0000 7fa20a99e640 1 -- 172.21.15.50:0/2535861554 wait complete. 2023-12-16T03:32:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.514+0000 7fa20a99e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.515+0000 7fa20a99e640 1 Processor -- start 2023-12-16T03:32:33.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.515+0000 7fa20a99e640 1 -- start start 2023-12-16T03:32:33.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.515+0000 7fa20a99e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 0x7fa20412b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.515+0000 7fa20a99e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20406ba30 con 0x7fa204097960 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa203fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 0x7fa20412b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa203fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 0x7fa20412b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41066/0 (socket says 172.21.15.50:41066) 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa203fff640 1 -- 172.21.15.50:0/2187288807 learned_addr learned my addr 172.21.15.50:0/2187288807 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa203fff640 1 -- 172.21.15.50:0/2187288807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20412cdd0 con 0x7fa204097960 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa203fff640 1 --2- 172.21.15.50:0/2187288807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 0x7fa20412b3b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa200ff9640 1 -- 172.21.15.50:0/2187288807 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa1f8014620 con 0x7fa204097960 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa200ff9640 1 -- 172.21.15.50:0/2187288807 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa1f8014780 con 0x7fa204097960 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20412d670 con 0x7fa204097960 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa200ff9640 1 -- 172.21.15.50:0/2187288807 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa1f8014a20 con 0x7fa204097960 2023-12-16T03:32:33.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.516+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa204095010 con 0x7fa204097960 2023-12-16T03:32:33.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.517+0000 7fa200ff9640 1 -- 172.21.15.50:0/2187288807 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fa1f8014bd0 con 0x7fa204097960 2023-12-16T03:32:33.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.517+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20412df70 con 0x7fa204097960 2023-12-16T03:32:33.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.517+0000 7fa200ff9640 1 --2- 172.21.15.50:0/2187288807 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa1f0037810 0x7fa1f0039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.517+0000 7fa200ff9640 1 -- 172.21.15.50:0/2187288807 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fa1f8019040 con 0x7fa204097960 2023-12-16T03:32:33.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.518+0000 7fa2037fe640 1 --2- 172.21.15.50:0/2187288807 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa1f0037810 0x7fa1f0039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.518+0000 7fa2037fe640 1 --2- 172.21.15.50:0/2187288807 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa1f0037810 0x7fa1f0039d20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.522+0000 7fa200ff9640 1 -- 172.21.15.50:0/2187288807 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fa1f800ee30 con 0x7fa204097960 2023-12-16T03:32:33.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.698+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa204062350 con 0x7fa204097960 2023-12-16T03:32:33.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.699+0000 7fa200ff9640 1 -- 172.21.15.50:0/2187288807 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8647 (crc 0 0 0) 0x7fa1f8019200 con 0x7fa204097960 2023-12-16T03:32:33.702 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:32:33.702 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":14,"fsid":"729b4ed4-c01a-4cd4-b8de-ed230cc4e269","created":"2023-12-16T03:32:21.212434+0000","modified":"2023-12-16T03:32:33.680467+0000","last_up_change":"2023-12-16T03:32:27.595846+0000","last_in_change":"2023-12-16T03:32:23.328457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:32:29.613500+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-16T03:32:31.631526+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45cfaef0-9a15-44c3-a207-62290b65ba02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6801","nonce":2523453502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2523453502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":2523453502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2523453502}]},"public_addr":"172.21.15.50:6801/2523453502","cluster_addr":"172.21.15.50:6800/2523453502","heartbeat_back_addr":"172.21.15.50:6805/2523453502","heartbeat_front_addr":"172.21.15.50:6804/2523453502","state":["exists","up"]},{"osd":1,"uuid":"ca4e14a7-d942-4820-ad67-37ec19b0f048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6803","nonce":3140644339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3140644339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3140644339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6807","nonce":3140644339}]},"public_addr":"172.21.15.50:6803/3140644339","cluster_addr":"172.21.15.50:6802/3140644339","heartbeat_back_addr":"172.21.15.50:6806/3140644339","heartbeat_front_addr":"172.21.15.50:6807/3140644339","state":["exists","up"]},{"osd":2,"uuid":"88e0fcc1-aa79-4fe7-90e7-b42c73046297","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":551945054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6803","nonce":551945054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":551945054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":551945054}]},"public_addr":"172.21.15.124:6802/551945054","cluster_addr":"172.21.15.124:6803/551945054","heartbeat_back_addr":"172.21.15.124:6806/551945054","heartbeat_front_addr":"172.21.15.124:6807/551945054","state":["exists","up"]},{"osd":3,"uuid":"c0d220e3-ebc2-4e96-9856-42756a0081f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":556257497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6805","nonce":556257497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6809","nonce":556257497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6808","nonce":556257497}]},"public_addr":"172.21.15.124:6804/556257497","cluster_addr":"172.21.15.124:6805/556257497","heartbeat_back_addr":"172.21.15.124:6809/556257497","heartbeat_front_addr":"172.21.15.124:6808/556257497","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:32:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.700+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa1f0037810 msgr2=0x7fa1f0039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.700+0000 7fa20a99e640 1 --2- 172.21.15.50:0/2187288807 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa1f0037810 0x7fa1f0039d20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.700+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 msgr2=0x7fa20412b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.700+0000 7fa20a99e640 1 --2- 172.21.15.50:0/2187288807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 0x7fa20412b3b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.700+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 shutdown_connections 2023-12-16T03:32:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.700+0000 7fa20a99e640 1 --2- 172.21.15.50:0/2187288807 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa1f0037810 0x7fa1f0039d20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.700+0000 7fa20a99e640 1 --2- 172.21.15.50:0/2187288807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa204097960 0x7fa20412b3b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.700+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 >> 172.21.15.50:0/2187288807 conn(0x7fa20409dff0 msgr2=0x7fa20409f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.701+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 shutdown_connections 2023-12-16T03:32:33.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.701+0000 7fa20a99e640 1 -- 172.21.15.50:0/2187288807 wait complete. 2023-12-16T03:32:33.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-16T03:32:33.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-16T03:32:33.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-16T03:32:33.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-16T03:32:33.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.832+0000 7faf5aa6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.832+0000 7f1b21a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.832+0000 7f777f91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.832+0000 7f7da56de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.837+0000 7f777f91e640 1 Processor -- start 2023-12-16T03:32:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.837+0000 7f7da56de640 1 Processor -- start 2023-12-16T03:32:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.837+0000 7f1b21a6d640 1 Processor -- start 2023-12-16T03:32:33.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.837+0000 7faf5aa6d640 1 Processor -- start 2023-12-16T03:32:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.837+0000 7f7da56de640 1 -- start start 2023-12-16T03:32:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.837+0000 7f777f91e640 1 -- start start 2023-12-16T03:32:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.837+0000 7f1b21a6d640 1 -- start start 2023-12-16T03:32:33.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.837+0000 7faf5aa6d640 1 -- start start 2023-12-16T03:32:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f777f91e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f777812ff00 0x7f7778130310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f7da56de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7da012cae0 0x7f7da012cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f1b21a6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b1c097960 0x7f1b1c12f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f1b21a6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c098960 con 0x7f1b1c097d70 2023-12-16T03:32:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f1b21a6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1c09a2a0 con 0x7f1b1c097960 2023-12-16T03:32:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f777f91e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777809af50 con 0x7f777812c500 2023-12-16T03:32:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f777f91e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777812fa00 con 0x7f777812ff00 2023-12-16T03:32:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f7da56de640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da009b3c0 con 0x7f7da009da10 2023-12-16T03:32:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f7da56de640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da0099de0 con 0x7f7da012cae0 2023-12-16T03:32:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7faf5aa6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf540727f0 0x7faf5409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f777d6ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f777812ff00 0x7f7778130310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7faf5aa6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf54071130 con 0x7faf540723e0 2023-12-16T03:32:33.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f1b1b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b1c097960 0x7f1b1c12f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7faf5aa6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf54131b00 con 0x7faf540727f0 2023-12-16T03:32:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f1b1b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b1c097960 0x7f1b1c12f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41088/0 (socket says 172.21.15.50:41088) 2023-12-16T03:32:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f777d6ba640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f777812ff00 0x7f7778130310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41070/0 (socket says 172.21.15.50:41070) 2023-12-16T03:32:33.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f777d6ba640 1 -- 172.21.15.50:0/3423923556 learned_addr learned my addr 172.21.15.50:0/3423923556 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f1b1b7fe640 1 -- 172.21.15.50:0/4049113911 learned_addr learned my addr 172.21.15.50:0/4049113911 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7faf53fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf540727f0 0x7faf5409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f7d9effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7da012cae0 0x7f7da012cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f7d9effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7da012cae0 0x7f7da012cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41082/0 (socket says 172.21.15.50:41082) 2023-12-16T03:32:33.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7f7d9effd640 1 -- 172.21.15.50:0/597431013 learned_addr learned my addr 172.21.15.50:0/597431013 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7faf53fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf540727f0 0x7faf5409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41102/0 (socket says 172.21.15.50:41102) 2023-12-16T03:32:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.838+0000 7faf53fff640 1 -- 172.21.15.50:0/4193740985 learned_addr learned my addr 172.21.15.50:0/4193740985 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f777d6ba640 1 -- 172.21.15.50:0/3423923556 >> v1:172.21.15.50:6789/0 conn(0x7f777812c500 legacy=0x7f777812c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f777d6ba640 1 -- 172.21.15.50:0/3423923556 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777806e220 con 0x7f777812ff00 2023-12-16T03:32:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f1b1b7fe640 1 -- 172.21.15.50:0/4049113911 >> v1:172.21.15.50:6789/0 conn(0x7f1b1c097d70 legacy=0x7f1b1c12f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f1b1b7fe640 1 -- 172.21.15.50:0/4049113911 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c072800 con 0x7f1b1c097960 2023-12-16T03:32:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f777d6ba640 1 --2- 172.21.15.50:0/3423923556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812ff00 0x7f7778130310 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce30ade4832c82a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f7d9effd640 1 -- 172.21.15.50:0/597431013 >> v1:172.21.15.50:6789/0 conn(0x7f7da009da10 legacy=0x7f7da009de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f7d9effd640 1 -- 172.21.15.50:0/597431013 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da009b660 con 0x7f7da012cae0 2023-12-16T03:32:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f7d9dffb640 1 -- 172.21.15.50:0/597431013 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303798406 0 0) 0x7f7da009b3c0 con 0x7f7da009da10 2023-12-16T03:32:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7faf53fff640 1 -- 172.21.15.50:0/4193740985 >> v1:172.21.15.50:6789/0 conn(0x7faf540723e0 legacy=0x7faf5409ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7faf53fff640 1 -- 172.21.15.50:0/4193740985 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf541312c0 con 0x7faf540727f0 2023-12-16T03:32:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f1b1b7fe640 1 --2- 172.21.15.50:0/4049113911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 0x7f1b1c12f240 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e093632f565f7114 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f776ffff640 1 -- 172.21.15.50:0/3423923556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7774009dd0 con 0x7f777812ff00 2023-12-16T03:32:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f776ffff640 1 -- 172.21.15.50:0/3423923556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f777400e230 con 0x7f777812ff00 2023-12-16T03:32:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7faf53fff640 1 --2- 172.21.15.50:0/4193740985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540727f0 0x7faf5409f1a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6450440014cd10 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f776ffff640 1 -- 172.21.15.50:0/3423923556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f777400e4d0 con 0x7f777812ff00 2023-12-16T03:32:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7faf537fe640 1 -- 172.21.15.50:0/4193740985 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7faf40009da0 con 0x7faf540727f0 2023-12-16T03:32:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f7d9effd640 1 --2- 172.21.15.50:0/597431013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da012cae0 0x7f7da012cef0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3963e0d2b30c88 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7f1b1a7fc640 1 -- 172.21.15.50:0/4049113911 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f1b0c009dd0 con 0x7f1b1c097960 2023-12-16T03:32:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.839+0000 7faf537fe640 1 -- 172.21.15.50:0/4193740985 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7faf4000e230 con 0x7faf540727f0 2023-12-16T03:32:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7faf537fe640 1 -- 172.21.15.50:0/4193740985 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7faf4000e4d0 con 0x7faf540727f0 2023-12-16T03:32:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f1b1a7fc640 1 -- 172.21.15.50:0/4049113911 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f1b0c00e230 con 0x7f1b1c097960 2023-12-16T03:32:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f1b1a7fc640 1 -- 172.21.15.50:0/4049113911 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f1b0c00e4d0 con 0x7f1b1c097960 2023-12-16T03:32:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f7d9dffb640 1 -- 172.21.15.50:0/597431013 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7d90010570 con 0x7f7da012cae0 2023-12-16T03:32:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f7d9dffb640 1 -- 172.21.15.50:0/597431013 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7d900106d0 con 0x7f7da012cae0 2023-12-16T03:32:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f777f91e640 1 -- 172.21.15.50:0/3423923556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812ff00 msgr2=0x7f7778130310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f7d9dffb640 1 -- 172.21.15.50:0/597431013 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7d90010570 con 0x7f7da012cae0 2023-12-16T03:32:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f777f91e640 1 --2- 172.21.15.50:0/3423923556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812ff00 0x7f7778130310 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f777f91e640 1 -- 172.21.15.50:0/3423923556 shutdown_connections 2023-12-16T03:32:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f777f91e640 1 --2- 172.21.15.50:0/3423923556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812ff00 0x7f7778130310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f777f91e640 1 -- 172.21.15.50:0/3423923556 >> 172.21.15.50:0/3423923556 conn(0x7f777809dff0 msgr2=0x7f777809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f1b21a6d640 1 -- 172.21.15.50:0/4049113911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 msgr2=0x7f1b1c12f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f1b21a6d640 1 --2- 172.21.15.50:0/4049113911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 0x7f1b1c12f240 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f1b21a6d640 1 -- 172.21.15.50:0/4049113911 shutdown_connections 2023-12-16T03:32:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.840+0000 7f1b21a6d640 1 --2- 172.21.15.50:0/4049113911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 0x7f1b1c12f240 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f1b21a6d640 1 -- 172.21.15.50:0/4049113911 >> 172.21.15.50:0/4049113911 conn(0x7f1b1c09dff0 msgr2=0x7f1b1c09e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f777f91e640 1 -- 172.21.15.50:0/3423923556 shutdown_connections 2023-12-16T03:32:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7faf5aa6d640 1 -- 172.21.15.50:0/4193740985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540727f0 msgr2=0x7faf5409f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f1b21a6d640 1 -- 172.21.15.50:0/4049113911 shutdown_connections 2023-12-16T03:32:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7faf5aa6d640 1 --2- 172.21.15.50:0/4193740985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540727f0 0x7faf5409f1a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f777f91e640 1 -- 172.21.15.50:0/3423923556 wait complete. 2023-12-16T03:32:33.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7faf5aa6d640 1 -- 172.21.15.50:0/4193740985 shutdown_connections 2023-12-16T03:32:33.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7faf5aa6d640 1 --2- 172.21.15.50:0/4193740985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540727f0 0x7faf5409f1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f1b21a6d640 1 -- 172.21.15.50:0/4049113911 wait complete. 2023-12-16T03:32:33.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7faf5aa6d640 1 -- 172.21.15.50:0/4193740985 >> 172.21.15.50:0/4193740985 conn(0x7faf54098a20 msgr2=0x7faf54098e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7faf5aa6d640 1 -- 172.21.15.50:0/4193740985 shutdown_connections 2023-12-16T03:32:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7faf5aa6d640 1 -- 172.21.15.50:0/4193740985 wait complete. 2023-12-16T03:32:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f7da56de640 1 -- 172.21.15.50:0/597431013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da012cae0 msgr2=0x7f7da012cef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f7da56de640 1 --2- 172.21.15.50:0/597431013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da012cae0 0x7f7da012cef0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f777f91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f7da56de640 1 -- 172.21.15.50:0/597431013 shutdown_connections 2023-12-16T03:32:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f1b21a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f7da56de640 1 --2- 172.21.15.50:0/597431013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da012cae0 0x7f7da012cef0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f7da56de640 1 -- 172.21.15.50:0/597431013 >> 172.21.15.50:0/597431013 conn(0x7f7da009eb00 msgr2=0x7f7da009ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7faf5aa6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f7da56de640 1 -- 172.21.15.50:0/597431013 shutdown_connections 2023-12-16T03:32:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f7da56de640 1 -- 172.21.15.50:0/597431013 wait complete. 2023-12-16T03:32:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.841+0000 7f7da56de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.842+0000 7f1b21a6d640 1 Processor -- start 2023-12-16T03:32:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.842+0000 7f777f91e640 1 Processor -- start 2023-12-16T03:32:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.842+0000 7f1b21a6d640 1 -- start start 2023-12-16T03:32:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.842+0000 7f777f91e640 1 -- start start 2023-12-16T03:32:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.842+0000 7faf5aa6d640 1 Processor -- start 2023-12-16T03:32:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.842+0000 7faf5aa6d640 1 -- start start 2023-12-16T03:32:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f1b21a6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 0x7f1b1c070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f1b21a6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c1b74b0 con 0x7f1b1c097960 2023-12-16T03:32:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f1b1b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 0x7f1b1c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f7da56de640 1 Processor -- start 2023-12-16T03:32:33.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f1b1b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 0x7f1b1c070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41106/0 (socket says 172.21.15.50:41106) 2023-12-16T03:32:33.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f1b1b7fe640 1 -- 172.21.15.50:0/2225456298 learned_addr learned my addr 172.21.15.50:0/2225456298 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f7da56de640 1 -- start start 2023-12-16T03:32:33.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f777f91e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812c500 0x7f7778135c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f777f91e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778135630 con 0x7f777812c500 2023-12-16T03:32:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f1b1b7fe640 1 -- 172.21.15.50:0/2225456298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c1b5910 con 0x7f1b1c097960 2023-12-16T03:32:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f777d6ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812c500 0x7f7778135c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f777d6ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812c500 0x7f7778135c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41118/0 (socket says 172.21.15.50:41118) 2023-12-16T03:32:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.843+0000 7f777d6ba640 1 -- 172.21.15.50:0/3511737127 learned_addr learned my addr 172.21.15.50:0/3511737127 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f1b1b7fe640 1 --2- 172.21.15.50:0/2225456298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 0x7f1b1c070280 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f777d6ba640 1 -- 172.21.15.50:0/3511737127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777806f340 con 0x7f777812c500 2023-12-16T03:32:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7faf5aa6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540723e0 0x7faf5406b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f1b03fff640 1 -- 172.21.15.50:0/2225456298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f1b0c014540 con 0x7f1b1c097960 2023-12-16T03:32:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7faf5aa6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5411f350 con 0x7faf540723e0 2023-12-16T03:32:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f1b03fff640 1 -- 172.21.15.50:0/2225456298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f1b0c0146a0 con 0x7f1b1c097960 2023-12-16T03:32:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1c071640 con 0x7f1b1c097960 2023-12-16T03:32:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f1b03fff640 1 -- 172.21.15.50:0/2225456298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f1b0c014940 con 0x7f1b1c097960 2023-12-16T03:32:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f777d6ba640 1 --2- 172.21.15.50:0/3511737127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812c500 0x7f7778135c70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f7da56de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da009da10 0x7f7da0118650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f7da56de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0119a40 con 0x7f7da009da10 2023-12-16T03:32:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7faf58809640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540723e0 0x7faf5406b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7faf58809640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540723e0 0x7faf5406b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41130/0 (socket says 172.21.15.50:41130) 2023-12-16T03:32:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7faf58809640 1 -- 172.21.15.50:0/324312384 learned_addr learned my addr 172.21.15.50:0/324312384 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f7d9effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da009da10 0x7f7da0118650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c1b70f0 con 0x7f1b1c097960 2023-12-16T03:32:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f7d9effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da009da10 0x7f7da0118650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41142/0 (socket says 172.21.15.50:41142) 2023-12-16T03:32:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f7d9effd640 1 -- 172.21.15.50:0/2720265184 learned_addr learned my addr 172.21.15.50:0/2720265184 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7faf58809640 1 -- 172.21.15.50:0/324312384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5411f060 con 0x7faf540723e0 2023-12-16T03:32:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7f7d9effd640 1 -- 172.21.15.50:0/2720265184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da006c9f0 con 0x7f7da009da10 2023-12-16T03:32:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7faf58809640 1 --2- 172.21.15.50:0/324312384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540723e0 0x7faf5406b850 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7f7d9effd640 1 --2- 172.21.15.50:0/2720265184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da009da10 0x7f7da0118650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7faf517fa640 1 -- 172.21.15.50:0/324312384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7faf4800c7e0 con 0x7faf540723e0 2023-12-16T03:32:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5411dec0 con 0x7faf540723e0 2023-12-16T03:32:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7f7d877fe640 1 -- 172.21.15.50:0/2720265184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7d9000f990 con 0x7f7da009da10 2023-12-16T03:32:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f7d877fe640 1 -- 172.21.15.50:0/2720265184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7d90016040 con 0x7f7da009da10 2023-12-16T03:32:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f7d877fe640 1 -- 172.21.15.50:0/2720265184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7d9000fc20 con 0x7f7da009da10 2023-12-16T03:32:33.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5411e140 con 0x7faf540723e0 2023-12-16T03:32:33.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da011b2b0 con 0x7f7da009da10 2023-12-16T03:32:33.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.844+0000 7f776dffb640 1 -- 172.21.15.50:0/3511737127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7774014540 con 0x7f777812c500 2023-12-16T03:32:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da011c2e0 con 0x7f7da009da10 2023-12-16T03:32:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7f1b03fff640 1 -- 172.21.15.50:0/2225456298 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f1b0c014af0 con 0x7f1b1c097960 2023-12-16T03:32:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7f776dffb640 1 -- 172.21.15.50:0/3511737127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f77740146a0 con 0x7f777812c500 2023-12-16T03:32:33.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7f776dffb640 1 -- 172.21.15.50:0/3511737127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7774014940 con 0x7f777812c500 2023-12-16T03:32:33.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7f777f91e640 1 -- 172.21.15.50:0/3511737127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7778135840 con 0x7f777812c500 2023-12-16T03:32:33.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.845+0000 7f777f91e640 1 -- 172.21.15.50:0/3511737127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77780701b0 con 0x7f777812c500 2023-12-16T03:32:33.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f777f91e640 1 -- 172.21.15.50:0/3511737127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f777806ba50 con 0x7f777812c500 2023-12-16T03:32:33.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7faf517fa640 1 -- 172.21.15.50:0/324312384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7faf4800c940 con 0x7faf540723e0 2023-12-16T03:32:33.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f1b03fff640 1 --2- 172.21.15.50:0/2225456298 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f1b08037810 0x7f1b08039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b1c0714d0 con 0x7f1b1c097960 2023-12-16T03:32:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f1b03fff640 1 -- 172.21.15.50:0/2225456298 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f1b0c019040 con 0x7f1b1c097960 2023-12-16T03:32:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f1b03fff640 1 --2- 172.21.15.50:0/2225456298 >> v2:172.21.15.124:6802/551945054 conn(0x7f1b0803c7b0 0x7f1b0803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f1b03fff640 1 -- 172.21.15.50:0/2225456298 --> v2:172.21.15.124:6802/551945054 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b0803f2d0 con 0x7f1b0803c7b0 2023-12-16T03:32:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7faf517fa640 1 -- 172.21.15.50:0/324312384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7faf4800c7e0 con 0x7faf540723e0 2023-12-16T03:32:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.846+0000 7f1b1affd640 1 --2- 172.21.15.50:0/2225456298 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f1b08037810 0x7f1b08039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf34000f10 con 0x7faf540723e0 2023-12-16T03:32:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f1b03fff640 1 -- 172.21.15.50:0/2225456298 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7f1b0c00fea0 con 0x7f1b1c097960 2023-12-16T03:32:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f776dffb640 1 -- 172.21.15.50:0/3511737127 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f7774014aa0 con 0x7f777812c500 2023-12-16T03:32:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7da00a0d20 con 0x7f7da009da10 2023-12-16T03:32:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f776dffb640 1 --2- 172.21.15.50:0/3511737127 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f775c0378b0 0x7f775c039dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f7d877fe640 1 -- 172.21.15.50:0/2720265184 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f7d9000e360 con 0x7f7da009da10 2023-12-16T03:32:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f776dffb640 1 -- 172.21.15.50:0/3511737127 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f7774019040 con 0x7f777812c500 2023-12-16T03:32:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f1b1affd640 1 --2- 172.21.15.50:0/2225456298 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f1b08037810 0x7f1b08039d20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7faf517fa640 1 -- 172.21.15.50:0/324312384 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7faf4800cb00 con 0x7faf540723e0 2023-12-16T03:32:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f776dffb640 1 --2- 172.21.15.50:0/3511737127 >> v2:172.21.15.124:6804/556257497 conn(0x7f775c03c8d0 0x7f775c03ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f776dffb640 1 -- 172.21.15.50:0/3511737127 --> v2:172.21.15.124:6804/556257497 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f775c03f3f0 con 0x7f775c03c8d0 2023-12-16T03:32:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f776dffb640 1 -- 172.21.15.50:0/3511737127 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7f777404a950 con 0x7f777812c500 2023-12-16T03:32:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f1b1bfff640 1 --2- 172.21.15.50:0/2225456298 >> v2:172.21.15.124:6802/551945054 conn(0x7f1b0803c7b0 0x7f1b0803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-16T03:32:33.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f777ceb9640 1 --2- 172.21.15.50:0/3511737127 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f775c0378b0 0x7f775c039dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f7d877fe640 1 --2- 172.21.15.50:0/2720265184 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f7d8c037810 0x7f7d8c039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f7d877fe640 1 -- 172.21.15.50:0/2720265184 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f7d900098e0 con 0x7f7da009da10 2023-12-16T03:32:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f7d877fe640 1 --2- 172.21.15.50:0/2720265184 >> v2:172.21.15.50:6803/3140644339 conn(0x7f7d8c03cf20 0x7f7d8c03f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7f7d877fe640 1 -- 172.21.15.50:0/2720265184 --> v2:172.21.15.50:6803/3140644339 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d8c03faa0 con 0x7f7d8c03cf20 2023-12-16T03:32:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.847+0000 7faf517fa640 1 --2- 172.21.15.50:0/324312384 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7faf38037850 0x7faf38039d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7faf517fa640 1 -- 172.21.15.50:0/324312384 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7faf48046d20 con 0x7faf540723e0 2023-12-16T03:32:33.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7f7d9e7fc640 1 --2- 172.21.15.50:0/2720265184 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f7d8c037810 0x7f7d8c039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7f7d877fe640 1 -- 172.21.15.50:0/2720265184 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7f7d9000dee0 con 0x7f7da009da10 2023-12-16T03:32:33.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7faf517fa640 1 --2- 172.21.15.50:0/324312384 >> v2:172.21.15.50:6801/2523453502 conn(0x7faf3803c7f0 0x7faf3803ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:33.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7faf517fa640 1 -- 172.21.15.50:0/324312384 --> v2:172.21.15.50:6801/2523453502 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf3803f310 con 0x7faf3803c7f0 2023-12-16T03:32:33.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7faf517fa640 1 -- 172.21.15.50:0/324312384 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7faf4804a040 con 0x7faf540723e0 2023-12-16T03:32:33.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7faf53fff640 1 --2- 172.21.15.50:0/324312384 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7faf38037850 0x7faf38039d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:33.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7f777ceb9640 1 --2- 172.21.15.50:0/3511737127 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f775c0378b0 0x7f775c039dc0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7f777debb640 1 --2- 172.21.15.50:0/3511737127 >> v2:172.21.15.124:6804/556257497 conn(0x7f775c03c8d0 0x7f775c03ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-16T03:32:33.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7f7d9e7fc640 1 --2- 172.21.15.50:0/2720265184 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f7d8c037810 0x7f7d8c039d20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7f7d9f7fe640 1 --2- 172.21.15.50:0/2720265184 >> v2:172.21.15.50:6803/3140644339 conn(0x7f7d8c03cf20 0x7f7d8c03f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-16T03:32:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.848+0000 7faf53fff640 1 --2- 172.21.15.50:0/324312384 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7faf38037850 0x7faf38039d60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.850+0000 7f7d9f7fe640 1 --2- 172.21.15.50:0/2720265184 >> v2:172.21.15.50:6803/3140644339 conn(0x7f7d8c03cf20 0x7f7d8c03f410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.851+0000 7f777debb640 1 --2- 172.21.15.50:0/3511737127 >> v2:172.21.15.124:6804/556257497 conn(0x7f775c03c8d0 0x7f775c03ed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.851+0000 7f7d877fe640 1 -- 172.21.15.50:0/2720265184 <== osd.1 v2:172.21.15.50:6803/3140644339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f7d8c03faa0 con 0x7f7d8c03cf20 2023-12-16T03:32:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.852+0000 7f776dffb640 1 -- 172.21.15.50:0/3511737127 <== osd.3 v2:172.21.15.124:6804/556257497 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f775c03f3f0 con 0x7f775c03c8d0 2023-12-16T03:32:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.852+0000 7faf5900a640 1 --2- 172.21.15.50:0/324312384 >> v2:172.21.15.50:6801/2523453502 conn(0x7faf3803c7f0 0x7faf3803ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-16T03:32:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.854+0000 7f1b1bfff640 1 --2- 172.21.15.50:0/2225456298 >> v2:172.21.15.124:6802/551945054 conn(0x7f1b0803c7b0 0x7f1b0803ec40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.855+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 --> v2:172.21.15.50:6803/3140644339 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7da011b8a0 con 0x7f7d8c03cf20 2023-12-16T03:32:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.855+0000 7faf5900a640 1 --2- 172.21.15.50:0/324312384 >> v2:172.21.15.50:6801/2523453502 conn(0x7faf3803c7f0 0x7faf3803ec80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.855+0000 7f1b03fff640 1 -- 172.21.15.50:0/2225456298 <== osd.2 v2:172.21.15.124:6802/551945054 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f1b0803f2d0 con 0x7f1b0803c7b0 2023-12-16T03:32:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.857+0000 7faf517fa640 1 -- 172.21.15.50:0/324312384 <== osd.0 v2:172.21.15.50:6801/2523453502 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7faf3803f310 con 0x7faf3803c7f0 2023-12-16T03:32:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.858+0000 7f777f91e640 1 -- 172.21.15.50:0/3511737127 --> v2:172.21.15.124:6804/556257497 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f777806d840 con 0x7f775c03c8d0 2023-12-16T03:32:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.858+0000 7f7d877fe640 1 -- 172.21.15.50:0/2720265184 <== osd.1 v2:172.21.15.50:6803/3140644339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7da011b8a0 con 0x7f7d8c03cf20 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 >> v2:172.21.15.50:6803/3140644339 conn(0x7f7d8c03cf20 msgr2=0x7f7d8c03f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 --2- 172.21.15.50:0/2720265184 >> v2:172.21.15.50:6803/3140644339 conn(0x7f7d8c03cf20 0x7f7d8c03f410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f7d8c037810 msgr2=0x7f7d8c039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 --2- 172.21.15.50:0/2720265184 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f7d8c037810 0x7f7d8c039d20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da009da10 msgr2=0x7f7da0118650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 --2- 172.21.15.50:0/2720265184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da009da10 0x7f7da0118650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 shutdown_connections 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 --2- 172.21.15.50:0/2720265184 >> v2:172.21.15.50:6803/3140644339 conn(0x7f7d8c03cf20 0x7f7d8c03f410 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 --2- 172.21.15.50:0/2720265184 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f7d8c037810 0x7f7d8c039d20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 --2- 172.21.15.50:0/2720265184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da009da10 0x7f7da0118650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 >> 172.21.15.50:0/2720265184 conn(0x7f7da009eb00 msgr2=0x7f7da01b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 shutdown_connections 2023-12-16T03:32:33.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f7da56de640 1 -- 172.21.15.50:0/2720265184 wait complete. 2023-12-16T03:32:33.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f776dffb640 1 -- 172.21.15.50:0/3511737127 <== osd.3 v2:172.21.15.124:6804/556257497 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f777000a820 con 0x7f775c03c8d0 2023-12-16T03:32:33.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f775b7fe640 1 -- 172.21.15.50:0/3511737127 >> v2:172.21.15.124:6804/556257497 conn(0x7f775c03c8d0 msgr2=0x7f775c03ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f775b7fe640 1 --2- 172.21.15.50:0/3511737127 >> v2:172.21.15.124:6804/556257497 conn(0x7f775c03c8d0 0x7f775c03ed60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.859+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 --> v2:172.21.15.124:6802/551945054 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b1c0969d0 con 0x7f1b0803c7b0 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 -- 172.21.15.50:0/3511737127 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f775c0378b0 msgr2=0x7f775c039dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 --2- 172.21.15.50:0/3511737127 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f775c0378b0 0x7f775c039dc0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 -- 172.21.15.50:0/3511737127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812c500 msgr2=0x7f7778135c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 --2- 172.21.15.50:0/3511737127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812c500 0x7f7778135c70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 -- 172.21.15.50:0/3511737127 shutdown_connections 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 --2- 172.21.15.50:0/3511737127 >> v2:172.21.15.124:6804/556257497 conn(0x7f775c03c8d0 0x7f775c03ed60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 --2- 172.21.15.50:0/3511737127 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f775c0378b0 0x7f775c039dc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 --2- 172.21.15.50:0/3511737127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777812c500 0x7f7778135c70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 -- 172.21.15.50:0/3511737127 >> 172.21.15.50:0/3511737127 conn(0x7f777809dff0 msgr2=0x7f7778099e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 -- 172.21.15.50:0/3511737127 shutdown_connections 2023-12-16T03:32:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.860+0000 7f775b7fe640 1 -- 172.21.15.50:0/3511737127 wait complete. 2023-12-16T03:32:33.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b03fff640 1 -- 172.21.15.50:0/2225456298 <== osd.2 v2:172.21.15.124:6802/551945054 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b1c0969d0 con 0x7f1b0803c7b0 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 >> v2:172.21.15.124:6802/551945054 conn(0x7f1b0803c7b0 msgr2=0x7f1b0803ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 --2- 172.21.15.50:0/2225456298 >> v2:172.21.15.124:6802/551945054 conn(0x7f1b0803c7b0 0x7f1b0803ec40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f1b08037810 msgr2=0x7f1b08039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 --2- 172.21.15.50:0/2225456298 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f1b08037810 0x7f1b08039d20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 msgr2=0x7f1b1c070280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 --2- 172.21.15.50:0/2225456298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 0x7f1b1c070280 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 shutdown_connections 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 --2- 172.21.15.50:0/2225456298 >> v2:172.21.15.124:6802/551945054 conn(0x7f1b0803c7b0 0x7f1b0803ec40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 --2- 172.21.15.50:0/2225456298 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f1b08037810 0x7f1b08039d20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 --2- 172.21.15.50:0/2225456298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b1c097960 0x7f1b1c070280 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.861+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 >> 172.21.15.50:0/2225456298 conn(0x7f1b1c09dff0 msgr2=0x7f1b1c09f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.862+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 shutdown_connections 2023-12-16T03:32:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.862+0000 7f1b21a6d640 1 -- 172.21.15.50:0/2225456298 wait complete. 2023-12-16T03:32:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.862+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 --> v2:172.21.15.50:6801/2523453502 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf34002b20 con 0x7faf3803c7f0 2023-12-16T03:32:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.864+0000 7faf517fa640 1 -- 172.21.15.50:0/324312384 <== osd.0 v2:172.21.15.50:6801/2523453502 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faf34002b20 con 0x7faf3803c7f0 2023-12-16T03:32:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.864+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 >> v2:172.21.15.50:6801/2523453502 conn(0x7faf3803c7f0 msgr2=0x7faf3803ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.864+0000 7faf5aa6d640 1 --2- 172.21.15.50:0/324312384 >> v2:172.21.15.50:6801/2523453502 conn(0x7faf3803c7f0 0x7faf3803ec80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.864+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7faf38037850 msgr2=0x7faf38039d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.864+0000 7faf5aa6d640 1 --2- 172.21.15.50:0/324312384 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7faf38037850 0x7faf38039d60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.864+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540723e0 msgr2=0x7faf5406b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.864+0000 7faf5aa6d640 1 --2- 172.21.15.50:0/324312384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540723e0 0x7faf5406b850 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.865+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 shutdown_connections 2023-12-16T03:32:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.865+0000 7faf5aa6d640 1 --2- 172.21.15.50:0/324312384 >> v2:172.21.15.50:6801/2523453502 conn(0x7faf3803c7f0 0x7faf3803ec80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.865+0000 7faf5aa6d640 1 --2- 172.21.15.50:0/324312384 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7faf38037850 0x7faf38039d60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.865+0000 7faf5aa6d640 1 --2- 172.21.15.50:0/324312384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf540723e0 0x7faf5406b850 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.865+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 >> 172.21.15.50:0/324312384 conn(0x7faf54098a20 msgr2=0x7faf5409d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.865+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 shutdown_connections 2023-12-16T03:32:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:33.866+0000 7faf5aa6d640 1 -- 172.21.15.50:0/324312384 wait complete. 2023-12-16T03:32:33.894 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-12-16T03:32:33.895 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-16T03:32:33.896 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-12-16T03:32:33.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-16T03:32:33.897 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-12-16T03:32:33.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-16T03:32:33.898 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-12-16T03:32:33.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-16T03:32:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.051+0000 7fa3c215e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.051+0000 7f01eee6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.051+0000 7f8ed7ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.051+0000 7f9ba575e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.056+0000 7fa3c215e640 1 Processor -- start 2023-12-16T03:32:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.056+0000 7fa3c215e640 1 -- start start 2023-12-16T03:32:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.056+0000 7f01eee6d640 1 Processor -- start 2023-12-16T03:32:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.056+0000 7f01eee6d640 1 -- start start 2023-12-16T03:32:34.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7f8ed7ead640 1 Processor -- start 2023-12-16T03:32:34.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7f9ba575e640 1 Processor -- start 2023-12-16T03:32:34.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7f9ba575e640 1 -- start start 2023-12-16T03:32:34.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7f8ed7ead640 1 -- start start 2023-12-16T03:32:34.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7fa3c215e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3bc0a0fc0 0x7fa3bc133620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7fa3c215e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc09deb0 con 0x7fa3bc0a0bb0 2023-12-16T03:32:34.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7fa3c215e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3bc09d2b0 con 0x7fa3bc0a0fc0 2023-12-16T03:32:34.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7f01eee6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01e80a1040 0x7f01e8132f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7fa3bb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa3bc0a0bb0 0x7fa3bc132f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50822/0 (socket says 172.21.15.50:50822) 2023-12-16T03:32:34.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7f01eee6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e80a1870 con 0x7f01e81334c0 2023-12-16T03:32:34.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7f01eee6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e809cb90 con 0x7f01e80a1040 2023-12-16T03:32:34.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.057+0000 7fa3bb7fe640 1 -- 172.21.15.50:0/749001867 learned_addr learned my addr 172.21.15.50:0/749001867 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:34.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3baffd640 1 --2- 172.21.15.50:0/749001867 >> v2:172.21.15.50:3300/0 conn(0x7fa3bc0a0fc0 0x7fa3bc133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f01ecc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01e80a1040 0x7f01e8132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f9ba575e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ba0131690 0x7f9ba009ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f01ecc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01e80a1040 0x7f01e8132f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41156/0 (socket says 172.21.15.50:41156) 2023-12-16T03:32:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f01ecc09640 1 -- 172.21.15.50:0/2454868278 learned_addr learned my addr 172.21.15.50:0/2454868278 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f9ba575e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba009d580 con 0x7f9ba009efd0 2023-12-16T03:32:34.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f9ba575e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba009aa30 con 0x7f9ba0131690 2023-12-16T03:32:34.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118040987 0 0) 0x7fa3bc09deb0 con 0x7fa3bc0a0bb0 2023-12-16T03:32:34.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a40034f0 con 0x7fa3bc0a0bb0 2023-12-16T03:32:34.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f9b9effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ba0131690 0x7f9ba009ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f8ed7ead640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ed0131960 0x7f8ed009e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f8ed7ead640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed006ab20 con 0x7f8ed0131550 2023-12-16T03:32:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f8ed7ead640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed0130e80 con 0x7f8ed0131960 2023-12-16T03:32:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f9b9effd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ba0131690 0x7f9ba009ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41162/0 (socket says 172.21.15.50:41162) 2023-12-16T03:32:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f9b9effd640 1 -- 172.21.15.50:0/2319392212 learned_addr learned my addr 172.21.15.50:0/2319392212 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f01ecc09640 1 -- 172.21.15.50:0/2454868278 >> v1:172.21.15.50:6789/0 conn(0x7f01e81334c0 legacy=0x7f01e81382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:32:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f01ecc09640 1 -- 172.21.15.50:0/2454868278 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e81300a0 con 0x7f01e80a1040 2023-12-16T03:32:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3373656520 0 0) 0x7fa3a40034f0 con 0x7fa3bc0a0bb0 2023-12-16T03:32:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 >> v2:172.21.15.50:3300/0 conn(0x7fa3bc0a0fc0 msgr2=0x7fa3bc133620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:32:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 --2- 172.21.15.50:0/749001867 >> v2:172.21.15.50:3300/0 conn(0x7fa3bc0a0fc0 0x7fa3bc133620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc1302d0 con 0x7fa3bc0a0bb0 2023-12-16T03:32:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2290794903 0 0) 0x7fa3ac0015a0 con 0x7fa3bc0a0bb0 2023-12-16T03:32:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f9b9effd640 1 -- 172.21.15.50:0/2319392212 >> v1:172.21.15.50:6789/0 conn(0x7f9ba009efd0 legacy=0x7f9ba009f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f9b9effd640 1 -- 172.21.15.50:0/2319392212 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0099d10 con 0x7f9ba0131690 2023-12-16T03:32:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 >> v1:172.21.15.50:6789/0 conn(0x7fa3bc0a0bb0 legacy=0x7fa3bc132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 --2- 172.21.15.50:0/749001867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc09d2b0 con 0x7fa3a4003970 2023-12-16T03:32:34.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f01ecc09640 1 --2- 172.21.15.50:0/2454868278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 0x7f01e8132f80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92a364c3ffff4cd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f8ed5c49640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8ed0131550 0x7f8ed009da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50850/0 (socket says 172.21.15.50:50850) 2023-12-16T03:32:34.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.058+0000 7f8ed5c49640 1 -- 172.21.15.50:0/112412508 learned_addr learned my addr 172.21.15.50:0/112412508 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:34.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f8ed5448640 1 --2- 172.21.15.50:0/112412508 >> v2:172.21.15.50:3300/0 conn(0x7f8ed0131960 0x7f8ed009e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7fa3bb7fe640 1 --2- 172.21.15.50:0/749001867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f8ed5448640 1 -- 172.21.15.50:0/112412508 >> v1:172.21.15.50:6789/0 conn(0x7f8ed0131550 legacy=0x7f8ed009da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f01e77fe640 1 -- 172.21.15.50:0/2454868278 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f01e000e040 con 0x7f01e80a1040 2023-12-16T03:32:34.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f01e77fe640 1 -- 172.21.15.50:0/2454868278 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f01e00091e0 con 0x7f01e80a1040 2023-12-16T03:32:34.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f01e77fe640 1 -- 172.21.15.50:0/2454868278 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f01e0007730 con 0x7f01e80a1040 2023-12-16T03:32:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f8ed4c47640 1 -- 172.21.15.50:0/112412508 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665051542 0 0) 0x7f8ed006ab20 con 0x7f8ed0131550 2023-12-16T03:32:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f8ed5448640 1 -- 172.21.15.50:0/112412508 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed0131120 con 0x7f8ed0131960 2023-12-16T03:32:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f9b9effd640 1 --2- 172.21.15.50:0/2319392212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba0131690 0x7f9ba009ea90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f275b8fc53bdb4b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f9b9dffb640 1 -- 172.21.15.50:0/2319392212 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9b90009dd0 con 0x7f9ba0131690 2023-12-16T03:32:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7fa3bb7fe640 1 -- 172.21.15.50:0/749001867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc1302d0 con 0x7fa3a4003970 2023-12-16T03:32:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f9b9dffb640 1 -- 172.21.15.50:0/2319392212 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9b9000e230 con 0x7f9ba0131690 2023-12-16T03:32:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f9b9dffb640 1 -- 172.21.15.50:0/2319392212 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9b9000e4d0 con 0x7f9ba0131690 2023-12-16T03:32:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7f8ed5448640 1 --2- 172.21.15.50:0/112412508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131960 0x7f8ed009e120 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c568b0c7a33a75 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.059+0000 7fa3bb7fe640 1 --2- 172.21.15.50:0/749001867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3a4003dc0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1692df3aaeb010dd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa3ac007c10 con 0x7fa3a4003970 2023-12-16T03:32:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa3ac0058a0 con 0x7fa3a4003970 2023-12-16T03:32:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f01eee6d640 1 -- 172.21.15.50:0/2454868278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 msgr2=0x7f01e8132f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f01eee6d640 1 --2- 172.21.15.50:0/2454868278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 0x7f01e8132f80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f8ed4c47640 1 -- 172.21.15.50:0/112412508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8ec0009ce0 con 0x7f8ed0131960 2023-12-16T03:32:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f8ed4c47640 1 -- 172.21.15.50:0/112412508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8ec0009e40 con 0x7f8ed0131960 2023-12-16T03:32:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f8ed4c47640 1 -- 172.21.15.50:0/112412508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8ec000e360 con 0x7f8ed0131960 2023-12-16T03:32:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7fa3ba7fc640 1 -- 172.21.15.50:0/749001867 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa3ac005b40 con 0x7fa3a4003970 2023-12-16T03:32:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f01eee6d640 1 -- 172.21.15.50:0/2454868278 shutdown_connections 2023-12-16T03:32:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f01eee6d640 1 --2- 172.21.15.50:0/2454868278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 0x7f01e8132f80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f01eee6d640 1 -- 172.21.15.50:0/2454868278 >> 172.21.15.50:0/2454868278 conn(0x7f01e806c9c0 msgr2=0x7f01e806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f01eee6d640 1 -- 172.21.15.50:0/2454868278 shutdown_connections 2023-12-16T03:32:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f01eee6d640 1 -- 172.21.15.50:0/2454868278 wait complete. 2023-12-16T03:32:34.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f9ba575e640 1 -- 172.21.15.50:0/2319392212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba0131690 msgr2=0x7f9ba009ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f9ba575e640 1 --2- 172.21.15.50:0/2319392212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba0131690 0x7f9ba009ea90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f9ba575e640 1 -- 172.21.15.50:0/2319392212 shutdown_connections 2023-12-16T03:32:34.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f9ba575e640 1 --2- 172.21.15.50:0/2319392212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba0131690 0x7f9ba009ea90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f9ba575e640 1 -- 172.21.15.50:0/2319392212 >> 172.21.15.50:0/2319392212 conn(0x7f9ba0098a20 msgr2=0x7f9ba0098e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f9ba575e640 1 -- 172.21.15.50:0/2319392212 shutdown_connections 2023-12-16T03:32:34.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f01eee6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.060+0000 7f9ba575e640 1 -- 172.21.15.50:0/2319392212 wait complete. 2023-12-16T03:32:34.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7f9ba575e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7fa3c215e640 1 -- 172.21.15.50:0/749001867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 msgr2=0x7fa3a4003dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7fa3c215e640 1 --2- 172.21.15.50:0/749001867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3a4003dc0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7fa3c215e640 1 -- 172.21.15.50:0/749001867 shutdown_connections 2023-12-16T03:32:34.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7f8ed7ead640 1 -- 172.21.15.50:0/112412508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131960 msgr2=0x7f8ed009e120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7f8ed7ead640 1 --2- 172.21.15.50:0/112412508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131960 0x7f8ed009e120 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7fa3c215e640 1 --2- 172.21.15.50:0/749001867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3a4003dc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7fa3c215e640 1 --2- 172.21.15.50:0/749001867 >> v2:172.21.15.50:3300/0 conn(0x7fa3bc0a0fc0 0x7fa3bc133620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7fa3c215e640 1 -- 172.21.15.50:0/749001867 >> 172.21.15.50:0/749001867 conn(0x7fa3bc06c9a0 msgr2=0x7fa3bc06cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7f8ed7ead640 1 -- 172.21.15.50:0/112412508 shutdown_connections 2023-12-16T03:32:34.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7f8ed7ead640 1 --2- 172.21.15.50:0/112412508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131960 0x7f8ed009e120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7f8ed7ead640 1 -- 172.21.15.50:0/112412508 >> 172.21.15.50:0/112412508 conn(0x7f8ed009eca0 msgr2=0x7f8ed009f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7fa3c215e640 1 -- 172.21.15.50:0/749001867 shutdown_connections 2023-12-16T03:32:34.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7fa3c215e640 1 -- 172.21.15.50:0/749001867 wait complete. 2023-12-16T03:32:34.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7f8ed7ead640 1 -- 172.21.15.50:0/112412508 shutdown_connections 2023-12-16T03:32:34.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7f8ed7ead640 1 -- 172.21.15.50:0/112412508 wait complete. 2023-12-16T03:32:34.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7fa3c215e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.061+0000 7f8ed7ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.062+0000 7f01eee6d640 1 Processor -- start 2023-12-16T03:32:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.062+0000 7f01eee6d640 1 -- start start 2023-12-16T03:32:34.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.062+0000 7f9ba575e640 1 Processor -- start 2023-12-16T03:32:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.062+0000 7f8ed7ead640 1 Processor -- start 2023-12-16T03:32:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.062+0000 7f9ba575e640 1 -- start start 2023-12-16T03:32:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.062+0000 7fa3c215e640 1 Processor -- start 2023-12-16T03:32:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.062+0000 7f8ed7ead640 1 -- start start 2023-12-16T03:32:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.062+0000 7fa3c215e640 1 -- start start 2023-12-16T03:32:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7f8ed7ead640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131550 0x7f8ed01199d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7f8ed7ead640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0118ed0 con 0x7f8ed0131550 2023-12-16T03:32:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7f8ed5c49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131550 0x7f8ed01199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7f8ed5c49640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131550 0x7f8ed01199d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41204/0 (socket says 172.21.15.50:41204) 2023-12-16T03:32:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7f8ed5c49640 1 -- 172.21.15.50:0/3897427507 learned_addr learned my addr 172.21.15.50:0/3897427507 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7f01eee6d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 0x7f01e81c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7f01eee6d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e811c470 con 0x7f01e80a1040 2023-12-16T03:32:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7f9ba575e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba009efd0 0x7f9ba012cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7fa3c215e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3bc1c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7fa3c215e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc1213c0 con 0x7fa3a4003970 2023-12-16T03:32:34.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.063+0000 7f9ba575e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba0136910 con 0x7f9ba009efd0 2023-12-16T03:32:34.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f8ed5c49640 1 -- 172.21.15.50:0/3897427507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed012d5e0 con 0x7f8ed0131550 2023-12-16T03:32:34.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f9b9effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba009efd0 0x7f9ba012cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f01ecc09640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 0x7f01e81c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7fa3bb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3bc1c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7fa3bb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3bc1c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41230/0 (socket says 172.21.15.50:41230) 2023-12-16T03:32:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f01ecc09640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 0x7f01e81c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41216/0 (socket says 172.21.15.50:41216) 2023-12-16T03:32:34.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7fa3bb7fe640 1 -- 172.21.15.50:0/366091469 learned_addr learned my addr 172.21.15.50:0/366091469 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f01ecc09640 1 -- 172.21.15.50:0/1836783879 learned_addr learned my addr 172.21.15.50:0/1836783879 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f9b9effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba009efd0 0x7f9ba012cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41240/0 (socket says 172.21.15.50:41240) 2023-12-16T03:32:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f9b9effd640 1 -- 172.21.15.50:0/2290154524 learned_addr learned my addr 172.21.15.50:0/2290154524 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f8ed5c49640 1 --2- 172.21.15.50:0/3897427507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131550 0x7f8ed01199d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7fa3bb7fe640 1 -- 172.21.15.50:0/366091469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc11f800 con 0x7fa3a4003970 2023-12-16T03:32:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7fa3bb7fe640 1 --2- 172.21.15.50:0/366091469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3bc1c8010 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f9b9effd640 1 -- 172.21.15.50:0/2290154524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0135480 con 0x7f9ba009efd0 2023-12-16T03:32:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f01ecc09640 1 -- 172.21.15.50:0/1836783879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e811da70 con 0x7f01e80a1040 2023-12-16T03:32:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f8ec67fc640 1 -- 172.21.15.50:0/3897427507 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8ecc004af0 con 0x7f8ed0131550 2023-12-16T03:32:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f9b9effd640 1 --2- 172.21.15.50:0/2290154524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba009efd0 0x7f9ba012cf30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f8ec67fc640 1 -- 172.21.15.50:0/3897427507 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8ecc004c50 con 0x7f8ed0131550 2023-12-16T03:32:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f8ec67fc640 1 -- 172.21.15.50:0/3897427507 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8ecc007120 con 0x7f8ed0131550 2023-12-16T03:32:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7fa3a3fff640 1 -- 172.21.15.50:0/366091469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa3ac007170 con 0x7fa3a4003970 2023-12-16T03:32:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc121120 con 0x7fa3a4003970 2023-12-16T03:32:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7f9b877fe640 1 -- 172.21.15.50:0/2290154524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9b90014410 con 0x7f9ba009efd0 2023-12-16T03:32:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.065+0000 7f9b877fe640 1 -- 172.21.15.50:0/2290154524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9b90014570 con 0x7f9ba009efd0 2023-12-16T03:32:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.065+0000 7f9ba575e640 1 -- 172.21.15.50:0/2290154524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba0136c90 con 0x7f9ba009efd0 2023-12-16T03:32:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.065+0000 7f01ecc09640 1 --2- 172.21.15.50:0/1836783879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 0x7f01e81c8320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.065+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed0119410 con 0x7f8ed0131550 2023-12-16T03:32:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7fa3a3fff640 1 -- 172.21.15.50:0/366091469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa3ac0072d0 con 0x7fa3a4003970 2023-12-16T03:32:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.064+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc12f6b0 con 0x7fa3a4003970 2023-12-16T03:32:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.065+0000 7fa3a3fff640 1 -- 172.21.15.50:0/366091469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa3ac007570 con 0x7fa3a4003970 2023-12-16T03:32:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.065+0000 7f9b877fe640 1 -- 172.21.15.50:0/2290154524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9b90014810 con 0x7f9ba009efd0 2023-12-16T03:32:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.065+0000 7f9ba575e640 1 -- 172.21.15.50:0/2290154524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba011aa00 con 0x7f9ba009efd0 2023-12-16T03:32:34.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.065+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed011a9c0 con 0x7f8ed0131550 2023-12-16T03:32:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7f01e57fa640 1 -- 172.21.15.50:0/1836783879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f01e000e040 con 0x7f01e80a1040 2023-12-16T03:32:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e811c0d0 con 0x7f01e80a1040 2023-12-16T03:32:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7f01e57fa640 1 -- 172.21.15.50:0/1836783879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f01e00094d0 con 0x7f01e80a1040 2023-12-16T03:32:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e811fc10 con 0x7f01e80a1040 2023-12-16T03:32:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed0062350 con 0x7f8ed0131550 2023-12-16T03:32:34.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7fa3a3fff640 1 -- 172.21.15.50:0/366091469 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fa3ac016420 con 0x7fa3a4003970 2023-12-16T03:32:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc1224c0 con 0x7fa3a4003970 2023-12-16T03:32:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7fa3a3fff640 1 --2- 172.21.15.50:0/366091469 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa3a8037850 0x7fa3a8039d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7f01e57fa640 1 -- 172.21.15.50:0/1836783879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f01e000e040 con 0x7f01e80a1040 2023-12-16T03:32:34.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7fa3a3fff640 1 -- 172.21.15.50:0/366091469 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fa3ac048140 con 0x7fa3a4003970 2023-12-16T03:32:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7f8ec67fc640 1 -- 172.21.15.50:0/3897427507 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f8ecc007310 con 0x7f8ed0131550 2023-12-16T03:32:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f8ec67fc640 1 --2- 172.21.15.50:0/3897427507 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f8eb4037860 0x7f8eb4039d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7fa3baffd640 1 --2- 172.21.15.50:0/366091469 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa3a8037850 0x7fa3a8039d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f8ec67fc640 1 -- 172.21.15.50:0/3897427507 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f8ecc046e50 con 0x7f8ed0131550 2023-12-16T03:32:34.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.066+0000 7f9b877fe640 1 -- 172.21.15.50:0/2290154524 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f9b900149c0 con 0x7f9ba009efd0 2023-12-16T03:32:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f9b877fe640 1 --2- 172.21.15.50:0/2290154524 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9b8c037860 0x7f9b8c039d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f9b877fe640 1 -- 172.21.15.50:0/2290154524 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f9b90019040 con 0x7f9ba009efd0 2023-12-16T03:32:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f9b9e7fc640 1 --2- 172.21.15.50:0/2290154524 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9b8c037860 0x7f9b8c039d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f8ed5448640 1 --2- 172.21.15.50:0/3897427507 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f8eb4037860 0x7f8eb4039d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f01e57fa640 1 -- 172.21.15.50:0/1836783879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f01e00118a0 con 0x7f01e80a1040 2023-12-16T03:32:34.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f01e57fa640 1 --2- 172.21.15.50:0/1836783879 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f01c8037830 0x7f01c8039d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7fa3baffd640 1 --2- 172.21.15.50:0/366091469 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa3a8037850 0x7fa3a8039d60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e8067c60 con 0x7f01e80a1040 2023-12-16T03:32:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f8ed5448640 1 --2- 172.21.15.50:0/3897427507 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f8eb4037860 0x7f8eb4039d70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.067+0000 7f01e57fa640 1 -- 172.21.15.50:0/1836783879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f01e00480a0 con 0x7f01e80a1040 2023-12-16T03:32:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.068+0000 7f01e7fff640 1 --2- 172.21.15.50:0/1836783879 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f01c8037830 0x7f01c8039d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.068+0000 7f9b857fa640 1 -- 172.21.15.50:0/2290154524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba01196d0 con 0x7f9ba009efd0 2023-12-16T03:32:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.068+0000 7f01e7fff640 1 --2- 172.21.15.50:0/1836783879 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f01c8037830 0x7f01c8039d40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.068+0000 7f9b9e7fc640 1 --2- 172.21.15.50:0/2290154524 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9b8c037860 0x7f9b8c039d70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.072+0000 7fa3a3fff640 1 -- 172.21.15.50:0/366091469 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fa3bc1224c0 con 0x7fa3a4003970 2023-12-16T03:32:34.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.076+0000 7f8ec67fc640 1 -- 172.21.15.50:0/3897427507 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f8ecc00a920 con 0x7f8ed0131550 2023-12-16T03:32:34.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.082+0000 7f01e57fa640 1 -- 172.21.15.50:0/1836783879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f01e0015970 con 0x7f01e80a1040 2023-12-16T03:32:34.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.089+0000 7f9b877fe640 1 -- 172.21.15.50:0/2290154524 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f9b90019a80 con 0x7f9ba009efd0 2023-12-16T03:32:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.250+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3bc1224c0 con 0x7fa3a4003970 2023-12-16T03:32:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.250+0000 7fa3a3fff640 1 -- 172.21.15.50:0/366091469 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7fa3bc1224c0 con 0x7fa3a4003970 2023-12-16T03:32:34.254 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-12-16T03:32:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.253+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa3a8037850 msgr2=0x7fa3a8039d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.253+0000 7fa3c215e640 1 --2- 172.21.15.50:0/366091469 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa3a8037850 0x7fa3a8039d60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.253+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 msgr2=0x7fa3bc1c8010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.253+0000 7fa3c215e640 1 --2- 172.21.15.50:0/366091469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3bc1c8010 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.253+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 shutdown_connections 2023-12-16T03:32:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.253+0000 7fa3c215e640 1 --2- 172.21.15.50:0/366091469 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7fa3a8037850 0x7fa3a8039d60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.253+0000 7fa3c215e640 1 --2- 172.21.15.50:0/366091469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3a4003970 0x7fa3bc1c8010 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.253+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 >> 172.21.15.50:0/366091469 conn(0x7fa3bc06c9a0 msgr2=0x7fa3bc132d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.254+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 shutdown_connections 2023-12-16T03:32:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.254+0000 7fa3c215e640 1 -- 172.21.15.50:0/366091469 wait complete. 2023-12-16T03:32:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.257+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ed0067040 con 0x7f8ed0131550 2023-12-16T03:32:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.257+0000 7f8ec67fc640 1 -- 172.21.15.50:0/3897427507 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f8ecc00a530 con 0x7f8ed0131550 2023-12-16T03:32:34.261 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.259+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f8eb4037860 msgr2=0x7f8eb4039d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.259+0000 7f8ed7ead640 1 --2- 172.21.15.50:0/3897427507 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f8eb4037860 0x7f8eb4039d70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.259+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131550 msgr2=0x7f8ed01199d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.259+0000 7f8ed7ead640 1 --2- 172.21.15.50:0/3897427507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131550 0x7f8ed01199d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.259+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 shutdown_connections 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.259+0000 7f8ed7ead640 1 --2- 172.21.15.50:0/3897427507 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f8eb4037860 0x7f8eb4039d70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.259+0000 7f8ed7ead640 1 --2- 172.21.15.50:0/3897427507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ed0131550 0x7f8ed01199d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.259+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 >> 172.21.15.50:0/3897427507 conn(0x7f8ed009eca0 msgr2=0x7f8ed01b9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.260+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 shutdown_connections 2023-12-16T03:32:34.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.260+0000 7f8ed7ead640 1 -- 172.21.15.50:0/3897427507 wait complete. 2023-12-16T03:32:34.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2023-12-16T03:32:34.273 DEBUG:teuthology.parallel:result is None 2023-12-16T03:32:34.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2023-12-16T03:32:34.274 DEBUG:teuthology.parallel:result is None 2023-12-16T03:32:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.279+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01e8062350 con 0x7f01e80a1040 2023-12-16T03:32:34.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.279+0000 7f01e57fa640 1 -- 172.21.15.50:0/1836783879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f01e000f680 con 0x7f01e80a1040 2023-12-16T03:32:34.283 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-12-16T03:32:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.281+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f01c8037830 msgr2=0x7f01c8039d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.281+0000 7f01eee6d640 1 --2- 172.21.15.50:0/1836783879 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f01c8037830 0x7f01c8039d40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.282+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 msgr2=0x7f01e81c8320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.282+0000 7f01eee6d640 1 --2- 172.21.15.50:0/1836783879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 0x7f01e81c8320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.282+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 shutdown_connections 2023-12-16T03:32:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.282+0000 7f01eee6d640 1 --2- 172.21.15.50:0/1836783879 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f01c8037830 0x7f01c8039d40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.282+0000 7f01eee6d640 1 --2- 172.21.15.50:0/1836783879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01e80a1040 0x7f01e81c8320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.282+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 >> 172.21.15.50:0/1836783879 conn(0x7f01e806c9c0 msgr2=0x7f01e80a1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.282+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 shutdown_connections 2023-12-16T03:32:34.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.282+0000 7f01eee6d640 1 -- 172.21.15.50:0/1836783879 wait complete. 2023-12-16T03:32:34.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2023-12-16T03:32:34.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.292+0000 7f9b857fa640 1 -- 172.21.15.50:0/2290154524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ba0062350 con 0x7f9ba009efd0 2023-12-16T03:32:34.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.292+0000 7f9b877fe640 1 -- 172.21.15.50:0/2290154524 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f9b90019670 con 0x7f9ba009efd0 2023-12-16T03:32:34.296 DEBUG:teuthology.parallel:result is None 2023-12-16T03:32:34.296 INFO:teuthology.orchestra.run.smithi050.stdout:38654705670 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.294+0000 7f9b857fa640 1 -- 172.21.15.50:0/2290154524 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9b8c037860 msgr2=0x7f9b8c039d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.294+0000 7f9b857fa640 1 --2- 172.21.15.50:0/2290154524 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9b8c037860 0x7f9b8c039d70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.294+0000 7f9b857fa640 1 -- 172.21.15.50:0/2290154524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba009efd0 msgr2=0x7f9ba012cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.294+0000 7f9b857fa640 1 --2- 172.21.15.50:0/2290154524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba009efd0 0x7f9ba012cf30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.294+0000 7f9b857fa640 1 -- 172.21.15.50:0/2290154524 shutdown_connections 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.294+0000 7f9b857fa640 1 --2- 172.21.15.50:0/2290154524 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f9b8c037860 0x7f9b8c039d70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.294+0000 7f9b857fa640 1 --2- 172.21.15.50:0/2290154524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ba009efd0 0x7f9ba012cf30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.295+0000 7f9b857fa640 1 -- 172.21.15.50:0/2290154524 >> 172.21.15.50:0/2290154524 conn(0x7f9ba0098a20 msgr2=0x7f9ba00a1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.295+0000 7f9b857fa640 1 -- 172.21.15.50:0/2290154524 shutdown_connections 2023-12-16T03:32:34.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.295+0000 7f9b857fa640 1 -- 172.21.15.50:0/2290154524 wait complete. 2023-12-16T03:32:34.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2023-12-16T03:32:34.308 DEBUG:teuthology.parallel:result is None 2023-12-16T03:32:34.308 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-16T03:32:34.308 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:32:34.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.454+0000 7f694a19e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.458+0000 7f694a19e640 1 Processor -- start 2023-12-16T03:32:34.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.458+0000 7f694a19e640 1 -- start start 2023-12-16T03:32:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f694a19e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6944097d70 0x7f694412f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f694a19e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6944098960 con 0x7f6944097960 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f694a19e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694409a2a0 con 0x7f6944097d70 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f6942ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6944097d70 0x7f694412f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f69437fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6944097960 0x7f694412f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50854/0 (socket says 172.21.15.50:50854) 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f69437fe640 1 -- 172.21.15.50:0/2332631856 learned_addr learned my addr 172.21.15.50:0/2332631856 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f69427fc640 1 -- 172.21.15.50:0/2332631856 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310836890 0 0) 0x7f6944098960 con 0x7f6944097960 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f69427fc640 1 -- 172.21.15.50:0/2332631856 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f692c003410 con 0x7f6944097960 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f6942ffd640 1 -- 172.21.15.50:0/2332631856 >> v1:172.21.15.50:6789/0 conn(0x7f6944097960 legacy=0x7f694412f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f6942ffd640 1 -- 172.21.15.50:0/2332631856 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6944072800 con 0x7f6944097d70 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f6942ffd640 1 --2- 172.21.15.50:0/2332631856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097d70 0x7f694412f950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8070686c25efc282 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.459+0000 7f69427fc640 1 -- 172.21.15.50:0/2332631856 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6938009ce0 con 0x7f6944097d70 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f69427fc640 1 -- 172.21.15.50:0/2332631856 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6938009e40 con 0x7f6944097d70 2023-12-16T03:32:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f69427fc640 1 -- 172.21.15.50:0/2332631856 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f693800e360 con 0x7f6944097d70 2023-12-16T03:32:34.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f694a19e640 1 -- 172.21.15.50:0/2332631856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097d70 msgr2=0x7f694412f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f694a19e640 1 --2- 172.21.15.50:0/2332631856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097d70 0x7f694412f950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f694a19e640 1 -- 172.21.15.50:0/2332631856 shutdown_connections 2023-12-16T03:32:34.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f694a19e640 1 --2- 172.21.15.50:0/2332631856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097d70 0x7f694412f950 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f694a19e640 1 -- 172.21.15.50:0/2332631856 >> 172.21.15.50:0/2332631856 conn(0x7f694409dff0 msgr2=0x7f694409e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f694a19e640 1 -- 172.21.15.50:0/2332631856 shutdown_connections 2023-12-16T03:32:34.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f694a19e640 1 -- 172.21.15.50:0/2332631856 wait complete. 2023-12-16T03:32:34.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.460+0000 7f694a19e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.461+0000 7f694a19e640 1 Processor -- start 2023-12-16T03:32:34.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.462+0000 7f694a19e640 1 -- start start 2023-12-16T03:32:34.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.462+0000 7f694a19e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097960 0x7f69441c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.462+0000 7f694a19e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694408a670 con 0x7f6944097960 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.462+0000 7f69437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097960 0x7f69441c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.462+0000 7f69437fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097960 0x7f69441c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41250/0 (socket says 172.21.15.50:41250) 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.462+0000 7f69437fe640 1 -- 172.21.15.50:0/3921393398 learned_addr learned my addr 172.21.15.50:0/3921393398 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.463+0000 7f69437fe640 1 -- 172.21.15.50:0/3921393398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694412e540 con 0x7f6944097960 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.463+0000 7f69437fe640 1 --2- 172.21.15.50:0/3921393398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097960 0x7f69441c83f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.463+0000 7f692bfff640 1 -- 172.21.15.50:0/3921393398 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f69340059d0 con 0x7f6944097960 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.463+0000 7f692bfff640 1 -- 172.21.15.50:0/3921393398 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6934005b30 con 0x7f6944097960 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.463+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694408c280 con 0x7f6944097960 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.463+0000 7f692bfff640 1 -- 172.21.15.50:0/3921393398 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6934005dd0 con 0x7f6944097960 2023-12-16T03:32:34.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.463+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6944094b90 con 0x7f6944097960 2023-12-16T03:32:34.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.464+0000 7f692bfff640 1 -- 172.21.15.50:0/3921393398 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f69340070b0 con 0x7f6944097960 2023-12-16T03:32:34.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.464+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694412ef40 con 0x7f6944097960 2023-12-16T03:32:34.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.464+0000 7f692bfff640 1 --2- 172.21.15.50:0/3921393398 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6930037810 0x7f6930039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.464+0000 7f692bfff640 1 -- 172.21.15.50:0/3921393398 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f6934046c40 con 0x7f6944097960 2023-12-16T03:32:34.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.464+0000 7f6942ffd640 1 --2- 172.21.15.50:0/3921393398 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6930037810 0x7f6930039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.465+0000 7f6942ffd640 1 --2- 172.21.15.50:0/3921393398 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6930037810 0x7f6930039d20 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.469+0000 7f692bfff640 1 -- 172.21.15.50:0/3921393398 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f693400d750 con 0x7f6944097960 2023-12-16T03:32:34.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.640+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 --> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f694412f690 con 0x7f6930037810 2023-12-16T03:32:34.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.643+0000 7f692bfff640 1 -- 172.21.15.50:0/3921393398 <== mgr.4101 v2:172.21.15.124:6800/3615071509 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30046 (crc 0 0 0) 0x7f6938009300 con 0x7f6930037810 2023-12-16T03:32:34.646 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:32:34.646 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-16T03:32:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6930037810 msgr2=0x7f6930039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 --2- 172.21.15.50:0/3921393398 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6930037810 0x7f6930039d20 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097960 msgr2=0x7f69441c83f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 --2- 172.21.15.50:0/3921393398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097960 0x7f69441c83f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 shutdown_connections 2023-12-16T03:32:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 --2- 172.21.15.50:0/3921393398 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f6930037810 0x7f6930039d20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 --2- 172.21.15.50:0/3921393398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6944097960 0x7f69441c83f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 >> 172.21.15.50:0/3921393398 conn(0x7f694409dff0 msgr2=0x7f694409f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 shutdown_connections 2023-12-16T03:32:34.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.644+0000 7f694a19e640 1 -- 172.21.15.50:0/3921393398 wait complete. 2023-12-16T03:32:34.658 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-12-16T03:32:33.866409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109568,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320832,"statfs":{"total":429496729600,"available":429384531968,"internally_reserved":0,"allocated":1417216,"data_stored":1259008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.750730+0000","last_change":"2023-12-16T03:32:32.751436+0000","last_active":"2023-12-16T03:32:32.750730+0000","last_peered":"2023-12-16T03:32:32.750730+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.744265+0000","last_became_peered":"2023-12-16T03:32:32.744265+0000","last_unstale":"2023-12-16T03:32:32.750730+0000","last_undegraded":"2023-12-16T03:32:32.750730+0000","last_fullsized":"2023-12-16T03:32:32.750730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.753035+0000","last_change":"2023-12-16T03:32:32.753490+0000","last_active":"2023-12-16T03:32:32.753035+0000","last_peered":"2023-12-16T03:32:32.753035+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.745779+0000","last_became_peered":"2023-12-16T03:32:32.745779+0000","last_unstale":"2023-12-16T03:32:32.753035+0000","last_undegraded":"2023-12-16T03:32:32.753035+0000","last_fullsized":"2023-12-16T03:32:32.753035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-16T03:32:33.691546+0000","last_change":"2023-12-16T03:32:32.730579+0000","last_active":"2023-12-16T03:32:33.691546+0000","last_peered":"2023-12-16T03:32:33.691546+0000","last_clean":"2023-12-16T03:32:33.691546+0000","last_became_active":"2023-12-16T03:32:32.727348+0000","last_became_peered":"2023-12-16T03:32:32.727348+0000","last_unstale":"2023-12-16T03:32:33.691546+0000","last_undegraded":"2023-12-16T03:32:33.691546+0000","last_fullsized":"2023-12-16T03:32:33.691546+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.741177+0000","last_change":"2023-12-16T03:32:32.741660+0000","last_active":"2023-12-16T03:32:32.741177+0000","last_peered":"2023-12-16T03:32:32.741177+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.730678+0000","last_became_peered":"2023-12-16T03:32:32.730678+0000","last_unstale":"2023-12-16T03:32:32.741177+0000","last_undegraded":"2023-12-16T03:32:32.741177+0000","last_fullsized":"2023-12-16T03:32:32.741177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.749109+0000","last_change":"2023-12-16T03:32:32.753003+0000","last_active":"2023-12-16T03:32:32.749109+0000","last_peered":"2023-12-16T03:32:32.749109+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.740958+0000","last_became_peered":"2023-12-16T03:32:32.740958+0000","last_unstale":"2023-12-16T03:32:32.749109+0000","last_undegraded":"2023-12-16T03:32:32.749109+0000","last_fullsized":"2023-12-16T03:32:32.749109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.734627+0000","last_change":"2023-12-16T03:32:32.735120+0000","last_active":"2023-12-16T03:32:32.734627+0000","last_peered":"2023-12-16T03:32:32.734627+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.727408+0000","last_became_peered":"2023-12-16T03:32:32.727408+0000","last_unstale":"2023-12-16T03:32:32.734627+0000","last_undegraded":"2023-12-16T03:32:32.734627+0000","last_fullsized":"2023-12-16T03:32:32.734627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.746578+0000","last_change":"2023-12-16T03:32:32.747117+0000","last_active":"2023-12-16T03:32:32.746578+0000","last_peered":"2023-12-16T03:32:32.746578+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.739823+0000","last_became_peered":"2023-12-16T03:32:32.739823+0000","last_unstale":"2023-12-16T03:32:32.746578+0000","last_undegraded":"2023-12-16T03:32:32.746578+0000","last_fullsized":"2023-12-16T03:32:32.746578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.748732+0000","last_change":"2023-12-16T03:32:32.749130+0000","last_active":"2023-12-16T03:32:32.748732+0000","last_peered":"2023-12-16T03:32:32.748732+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.744006+0000","last_became_peered":"2023-12-16T03:32:32.744006+0000","last_unstale":"2023-12-16T03:32:32.748732+0000","last_undegraded":"2023-12-16T03:32:32.748732+0000","last_fullsized":"2023-12-16T03:32:32.748732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-16T03:32:33.689690+0000","last_change":"2023-12-16T03:32:30.701858+0000","last_active":"2023-12-16T03:32:33.689690+0000","last_peered":"2023-12-16T03:32:33.689690+0000","last_clean":"2023-12-16T03:32:33.689690+0000","last_became_active":"2023-12-16T03:32:30.698558+0000","last_became_peered":"2023-12-16T03:32:30.698558+0000","last_unstale":"2023-12-16T03:32:33.689690+0000","last_undegraded":"2023-12-16T03:32:33.689690+0000","last_fullsized":"2023-12-16T03:32:33.689690+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:29.663756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:29.663756+0000","last_clean_scrub_stamp":"2023-12-16T03:32:29.663756+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":651264,"data_stored":609936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27008,"kb_used_data":56,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830592,"statfs":{"total":107374182400,"available":107346526208,"internally_reserved":0,"allocated":57344,"data_stored":19568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27008,"kb_used_data":56,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830592,"statfs":{"total":107374182400,"available":107346526208,"internally_reserved":0,"allocated":57344,"data_stored":19568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":651264,"data_stored":609936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-12-16T03:32:34.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:32:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.763+0000 7f064839e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.767+0000 7f064839e640 1 Processor -- start 2023-12-16T03:32:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.767+0000 7f064839e640 1 -- start start 2023-12-16T03:32:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.768+0000 7f064839e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06400a0bb0 0x7f0640132f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.768+0000 7f064839e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064009deb0 con 0x7f06400a0fc0 2023-12-16T03:32:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.768+0000 7f064839e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064009d2b0 con 0x7f06400a0bb0 2023-12-16T03:32:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.768+0000 7f064613a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06400a0bb0 0x7f0640132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.768+0000 7f0645939640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f06400a0fc0 0x7f0640133450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50856/0 (socket says 172.21.15.50:50856) 2023-12-16T03:32:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.768+0000 7f0645939640 1 -- 172.21.15.50:0/4261840832 learned_addr learned my addr 172.21.15.50:0/4261840832 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.769+0000 7f064613a640 1 -- 172.21.15.50:0/4261840832 >> v1:172.21.15.50:6789/0 conn(0x7f06400a0fc0 legacy=0x7f0640133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.769+0000 7f064613a640 1 -- 172.21.15.50:0/4261840832 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06401302d0 con 0x7f06400a0bb0 2023-12-16T03:32:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.769+0000 7f064613a640 1 --2- 172.21.15.50:0/4261840832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 0x7f0640132f10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36066782e50d277 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.769+0000 7f0645138640 1 -- 172.21.15.50:0/4261840832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f063c009ce0 con 0x7f06400a0bb0 2023-12-16T03:32:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.769+0000 7f0645138640 1 -- 172.21.15.50:0/4261840832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f063c009e40 con 0x7f06400a0bb0 2023-12-16T03:32:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.769+0000 7f0645138640 1 -- 172.21.15.50:0/4261840832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f063c00e360 con 0x7f06400a0bb0 2023-12-16T03:32:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.770+0000 7f064839e640 1 -- 172.21.15.50:0/4261840832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 msgr2=0x7f0640132f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.770+0000 7f064839e640 1 --2- 172.21.15.50:0/4261840832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 0x7f0640132f10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.770+0000 7f064839e640 1 -- 172.21.15.50:0/4261840832 shutdown_connections 2023-12-16T03:32:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.770+0000 7f064839e640 1 --2- 172.21.15.50:0/4261840832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 0x7f0640132f10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.770+0000 7f064839e640 1 -- 172.21.15.50:0/4261840832 >> 172.21.15.50:0/4261840832 conn(0x7f064006c9a0 msgr2=0x7f064006cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.770+0000 7f064839e640 1 -- 172.21.15.50:0/4261840832 shutdown_connections 2023-12-16T03:32:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.770+0000 7f064839e640 1 -- 172.21.15.50:0/4261840832 wait complete. 2023-12-16T03:32:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.770+0000 7f064839e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.771+0000 7f064839e640 1 Processor -- start 2023-12-16T03:32:34.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.771+0000 7f064839e640 1 -- start start 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f064839e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 0x7f064011b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f064839e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064011d3a0 con 0x7f06400a0bb0 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f064613a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 0x7f064011b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f064613a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 0x7f064011b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41268/0 (socket says 172.21.15.50:41268) 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f064613a640 1 -- 172.21.15.50:0/3641380513 learned_addr learned my addr 172.21.15.50:0/3641380513 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f064613a640 1 -- 172.21.15.50:0/3641380513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064011f100 con 0x7f06400a0bb0 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f064613a640 1 --2- 172.21.15.50:0/3641380513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 0x7f064011b7f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f0636ffd640 1 -- 172.21.15.50:0/3641380513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f063c014620 con 0x7f06400a0bb0 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f0636ffd640 1 -- 172.21.15.50:0/3641380513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f063c014780 con 0x7f06400a0bb0 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064006a960 con 0x7f06400a0bb0 2023-12-16T03:32:34.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f0636ffd640 1 -- 172.21.15.50:0/3641380513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f063c014a20 con 0x7f06400a0bb0 2023-12-16T03:32:34.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.772+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064011cfd0 con 0x7f06400a0bb0 2023-12-16T03:32:34.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.773+0000 7f0636ffd640 1 -- 172.21.15.50:0/3641380513 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f063c014bd0 con 0x7f06400a0bb0 2023-12-16T03:32:34.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.773+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064011d890 con 0x7f06400a0bb0 2023-12-16T03:32:34.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.773+0000 7f0636ffd640 1 --2- 172.21.15.50:0/3641380513 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f0624037810 0x7f0624039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:34.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.773+0000 7f0636ffd640 1 -- 172.21.15.50:0/3641380513 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f063c019040 con 0x7f06400a0bb0 2023-12-16T03:32:34.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.774+0000 7f0645939640 1 --2- 172.21.15.50:0/3641380513 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f0624037810 0x7f0624039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:34.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.774+0000 7f0645939640 1 --2- 172.21.15.50:0/3641380513 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f0624037810 0x7f0624039d20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.778+0000 7f0636ffd640 1 -- 172.21.15.50:0/3641380513 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f063c00ec70 con 0x7f06400a0bb0 2023-12-16T03:32:34.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.949+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 --> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f064009f570 con 0x7f0624037810 2023-12-16T03:32:34.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.951+0000 7f0636ffd640 1 -- 172.21.15.50:0/3641380513 <== mgr.4101 v2:172.21.15.124:6800/3615071509 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30046 (crc 0 0 0) 0x7f0630001250 con 0x7f0624037810 2023-12-16T03:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:32:34.955 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-16T03:32:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.952+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f0624037810 msgr2=0x7f0624039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.953+0000 7f064839e640 1 --2- 172.21.15.50:0/3641380513 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f0624037810 0x7f0624039d20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.953+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 msgr2=0x7f064011b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.953+0000 7f064839e640 1 --2- 172.21.15.50:0/3641380513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 0x7f064011b7f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.953+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 shutdown_connections 2023-12-16T03:32:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.953+0000 7f064839e640 1 --2- 172.21.15.50:0/3641380513 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f0624037810 0x7f0624039d20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.953+0000 7f064839e640 1 --2- 172.21.15.50:0/3641380513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06400a0bb0 0x7f064011b7f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.953+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 >> 172.21.15.50:0/3641380513 conn(0x7f064006c9a0 msgr2=0x7f06401bb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:34.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.953+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 shutdown_connections 2023-12-16T03:32:34.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:34.953+0000 7f064839e640 1 -- 172.21.15.50:0/3641380513 wait complete. 2023-12-16T03:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-12-16T03:32:33.866409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109568,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320832,"statfs":{"total":429496729600,"available":429384531968,"internally_reserved":0,"allocated":1417216,"data_stored":1259008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.750730+0000","last_change":"2023-12-16T03:32:32.751436+0000","last_active":"2023-12-16T03:32:32.750730+0000","last_peered":"2023-12-16T03:32:32.750730+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.744265+0000","last_became_peered":"2023-12-16T03:32:32.744265+0000","last_unstale":"2023-12-16T03:32:32.750730+0000","last_undegraded":"2023-12-16T03:32:32.750730+0000","last_fullsized":"2023-12-16T03:32:32.750730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.753035+0000","last_change":"2023-12-16T03:32:32.753490+0000","last_active":"2023-12-16T03:32:32.753035+0000","last_peered":"2023-12-16T03:32:32.753035+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.745779+0000","last_became_peered":"2023-12-16T03:32:32.745779+0000","last_unstale":"2023-12-16T03:32:32.753035+0000","last_undegraded":"2023-12-16T03:32:32.753035+0000","last_fullsized":"2023-12-16T03:32:32.753035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-16T03:32:33.691546+0000","last_change":"2023-12-16T03:32:32.730579+0000","last_active":"2023-12-16T03:32:33.691546+0000","last_peered":"2023-12-16T03:32:33.691546+0000","last_clean":"2023-12-16T03:32:33.691546+0000","last_became_active":"2023-12-16T03:32:32.727348+0000","last_became_peered":"2023-12-16T03:32:32.727348+0000","last_unstale":"2023-12-16T03:32:33.691546+0000","last_undegraded":"2023-12-16T03:32:33.691546+0000","last_fullsized":"2023-12-16T03:32:33.691546+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.741177+0000","last_change":"2023-12-16T03:32:32.741660+0000","last_active":"2023-12-16T03:32:32.741177+0000","last_peered":"2023-12-16T03:32:32.741177+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.730678+0000","last_became_peered":"2023-12-16T03:32:32.730678+0000","last_unstale":"2023-12-16T03:32:32.741177+0000","last_undegraded":"2023-12-16T03:32:32.741177+0000","last_fullsized":"2023-12-16T03:32:32.741177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.749109+0000","last_change":"2023-12-16T03:32:32.753003+0000","last_active":"2023-12-16T03:32:32.749109+0000","last_peered":"2023-12-16T03:32:32.749109+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.740958+0000","last_became_peered":"2023-12-16T03:32:32.740958+0000","last_unstale":"2023-12-16T03:32:32.749109+0000","last_undegraded":"2023-12-16T03:32:32.749109+0000","last_fullsized":"2023-12-16T03:32:32.749109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.734627+0000","last_change":"2023-12-16T03:32:32.735120+0000","last_active":"2023-12-16T03:32:32.734627+0000","last_peered":"2023-12-16T03:32:32.734627+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.727408+0000","last_became_peered":"2023-12-16T03:32:32.727408+0000","last_unstale":"2023-12-16T03:32:32.734627+0000","last_undegraded":"2023-12-16T03:32:32.734627+0000","last_fullsized":"2023-12-16T03:32:32.734627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.746578+0000","last_change":"2023-12-16T03:32:32.747117+0000","last_active":"2023-12-16T03:32:32.746578+0000","last_peered":"2023-12-16T03:32:32.746578+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.739823+0000","last_became_peered":"2023-12-16T03:32:32.739823+0000","last_unstale":"2023-12-16T03:32:32.746578+0000","last_undegraded":"2023-12-16T03:32:32.746578+0000","last_fullsized":"2023-12-16T03:32:32.746578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-16T03:32:32.748732+0000","last_change":"2023-12-16T03:32:32.749130+0000","last_active":"2023-12-16T03:32:32.748732+0000","last_peered":"2023-12-16T03:32:32.748732+0000","last_clean":"2023-12-16T03:32:31.672444+0000","last_became_active":"2023-12-16T03:32:32.744006+0000","last_became_peered":"2023-12-16T03:32:32.744006+0000","last_unstale":"2023-12-16T03:32:32.748732+0000","last_undegraded":"2023-12-16T03:32:32.748732+0000","last_fullsized":"2023-12-16T03:32:32.748732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:31.672444+0000","last_clean_scrub_stamp":"2023-12-16T03:32:31.672444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-16T03:32:33.689690+0000","last_change":"2023-12-16T03:32:30.701858+0000","last_active":"2023-12-16T03:32:33.689690+0000","last_peered":"2023-12-16T03:32:33.689690+0000","last_clean":"2023-12-16T03:32:33.689690+0000","last_became_active":"2023-12-16T03:32:30.698558+0000","last_became_peered":"2023-12-16T03:32:30.698558+0000","last_unstale":"2023-12-16T03:32:33.689690+0000","last_undegraded":"2023-12-16T03:32:33.689690+0000","last_fullsized":"2023-12-16T03:32:33.689690+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:32:29.663756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:32:29.663756+0000","last_clean_scrub_stamp":"2023-12-16T03:32:29.663756+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":651264,"data_stored":609936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27008,"kb_used_data":56,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830592,"statfs":{"total":107374182400,"available":107346526208,"internally_reserved":0,"allocated":57344,"data_stored":19568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27008,"kb_used_data":56,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830592,"statfs":{"total":107374182400,"available":107346526208,"internally_reserved":0,"allocated":57344,"data_stored":19568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":651264,"data_stored":609936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-12-16T03:32:34.967 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-16T03:32:34.967 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-16T03:32:34.967 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-16T03:32:34.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-16T03:32:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.072+0000 7f392326d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.075+0000 7f392326d640 1 Processor -- start 2023-12-16T03:32:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.075+0000 7f392326d640 1 -- start start 2023-12-16T03:32:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.075+0000 7f392326d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f391c097960 0x7f391c12f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.075+0000 7f392326d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c098960 con 0x7f391c097d70 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.075+0000 7f392326d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c09a2a0 con 0x7f391c097960 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3921009640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f391c097960 0x7f391c12f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3920808640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f391c097d70 0x7f391c12f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50868/0 (socket says 172.21.15.50:50868) 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3920808640 1 -- 172.21.15.50:0/375543312 learned_addr learned my addr 172.21.15.50:0/375543312 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3913fff640 1 -- 172.21.15.50:0/375543312 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390867598 0 0) 0x7f391c098960 con 0x7f391c097d70 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3913fff640 1 -- 172.21.15.50:0/375543312 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39080034f0 con 0x7f391c097d70 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3921009640 1 -- 172.21.15.50:0/375543312 >> v1:172.21.15.50:6789/0 conn(0x7f391c097d70 legacy=0x7f391c12f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3921009640 1 -- 172.21.15.50:0/375543312 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c072800 con 0x7f391c097960 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3921009640 1 --2- 172.21.15.50:0/375543312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 0x7f391c12f240 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a521ba0200b547 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3913fff640 1 -- 172.21.15.50:0/375543312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3918009ce0 con 0x7f391c097960 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3913fff640 1 -- 172.21.15.50:0/375543312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3918009e40 con 0x7f391c097960 2023-12-16T03:32:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.076+0000 7f3913fff640 1 -- 172.21.15.50:0/375543312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f391800e360 con 0x7f391c097960 2023-12-16T03:32:35.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.077+0000 7f392326d640 1 -- 172.21.15.50:0/375543312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 msgr2=0x7f391c12f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:35.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.077+0000 7f392326d640 1 --2- 172.21.15.50:0/375543312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 0x7f391c12f240 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.077+0000 7f392326d640 1 -- 172.21.15.50:0/375543312 shutdown_connections 2023-12-16T03:32:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.077+0000 7f392326d640 1 --2- 172.21.15.50:0/375543312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 0x7f391c12f240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.077+0000 7f392326d640 1 -- 172.21.15.50:0/375543312 >> 172.21.15.50:0/375543312 conn(0x7f391c09dff0 msgr2=0x7f391c09e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.077+0000 7f392326d640 1 -- 172.21.15.50:0/375543312 shutdown_connections 2023-12-16T03:32:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.077+0000 7f392326d640 1 -- 172.21.15.50:0/375543312 wait complete. 2023-12-16T03:32:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.077+0000 7f392326d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:32:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.078+0000 7f392326d640 1 Processor -- start 2023-12-16T03:32:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.078+0000 7f392326d640 1 -- start start 2023-12-16T03:32:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.079+0000 7f392326d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 0x7f391c1b8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.079+0000 7f392326d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c126ad0 con 0x7f391c097960 2023-12-16T03:32:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.079+0000 7f3921009640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 0x7f391c1b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.079+0000 7f3921009640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 0x7f391c1b8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41288/0 (socket says 172.21.15.50:41288) 2023-12-16T03:32:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.079+0000 7f3921009640 1 -- 172.21.15.50:0/3711534547 learned_addr learned my addr 172.21.15.50:0/3711534547 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:32:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.079+0000 7f3921009640 1 -- 172.21.15.50:0/3711534547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c1272a0 con 0x7f391c097960 2023-12-16T03:32:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.079+0000 7f3921009640 1 --2- 172.21.15.50:0/3711534547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 0x7f391c1b8140 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.080+0000 7f3911ffb640 1 -- 172.21.15.50:0/3711534547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3918014540 con 0x7f391c097960 2023-12-16T03:32:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.080+0000 7f3911ffb640 1 -- 172.21.15.50:0/3711534547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f39180146a0 con 0x7f391c097960 2023-12-16T03:32:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.080+0000 7f3911ffb640 1 -- 172.21.15.50:0/3711534547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3918014940 con 0x7f391c097960 2023-12-16T03:32:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.080+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c126f70 con 0x7f391c097960 2023-12-16T03:32:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.080+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c1b9b70 con 0x7f391c097960 2023-12-16T03:32:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.080+0000 7f3911ffb640 1 -- 172.21.15.50:0/3711534547 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f3918014af0 con 0x7f391c097960 2023-12-16T03:32:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.081+0000 7f3911ffb640 1 --2- 172.21.15.50:0/3711534547 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3900037810 0x7f3900039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:32:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.081+0000 7f3911ffb640 1 -- 172.21.15.50:0/3711534547 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f3918019040 con 0x7f391c097960 2023-12-16T03:32:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.081+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c127100 con 0x7f391c097960 2023-12-16T03:32:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.081+0000 7f3920808640 1 --2- 172.21.15.50:0/3711534547 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3900037810 0x7f3900039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:32:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.081+0000 7f3920808640 1 --2- 172.21.15.50:0/3711534547 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3900037810 0x7f3900039d20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:32:35.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.085+0000 7f3911ffb640 1 -- 172.21.15.50:0/3711534547 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f391c127100 con 0x7f391c097960 2023-12-16T03:32:35.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.297+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f391c127100 con 0x7f391c097960 2023-12-16T03:32:35.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.297+0000 7f3911ffb640 1 -- 172.21.15.50:0/3711534547 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (crc 0 0 0) 0x7f391c127100 con 0x7f391c097960 2023-12-16T03:32:35.301 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-16T03:32:35.301 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.299+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3900037810 msgr2=0x7f3900039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.299+0000 7f392326d640 1 --2- 172.21.15.50:0/3711534547 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3900037810 0x7f3900039d20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.299+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 msgr2=0x7f391c1b8140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.299+0000 7f392326d640 1 --2- 172.21.15.50:0/3711534547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 0x7f391c1b8140 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.299+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 shutdown_connections 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.299+0000 7f392326d640 1 --2- 172.21.15.50:0/3711534547 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f3900037810 0x7f3900039d20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.299+0000 7f392326d640 1 --2- 172.21.15.50:0/3711534547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f391c097960 0x7f391c1b8140 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.299+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 >> 172.21.15.50:0/3711534547 conn(0x7f391c09dff0 msgr2=0x7f391c06df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.299+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 shutdown_connections 2023-12-16T03:32:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T03:32:35.300+0000 7f392326d640 1 -- 172.21.15.50:0/3711534547 wait complete. 2023-12-16T03:32:35.313 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-16T03:32:35.313 INFO:teuthology.run_tasks:Running task workunit... 2023-12-16T03:32:35.328 INFO:tasks.workunit:Pulling workunits from ref ac5f0a00b675c1157dbca443e10f2f8ddb2e351a 2023-12-16T03:32:35.329 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-16T03:32:35.329 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-16T03:32:35.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:32:35.344 INFO:teuthology.orchestra.run.smithi050.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-16T03:32:35.344 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-16T03:32:35.400 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-16T03:32:35.400 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-16T03:32:35.455 INFO:tasks.workunit:timeout=3h 2023-12-16T03:32:35.455 INFO:tasks.workunit:cleanup=True 2023-12-16T03:32:35.455 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ac5f0a00b675c1157dbca443e10f2f8ddb2e351a 2023-12-16T03:32:35.511 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-16T03:33:21.248 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to 'ac5f0a00b675c1157dbca443e10f2f8ddb2e351a'. 2023-12-16T03:33:21.248 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-12-16T03:33:21.248 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T03:33:21.248 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-12-16T03:33:21.249 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at ac5f0a00b67 Merge branches sjust/wip-crimson-2023-12-13-fixes 2023-12-16T03:33:21.253 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-16T03:33:21.318 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T03:33:21.320 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T03:33:21.321 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T03:33:22.103 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T03:33:22.177 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T03:33:22.219 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T03:33:22.221 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T03:33:22.221 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T03:33:22.261 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T03:33:22.264 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-16T03:33:22.265 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-16T03:33:22.320 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2023-12-16T03:33:22.321 INFO:tasks.workunit:Running workunit rados/test.sh... 2023-12-16T03:33:22.322 DEBUG:teuthology.orchestra.run.smithi050:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac5f0a00b675c1157dbca443e10f2f8ddb2e351a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2023-12-16T03:33:22.380 INFO:tasks.workunit.client.0.smithi050.stderr:+ parallel=1 2023-12-16T03:33:22.380 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' '' = --serial ']' 2023-12-16T03:33:22.380 INFO:tasks.workunit.client.0.smithi050.stderr:+ color= 2023-12-16T03:33:22.380 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -t 1 ']' 2023-12-16T03:33:22.380 INFO:tasks.workunit.client.0.smithi050.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2023-12-16T03:33:22.381 INFO:tasks.workunit.client.0.smithi050.stderr:+ GTEST_OUTPUT=xml:/home/ubuntu/cephtest/archive/gtest_xml_report 2023-12-16T03:33:22.381 INFO:tasks.workunit.client.0.smithi050.stderr:+ declare -A pids 2023-12-16T03:33:22.381 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.381 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.381 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_aio 2023-12-16T03:33:22.381 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_aio' 2023-12-16T03:33:22.381 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_aio 2023-12-16T03:33:22.381 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.382 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_aio 2023-12-16T03:33:22.382 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84281 2023-12-16T03:33:22.382 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_aio on pid 84281' 2023-12-16T03:33:22.382 INFO:tasks.workunit.client.0.smithi050.stdout:test api_aio on pid 84281 2023-12-16T03:33:22.385 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84281 2023-12-16T03:33:22.385 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.385 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.385 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2023-12-16T03:33:22.385 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_aio_pp 2023-12-16T03:33:22.385 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_aio_pp' 2023-12-16T03:33:22.385 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_aio_pp 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.386 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_aio_pp 2023-12-16T03:33:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84288 2023-12-16T03:33:22.388 INFO:tasks.workunit.client.0.smithi050.stdout:test api_aio_pp on pid 84288 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_aio_pp on pid 84288' 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84288 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_io 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_io' 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_io 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.393 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.395 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.396 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.397 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.397 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.397 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.397 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.397 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.397 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_io 2023-12-16T03:33:22.397 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84298 2023-12-16T03:33:22.397 INFO:tasks.workunit.client.0.smithi050.stdout:test api_io on pid 84298 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_io on pid 84298' 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84298 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_io_pp 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_io_pp' 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_io_pp 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.405 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.407 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.407 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.407 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.407 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.407 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_io_pp 2023-12-16T03:33:22.407 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84309 2023-12-16T03:33:22.407 INFO:tasks.workunit.client.0.smithi050.stdout:test api_io_pp on pid 84309 2023-12-16T03:33:22.414 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_io_pp on pid 84309' 2023-12-16T03:33:22.414 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84309 2023-12-16T03:33:22.415 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.415 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.415 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2023-12-16T03:33:22.415 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_asio 2023-12-16T03:33:22.415 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_asio' 2023-12-16T03:33:22.415 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.415 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_asio 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.416 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.420 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_asio 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84322 2023-12-16T03:33:22.422 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.422 INFO:tasks.workunit.client.0.smithi050.stdout:test api_asio on pid 84322 2023-12-16T03:33:22.429 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_asio on pid 84322' 2023-12-16T03:33:22.429 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84322 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_list 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_list' 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_list 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.430 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.432 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84281/exe 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.436 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.437 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_list 2023-12-16T03:33:22.437 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.437 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.437 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.437 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.437 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84339 2023-12-16T03:33:22.437 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.437 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_list on pid 84339' 2023-12-16T03:33:22.437 INFO:tasks.workunit.client.0.smithi050.stdout:test api_list on pid 84339 2023-12-16T03:33:22.444 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84339 2023-12-16T03:33:22.444 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.444 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.444 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.444 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2023-12-16T03:33:22.444 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_lock 2023-12-16T03:33:22.444 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_lock' 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_lock 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.446 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.447 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_aio: /' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_aio.log 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84288/exe 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_lock 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.453 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84358 2023-12-16T03:33:22.453 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.453 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_lock on pid 84358' 2023-12-16T03:33:22.453 INFO:tasks.workunit.client.0.smithi050.stdout:test api_lock on pid 84358 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84358 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_lock_pp 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_lock_pp' 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_lock_pp 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_aio_pp.log 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.463 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_aio_pp: /' 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.464 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.466 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_lock_pp 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.467 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84376 2023-12-16T03:33:22.468 INFO:tasks.workunit.client.0.smithi050.stdout:test api_lock_pp on pid 84376 2023-12-16T03:33:22.476 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_lock_pp on pid 84376' 2023-12-16T03:33:22.476 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84376 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.478 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.478 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.478 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_misc 2023-12-16T03:33:22.478 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.480 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.480 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.480 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.480 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_misc' 2023-12-16T03:33:22.480 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.480 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84298/exe 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_misc 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.481 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.484 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.486 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_io: /' 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_misc 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84398 2023-12-16T03:33:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_misc on pid 84398' 2023-12-16T03:33:22.488 INFO:tasks.workunit.client.0.smithi050.stdout:test api_misc on pid 84398 2023-12-16T03:33:22.499 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84398 2023-12-16T03:33:22.499 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.499 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.499 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2023-12-16T03:33:22.499 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_misc_pp 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_io.log 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_misc_pp' 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84309/exe 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_misc_pp 2023-12-16T03:33:22.501 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.505 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84322/exe 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.507 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_io_pp: /' 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_misc_pp 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84420 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.510 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.510 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_misc_pp on pid 84420' 2023-12-16T03:33:22.510 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.510 INFO:tasks.workunit.client.0.smithi050.stdout:test api_misc_pp on pid 84420 2023-12-16T03:33:22.528 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.528 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.528 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84420 2023-12-16T03:33:22.528 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.528 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.528 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_tier_pp 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_tier_pp' 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_io_pp.log 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_asio.log 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.529 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.530 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.533 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_asio: /' 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84339/exe 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.537 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_tier_pp 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2023-12-16T03:33:22.538 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_list: /' 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_list.log 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.541 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84358/exe 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_tier_pp 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84457 2023-12-16T03:33:22.543 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_tier_pp on pid 84457' 2023-12-16T03:33:22.544 INFO:tasks.workunit.client.0.smithi050.stdout:test api_tier_pp on pid 84457 2023-12-16T03:33:22.553 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84457 2023-12-16T03:33:22.553 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.553 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.553 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2023-12-16T03:33:22.553 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.553 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_pool 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84398/exe 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.556 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_misc: /' 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_pool' 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_pool 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_lock: /' 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.558 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_lock.log 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.560 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_pool 2023-12-16T03:33:22.561 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84482 2023-12-16T03:33:22.561 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_pool on pid 84482' 2023-12-16T03:33:22.561 INFO:tasks.workunit.client.0.smithi050.stdout:test api_pool on pid 84482 2023-12-16T03:33:22.570 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84482 2023-12-16T03:33:22.570 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.570 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.570 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_misc.log 2023-12-16T03:33:22.570 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.570 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.570 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84376/exe 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.574 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_snapshots 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_snapshots' 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.576 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.577 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_snapshots 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_snapshots 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84547 2023-12-16T03:33:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_snapshots on pid 84547' 2023-12-16T03:33:22.579 INFO:tasks.workunit.client.0.smithi050.stdout:test api_snapshots on pid 84547 2023-12-16T03:33:22.580 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84547 2023-12-16T03:33:22.580 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.580 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.580 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_snapshots_pp 2023-12-16T03:33:22.580 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_snapshots_pp' 2023-12-16T03:33:22.580 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.580 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.581 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_snapshots_pp 2023-12-16T03:33:22.581 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_lock_pp.log 2023-12-16T03:33:22.581 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_lock_pp: /' 2023-12-16T03:33:22.581 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_snapshots_pp 2023-12-16T03:33:22.581 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84568 2023-12-16T03:33:22.581 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_snapshots_pp on pid 84568' 2023-12-16T03:33:22.581 INFO:tasks.workunit.client.0.smithi050.stdout:test api_snapshots_pp on pid 84568 2023-12-16T03:33:22.591 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84568 2023-12-16T03:33:22.591 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_stat 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_stat' 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_stat 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.593 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.596 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.600 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_stat 2023-12-16T03:33:22.601 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84605 2023-12-16T03:33:22.602 INFO:tasks.workunit.client.0.smithi050.stdout:test api_stat on pid 84605 2023-12-16T03:33:22.610 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_stat on pid 84605' 2023-12-16T03:33:22.610 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84605 2023-12-16T03:33:22.610 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.610 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.610 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84420/exe 2023-12-16T03:33:22.610 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_stat_pp 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_stat_pp' 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.613 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_stat_pp 2023-12-16T03:33:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.615 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_misc_pp: /' 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_misc_pp.log 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84457/exe 2023-12-16T03:33:22.616 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.618 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.618 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.618 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_stat_pp 2023-12-16T03:33:22.618 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.618 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.618 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.618 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84626 2023-12-16T03:33:22.618 INFO:tasks.workunit.client.0.smithi050.stdout:test api_stat_pp on pid 84626 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_stat_pp on pid 84626' 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84626 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_watch_notify 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_watch_notify' 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.639 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.641 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_tier_pp.log 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.642 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.643 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.644 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.645 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.646 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.647 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84482/exe 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.648 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.650 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.651 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.652 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_pool: /' 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_pool.log 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.653 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.654 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84547/exe 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_tier_pp: /' 2023-12-16T03:33:22.655 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.464+0000 7f22c00a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.483+0000 7f22c00a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.483+0000 7f22c00a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] Global test environment set-up. 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] 12 tests from AsioRados 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.484+0000 7f22c00a6640 1 Processor -- start 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.484+0000 7f22c00a6640 1 -- start start 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.485+0000 7f22c00a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bd87980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.485+0000 7f22c00a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82bbee1a0 con 0x55a82bc5aaa0 2023-12-16T03:33:22.656 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.485+0000 7f22b919a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bd87980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.485+0000 7f22b919a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bd87980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36758/0 (socket says 172.21.15.50:36758) 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.485+0000 7f22b919a640 1 -- 172.21.15.50:0/142731170 learned_addr learned my addr 172.21.15.50:0/142731170 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.486+0000 7f22b919a640 1 -- 172.21.15.50:0/142731170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a82bb8f6b0 con 0x55a82bc5aaa0 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.486+0000 7f22b919a640 1 --2- 172.21.15.50:0/142731170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bd87980 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc4d71be8f9e455 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.525+0000 7f22ab7fe640 1 -- 172.21.15.50:0/142731170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f22ac0068b0 con 0x55a82bc5aaa0 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.526+0000 7f22ab7fe640 1 -- 172.21.15.50:0/142731170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f22ac006a10 con 0x55a82bc5aaa0 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.526+0000 7f22ab7fe640 1 -- 172.21.15.50:0/142731170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f22ac006cb0 con 0x55a82bc5aaa0 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.527+0000 7f22c00a6640 1 -- 172.21.15.50:0/142731170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 msgr2=0x55a82bd87980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.527+0000 7f22c00a6640 1 --2- 172.21.15.50:0/142731170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bd87980 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:33:22.657 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.527+0000 7f22c00a6640 1 -- 172.21.15.50:0/142731170 shutdown_connections 2023-12-16T03:33:22.661 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.661 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.661 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.661 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.662 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.663 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_watch_notify 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_watch_notify 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84701 2023-12-16T03:33:22.664 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_watch_notify on pid 84701' 2023-12-16T03:33:22.665 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.527+0000 7f22c00a6640 1 --2- 172.21.15.50:0/1test api_watch_notify on pid 84701 2023-12-16T03:33:22.673 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84701 2023-12-16T03:33:22.673 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.673 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.673 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.673 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84568/exe 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.674 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_snapshots.log 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.675 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.676 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.677 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_snapshots: /' 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_watch_notify_pp 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_watch_notify_pp' 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_watch_notify_pp 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.678 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_snapshots_pp: /' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.679 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_watch_notify_pp 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84730 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_watch_notify_pp on pid 84730' 2023-12-16T03:33:22.680 INFO:tasks.workunit.client.0.smithi050.stdout:test api_watch_notify_pp on pid 84730 2023-12-16T03:33:22.696 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84730 2023-12-16T03:33:22.696 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.696 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.696 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.696 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_cmd 2023-12-16T03:33:22.696 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.696 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.696 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_cmd' 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.697 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84626/exe 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_cmd 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.698 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_stat_pp.log 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.699 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_stat_pp: /' 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.700 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.701 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.702 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.703 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.704 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84605/exe 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.705 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_stat: /' 2023-12-16T03:33:22.706 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_stat.log 2023-12-16T03:33:22.707 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2023-12-16T03:33:22.707 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.707 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_cmd 2023-12-16T03:33:22.707 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84768 2023-12-16T03:33:22.707 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.707 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.707 INFO:tasks.workunit.client.0.smithi050.stdout:test api_cmd on pid 84768 2023-12-16T03:33:22.714 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_cmd on pid 84768' 2023-12-16T03:33:22.714 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84768 2023-12-16T03:33:22.714 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.714 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.714 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.714 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_cmd_pp 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_cmd_pp' 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.715 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_cmd_pp 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.716 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.717 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.718 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84730/exe 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.719 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_cmd_pp 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84798 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_cmd_pp on pid 84798' 2023-12-16T03:33:22.720 INFO:tasks.workunit.client.0.smithi050.stdout:test api_cmd_pp on pid 84798 2023-12-16T03:33:22.730 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84798 2023-12-16T03:33:22.730 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.730 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.730 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.731 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.732 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.733 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_service 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.734 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_service' 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_service 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.735 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.736 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.737 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.738 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.739 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.739 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.739 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.739 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.739 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.739 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.739 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_service 2023-12-16T03:33:22.739 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84833 2023-12-16T03:33:22.739 INFO:tasks.workunit.client.0.smithi050.stdout:test api_service on pid 84833 2023-12-16T03:33:22.746 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_service on pid 84833' 2023-12-16T03:33:22.746 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84833 2023-12-16T03:33:22.746 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.746 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.746 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2023-12-16T03:33:22.746 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_service_pp 2023-12-16T03:33:22.746 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.746 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.746 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_service_pp' 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_service_pp 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.747 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.748 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.749 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.750 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_service_pp 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84856 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_service_pp on pid 84856' 2023-12-16T03:33:22.751 INFO:tasks.workunit.client.0.smithi050.stdout:test api_service_pp on pid 84856 2023-12-16T03:33:22.759 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2023-12-16T03:33:22.759 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84856 2023-12-16T03:33:22.759 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.759 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.759 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.759 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_c_write_operations 2023-12-16T03:33:22.759 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.759 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.759 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_c_write_operations' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.760 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_c_write_operations 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.761 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.762 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.763 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.764 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.765 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_c_write_operations 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.766 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84868 2023-12-16T03:33:22.767 INFO:tasks.workunit.client.0.smithi050.stdout:test api_c_write_operations on pid 84868 2023-12-16T03:33:22.775 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_c_write_operations on pid 84868' 2023-12-16T03:33:22.775 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84868 2023-12-16T03:33:22.775 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.775 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.775 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84798/exe 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_c_read_operations 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_c_read_operations' 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.776 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_c_read_operations 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.777 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.778 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84701/exe 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.779 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.780 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.781 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.782 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_c_read_operations 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84887 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_c_read_operations on pid 84887' 2023-12-16T03:33:22.783 INFO:tasks.workunit.client.0.smithi050.stdout:test api_c_read_operations on pid 84887 2023-12-16T03:33:22.792 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84887 2023-12-16T03:33:22.792 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_watch_notify.log 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_watch_notify: /' 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.793 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.794 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.795 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.796 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_cmd_pp: /' 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.797 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s api_cls_remote_reads 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' api_cls_remote_reads' 2023-12-16T03:33:22.798 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo api_cls_remote_reads 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.800 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.801 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=api_cls_remote_reads 2023-12-16T03:33:22.801 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.801 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84916 2023-12-16T03:33:22.801 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2023-12-16T03:33:22.801 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test api_cls_remote_reads on pid 84916' 2023-12-16T03:33:22.801 INFO:tasks.workunit.client.0.smithi050.stdout:test api_cls_remote_reads on pid 84916 2023-12-16T03:33:22.805 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=84916 2023-12-16T03:33:22.805 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s list_parallel 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' list_parallel' 2023-12-16T03:33:22.806 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84768/exe 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.807 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.808 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stdout:42731170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bd87980 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.527+0000 7f22c00a6640 1 -- 172.21.15.50:0/142731170 >> 172.21.15.50:0/142731170 conn(0x55a82bb62e00 msgr2=0x55a82bcef160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.528+0000 7f22c00a6640 1 -- 172.21.15.50:0/142731170 shutdown_connections 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.528+0000 7f22c00a6640 1 -- 172.21.15.50:0/142731170 wait complete. 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.530+0000 7f22c00a6640 1 Processor -- start 2023-12-16T03:33:22.809 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.530+0000 7f22c00a6640 1 -- start start 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.531+0000 7f22c00a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bced540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.531+0000 7f22c00a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82bbe9a90 con 0x55a82bc5aaa0 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.532+0000 7f22b919a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bced540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.532+0000 7f22b919a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bced540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36800/0 (socket says 172.21.15.50:36800) 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.532+0000 7f22b919a640 1 -- 172.21.15.50:0/1969451787 learned_addr learned my addr 172.21.15.50:0/1969451787 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.532+0000 7f22b919a640 1 -- 172.21.15.50:0/1969451787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a82bb82860 con 0x55a82bc5aaa0 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.533+0000 7f22b919a640 1 --2- 172.21.15.50:0/1969451787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bced540 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.648+0000 7f22aa7fc640 1 -- 172.21.15.50:0/1969451787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f22ac038040 con 0x55a82bc5aaa0 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.648+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a82bb822c0 con 0x55a82bc5aaa0 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.648+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a82bcee670 con 0x55a82bc5aaa0 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.649+0000 7f22aa7fc640 1 -- 172.21.15.50:0/1969451787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f22ac006b80 con 0x55a82bc5aaa0 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.649+0000 7f22aa7fc640 1 -- 172.21.15.50:0/1969451787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f22ac0068b0 con 0x55a82bc5aaa0 2023-12-16T03:33:22.810 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.651+0000 7f22aa7fc640 1 -- 172.21.15.50:0/1969451787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f22ac03b040 con 0x55a82bc5aaa0 2023-12-16T03:33:22.821 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.822 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo list_parallel 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.823 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.824 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.825 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_cmd.log 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_cmd: /' 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.826 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.827 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84833/exe 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.828 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.829 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84856/exe 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.830 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2023-12-16T03:33:22.831 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.832 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.832 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=list_parallel 2023-12-16T03:33:22.832 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.832 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=85033 2023-12-16T03:33:22.832 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test list_parallel on pid 85033' 2023-12-16T03:33:22.832 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.651+0000 7f22aa7fc640 1 --2- 172.21.15.50:0/1969451787 >> [v2:172.21.test list_parallel on pid 85033 2023-12-16T03:33:22.846 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=85033 2023-12-16T03:33:22.846 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.846 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.846 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.846 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.846 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.846 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.846 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_service.log 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.847 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_service: /' 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_service_pp.log 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.848 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_service_pp: /' 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84887/exe 2023-12-16T03:33:22.849 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.850 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.851 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s open_pools_parallel 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_c_read_operations: /' 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.852 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.853 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' open_pools_parallel' 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.855 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.856 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo open_pools_parallel 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=open_pools_parallel 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.857 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=85077 2023-12-16T03:33:22.858 INFO:tasks.workunit.client.0.smithi050.stdout:test open_pools_parallel on pid 85077 2023-12-16T03:33:22.865 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test open_pools_parallel on pid 85077' 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=85077 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84916/exe 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.866 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.867 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.868 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:++ printf %25s delete_pools_parallel 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ r=' delete_pools_parallel' 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/84868/exe 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.869 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:++ awk '{print $1}' 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.871 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:++ echo delete_pools_parallel 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:+ ff=delete_pools_parallel 2023-12-16T03:33:22.872 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=85112 2023-12-16T03:33:22.873 INFO:tasks.workunit.client.0.smithi050.stdout:test delete_pools_parallel on pid 85112 2023-12-16T03:33:22.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'test delete_pools_parallel on pid 85112' 2023-12-16T03:33:22.889 INFO:tasks.workunit.client.0.smithi050.stderr:+ pids[$f]=85112 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+ ret=0 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' 1 -eq 1 ']' 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84457 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 84457 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ api_c_write_operations: /' 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.890 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.891 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -f /etc/bashrc ']' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:+ . /etc/bashrc 2023-12-16T03:33:22.892 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ BASHRCSOURCED=Y 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ shopt -q login_shell 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:+++ umask 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.893 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' 0022 -eq 0 ']' 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ SHELL=/bin/bash 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/85033/exe 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-16T03:33:22.894 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.895 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ list_parallel: /' 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.896 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'grep=grep --color=auto' 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_list_parallel.log 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorls.sh 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' '!' -t 0 ']' 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:+++ return 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-16T03:33:22.897 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export S_COLORS=auto 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:+++ S_COLORS=auto 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-16T03:33:22.898 INFO:tasks.workunit.client.0.smithi050.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.899 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/gawk.sh 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.900 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/lang.sh 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/locale 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-16T03:33:22.901 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.902 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/cls_remote_reads.cc:13: Skipped 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: Not supported by crimson yet. Skipped 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather (0 ms) 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (0 ms total) 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (0 ms total) 2023-12-16T03:33:22.903 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ PASSED ] 0 tests. 2023-12-16T03:33:22.904 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ SKIPPED ] 1 test, listed below: 2023-12-16T03:33:22.904 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather 2023-12-16T03:33:22.904 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: 2023-12-16T03:33:22.766+0000 7ff695e35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:22.904 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: 2023-12-16T03:33:22.766+0000 7ff695e35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:22.904 INFO:tasks.workunit.client.0.smithi050.stdout: api_cls_remote_reads: 2023-12-16T03:33:22.766+0000 7ff695e35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:22.909 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.909 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.909 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.909 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.909 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.909 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.909 INFO:tasks.workunit.client.0.smithi050.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-16T03:33:22.909 INFO:tasks.workunit.client.0.smithi050.stderr:++++ export LANG=en_US.UTF-8 2023-12-16T03:33:22.909 INFO:tasks.workunit.client.0.smithi050.stderr:++++ LANG=en_US.UTF-8 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ LANG=en_US.UTF-8 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ unset LANG_backup config 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n '' ']' 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' dumb = linux ']' 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/less.sh 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ for i in /etc/profile.d/*.sh 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-16T03:33:22.910 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '' ']' 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:++ . /etc/profile.d/which2.sh 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/85112/exe 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+++++ readlink /proc/85077/exe 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:++++ basename /usr/bin/bash 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.911 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_declare='declare -f' 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+++ which_opt=-f 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export which_declare 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+++ export -f which 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset i 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset -f pathmunge 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ delete_pools_parallel: /' 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset rc 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2023-12-16T03:33:22.912 INFO:tasks.workunit.client.0.smithi050.stderr:+ sed 's/^/ open_pools_parallel: /' 2023-12-16T03:33:27.125 INFO:tasks.workunit.client.0.smithi050.stdout:15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f22a40364d0 0x7f22a40389e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:33:27.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.651+0000 7f22aa7fc640 1 -- 172.21.15.50:0/1969451787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f22ac068350 con 0x55a82bc5aaa0 2023-12-16T03:33:27.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.651+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55a82bbe2920 con 0x55a82bc5aaa0 2023-12-16T03:33:27.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.652+0000 7f22b8999640 1 --2- 172.21.15.50:0/1969451787 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f22a40364d0 0x7f22a40389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:33:27.125 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.652+0000 7f22aa7fc640 1 -- 172.21.15.50:0/1969451787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7f22ac030ee0 con 0x55a82bc5aaa0 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.652+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x55a82bbf3b20 con 0x55a82bc5aaa0 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:22.653+0000 7f22b8999640 1 --2- 172.21.15.50:0/1969451787 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f22a40364d0 0x7f22a40389e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:23.235+0000 7f22aa7fc640 1 -- 172.21.15.50:0/1969451787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v15) v1 ==== 43+0+0 (crc 0 0 0) 0x7f22ac0323a0 con 0x55a82bc5aaa0 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:23.236+0000 7f22aa7fc640 1 -- 172.21.15.50:0/1969451787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=15}) v3 -- 0x7f22a403adf0 con 0x55a82bc5aaa0 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:23.267+0000 7f22aa7fc640 1 -- 172.21.15.50:0/1969451787 <== mon.0 v2:172.21.15.50:3300/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 8124+0+0 (crc 0 0 0) 0x7f22ac03a8c0 con 0x55a82bc5aaa0 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:23.267+0000 7f22c00a6640 1 --2- 172.21.15.50:0/1969451787 >> v2:172.21.15.50:6801/2523453502 conn(0x55a82bcf2100 0x55a82bd93e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:23.267+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:2 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bcddb30 con 0x55a82bcf2100 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:23.268+0000 7f22b999b640 1 --2- 172.21.15.50:0/1969451787 >> v2:172.21.15.50:6801/2523453502 conn(0x55a82bcf2100 0x55a82bd93e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:23.280+0000 7f22b999b640 1 --2- 172.21.15.50:0/1969451787 >> v2:172.21.15.50:6801/2523453502 conn(0x55a82bcf2100 0x55a82bd93e40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:27.123+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 1 ==== osd_op_reply(2 exist [writefull 0~5] v16'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:27.126 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2023-12-16T03:33:27.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2023-12-16T03:33:27.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] Global test environment set-up. 2023-12-16T03:33:27.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2023-12-16T03:33:27.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: seed 84640 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-12-16T03:33:22.562+0000 7f3002a90940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-12-16T03:33:22.562+0000 7f3002a90940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-12-16T03:33:22.562+0000 7f3002a90940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:287: Skipped 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:2182: Skipped 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:2561: Skipped 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (0 ms total) 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-12-16T03:33:27.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.278 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (1 ms) 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.279 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2023-12-16T03:33:27.280 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.281 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2023-12-16T03:33:27.282 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2023-12-16T03:33:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2023-12-16T03:33:27.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-12-16T03:33:27.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-12-16T03:33:27.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:27.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:27.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:28.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2023-12-16T03:33:28.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-12-16T03:33:28.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:28.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:28.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.285 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2023-12-16T03:33:28.286 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.287 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.288 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (0 ms total) 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6267: Skipped 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2023-12-16T03:33:28.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2023-12-16T03:33:28.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2023-12-16T03:33:28.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2023-12-16T03:33:28.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2023-12-16T03:33:28.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (1 ms) 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2023-12-16T03:33:28.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2023-12-16T03:33:28.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2023-12-16T03:33:28.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/tier_cxx.cc:6272: Skipped 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [----------] Global test environment tear-down 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (5721 ms total) 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ PASSED ] 0 tests. 2023-12-16T03:33:28.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] 77 tests, listed below: 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-12-16T03:33:28.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2023-12-16T03:33:28.301 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-12-16T03:33:28.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2023-12-16T03:33:28.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-12-16T03:33:28.304 INFO:tasks.workunit.client.0.smithi050.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-12-16T03:33:28.305 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-12-16T03:33:28.305 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84322 2023-12-16T03:33:28.305 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 84322 2023-12-16T03:33:38.864 INFO:tasks.workunit.client.0.smithi050.stdout:api_asio: 2023-12-16T03:33:27.123+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:3 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bcee920 con 0x55a82bcf2100 2023-12-16T03:33:38.864 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:27.123+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:4 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bcda440 con 0x55a82bcf2100 2023-12-16T03:33:38.864 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:34.211+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 2 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:38.864 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:34.211+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v16'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:38.864 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (7088 ms) 2023-12-16T03:33:38.864 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:34.211+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:5 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bcd9fa0 con 0x55a82bcf2100 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:34.211+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:6 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bcdacc0 con 0x55a82bcf2100 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:38.828+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:38.828+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v16'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (4617 ms) 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:38.828+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:7 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bcda820 con 0x55a82bcf2100 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:38.828+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:8 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bdd4eb0 con 0x55a82bcf2100 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:38.849+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 6 ==== osd_op_reply(7 exist [read 0~5 out=5b] v16'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:38.861+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 7 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (33 ms) 2023-12-16T03:33:38.865 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2023-12-16T03:33:39.200 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:38.861+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2 api_stat: Running main() from gmock_main.cc 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] Global test environment set-up. 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] 5 tests from LibRadosStat 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.Stat (10080 ms) 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (1787 ms) 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.StatNS (2830 ms) 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2023-12-16T03:33:39.201 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (8 ms) 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] 5 tests from LibRadosStat (14705 ms total) 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:168: Skipped 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:33:39.202 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2023-12-16T03:33:39.203 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:176: Skipped 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (0 ms total) 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [----------] Global test environment tear-down 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (16591 ms total) 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ PASSED ] 5 tests. 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ SKIPPED ] 4 tests, listed below: 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.Stat 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.StatNS 2023-12-16T03:33:39.204 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.ClusterStat 2023-12-16T03:33:39.205 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.PoolStat 2023-12-16T03:33:42.144 INFO:tasks.workunit.client.0.smithi050.stdout::172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:9 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd95830 con 0x55a82bcf2100 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:40.101+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 8 ==== osd_op_reply(9 exist [write 0~5] v30'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (1240 ms) 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:40.102+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:10 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd95830 con 0x55a82bcf2100 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:41.058+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 9 ==== osd_op_reply(10 exist [write 0~5] v31'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (957 ms) 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:41.058+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:11 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bdb7f00 con 0x55a82bcf2100 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.102+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 10 ==== osd_op_reply(11 exist [write 0~5] v32'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (1044 ms) 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2023-12-16T03:33:42.145 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.103+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:12 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd94820 con 0x55a82bcf2100 2023-12-16T03:33:42.146 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.103+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:13 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd95170 con 0x55a82bcf2100 2023-12-16T03:33:42.146 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.121+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 11 ==== osd_op_reply(12 exist [read 0~5 out=5b] v32'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:42.146 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.130+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 12 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:42.146 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (28 ms) 2023-12-16T03:33:42.146 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2023-12-16T03:33:42.146 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.130+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:14 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd94820 con 0x55a82bcf2100 2023-12-16T03:33:42.146 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.130+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:15 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd952c0 con 0x55a82bcf2100 2023-12-16T03:33:45.232 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:4 api_stat_pp: Running main() from gmock_main.cc 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] Global test environment set-up. 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: seed 84741 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (4041 ms) 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (4444 ms) 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (6044 ms) 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2023-12-16T03:33:45.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (6169 ms) 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (20698 ms total) 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:45.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2023-12-16T03:33:45.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (0 ms total) 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [----------] Global test environment tear-down 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (22642 ms total) 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ PASSED ] 5 tests. 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ SKIPPED ] 4 tests, listed below: 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPP 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2023-12-16T03:33:45.236 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.PoolStatPP 2023-12-16T03:33:45.237 INFO:tasks.workunit.client.0.smithi050.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPPNS 2023-12-16T03:33:46.981 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2023-12-16T03:33:46.981 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] Global test environment set-up. 2023-12-16T03:33:46.981 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2023-12-16T03:33:46.981 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2023-12-16T03:33:46.981 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2023-12-16T03:33:46.981 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-12-16T03:33:46.981 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-12-16T03:33:22.496+0000 7f721b42b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-12-16T03:33:22.496+0000 7f721b42b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-12-16T03:33:22.497+0000 7f721b42b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-12-16T03:33:22.712+0000 7f721b42b640 -1 failed for service _ceph-mon._tcp 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-12-16T03:33:22.712+0000 7f721b42b640 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (218 ms) 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2024 ms) 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2242 ms total) 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2023-12-16T03:33:46.982 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x7f71e4005d20 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x7f71fc005de0 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f433720 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f407f30 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f405110 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f752a20 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f7534d0 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f753f80 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f7549e0 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f6b86b0 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f755530 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f755ff0 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f754760 2023-12-16T03:33:46.983 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f756f30 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 0x561f4f755da0 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: started 15 aios 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x7f71e4005d20 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x7f71fc005de0 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f433720 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f407f30 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f405110 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f752a20 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f7534d0 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f753f80 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f7549e0 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f6b86b0 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f755530 2023-12-16T03:33:46.984 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f755ff0 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f754760 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f756f30 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: waiting 0x561f4f755da0 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: done. 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (18482 ms) 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (18482 ms total) 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2023-12-16T03:33:46.985 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.Exec (1750 ms) 2023-12-16T03:33:47.130 INFO:tasks.workunit.client.0.smithi050.stdout: api_m api_watch_notify_pp: Running main() from gmock_main.cc 2023-12-16T03:33:47.130 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2023-12-16T03:33:47.130 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2023-12-16T03:33:47.130 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2023-12-16T03:33:47.130 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-16T03:33:47.130 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:47.130 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2023-12-16T03:33:47.130 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2023-12-16T03:33:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (12762 ms) 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3930 ms) 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (3045 ms) 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (96 ms) 2023-12-16T03:33:47.132 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2023-12-16T03:33:47.241 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476857584 api_cmd_pp: Running main() from gmock_main.cc 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [----------] Global test environment set-up. 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (401 ms) 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (217 ms) 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (23948 ms) 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (24567 ms total) 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [----------] Global test environment tear-down 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (24568 ms total) 2023-12-16T03:33:47.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2023-12-16T03:33:48.117 INFO:tasks.workunit.client.0.smithi050.stdout:2.142+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v32'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:48.117 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.143+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:48.117 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (13 ms) 2023-12-16T03:33:48.117 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2023-12-16T03:33:48.117 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.144+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:16 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bdb7d30 con 0x55a82bcf2100 2023-12-16T03:33:48.117 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.144+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:17 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd952c0 con 0x55a82bcf2100 2023-12-16T03:33:48.117 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.157+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 15 ==== osd_op_reply(16 exist [read 0~5 out=5b] v32'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.160+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 16 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (17 ms) 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:42.160+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:18 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd94e20 con 0x55a82bcf2100 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:44.263+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 17 ==== osd_op_reply(18 exist [writefull 0~5] v33'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (2103 ms) 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:44.264+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:19 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd94e20 con 0x55a82bcf2100 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:46.160+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 18 ==== osd_op_reply(19 exist [writefull 0~5] v35'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1897 ms) 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2023-12-16T03:33:48.118 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:46.160+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 --> v2:172.21.15.50:6801/2523453502 -- osd_op(unknown.0.0:20 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55a82bd94e20 con 0x55a82bcf2100 2023-12-16T03:33:48.120 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.113+0000 7f22b999b640 1 -- 172.21.15.50:0/1969451787 <== osd.0 v2:172.21.15.50:6801/2523453502 19 ==== osd_op_reply(20 exist [writefull 0~5] v37'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f22b000c430 con 0x55a82bcf2100 2023-12-16T03:33:48.120 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1954 ms) 2023-12-16T03:33:48.120 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 >> v2:172.21.15.50:6801/2523453502 conn(0x55a82bcf2100 msgr2=0x55a82bd93e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:33:48.120 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 --2- 172.21.15.50:0/1969451787 >> v2:172.21.15.50:6801/2523453502 conn(0x55a82bcf2100 0x55a82bd93e40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:33:48.120 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f22a40364d0 msgr2=0x7f22a40389e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:33:48.120 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 --2- 172.21.15.50:0/1969451787 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f22a40364d0 0x7f22a40389e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 msgr2=0x55a82bced540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 --2- 172.21.15.50:0/1969451787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bced540 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 shutdown_connections 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 --2- 172.21.15.50:0/1969451787 >> v2:172.21.15.50:6801/2523453502 conn(0x55a82bcf2100 0x55a82bd93e40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 --2- 172.21.15.50:0/1969451787 >> [v2:172.21.15.124:6800/3615071509,v1:172.21.15.124:6801/3615071509] conn(0x7f22a40364d0 0x7f22a40389e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 --2- 172.21.15.50:0/1969451787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a82bc5aaa0 0x55a82bced540 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 >> 172.21.15.50:0/1969451787 conn(0x55a82bb62e00 msgr2=0x55a82bc34270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 shutdown_connections 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.114+0000 7f22c00a6640 1 -- 172.21.15.50:0/1969451787 wait complete. 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] 12 tests from AsioRados (20991 ms total) 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [----------] Global test environment tear-down 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (25632 ms total) 2023-12-16T03:33:48.121 INFO:tasks.workunit.client.0.smithi050.stdout: api_asio: [ PASSED ] 12 tests. 2023-12-16T03:33:48.122 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-12-16T03:33:48.122 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84547 2023-12-16T03:33:48.122 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 84547 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] Global test environment set-up. 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] 4 tests from LibRadosService 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:22.729+0000 7fdc4da2f7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:22.729+0000 7fdc4da2f7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:22.729+0000 7fdc4da2f7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5301 ms) 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.RegisterLate (38 ms) 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2023-12-16T03:33:50.369 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_WARN 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 6 pool(s) do not have an application enabled 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 1 daemons, quorum a (age 67s) 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: x(active, since 62s) 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 4 osds: 4 up (since 60s), 4 in (since 64s) 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: laundry: 2 daemons active (1 hosts) 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 28 pools, 841 pgs 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 2 objects, 577 KiB 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 107 MiB used, 400 GiB / 400 GiB avail 2023-12-16T03:33:50.370 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 98.930% pgs unknown 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 832 unknown 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 9 active+clean 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: cluster: 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: id: 729b4ed4-c01a-4cd4-b8de-ed230cc4e269 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: health: HEALTH_WARN 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 7 pool(s) do not have an application enabled 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: services: 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mon: 1 daemons, quorum a (age 69s) 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: mgr: x(active, since 64s) 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: osd: 4 osds: 4 up (since 62s), 4 in (since 66s) 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: laundry: 1 daemon active (1 hosts) 2023-12-16T03:33:50.371 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: data: 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pools: 28 pools, 841 pgs 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: objects: 10 objects, 577 KiB 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: usage: 123 MiB used, 400 GiB / 400 GiB avail 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: pgs: 43.520% pgs unknown 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 25.089% pgs not active 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 366 unknown 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 264 active+clean 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 139 creating+peering 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 72 creating+activating 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: io: 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: client: 1.7 KiB/s wr, 0 op/s rd, 1 op/s wr 2023-12-16T03:33:50.372 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.373 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.373 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2259 ms) 2023-12-16T03:33:50.373 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ RUN ] LibRadosService.Status 2023-12-16T03:33:50.373 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ OK ] LibRadosService.Status (20039 ms) 2023-12-16T03:33:50.373 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] 4 tests from LibRadosService (27637 ms total) 2023-12-16T03:33:50.373 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: 2023-12-16T03:33:50.373 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [----------] Global test environment tear-down 2023-12-16T03:33:50.374 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27637 ms total) 2023-12-16T03:33:50.374 INFO:tasks.workunit.client.0.smithi050.stdout: api_service: [ PASSED ] 4 tests. 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: Running main() from gmock_main.cc 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] Global test environment set-up. 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] 9 tests from LibRadosPools 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2705 ms) 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3026 ms) 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3000 ms) 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2023-12-16T03:33:52.268 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3014 ms) 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (2899 ms) 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5018 ms) 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5024 ms) 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5026 ms) 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/pool.cc:139: Skipped 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: Not supported by crimson yet. Skipped 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] 9 tests from LibRadosPools (29712 ms total) 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: 2023-12-16T03:33:52.269 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [----------] Global test environment tear-down 2023-12-16T03:33:52.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (29712 ms total) 2023-12-16T03:33:52.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ PASSED ] 8 tests. 2023-12-16T03:33:52.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ SKIPPED ] 1 test, listed below: 2023-12-16T03:33:52.270 INFO:tasks.workunit.client.0.smithi050.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier 2023-12-16T03:33:53.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2023-12-16T03:33:53.233 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] Global test environment set-up. 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2023-12-16T03:33:22.722+0000 7fcd5c63c7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2023-12-16T03:33:22.722+0000 7fcd5c63c7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2023-12-16T03:33:22.722+0000 7fcd5c63c7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5308 ms) 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (75 ms) 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20048 ms) 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: attempt 0 of 20 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5075 ms) 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30506 ms total) 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: 2023-12-16T03:33:53.234 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [----------] Global test environment tear-down 2023-12-16T03:33:53.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30506 ms total) 2023-12-16T03:33:53.235 INFO:tasks.workunit.client.0.smithi050.stdout: api_service_pp: [ PASSED ] 4 tests. 2023-12-16T03:33:58.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: Running main() from gmock_main.cc 2023-12-16T03:33:58.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2023-12-16T03:33:58.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [----------] Global test environment set-up. 2023-12-16T03:33:58.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2023-12-16T03:33:58.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2023-12-16T03:33:58.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (590 ms) 2023-12-16T03:33:58.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2023-12-16T03:33:58.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (59 ms) 2023-12-16T03:33:58.302 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (29940 ms) 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:52.268018+0000 mon.a [INF] from='client.? 172.21.15.50:0/2647070976' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-84368-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:53.225183+0000 mon.a [INF] from='client.? 172.21.15.50:0/998550790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-84463-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:53.264535+0000 mon.a [INF] from='client.? 172.21.15.50:0/2647070976' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi050-84368-5","app": "rados","yes_i_really_mean_it": true}]': finished 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:53.264642+0000 mon.a [INF] from='client.? 172.21.15.50:0/998550790' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-84463-1","app": "app1","yes_i_really_mean_it": true}]': finished 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:53.274394+0000 mon.a [INF] from='client.? 172.21.15.50:0/998550790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-84463-1","app": "app2"}]: dispatch 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:53.274801+0000 mon.a [INF] from='client.? 172.21.15.50:0/998550790' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi050-84463-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:53.306648+0000 client.admin [INF] onexx 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:53.306853+0000 mon.a [INF] from='client.? 172.21.15.50:0/925954911' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:56.280886+0000 mon.a [INF] from='client.? 172.21.15.50:0/998550790' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi050-84463-1","app":"app1","key":"key2","value":"value2"}]': finished 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:56.285630+0000 mon.a [INF] from='client.? 172.21.15.50:0/925954911' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:56.289453+0000 mon.a [INF] from='client.? 172.21.15.50:0/129621107' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-84348-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:56.289734+0000 mon.a [INF] from='client.? 172.21.15.50:0/998550790' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi050-84463-1","app":"app1","key":"key1"}]: dispatch 2023-12-16T03:33:58.303 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:57.286569+0000 mon.a [INF] from='client.? 172.21.15.50:0/129621107' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi050-84348-5","app": "rados","yes_i_really_mean_it": true}]': finished 2023-12-16T03:34:01.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:57.286675+0000 mon.a [INF] from='client.? 172.21.15.50:0/998550790' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi050-84463-1","app":"app1","key":"key1"}]': finished 2023-12-16T03:34:01.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:58.286106+0000 client.admin [INF] threexx 2023-12-16T03:34:01.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: got: 2023-12-16T03:33:58.286411+0000 mon.a [INF] from='client.? 172.21.15.50:0/925954911' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2023-12-16T03:34:01.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8038 ms) 2023-12-16T03:34:01.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (38627 ms total) 2023-12-16T03:34:01.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: 2023-12-16T03:34:01.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [----------] Global test environment tear-down 2023-12-16T03:34:01.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (38628 ms total) 2023-12-16T03:34:01.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_cmd: [ PASSED ] 4 tests. 2023-12-16T03:34:08.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-16T03:34:13.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2023-12-16T03:34:14.401 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Running main() from gmock_main.cc 2023-12-16T03:34:14.401 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2023-12-16T03:34:14.401 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] Global test environment set-up. 2023-12-16T03:34:14.401 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] 8 tests from LibRadosLock 2023-12-16T03:34:14.401 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (12807 ms) 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockShared (3873 ms) 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (3095 ms) 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1173 ms) 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (3752 ms) 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.Unlock (6141 ms) 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2023-12-16T03:34:14.402 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (6195 ms) 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (12888 ms) 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] 8 tests from LibRadosLock (49924 ms total) 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:168: Skipped 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.403 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2023-12-16T03:34:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.405 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2023-12-16T03:34:14.406 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:14.424 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.424 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:14.424 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:176: Skipped 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (0 ms total) 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [----------] Global test environment tear-down 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (51937 ms total) 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ PASSED ] 8 tests. 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] 8 tests, listed below: 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusive 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockShared 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockSharedDur 2023-12-16T03:34:14.425 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockMayRenew 2023-12-16T03:34:14.426 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.Unlock 2023-12-16T03:34:14.426 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.ListLockers 2023-12-16T03:34:14.426 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.BreakLock 2023-12-16T03:34:19.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~11s 2023-12-16T03:34:25.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~17s 2023-12-16T03:34:25.454 INFO:tasks.workunit.client.0.smithi050.stdout:isc: [ RUN ] LibRadosMisc.WriteSame 2023-12-16T03:34:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (4030 ms) 2023-12-16T03:34:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2023-12-16T03:34:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (2213 ms) 2023-12-16T03:34:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2023-12-16T03:34:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4074 ms) 2023-12-16T03:34:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2023-12-16T03:34:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2023-12-16T03:34:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2023-12-16T03:34:25.455 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2023-12-16T03:34:25.455 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2023-12-16T03:34:25.455 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (27355 ms) 2023-12-16T03:34:25.455 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] 8 tests from LibRadosMisc (39422 ms total) 2023-12-16T03:34:25.455 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: 2023-12-16T03:34:25.455 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [----------] Global test environment tear-down 2023-12-16T03:34:25.455 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (62942 ms total) 2023-12-16T03:34:25.455 INFO:tasks.workunit.client.0.smithi050.stdout: api_misc: [ PASSED ] 12 tests. 2023-12-16T03:34:30.466 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Running main() from gmock_main.cc 2023-12-16T03:34:30.466 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2023-12-16T03:34:30.466 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] Global test environment set-up. 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: seed 84524 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (6969 ms) 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (1709 ms) 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (5963 ms) 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (5993 ms) 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (285 ms) 2023-12-16T03:34:30.467 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (1913 ms) 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (6216 ms) 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (36252 ms) 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (65300 ms total) 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.468 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.469 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (1 ms) 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2023-12-16T03:34:30.470 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2023-12-16T03:34:30.471 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (1 ms total) 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [----------] Global test environment tear-down 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (67957 ms total) 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ PASSED ] 8 tests. 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] 8 tests, listed below: 2023-12-16T03:34:30.472 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2023-12-16T03:34:30.473 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedPP 2023-12-16T03:34:30.473 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2023-12-16T03:34:30.473 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2023-12-16T03:34:30.473 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2023-12-16T03:34:30.473 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.UnlockPP 2023-12-16T03:34:30.473 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.ListLockersPP 2023-12-16T03:34:30.473 INFO:tasks.workunit.client.0.smithi050.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.BreakLockPP 2023-12-16T03:34:30.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~22s 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Running main() from gmock_main.cc 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] Global test environment set-up. 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: seed 84413 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (1 ms) 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (4408 ms) 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (2412 ms) 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (1891 ms) 2023-12-16T03:34:33.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (1785 ms) 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (1176 ms) 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (1236 ms) 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (1687 ms) 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (4043 ms) 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (1101 ms) 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (945 ms) 2023-12-16T03:34:33.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (2238 ms) 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (2849 ms) 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (5050 ms) 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (983 ms) 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (34221 ms) 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (15 ms) 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (120 ms) 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (23 ms) 2023-12-16T03:34:33.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (2121 ms) 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (68306 ms total) 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.ReadOpPP (1 ms) 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2023-12-16T03:34:33.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2023-12-16T03:34:33.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2023-12-16T03:34:33.228 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1 ms total) 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [----------] Global test environment tear-down 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (70776 ms total) 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ PASSED ] 20 tests. 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] 17 tests, listed below: 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.ReadOpPP 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2023-12-16T03:34:33.229 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.TruncTestPP 2023-12-16T03:34:33.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2023-12-16T03:34:33.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2023-12-16T03:34:33.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RmXattrPP 2023-12-16T03:34:33.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrListPP 2023-12-16T03:34:33.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtPP 2023-12-16T03:34:33.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2023-12-16T03:34:33.230 INFO:tasks.workunit.client.0.smithi050.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2023-12-16T03:34:36.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~28s 2023-12-16T03:34:39.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Running main() from gmock_main.cc 2023-12-16T03:34:39.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2023-12-16T03:34:39.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] Global test environment set-up. 2023-12-16T03:34:39.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] 14 tests from LibRadosIo 2023-12-16T03:34:39.242 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (5000 ms) 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: no timeout :/ 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (3785 ms) 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (7110 ms) 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.Checksum (2912 ms) 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2023-12-16T03:34:39.243 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (973 ms) 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (2905 ms) 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (3271 ms) 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (27 ms) 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.TruncTest (6089 ms) 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (32666 ms) 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2023-12-16T03:34:39.244 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (7158 ms) 2023-12-16T03:34:39.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2023-12-16T03:34:39.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.RmXattr (3011 ms) 2023-12-16T03:34:39.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2023-12-16T03:34:39.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ OK ] LibRadosIo.XattrIter (17 ms) 2023-12-16T03:34:39.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] 14 tests from LibRadosIo (74924 ms total) 2023-12-16T03:34:39.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: 2023-12-16T03:34:39.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2023-12-16T03:34:39.245 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:168: Skipped 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.246 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.247 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2023-12-16T03:34:39.248 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2023-12-16T03:34:39.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.249 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (1 ms) 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:176: Skipped 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1 ms total) 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [----------] Global test environment tear-down 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [==========] 24 tests from 2 test suites ran. (76802 ms total) 2023-12-16T03:34:39.251 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ PASSED ] 14 tests. 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] 10 tests, listed below: 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.SimpleWrite 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RoundTrip 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.TruncTest 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RemoveTest 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RmXattr 2023-12-16T03:34:39.252 INFO:tasks.workunit.client.0.smithi050.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrIter 2023-12-16T03:34:41.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~33s 2023-12-16T03:34:42.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Running main() from gmock_main.cc 2023-12-16T03:34:42.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2023-12-16T03:34:42.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] Global test environment set-up. 2023-12-16T03:34:42.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2023-12-16T03:34:42.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2023-12-16T03:34:42.218 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (4026 ms) 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (9914 ms) 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2011 ms) 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (4014 ms) 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (19965 ms total) 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (44404 ms) 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (4008 ms) 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (6496 ms) 2023-12-16T03:34:42.219 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (54908 ms total) 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:168: Skipped 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.220 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:176: Skipped 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:168: Skipped 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2023-12-16T03:34:42.222 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2023-12-16T03:34:42.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:42.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:42.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2023-12-16T03:34:42.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:176: Skipped 2023-12-16T03:34:42.223 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [----------] Global test environment tear-down 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (79647 ms total) 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ PASSED ] 7 tests. 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] 6 tests, listed below: 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapList 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.Rollback 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: Running main() from gmock_main.cc 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [----------] Global test environment set-up. 2023-12-16T03:34:42.224 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (14621 ms) 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (1253 ms) 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (4159 ms) 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (10973 ms) 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (861 ms) 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (36 ms) 2023-12-16T03:34:42.225 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (1125 ms) 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (989 ms) 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (30726 ms) 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (1320 ms) 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (111 ms) 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (18 ms) 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (6240 ms) 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (2432 ms) 2023-12-16T03:34:42.226 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2023-12-16T03:34:42.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (43 ms) 2023-12-16T03:34:42.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2023-12-16T03:34:42.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (2894 ms) 2023-12-16T03:34:42.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (77802 ms total) 2023-12-16T03:34:42.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: 2023-12-16T03:34:42.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [----------] Global test environment tear-down 2023-12-16T03:34:42.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (79483 ms total) 2023-12-16T03:34:42.227 INFO:tasks.workunit.client.0.smithi050.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2023-12-16T03:34:42.227 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-12-16T03:34:42.228 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=85112 2023-12-16T03:34:42.228 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 85112 2023-12-16T03:34:47.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~39s 2023-12-16T03:34:52.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~44s 2023-12-16T03:34:54.272 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: Running main() from gmock_main.cc 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] Global test environment set-up. 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify_test_cb 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (9737 ms) 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94015738070880 err -107 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (5910 ms) 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2023-12-16T03:34:54.273 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94015738082544 err -107 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (4139 ms) 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 4239 notify_id 154618822656 cookie 94015738099232 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (4908 ms) 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 4239 notify_id 188978561025 cookie 94015738099232 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (7277 ms) 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 4239 notify_id 188978561027 cookie 94015738099232 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (50 ms) 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 4239 notify_id 317827579907 cookie 94015738099232 2023-12-16T03:34:54.274 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 4239 notify_id 317827579907 cookie 94015738121776 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (34073 ms) 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 4239 notify_id 317827579908 cookie 94015738121776 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 4239 notify_id 317827579911 cookie 94015738121776 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3922 ms) 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94015738121776 err -107 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_cb from 4239 notify_id 403726925831 cookie 94015738121776 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (14979 ms) 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94015738121776 err -107 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (4437 ms) 2023-12-16T03:34:54.275 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (89433 ms total) 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:168: Skipped 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:182: Skipped 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:196: Skipped 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/TestCase.cc:176: Skipped 2023-12-16T03:34:54.276 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-12-16T03:34:54.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2023-12-16T03:34:54.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: 2023-12-16T03:34:54.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [----------] Global test environment tear-down 2023-12-16T03:34:54.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (91598 ms total) 2023-12-16T03:34:54.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ PASSED ] 10 tests. 2023-12-16T03:34:54.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ SKIPPED ] 1 test, listed below: 2023-12-16T03:34:54.277 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify: [ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2023-12-16T03:34:57.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2023-12-16T03:34:57.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [==========] Running 19 tests from 4 test suites. 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: seed 84712 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (9032 ms) 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (7919 ms) 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (6030 ms) 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2014 ms) 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (9049 ms) 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (34044 ms total) 2023-12-16T03:34:57.290 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (25551 ms) 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/snapshots_cxx.cc:156: Skipped 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP (0 ms) 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/snapshots_cxx.cc:242: Skipped 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (0 ms) 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2023-12-16T03:34:57.291 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (6334 ms) 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2992 ms) 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/snapshots_cxx.cc:463: Skipped 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: deleting snap 13 in pool LibRadosSnapshotsSelfManagedPP_smithi050-84712-7 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: waiting for snaps to purge 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (21068 ms) 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (55945 ms total) 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.292 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.293 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:57.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2023-12-16T03:34:57.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2023-12-16T03:34:57.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:57.294 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:57.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2023-12-16T03:34:57.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-16T03:34:57.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2023-12-16T03:34:57.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2023-12-16T03:34:57.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2023-12-16T03:34:57.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-16T03:34:57.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2023-12-16T03:34:57.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [==========] 19 tests from 4 test suites ran. (94719 ms total) 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ PASSED ] 9 tests. 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] 10 tests, listed below: 2023-12-16T03:34:57.299 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2023-12-16T03:34:57.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2023-12-16T03:34:57.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-12-16T03:34:57.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2023-12-16T03:34:57.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2023-12-16T03:34:57.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2023-12-16T03:34:57.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2023-12-16T03:34:57.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2023-12-16T03:34:57.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2023-12-16T03:34:57.300 INFO:tasks.workunit.client.0.smithi050.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2023-12-16T03:34:58.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~50s 2023-12-16T03:34:59.294 INFO:tasks.workunit.client.0.smithi050.stdout:notify_id 103079215105 notifier_gid 4229 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (4909 ms) 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476874944 notify_id 103079215105 notifier_gid 4229 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (2128 ms) 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476874944 notify_id 188978561026 notifier_gid 4229 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (1944 ms) 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476874944 notify_id 210453397506 notifier_gid 4229 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (36488 ms) 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476874864 notify_id 317827579909 notifier_gid 4229 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (876 ms) 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476874864 notify_id 317827579910 notifier_gid 4229 2023-12-16T03:34:59.295 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (29 ms) 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: trying... 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476874864 notify_id 317827579912 notifier_gid 4229 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: timed out 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushing 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushed 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (9309 ms) 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: trying... 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476874864 notify_id 317827579908 notifier_gid 4229 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: timed out 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushing 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushed 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (4448 ms) 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2023-12-16T03:34:59.296 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: List watches 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify2 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476874864 notify_id 317827579909 notifier_gid 4229 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify2 done 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: watch_check 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: unwatch2 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushing 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: done 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3975 ms) 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: List watches 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify2 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: handle_notify cookie 94275476874864 notify_id 403726925833 notifier_gid 4229 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: notify2 done 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: watch_check 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: unwatch2 2023-12-16T03:34:59.297 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: flushing 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: done 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (11016 ms) 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (94955 ms total) 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (96661 ms total) 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ PASSED ] 14 tests. 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ SKIPPED ] 2 tests, listed below: 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2023-12-16T03:34:59.298 INFO:tasks.workunit.client.0.smithi050.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2023-12-16T03:35:03.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~55s 2023-12-16T03:35:09.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~61s 2023-12-16T03:35:14.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~66s 2023-12-16T03:35:20.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~72s 2023-12-16T03:35:25.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~77s 2023-12-16T03:35:31.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~83s 2023-12-16T03:35:36.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~88s 2023-12-16T03:35:42.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~94s 2023-12-16T03:35:47.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2023-12-16T03:35:53.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2023-12-16T03:35:58.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2023-12-16T03:36:04.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~116s 2023-12-16T03:36:09.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~121s 2023-12-16T03:36:15.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~127s 2023-12-16T03:36:20.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~132s 2023-12-16T03:36:26.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~138s 2023-12-16T03:36:31.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~143s 2023-12-16T03:36:32.366 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[85251]: starting. 2023-12-16T03:36:32.366 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[85251]: creating pool ceph_test_rados_open_pools_parallel.smithi050-85195 2023-12-16T03:36:32.366 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[85251]: created object 0... 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[85251]: created object 25... 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[85251]: created object 49... 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[85251]: finishing. 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_1_[85251]: shutting down. 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_2_[85257]: starting. 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_2_[85257]: rados_pool_create. 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_2_[85257]: rados_ioctx_create. 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_2_[85257]: shutting down. 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******************************* 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[148136]: starting. 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[148136]: creating pool ceph_test_rados_open_pools_parallel.smithi050-85195 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[148136]: created object 0... 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[148136]: created object 25... 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[148136]: created object 49... 2023-12-16T03:36:32.367 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[148136]: finishing. 2023-12-16T03:36:32.368 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_3_[148136]: shutting down. 2023-12-16T03:36:32.368 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******************************* 2023-12-16T03:36:32.368 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_4_[148137]: starting. 2023-12-16T03:36:32.368 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_4_[148137]: rados_pool_create. 2023-12-16T03:36:32.368 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_4_[148137]: rados_ioctx_create. 2023-12-16T03:36:32.368 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: process_4_[148137]: shutting down. 2023-12-16T03:36:32.368 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******************************* 2023-12-16T03:36:32.368 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******************************* 2023-12-16T03:36:32.368 INFO:tasks.workunit.client.0.smithi050.stdout: open_pools_parallel: ******* SUCCESS ********** 2023-12-16T03:36:37.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~149s 2023-12-16T03:36:42.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~154s 2023-12-16T03:36:48.123 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~160s 2023-12-16T03:36:53.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2023-12-16T03:36:59.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~171s 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[85266]: starting. 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[85266]: creating pool ceph_test_rados_delete_pools_parallel.smithi050-85192 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[85266]: created object 0... 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[85266]: created object 25... 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[85266]: created object 49... 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[85266]: finishing. 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_1_[85266]: shutting down. 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_2_[85267]: starting. 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_2_[85267]: deleting pool ceph_test_rados_delete_pools_parallel.smithi050-85192 2023-12-16T03:37:01.353 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_2_[85267]: shutting down. 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[148226]: starting. 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[148226]: creating pool ceph_test_rados_delete_pools_parallel.smithi050-85192 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[148226]: created object 0... 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[148226]: created object 25... 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[148226]: created object 49... 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[148226]: finishing. 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_3_[148226]: shutting down. 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[148228]: starting. 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[148228]: listing objects. 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[148228]: listed object 0... 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[148228]: listed object 25... 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[148228]: saw 50 objects 2023-12-16T03:37:01.354 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_5_[148228]: shutting down. 2023-12-16T03:37:01.355 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2023-12-16T03:37:01.355 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_4_[148227]: starting. 2023-12-16T03:37:01.355 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_4_[148227]: deleting pool ceph_test_rados_delete_pools_parallel.smithi050-85192 2023-12-16T03:37:01.355 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: process_4_[148227]: shutting down. 2023-12-16T03:37:01.355 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2023-12-16T03:37:01.355 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******************************* 2023-12-16T03:37:01.355 INFO:tasks.workunit.client.0.smithi050.stdout: delete_pools_parallel: ******* SUCCESS ********** 2023-12-16T03:37:01.356 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-12-16T03:37:01.356 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84798 2023-12-16T03:37:01.356 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 84798 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84626 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 84626 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84398 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 84398 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84730 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 84730 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ for t in "${!pids[@]}" 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ pid=84420 2023-12-16T03:37:01.357 INFO:tasks.workunit.client.0.smithi050.stderr:+ wait 84420 2023-12-16T03:37:04.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~176s 2023-12-16T03:37:10.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~182s 2023-12-16T03:37:15.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~187s 2023-12-16T03:37:21.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~193s 2023-12-16T03:37:26.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~198s 2023-12-16T03:37:32.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~204s 2023-12-16T03:37:37.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~209s 2023-12-16T03:37:43.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~215s 2023-12-16T03:37:48.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~220s 2023-12-16T03:37:54.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~226s 2023-12-16T03:37:59.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~231s 2023-12-16T03:38:05.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~237s 2023-12-16T03:38:10.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~242s 2023-12-16T03:38:16.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~248s 2023-12-16T03:38:21.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~253s 2023-12-16T03:38:27.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~259s 2023-12-16T03:38:32.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~264s 2023-12-16T03:38:38.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~270s 2023-12-16T03:38:43.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~275s 2023-12-16T03:38:49.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~281s 2023-12-16T03:38:54.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~286s 2023-12-16T03:39:00.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~292s 2023-12-16T03:39:05.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~297s 2023-12-16T03:39:07.375 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Running main() from gmock_main.cc 2023-12-16T03:39:07.375 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2023-12-16T03:39:07.375 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] Global test environment set-up. 2023-12-16T03:39:07.375 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] 26 tests from LibRadosAio 2023-12-16T03:39:07.375 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2023-12-16T03:39:07.375 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2833 ms) 2023-12-16T03:39:07.375 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (14952 ms) 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (8034 ms) 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (7037 ms) 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (35185 ms) 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (21794 ms) 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (4022 ms) 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (6940 ms) 2023-12-16T03:39:07.376 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2023-12-16T03:39:07.377 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (26112 ms) 2023-12-16T03:39:07.377 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2023-12-16T03:39:07.377 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (18071 ms) 2023-12-16T03:39:07.377 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2023-12-16T03:39:07.377 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3013 ms) 2023-12-16T03:39:07.377 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2023-12-16T03:39:07.377 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (6818 ms) 2023-12-16T03:39:07.377 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2023-12-16T03:39:07.377 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (13050 ms) 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (22076 ms) 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.Flush (14888 ms) 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (8030 ms) 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (18114 ms) 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (2860 ms) 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (21008 ms) 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2023-12-16T03:39:07.378 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (4033 ms) 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (14050 ms) 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (10923 ms) 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (14155 ms) 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (10035 ms) 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (28889 ms) 2023-12-16T03:39:07.379 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (8027 ms) 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] 26 tests from LibRadosAio (344949 ms total) 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1100: Skipped 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1132: Skipped 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2023-12-16T03:39:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1149: Skipped 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1182: Skipped 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1215: Skipped 2023-12-16T03:39:07.381 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1286: Skipped 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1326: Skipped 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2023-12-16T03:39:07.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1366: Skipped 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1385: Skipped 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1415: Skipped 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2023-12-16T03:39:07.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1454: Skipped 2023-12-16T03:39:07.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2023-12-16T03:39:07.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2023-12-16T03:39:07.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1498: Skipped 2023-12-16T03:39:07.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2023-12-16T03:39:07.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2023-12-16T03:39:07.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1532: Skipped 2023-12-16T03:39:07.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1593: Skipped 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1649: Skipped 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2023-12-16T03:39:07.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-201-gac5f0a00/rpm/el9/BUILD/ceph-19.0.0-201-gac5f0a00/src/test/librados/aio.cc:1681: Skipped 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (0 ms total) 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [----------] Global test environment tear-down 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (344949 ms total) 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ PASSED ] 26 tests. 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] 16 tests, listed below: 2023-12-16T03:39:07.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleWrite 2023-12-16T03:39:07.387 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.WaitForComplete 2023-12-16T03:39:07.387 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip 2023-12-16T03:39:07.387 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip2 2023-12-16T03:39:07.387 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripAppend 2023-12-16T03:39:07.387 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsComplete 2023-12-16T03:39:07.387 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsSafe 2023-12-16T03:39:07.387 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ReturnValue 2023-12-16T03:39:07.387 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.Flush 2023-12-16T03:39:07.388 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.FlushAsync 2023-12-16T03:39:07.388 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2023-12-16T03:39:07.388 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStat 2023-12-16T03:39:07.388 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStatNS 2023-12-16T03:39:07.388 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.StatRemove 2023-12-16T03:39:07.388 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ExecuteClass 2023-12-16T03:39:07.388 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.MultiWrite 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: Running main() from gmock_main.cc 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] Global test environment set-up. 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2823 ms) 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (18965 ms) 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (13077 ms) 2023-12-16T03:39:09.382 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (17118 ms) 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3020 ms) 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2991 ms) 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (9027 ms) 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (7775 ms) 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3014 ms) 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (12012 ms) 2023-12-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (7037 ms) 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (9953 ms) 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (20084 ms) 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (19077 ms) 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3014 ms) 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (16851 ms) 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (10033 ms) 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2023-12-16T03:39:09.384 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (14053 ms) 2023-12-16T03:39:09.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2023-12-16T03:39:09.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3013 ms) 2023-12-16T03:39:09.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2023-12-16T03:39:09.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (19905 ms) 2023-12-16T03:39:09.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2023-12-16T03:39:09.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (6069 ms) 2023-12-16T03:39:09.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2023-12-16T03:39:09.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (10039 ms) 2023-12-16T03:39:09.385 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2023-12-16T03:39:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (15340 ms) 2023-12-16T03:39:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2023-12-16T03:39:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (53695 ms) 2023-12-16T03:39:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2023-12-16T03:39:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (38924 ms) 2023-12-16T03:39:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2023-12-16T03:39:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (7022 ms) 2023-12-16T03:39:09.386 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2023-12-16T03:39:11.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~303s 2023-12-16T03:39:11.237 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-16T03:39:11.741 INFO:tasks.ceph.osd.1:Sent signal 15 2023-12-16T03:39:11.742 INFO:tasks.ceph.osd.2:Sent signal 15 2023-12-16T03:39:11.742 INFO:tasks.ceph.osd.3:Sent signal 15 2023-12-16T03:39:11.742 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-16T03:39:11.742 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-16T03:39:11.743 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-16T03:39:11.740+0000 7f69901fc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 82284) UID: 0 2023-12-16T03:39:11.743 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-16T03:39:11.740+0000 7f69901fc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-16T04:19:11.289 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripAppendPP (3012 ms) 2023-12-16T04:19:11.318 INFO:tasks.workunit.client.0.smithi050.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2023-12-16T04:19:11.318 INFO:tasks.workunit.client.0.smithi050.stderr:bash: line 1: 84368 Alarm clock ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2>&1 2023-12-16T04:19:11.319 INFO:tasks.workunit.client.0.smithi050.stderr: 84369 Done | tee ceph_test_rados_api_aio_pp.log 2023-12-16T04:19:11.319 INFO:tasks.workunit.client.0.smithi050.stderr: 84371 Done | sed "s/^/ api_aio_pp: /" 2023-12-16T06:33:22.378 INFO:tasks.workunit.client.0.smithi050.stderr:++ cleanup 2023-12-16T06:33:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:++ pkill -P 84276 2023-12-16T06:33:22.403 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-16T06:33:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:++ true 2023-12-16T06:33:22.404 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2023-12-16T06:33:22.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-16T06:33:22.705 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi050 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac5f0a00b675c1157dbca443e10f2f8ddb2e351a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-12-16T06:33:23.004 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3c4acef6a668462cb1105c31337d66d5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi050 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac5f0a00b675c1157dbca443e10f2f8ddb2e351a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-12-16T06:33:23.007 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-16T06:33:23.015 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-16T06:33:23.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T06:33:23.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.131+0000 7f886ee6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-16T06:33:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.135+0000 7f886ee6d640 1 Processor -- start 2023-12-16T06:33:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.135+0000 7f886ee6d640 1 -- start start 2023-12-16T06:33:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.136+0000 7f886ee6d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f886812f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.136+0000 7f886ee6d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f8868097d70 2023-12-16T06:33:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.136+0000 7f886ee6d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.136+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f886812f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.136+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f886812f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.136+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f886812f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.337+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f886812f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.337+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f886812f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.337+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f886812f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.738+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f886812f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.738+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f886812f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:23.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:23.738+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f886812f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:24.539+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f886812f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:24.539+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f886812f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:24.539+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f886812f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.137+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f886812f240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.137+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f886812f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.137+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f886812f780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.137+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.137+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f8868097d70 2023-12-16T06:33:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.137+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.137+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.137+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:26.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.137+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:26.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.338+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:26.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.338+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:26.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.338+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:26.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.739+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:26.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.739+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:26.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:26.739+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:27.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:27.540+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:27.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:27.540+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:27.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:27.540+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.137+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.137+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.137+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.137+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:29.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.137+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f8868097d70 2023-12-16T06:33:29.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.137+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:29.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.137+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:29.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.137+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:29.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.137+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.338+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.338+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:29.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.338+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.739+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.739+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:29.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:29.739+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:30.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:30.540+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:30.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:30.540+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:30.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:30.540+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:32.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.137+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:32.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.137+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.137+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.138+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.138+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f8868097d70 2023-12-16T06:33:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.138+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.138+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.138+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.138+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:32.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.339+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:32.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.339+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:32.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.339+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:32.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.740+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:32.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.740+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:32.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:32.740+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:33.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:33.541+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:33.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:33.541+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:33.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:33.541+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.138+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.138+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.138+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.138+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.138+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f8868097d70 2023-12-16T06:33:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.138+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.138+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.138+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.138+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:35.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.339+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:35.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.339+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:35.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.339+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:35.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.740+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:35.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.740+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:35.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:35.740+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:36.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:36.541+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:36.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:36.541+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:36.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:36.541+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:38.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.138+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:38.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.138+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:38.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.138+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f8868097d70 legacy=0x7f884c003be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:38.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.138+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:38.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.138+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00b870 2023-12-16T06:33:38.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.138+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:38.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.138+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00b870 legacy=0x7f884c00bca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:38.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.138+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:38.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.138+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:38.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.339+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00b870 legacy=0x7f884c00bca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:38.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.339+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:38.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.339+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:38.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.740+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:38.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.740+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00b870 legacy=0x7f884c00bca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:38.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:38.740+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:39.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:39.541+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:39.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:39.541+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00b870 legacy=0x7f884c00bca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:39.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:39.541+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:41.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.138+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:41.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.138+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:41.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.138+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00b870 legacy=0x7f884c00bca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:41.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.138+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:41.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.138+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c003be0 2023-12-16T06:33:41.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.138+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:41.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.139+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:41.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.139+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:41.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.139+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:41.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.340+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:41.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.340+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:41.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.340+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.741+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.741+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:41.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:41.741+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:42.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:42.542+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:42.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:42.542+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:42.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:42.542+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:44.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.139+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.139+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.139+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.139+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.139+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c003be0 2023-12-16T06:33:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.139+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.139+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:44.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.139+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:44.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.139+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:44.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.340+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:44.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.340+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:44.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.340+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:44.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.741+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:44.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.741+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:44.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:44.741+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:45.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:45.542+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:45.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:45.542+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:45.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:45.542+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.139+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c003600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.139+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c003600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.139+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.139+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.139+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c003be0 2023-12-16T06:33:47.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.139+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:47.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.139+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:47.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.139+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:47.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.139+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.340+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.340+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.340+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:47.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.741+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:47.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.741+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:47.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:47.741+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:48.542+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:48.542+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:48.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:48.542+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.139+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.139+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.139+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.139+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.139+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c003be0 2023-12-16T06:33:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.140+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.140+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.140+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.140+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:50.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.341+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:50.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.341+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:50.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.341+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:50.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.742+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:50.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.742+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:50.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:50.742+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:51.543+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:51.543+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:51.543+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.140+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.140+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.140+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c003be0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.140+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.140+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00c820 2023-12-16T06:33:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.140+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.140+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.140+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.140+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.341+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.341+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.341+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:53.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.742+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:53.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.742+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:53.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:53.742+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:54.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:54.543+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:54.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:54.543+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:54.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:54.543+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:56.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.141+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:56.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.141+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:56.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.141+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00ec40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:56.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.141+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:56.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.141+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00c820 2023-12-16T06:33:56.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.141+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.141+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.141+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.141+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:56.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.342+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:56.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.342+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:56.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.342+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:56.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.743+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:56.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.743+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:56.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:56.743+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:33:57.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:57.544+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:57.544+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:57.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:57.544+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:33:59.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.140+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:59.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.140+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:33:59.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.140+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:33:59.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.140+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:33:59.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.140+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00c820 2023-12-16T06:33:59.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.140+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:33:59.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.140+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:59.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.140+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:59.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.140+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:33:59.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.341+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:59.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.341+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:59.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.341+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:33:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.742+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:33:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.742+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:33:59.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:33:59.742+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:00.543+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:00.543+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:00.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:00.543+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.140+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.140+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.140+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.140+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.140+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00c820 2023-12-16T06:34:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.140+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f8868097960 2023-12-16T06:34:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.140+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:02.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.140+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:02.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.140+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.341+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.341+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:02.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.341+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.742+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.742+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:02.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:02.742+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:03.543+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:03.543+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:03.543+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.141+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.141+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8868097960 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.141+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.141+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c00f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.141+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00c820 2023-12-16T06:34:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.141+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00cc30 2023-12-16T06:34:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.141+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c00f050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.141+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.141+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c00f050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.342+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c00f050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.342+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.342+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c00f050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:05.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.743+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c00f050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:05.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.743+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:05.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:05.743+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c00f050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:06.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:06.544+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c00f050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:06.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:06.544+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:06.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:06.544+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c00f050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.141+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c00f050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.141+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c00f050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.141+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.141+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.141+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00c820 2023-12-16T06:34:08.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.141+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00cc30 2023-12-16T06:34:08.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.141+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:08.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.141+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:08.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.141+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.342+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.342+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:08.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.342+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:08.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.743+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:08.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.743+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:08.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:08.743+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:09.544+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:09.544+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:09.544+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:11.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.142+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.142+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.142+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.142+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.142+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00c820 2023-12-16T06:34:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.142+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00cc30 2023-12-16T06:34:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.142+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.142+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:11.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.142+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.343+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.343+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.343+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.744+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.744+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:11.744+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:12.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:12.545+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:12.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:12.545+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:12.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:12.545+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.142+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.142+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.142+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.142+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.142+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00c820 2023-12-16T06:34:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.142+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00cc30 2023-12-16T06:34:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.142+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.142+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.142+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:14.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.343+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:14.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.343+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:14.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.343+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.744+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.744+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:14.744+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:15.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:15.545+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:15.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:15.545+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:15.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:15.545+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.142+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.142+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.142+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.142+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:17.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.142+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00c820 2023-12-16T06:34:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.142+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00cc30 2023-12-16T06:34:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.142+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.142+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.142+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:17.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.343+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:17.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.343+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:17.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.343+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.744+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.744+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:17.744+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:18.545+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:18.545+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:18.545+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:20.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.143+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:20.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.143+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:20.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.143+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:20.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.143+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:20.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.143+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00c820 2023-12-16T06:34:20.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.143+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00cc30 2023-12-16T06:34:20.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.143+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:20.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.143+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:20.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.143+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.344+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.344+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.344+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:20.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.745+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:20.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.745+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:20.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:20.745+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:21.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:21.546+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:21.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:21.546+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:21.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:21.546+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:23.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.143+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.143+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.143+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00c820 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.143+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.143+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00d040 2023-12-16T06:34:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.143+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00cc30 2023-12-16T06:34:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.143+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.143+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.143+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.344+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.344+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.344+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.745+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.745+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:23.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:23.745+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:24.546+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:24.546+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:24.546+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.143+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.143+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.143+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00f460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.143+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.143+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00d040 2023-12-16T06:34:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.143+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00cc30 2023-12-16T06:34:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.143+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.143+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:26.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.143+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.344+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.344+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:26.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.345+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:26.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.745+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:26.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.745+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:26.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:26.746+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:27.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:27.546+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:27.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:27.546+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:27.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:27.547+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.144+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00cc30 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.144+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:29.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c00f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:29.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.144+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00d040 2023-12-16T06:34:29.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.144+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d450 2023-12-16T06:34:29.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.144+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c00f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:29.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.144+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:29.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.144+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c00f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:29.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.345+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:29.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.345+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c00f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:29.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.345+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c00f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:29.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.746+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:29.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.746+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c00f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:29.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:29.746+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c00f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:30.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:30.547+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:30.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:30.547+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c00f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:30.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:30.547+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c00f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:32.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.144+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c00f870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c00f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.144+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.144+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00d040 2023-12-16T06:34:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.144+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d450 2023-12-16T06:34:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.144+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.144+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:32.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.144+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:32.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.345+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:32.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.345+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:32.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.345+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:32.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.746+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:32.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.746+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:32.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:32.746+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:33.547+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:33.547+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:33.547+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.144+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.144+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.144+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00d040 2023-12-16T06:34:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.144+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d450 2023-12-16T06:34:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.144+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.144+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.144+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:35.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.345+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:35.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.345+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:35.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.345+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:35.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.746+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.746+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:35.746+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:36.547+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:36.547+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:36.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:36.547+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:38.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.144+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:38.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:38.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.144+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:38.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:38.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.144+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00d040 2023-12-16T06:34:38.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.144+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d450 2023-12-16T06:34:38.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.144+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:38.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.144+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:38.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.144+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:38.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.345+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.345+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:38.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.345+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:38.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.746+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:38.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.746+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:38.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:38.746+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:39.547+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:39.547+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:39.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:39.547+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:41.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.144+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 msgr2=0x7f884c0035c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:41.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d450 0x7f884c0035c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:41.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.144+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:41.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.144+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:41.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.144+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00d040 2023-12-16T06:34:41.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.144+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d860 2023-12-16T06:34:41.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.144+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:41.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.144+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:41.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.144+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:41.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.345+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:41.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.345+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:41.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.345+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.746+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.746+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:41.746+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:42.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:42.547+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:42.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:42.547+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:42.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:42.547+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.145+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.145+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.145+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:44.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.145+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.145+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00d040 2023-12-16T06:34:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.145+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d860 2023-12-16T06:34:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.145+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.145+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:44.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.145+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:44.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.346+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:44.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.346+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:44.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.346+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:44.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.747+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.747+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:44.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:44.747+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:45.548+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:45.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:45.548+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:45.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:45.548+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:47.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.145+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:47.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.145+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:47.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.145+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:47.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.145+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:47.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.145+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00dc70 2023-12-16T06:34:47.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.145+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d860 2023-12-16T06:34:47.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.146+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00dc70 legacy=0x7f884c010090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:47.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.146+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:47.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.146+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.347+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.347+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00dc70 legacy=0x7f884c010090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.347+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:47.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.748+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:47.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.748+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00dc70 legacy=0x7f884c010090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:47.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:47.748+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:48.549+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:48.549+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00dc70 legacy=0x7f884c010090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:48.549+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.146+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.146+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.146+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00dc70 legacy=0x7f884c010090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.146+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.146+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00d040 2023-12-16T06:34:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.146+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d860 2023-12-16T06:34:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.146+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.146+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.146+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.347+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.347+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:50.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.347+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:50.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.748+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:50.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.748+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:50.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:50.748+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:51.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:51.549+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:51.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:51.549+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:51.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:51.549+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.146+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.146+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.146+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.146+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.146+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00d040 2023-12-16T06:34:53.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.146+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d860 2023-12-16T06:34:53.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.146+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:53.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.146+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:53.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.146+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.347+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.347+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.347+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:53.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.748+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:53.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.748+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:53.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:53.748+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:54.549+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:54.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:54.549+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:54.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:54.549+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.146+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.146+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.146+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.146+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.146+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00d040 2023-12-16T06:34:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.146+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00d860 2023-12-16T06:34:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.146+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.146+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:56.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.147+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:56.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.348+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:56.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.348+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:56.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.348+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.749+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.749+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:56.749+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:34:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:57.550+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:57.550+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:57.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:57.550+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:34:59.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.147+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 msgr2=0x7f884c0035a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:59.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.147+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00d860 0x7f884c0035a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:34:59.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.147+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:34:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.147+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:34:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.147+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00d040 2023-12-16T06:34:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.147+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00a7d0 2023-12-16T06:34:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.147+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.147+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:59.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.147+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:34:59.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.348+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:59.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.348+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:59.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.348+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:34:59.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.749+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:34:59.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.749+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:34:59.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:34:59.749+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:35:00.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:00.550+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:00.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:00.550+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:00.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:00.550+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:35:02.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.147+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00abe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:02.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.147+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:35:02.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.147+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:02.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.147+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:35:02.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.147+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00d040 2023-12-16T06:35:02.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.147+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00a7d0 2023-12-16T06:35:02.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.147+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:02.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.147+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:02.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.147+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:35:02.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.348+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:02.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.348+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:02.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.348+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:35:02.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.749+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:02.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.749+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:02.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:02.749+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:35:03.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:03.550+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:03.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:03.550+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:03.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:03.550+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:35:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.148+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:35:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.148+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:35:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.148+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00abe0 2023-12-16T06:35:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.148+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00a7d0 2023-12-16T06:35:05.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.148+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:05.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.148+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:05.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.148+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:35:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.349+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.349+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:05.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.349+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:35:05.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.750+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:05.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.750+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:05.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:05.750+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:35:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:06.551+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:06.551+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:06.551+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:35:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.148+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:35:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.148+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:08.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:35:08.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.148+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00d040 2023-12-16T06:35:08.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.148+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00a7d0 2023-12-16T06:35:08.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.148+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:08.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.148+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:08.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.148+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:35:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.349+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:08.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.349+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:08.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.349+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:35:08.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.750+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.750+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:08.750+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:35:09.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:09.551+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:09.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:09.551+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:09.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:09.551+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:35:11.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.148+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c003580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:11.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c003580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:35:11.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.148+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:11.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c011890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:35:11.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.148+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00abe0 2023-12-16T06:35:11.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.148+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00a7d0 2023-12-16T06:35:11.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.148+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:11.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.148+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c011890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:11.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.148+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c011890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:35:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.349+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.349+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c011890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.349+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c011890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:35:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.750+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.750+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c011890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:11.750+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c011890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:35:12.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:12.551+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:12.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:12.551+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c011890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:12.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:12.551+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c011890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:35:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.148+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c011890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c011890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:35:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.148+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:35:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.148+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00d040 2023-12-16T06:35:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.148+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00a7d0 2023-12-16T06:35:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.148+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.148+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.148+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:35:14.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.349+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:14.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.349+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:14.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.349+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:35:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.750+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.750+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:14.750+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:35:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:15.551+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:15.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:15.551+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:15.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:15.551+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:35:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.148+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:35:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.148+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00d040 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:17.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:35:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.148+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868098960 con 0x7f884c00abe0 2023-12-16T06:35:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.148+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00a7d0 2023-12-16T06:35:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.148+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c010880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.148+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:17.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.148+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:35:17.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.349+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c010880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:17.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.349+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:17.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.349+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:35:17.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.750+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c010880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:17.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.750+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:17.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:17.750+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:35:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:18.551+0000 7f8867fff640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:18.551+0000 7f886cc09640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c010880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:18.551+0000 7f8867fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:35:20.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.148+0000 7f88667fc640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:20.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T06:35:20.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.148+0000 7f88667fc640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c010880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T06:35:20.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.148+0000 7f88667fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T06:35:20.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.148+0000 7f88667fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8868072800 con 0x7f884c00abe0 2023-12-16T06:35:20.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.148+0000 7f88667fc640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886809a2a0 con 0x7f884c00a7d0 2023-12-16T06:35:20.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.148+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:20.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.148+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:20.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.148+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T06:35:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.349+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.349+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.349+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T06:35:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.750+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.750+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:20.750+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T06:35:21.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:21.551+0000 7f886cc09640 1 -- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 msgr2=0x7f884c00aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.50:3300/0 2023-12-16T06:35:21.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:21.551+0000 7f8867fff640 1 -- >> v1:172.21.15.50:6789/0 conn(0x7f884c00abe0 legacy=0x7f884c00bc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.50:6789/0 2023-12-16T06:35:21.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-16T06:35:21.551+0000 7f886cc09640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f884c00a7d0 0x7f884c00aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T06:35:23.058 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-16T06:35:23.059 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-12-16T06:35:23.196 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-16T06:35:23.196 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-16T06:35:23.197 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-16T06:35:23.197 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T06:35:23.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:35:23.200 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log' 2023-12-16T06:35:23.215 INFO:tasks.ceph.osd.0:Stopped 2023-12-16T06:35:23.216 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-16T06:35:23.216 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T06:35:23.300 INFO:tasks.ceph.osd.1:Stopped 2023-12-16T06:35:23.301 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-16T06:35:23.301 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T06:35:23.383 INFO:tasks.ceph.osd.2:Stopped 2023-12-16T06:35:23.384 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-16T06:35:23.384 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T06:35:23.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:35:23.384 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi124 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log' 2023-12-16T06:35:23.396 INFO:tasks.ceph.osd.3:Stopped 2023-12-16T06:35:23.397 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-16T06:35:23.397 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-16T06:35:23.397 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T06:35:23.400 INFO:tasks.ceph.mgr.x:Stopped 2023-12-16T06:35:23.400 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-16T06:35:23.400 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-16T06:35:23.400 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T06:35:23.401 INFO:tasks.ceph.mon.a:Stopped 2023-12-16T06:35:23.401 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-16T06:35:23.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-12-16T06:35:23.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-16T06:35:23.440 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-16T06:35:23.578 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-16T06:35:23.578 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-16T06:35:23.663 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi124.front.sepia.ceph.com 2023-12-16T06:35:23.663 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-16T06:35:23.754 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi124.front.sepia.ceph.com 2023-12-16T06:35:23.755 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-16T06:35:23.809 INFO:tasks.ceph:Archiving mon data... 2023-12-16T06:35:23.811 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341/data/mon.a.tgz 2023-12-16T06:35:23.811 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-12-16T06:35:23.828 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.cpTXSagSvH 2023-12-16T06:35:23.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.cpTXSagSvH 2023-12-16T06:35:24.041 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.cpTXSagSvH 2023-12-16T06:35:24.130 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.cpTXSagSvH is 629KB 2023-12-16T06:35:24.231 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.cpTXSagSvH 2023-12-16T06:35:24.245 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-16T06:35:24.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T06:35:24.287 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T06:35:24.370 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-16T06:35:24.388 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-16T06:35:24.388 INFO:tasks.ceph:Archiving crash dumps... 2023-12-16T06:35:24.390 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341/remote/smithi050/crash 2023-12-16T06:35:24.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T06:35:24.442 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/lib/ceph/crash to /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341/remote/smithi124/crash 2023-12-16T06:35:24.442 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T06:35:24.490 INFO:tasks.ceph:Compressing logs... 2023-12-16T06:35:24.490 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:35:24.493 DEBUG:teuthology.orchestra.run.smithi124:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:35:24.524 INFO:teuthology.orchestra.run.smithi124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81914.log 2023-12-16T06:35:24.524 INFO:teuthology.orchestra.run.smithi124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-16T06:35:24.524 INFO:teuthology.orchestra.run.smithi124.stderr:/var/log/ceph/ceph-client.admin.81914.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-16T06:35:24.524 INFO:teuthology.orchestra.run.smithi124.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.81914.log.gz 2023-12-16T06:35:24.525 INFO:teuthology.orchestra.run.smithi124.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81994.log 2023-12-16T06:35:24.525 INFO:teuthology.orchestra.run.smithi124.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-16T06:35:24.525 INFO:teuthology.orchestra.run.smithi124.stderr:/var/log/ceph/ceph-client.admin.81994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81954.log 2023-12-16T06:35:24.525 INFO:teuthology.orchestra.run.smithi124.stderr:/var/log/ceph/ceph-osd.2.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.81994.log.gz 2023-12-16T06:35:24.525 INFO:teuthology.orchestra.run.smithi124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81874.log 2023-12-16T06:35:24.525 INFO:teuthology.orchestra.run.smithi124.stderr:/var/log/ceph/ceph-client.admin.81954.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.81954.log.gz 2023-12-16T06:35:24.525 INFO:teuthology.orchestra.run.smithi124.stderr:/var/log/ceph/ceph-client.admin.81874.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.81874.log.gz 2023-12-16T06:35:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-16T06:35:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84017.log 2023-12-16T06:35:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84348.log 2023-12-16T06:35:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.a.log: gzip/var/log/ceph/ceph-client.admin.84017.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.84704.log 2023-12-16T06:35:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84348.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.84017.log.gz 2023-12-16T06:35:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85266.log 2023-12-16T06:35:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85251.log 2023-12-16T06:35:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84704.log: /var/log/ceph/ceph-client.admin.85266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84454.log 2023-12-16T06:35:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84463.log 2023-12-16T06:35:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83866.log 2023-12-16T06:35:24.550 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85266.log.gz 2023-12-16T06:35:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83471.log 2023-12-16T06:35:24.550 INFO:teuthology.orchestra.run.smithi050.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.84704.log.gz 2023-12-16T06:35:24.550 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85251.log.gz 2023-12-16T06:35:24.550 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.84454.log.gz 2023-12-16T06:35:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85257.log 2023-12-16T06:35:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83866.log: /var/log/ceph/ceph-client.admin.83471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148228.log 2023-12-16T06:35:24.550 INFO:teuthology.orchestra.run.smithi050.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83866.log.gz 2023-12-16T06:35:24.551 INFO:teuthology.orchestra.run.smithi050.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.83471.log.gz 2023-12-16T06:35:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84959.log 2023-12-16T06:35:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148228.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.85257.log.gz 2023-12-16T06:35:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83699.log 2023-12-16T06:35:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83697.log 2023-12-16T06:35:24.551 INFO:teuthology.orchestra.run.smithi050.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.148228.log.gz 2023-12-16T06:35:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84712.log 2023-12-16T06:35:24.551 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83699.log.gz 2023-12-16T06:35:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84759.log 2023-12-16T06:35:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84712.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83697.log.gz 2023-12-16T06:35:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85164.log 2023-12-16T06:35:24.552 INFO:teuthology.orchestra.run.smithi050.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.84959.log.gz 2023-12-16T06:35:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83867.log 2023-12-16T06:35:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85098.log 2023-12-16T06:35:24.552 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84759.log.gz 2023-12-16T06:35:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148815.log 2023-12-16T06:35:24.553 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84712.log.gz 2023-12-16T06:35:24.553 INFO:teuthology.orchestra.run.smithi050.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.84348.log.gz 2023-12-16T06:35:24.553 INFO:teuthology.orchestra.run.smithi050.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.85164.log.gz 2023-12-16T06:35:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148137.log 2023-12-16T06:35:24.553 INFO:teuthology.orchestra.run.smithi050.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.83867.log.gz 2023-12-16T06:35:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85098.log: /var/log/ceph/ceph-client.admin.148815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84741.log 2023-12-16T06:35:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148137.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-16T06:35:24.553 INFO:teuthology.orchestra.run.smithi050.stderr: 86.3%/var/log/ceph/ceph-client.admin.84741.log: -- replaced with /var/log/ceph/ceph-client.admin.148137.log.gz 2023-12-16T06:35:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83696.log 2023-12-16T06:35:24.554 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148815.log.gz 2023-12-16T06:35:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83865.log 2023-12-16T06:35:24.554 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84741.log.gz 2023-12-16T06:35:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84422.log 2023-12-16T06:35:24.554 INFO:teuthology.orchestra.run.smithi050.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83696.log.gz 2023-12-16T06:35:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84640.log 2023-12-16T06:35:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83865.log: /var/log/ceph/ceph-client.admin.84422.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.83865.log.gz 2023-12-16T06:35:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-16T06:35:24.554 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.83975.log 2023-12-16T06:35:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84640.log: gzip -5 --verbose 89.7% -- replaced with /var/log/ceph/ceph-client.admin.84422.log.gz 2023-12-16T06:35:24.555 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.148227.log 2023-12-16T06:35:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83975.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84640.log.gz 2023-12-16T06:35:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85267.log 2023-12-16T06:35:24.555 INFO:teuthology.orchestra.run.smithi050.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.83975.log.gz 2023-12-16T06:35:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-16T06:35:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148227.log: /var/log/ceph/ceph-client.admin.85267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82365.log 2023-12-16T06:35:24.555 INFO:teuthology.orchestra.run.smithi050.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.148227.log.gz 2023-12-16T06:35:24.555 INFO:teuthology.orchestra.run.smithi050.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.85267.log.gz 2023-12-16T06:35:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85081.log 2023-12-16T06:35:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.82365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84524.log 2023-12-16T06:35:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148816.log 2023-12-16T06:35:24.556 INFO:teuthology.orchestra.run.smithi050.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.82365.log.gz 2023-12-16T06:35:24.556 INFO:teuthology.orchestra.run.smithi050.stderr: 67.7% -- replaced with /var/log/ceph/ceph-client.admin.85081.log.gz 2023-12-16T06:35:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82521.log 2023-12-16T06:35:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83597.log 2023-12-16T06:35:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82521.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.84524.log.gz 2023-12-16T06:35:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83555.log 2023-12-16T06:35:24.557 INFO:teuthology.orchestra.run.smithi050.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.82521.log.gz 2023-12-16T06:35:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.83597.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.85019.log 2023-12-16T06:35:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83555.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.83597.log.gz 2023-12-16T06:35:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83513.log 2023-12-16T06:35:24.557 INFO:teuthology.orchestra.run.smithi050.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.83555.log.gz 2023-12-16T06:35:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84059.log 2023-12-16T06:35:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85019.log: /var/log/ceph/ceph-client.admin.83513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82286.log 2023-12-16T06:35:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84059.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.83513.log.gz 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.84059.log.gz 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148226.log 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82286.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.85019.log.gz 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85043.log 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148226.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.82286.log.gz 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148299.log 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85043.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79965.log 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148226.log.gz 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148298.log 2023-12-16T06:35:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.tmp-client.admin.79965.log: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79965.log.gz 2023-12-16T06:35:24.559 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84888.log 2023-12-16T06:35:24.559 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85043.log.gz 2023-12-16T06:35:24.559 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.148299.log.gz 2023-12-16T06:35:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83421.log 2023-12-16T06:35:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84888.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.148298.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83698.log 2023-12-16T06:35:24.559 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-16T06:35:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-16T06:35:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83421.log: /var/log/ceph/ceph-client.admin.83698.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.83421.log.gz 2023-12-16T06:35:24.560 INFO:teuthology.orchestra.run.smithi050.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.84888.log.gzgzip 2023-12-16T06:35:24.560 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83698.log.gz 2023-12-16T06:35:24.560 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.84392.log 2023-12-16T06:35:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.0.log: -- /var/log/ceph/ceph-client.admin.148136.log 2023-12-16T06:35:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84615.log 2023-12-16T06:35:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148136.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.84392.log.gz 2023-12-16T06:35:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-16T06:35:24.560 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148136.log.gz 2023-12-16T06:35:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84785.log 2023-12-16T06:35:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: 87.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-16T06:35:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82549.log 2023-12-16T06:35:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84785.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.84785.log.gz 2023-12-16T06:35:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85162.log 2023-12-16T06:35:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.82549.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.82549.log.gz 2023-12-16T06:35:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84656.log 2023-12-16T06:35:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85162.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85162.log.gz 2023-12-16T06:35:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83864.log 2023-12-16T06:35:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84656.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.84656.log.gz 2023-12-16T06:35:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149128.log 2023-12-16T06:35:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83864.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83864.log.gz 2023-12-16T06:35:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84368.log 2023-12-16T06:35:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149128.log: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.149128.log.gz 2023-12-16T06:35:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84413.log 2023-12-16T06:35:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148297.log 2023-12-16T06:35:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84413.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.84413.log.gz 2023-12-16T06:35:24.576 INFO:teuthology.orchestra.run.smithi050.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.84368.log.gz 2023-12-16T06:35:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148817.log 2023-12-16T06:35:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148297.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148297.log.gz 2023-12-16T06:35:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84883.log 2023-12-16T06:35:24.579 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.148817.log: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.85098.log.gz 2023-12-16T06:35:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85026.log 2023-12-16T06:35:24.580 INFO:teuthology.orchestra.run.smithi050.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.148816.log.gz 2023-12-16T06:35:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83365.log 2023-12-16T06:35:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85026.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.84883.log.gz 2023-12-16T06:35:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84443.log 2023-12-16T06:35:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83365.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.83365.log.gz 2023-12-16T06:35:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84443.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.85026.log.gz 2023-12-16T06:35:24.597 INFO:teuthology.orchestra.run.smithi050.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84615.log.gz 2023-12-16T06:35:24.629 INFO:teuthology.orchestra.run.smithi050.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.148817.log.gz 2023-12-16T06:35:24.635 INFO:teuthology.orchestra.run.smithi050.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.84443.log.gz 2023-12-16T06:35:24.673 INFO:teuthology.orchestra.run.smithi124.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-16T06:35:24.972 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.84463.log.gz 2023-12-16T06:35:25.580 INFO:teuthology.orchestra.run.smithi050.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-16T06:35:25.745 INFO:teuthology.orchestra.run.smithi050.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-16T06:35:33.667 INFO:teuthology.orchestra.run.smithi124.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-16T06:35:33.750 INFO:teuthology.orchestra.run.smithi124.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-16T06:35:33.752 INFO:teuthology.orchestra.run.smithi124.stderr: 2023-12-16T06:35:33.752 INFO:teuthology.orchestra.run.smithi124.stderr:real 0m9.244s 2023-12-16T06:35:33.752 INFO:teuthology.orchestra.run.smithi124.stderr:user 0m17.740s 2023-12-16T06:35:33.752 INFO:teuthology.orchestra.run.smithi124.stderr:sys 0m0.778s 2023-12-16T06:35:34.610 INFO:teuthology.orchestra.run.smithi050.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-16T06:35:34.611 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-16T06:35:34.612 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m10.107s 2023-12-16T06:35:34.612 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m12.634s 2023-12-16T06:35:34.612 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m0.525s 2023-12-16T06:35:34.612 INFO:tasks.ceph:Archiving logs... 2023-12-16T06:35:34.612 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341/remote/smithi050/log 2023-12-16T06:35:34.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T06:35:37.122 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/log/ceph to /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341/remote/smithi124/log 2023-12-16T06:35:37.136 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T06:35:40.098 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-12-16T06:35:40.108 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-16T06:35:40.118 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-12-16T06:35:40.123 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-16T06:35:40.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T06:35:40.128 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T06:35:40.214 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-16T06:35:40.224 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-16T06:35:40.224 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T06:35:40.227 DEBUG:teuthology.orchestra.run.smithi124:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T06:35:40.240 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2023-12-16T06:35:40.241 INFO:teuthology.orchestra.run.smithi124.stderr:bash: line 1: ntpq: command not found 2023-12-16T06:35:40.244 INFO:teuthology.orchestra.run.smithi124.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T06:35:40.244 INFO:teuthology.orchestra.run.smithi124.stdout:=============================================================================== 2023-12-16T06:35:40.245 INFO:teuthology.orchestra.run.smithi124.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 232 +626us[ +626us] +/- 88ms 2023-12-16T06:35:40.245 INFO:teuthology.orchestra.run.smithi124.stdout:^* hv02.front.sepia.ceph.com 3 9 377 414 -530us[ -562us] +/- 59ms 2023-12-16T06:35:40.245 INFO:teuthology.orchestra.run.smithi124.stdout:^+ hv03.front.sepia.ceph.com 3 9 377 405 +97us[ +97us] +/- 72ms 2023-12-16T06:35:40.245 INFO:teuthology.orchestra.run.smithi124.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T06:35:40.246 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T06:35:40.247 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-12-16T06:35:40.247 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 91 +626us[ +626us] +/- 67ms 2023-12-16T06:35:40.247 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv02.front.sepia.ceph.com 3 8 377 87 -508us[ -508us] +/- 64ms 2023-12-16T06:35:40.247 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 81 +110us[ +110us] +/- 76ms 2023-12-16T06:35:40.247 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T06:35:40.247 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-16T06:35:40.257 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-16T06:35:40.257 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-16T06:35:40.296 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T06:35:40.401 DEBUG:teuthology.orchestra.run.smithi124:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T06:35:40.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T06:35:40.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:35:40.527 DEBUG:teuthology.orchestra.run.smithi124:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T06:35:40.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:35:40.559 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-16T06:35:40.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-16T06:35:40.579 INFO:teuthology.task.internal:Duration was 11558.891434 seconds 2023-12-16T06:35:40.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-16T06:35:40.590 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-16T06:35:40.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T06:35:40.593 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T06:35:40.641 INFO:teuthology.orchestra.run.smithi124.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T06:35:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T06:35:41.044 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-16T06:35:41.044 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-12-16T06:35:41.045 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T06:35:41.065 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi124.front.sepia.ceph.com 2023-12-16T06:35:41.066 DEBUG:teuthology.orchestra.run.smithi124:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T06:35:41.088 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-16T06:35:41.089 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T06:35:41.108 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T06:35:41.157 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-16T06:35:41.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T06:35:41.181 DEBUG:teuthology.orchestra.run.smithi124:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T06:35:41.294 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-16T06:35:41.307 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-16T06:35:41.307 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T06:35:41.338 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T06:35:41.365 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-16T06:35:41.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T06:35:41.381 DEBUG:teuthology.orchestra.run.smithi124:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T06:35:41.408 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-12-16T06:35:41.431 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = core 2023-12-16T06:35:41.453 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T06:35:41.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:35:41.492 DEBUG:teuthology.orchestra.run.smithi124:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T06:35:41.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:35:41.508 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-16T06:35:41.518 INFO:teuthology.task.internal:Transferring archived files... 2023-12-16T06:35:41.518 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341/remote/smithi050 2023-12-16T06:35:41.519 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T06:35:41.591 DEBUG:teuthology.misc:Transferring archived files from smithi124:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341/remote/smithi124 2023-12-16T06:35:41.591 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T06:35:41.626 INFO:teuthology.task.internal:Removing archive directory... 2023-12-16T06:35:41.627 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T06:35:41.629 DEBUG:teuthology.orchestra.run.smithi124:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T06:35:41.676 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-16T06:35:41.689 INFO:teuthology.task.internal:Not uploading archives. 2023-12-16T06:35:41.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-16T06:35:41.698 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-16T06:35:41.699 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T06:35:41.701 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T06:35:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 16 06:35 /home/ubuntu/cephtest 2023-12-16T06:35:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: 531675 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 16 03:32 /home/ubuntu/cephtest/mnt.0 2023-12-16T06:35:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: 531676 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T06:35:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: 669319 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-16T06:35:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: 669330 60 -rw-r--r-- 1 ubuntu ubuntu 58706 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_tier_pp.log 2023-12-16T06:35:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: 669334 8 -rw-r--r-- 1 ubuntu ubuntu 4464 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat_pp.log 2023-12-16T06:35:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: 669326 8 -rw-r--r-- 1 ubuntu ubuntu 7551 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock.log 2023-12-16T06:35:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: 669342 4 -rw-r--r-- 1 ubuntu ubuntu 1711 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_read_operations.log 2023-12-16T06:35:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: 669345 4 -rw-r--r-- 1 ubuntu ubuntu 1709 Dec 16 03:39 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_list_parallel.log 2023-12-16T06:35:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: 669329 4 -rw-r--r-- 1 ubuntu ubuntu 1995 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc_pp.log 2023-12-16T06:35:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: 669320 12 -rw-r--r-- 1 ubuntu ubuntu 9344 Dec 16 03:39 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio.log 2023-12-16T06:35:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: 669327 4 -rw-r--r-- 1 ubuntu ubuntu 3101 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc.log 2023-12-16T06:35:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: 669343 4 -rw-r--r-- 1 ubuntu ubuntu 1169 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cls_remote_reads.log 2023-12-16T06:35:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: 669337 4 -rw-r--r-- 1 ubuntu ubuntu 592 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd_pp.log 2023-12-16T06:35:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: 669339 4 -rw-r--r-- 1 ubuntu ubuntu 4013 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd.log 2023-12-16T06:35:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: 669338 4 -rw-r--r-- 1 ubuntu ubuntu 3963 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify.log 2023-12-16T06:35:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: 669332 8 -rw-r--r-- 1 ubuntu ubuntu 7103 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots.log 2023-12-16T06:35:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: 669323 24 -rw-r--r-- 1 ubuntu ubuntu 24376 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_asio.log 2023-12-16T06:35:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: 669335 8 -rw-r--r-- 1 ubuntu ubuntu 4303 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat.log 2023-12-16T06:35:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: 669346 4 -rw-r--r-- 1 ubuntu ubuntu 1311 Dec 16 03:37 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_delete_pools_parallel.log 2023-12-16T06:35:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: 669341 4 -rw-r--r-- 1 ubuntu ubuntu 1087 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service_pp.log 2023-12-16T06:35:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: 669344 4 -rw-r--r-- 1 ubuntu ubuntu 958 Dec 16 03:35 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_write_operations.log 2023-12-16T06:35:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: 669340 4 -rw-r--r-- 1 ubuntu ubuntu 2365 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service.log 2023-12-16T06:35:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: 669321 4 -rw-r--r-- 1 ubuntu ubuntu 2612 Dec 16 03:39 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio_pp.log 2023-12-16T06:35:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: 669324 16 -rw-r--r-- 1 ubuntu ubuntu 15469 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io_pp.log 2023-12-16T06:35:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: 669347 4 -rw-r--r-- 1 ubuntu ubuntu 1040 Dec 16 03:36 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_open_pools_parallel.log 2023-12-16T06:35:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: 669336 8 -rw-r--r-- 1 ubuntu ubuntu 6065 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify_pp.log 2023-12-16T06:35:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: 669328 8 -rw-r--r-- 1 ubuntu ubuntu 7800 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock_pp.log 2023-12-16T06:35:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: 669331 4 -rw-r--r-- 1 ubuntu ubuntu 1609 Dec 16 03:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_pool.log 2023-12-16T06:35:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: 669325 4 -rw-r--r-- 1 ubuntu ubuntu 2065 Dec 16 03:39 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_list.log 2023-12-16T06:35:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: 669333 12 -rw-r--r-- 1 ubuntu ubuntu 9820 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots_pp.log 2023-12-16T06:35:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: 669322 12 -rw-r--r-- 1 ubuntu ubuntu 9516 Dec 16 03:34 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io.log 2023-12-16T06:35:41.719 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-12-16T06:35:41.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T06:35:41.721 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_ac5f0a00b675c1157dbca443e10f2f8ddb2e351a/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-12-16T06:35:41.735 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-16T06:35:41.746 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-16T06:35:41.757 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi050 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-12-16T06:35:41.757 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T06:35:41.764 INFO:teuthology.orchestra.run.smithi124.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 06:35 /home/ubuntu/cephtest 2023-12-16T06:35:41.789 DEBUG:teuthology.nuke:shortname: smithi050 2023-12-16T06:35:41.790 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T06:35:41.815 DEBUG:teuthology.nuke:shortname: smithi124 2023-12-16T06:35:41.816 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T06:35:41.819 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 03:14:26.299744', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDGX+YyyAuE3WVWAKT+FLO57OmYnFf3xkwyITAUpsA6lV1J3EjwxdvcBQWMXzTvB/coMSd9+APSk728Oozcl85M='} 2023-12-16T06:35:41.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2023-12-16_03:12:47-crimson-rados-wip-sjust-crimson-testing-2023-12-15-distro-default-smithi/7494341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 03:14:26.298354', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNO919USKbDzxfzmiSSbynE/I9bLnlkX8NCromj3T062RN+dTrQuqfZBFQ2/UQ6vbSoCsxiHxpFDC0AAPFhmn9Y='} 2023-12-16T06:35:41.873 INFO:teuthology.orchestra.console.smithi050:Power off 2023-12-16T06:35:41.874 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T06:35:41.897 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-12-16T06:35:41.897 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:35:41.915 INFO:teuthology.orchestra.console.smithi124:Power off 2023-12-16T06:35:41.915 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T06:35:41.926 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-16T06:35:41.938 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-12-16T06:35:41.938 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:35:41.962 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-12-16T06:35:45.927 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:35:45.964 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:35:46.038 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-16T06:35:46.075 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-12-16T06:35:50.041 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:35:50.076 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:35:50.152 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-12-16T06:35:50.186 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-16T06:35:50.254 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-12-16T06:35:50.287 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-12-16T06:35:50.393 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 11558.891434192657 failure_reason: 'Command failed (workunit test rados/test.sh) on smithi050 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ac5f0a00b675c1157dbca443e10f2f8ddb2e351a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh''' flavor: crimson owner: scheduled_sjust@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3c4acef6a668462cb1105c31337d66d5 status: fail success: false 2023-12-16T06:35:50.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:35:50.473 INFO:teuthology.run:FAIL