2024-01-17T15:54:43.015 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-17T15:54:43.016 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842 --owner scheduled_matan@teuthology --name matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi --verbose --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} -- /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842/orig.config.yaml 2024-01-17T15:54:43.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T15:54:43.112 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842 branch: wip-matanb-crimson-testing-17.1-crimson-only description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: null first_in_suite: false job_id: '7518842' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-17.1-crimson-only ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson seastar smp: 3 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: cecb6cb5cdba1d67db289980b0e46cfe0334a30f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: cecb6cb5cdba1d67db289980b0e46cfe0334a30f workunit: branch: wip-matanb-crimson-testing-17.1-crimson-only env: CRIMSON_COMPAT: '1' sha1: cecb6cb5cdba1d67db289980b0e46cfe0334a30f owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1084 sha1: cecb6cb5cdba1d67db289980b0e46cfe0334a30f sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-matanb-crimson-testing-17.1-crimson-only suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cecb6cb5cdba1d67db289980b0e46cfe0334a30f targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9JHUYiSDs+eSJB6N1t8wuVYL+5hSY92TdMf7FvQqEhqcWBcU7htAr3e5uOAqTL8Yhx/VWVDzw/xRMP3kqmD3A= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7QE6FHsWHdnD+uknp03lBjueOu1SCwS8NyzbAI3HVm4iE3fkdCMErhNAuToijZjx9u++5PGRc0taKSsUXGSdo= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-17_15:47:21 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-17T15:54:43.112 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa; will attempt to use it 2024-01-17T15:54:43.113 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks 2024-01-17T15:54:43.113 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-17T15:54:43.114 INFO:teuthology.task.internal:Checking packages... 2024-01-17T15:54:43.137 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f' 2024-01-17T15:54:43.137 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-17T15:54:43.137 INFO:teuthology.packaging:ref: None 2024-01-17T15:54:43.137 INFO:teuthology.packaging:tag: None 2024-01-17T15:54:43.138 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-17.1-crimson-only 2024-01-17T15:54:43.138 INFO:teuthology.packaging:sha1: cecb6cb5cdba1d67db289980b0e46cfe0334a30f 2024-01-17T15:54:43.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-17.1-crimson-only 2024-01-17T15:54:43.280 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-720.gcecb6cb5 2024-01-17T15:54:43.282 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-17T15:54:43.287 INFO:teuthology.task.internal:no buildpackages task found 2024-01-17T15:54:43.288 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-17T15:54:43.306 INFO:teuthology.task.internal:Saving configuration 2024-01-17T15:54:43.318 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-17T15:54:43.323 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T15:54:43.349 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 15:48:24.837544', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9JHUYiSDs+eSJB6N1t8wuVYL+5hSY92TdMf7FvQqEhqcWBcU7htAr3e5uOAqTL8Yhx/VWVDzw/xRMP3kqmD3A='} 2024-01-17T15:54:43.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 15:48:24.840012', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7QE6FHsWHdnD+uknp03lBjueOu1SCwS8NyzbAI3HVm4iE3fkdCMErhNAuToijZjx9u++5PGRc0taKSsUXGSdo='} 2024-01-17T15:54:43.372 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-17T15:54:43.379 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-01-17T15:54:43.379 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-01-17T15:54:43.379 INFO:teuthology.run_tasks:Running task console_log... 2024-01-17T15:54:43.454 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa826b6fdc0>, signals=[15]) 2024-01-17T15:54:43.455 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-17T15:54:43.460 INFO:teuthology.task.internal:Opening connections... 2024-01-17T15:54:43.461 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2024-01-17T15:54:43.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T15:54:43.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T15:54:43.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T15:54:43.652 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-17T15:54:43.658 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-01-17T15:54:43.675 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-01-17T15:54:43.676 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-01-17T15:54:43.733 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-17T15:54:43.734 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-01-17T15:54:43.734 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T15:54:43.734 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-17T15:54:43.734 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-17T15:54:43.734 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-01-17T15:54:43.766 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-01-17T15:54:43.782 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-01-17T15:54:43.782 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-01-17T15:54:43.837 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-01-17T15:54:43.837 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-17T15:54:43.838 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-17T15:54:43.838 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-01-17T15:54:43.857 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-17T15:54:43.866 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-17T15:54:43.873 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-17T15:54:43.873 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2024-01-17T15:54:43.876 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-01-17T15:54:43.893 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-17T15:54:43.899 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-17T15:54:43.899 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2024-01-17T15:54:43.934 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-01-17T15:54:44.035 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-17T15:54:44.084 INFO:teuthology.run_tasks:Running task kernel... 2024-01-17T15:54:44.100 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-01-17T15:54:44.100 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-01-17T15:54:44.100 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-17T15:54:44.101 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-17T15:54:44.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T15:54:44.115 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-01-17T15:54:44.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T15:54:44.118 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-01-17T15:54:44.171 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-361.el9.x86_64 2024-01-17T15:54:44.171 INFO:teuthology.task.kernel:Running kernel on smithi137: 5.14.0-361.el9.x86_64 2024-01-17T15:54:44.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum install -y kernel 2024-01-17T15:54:44.175 INFO:teuthology.orchestra.run.smithi026.stdout:5.14.0-361.el9.x86_64 2024-01-17T15:54:44.175 INFO:teuthology.task.kernel:Running kernel on smithi026: 5.14.0-361.el9.x86_64 2024-01-17T15:54:44.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2024-01-17T15:54:47.270 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-9 - AppStream 4.2 MB/s | 6.4 MB 00:01 2024-01-17T15:54:47.325 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - AppStream 4.3 MB/s | 6.4 MB 00:01 2024-01-17T15:54:49.078 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-9 - BaseOS 2.9 MB/s | 2.0 MB 00:00 2024-01-17T15:54:49.158 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - BaseOS 2.6 MB/s | 2.0 MB 00:00 2024-01-17T15:54:50.082 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-01-17T15:54:51.601 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.0 MB 00:02 2024-01-17T15:54:55.727 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:02 2024-01-17T15:54:55.900 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 3.9 MB/s | 19 MB 00:04 2024-01-17T15:55:01.480 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 5.9 MB 00:02 2024-01-17T15:55:01.749 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 5.9 MB 00:02 2024-01-17T15:55:03.267 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 15 kB 00:00 2024-01-17T15:55:03.528 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 15 kB 00:00 2024-01-17T15:55:06.171 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 20 MB 00:02 2024-01-17T15:55:08.920 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 3.6 MB/s | 20 MB 00:05 2024-01-17T15:55:11.246 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-01-17T15:55:13.544 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-17T15:55:13.545 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-17T15:55:13.630 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T15:55:13.639 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 5.14.0-408.el9 CentOS-BaseOS 6.0 M 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-core x86_64 5.14.0-408.el9 CentOS-BaseOS 21 M 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules x86_64 5.14.0-408.el9 CentOS-BaseOS 39 M 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules-core x86_64 5.14.0-408.el9 CentOS-BaseOS 33 M 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T15:55:13.640 INFO:teuthology.orchestra.run.smithi026.stdout:Install 4 Packages 2024-01-17T15:55:13.641 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T15:55:13.641 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 99 M 2024-01-17T15:55:13.641 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 122 M 2024-01-17T15:55:13.641 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T15:55:13.734 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-01-17T15:55:14.064 INFO:teuthology.orchestra.run.smithi026.stdout:(1/4): kernel-5.14.0-408.el9.x86_64.rpm 14 MB/s | 6.0 MB 00:00 2024-01-17T15:55:14.881 INFO:teuthology.orchestra.run.smithi026.stdout:(2/4): kernel-core-5.14.0-408.el9.x86_64.rpm 17 MB/s | 21 MB 00:01 2024-01-17T15:55:15.991 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-17T15:55:15.991 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-17T15:55:16.075 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T15:55:16.086 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T15:55:16.086 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T15:55:16.086 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout: kernel x86_64 5.14.0-408.el9 CentOS-BaseOS 6.0 M 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-core x86_64 5.14.0-408.el9 CentOS-BaseOS 21 M 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules x86_64 5.14.0-408.el9 CentOS-BaseOS 39 M 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-core x86_64 5.14.0-408.el9 CentOS-BaseOS 33 M 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout:Install 4 Packages 2024-01-17T15:55:16.087 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T15:55:16.088 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 99 M 2024-01-17T15:55:16.088 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 122 M 2024-01-17T15:55:16.088 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T15:55:16.264 INFO:teuthology.orchestra.run.smithi026.stdout:(3/4): kernel-modules-core-5.14.0-408.el9.x86_6 15 MB/s | 33 MB 00:02 2024-01-17T15:55:16.593 INFO:teuthology.orchestra.run.smithi137.stdout:(1/4): kernel-5.14.0-408.el9.x86_64.rpm 12 MB/s | 6.0 MB 00:00 2024-01-17T15:55:16.781 INFO:teuthology.orchestra.run.smithi026.stdout:(4/4): kernel-modules-5.14.0-408.el9.x86_64.rpm 12 MB/s | 39 MB 00:03 2024-01-17T15:55:16.784 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T15:55:16.784 INFO:teuthology.orchestra.run.smithi026.stdout:Total 32 MB/s | 99 MB 00:03 2024-01-17T15:55:16.784 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T15:55:17.261 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T15:55:17.262 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T15:55:17.352 INFO:teuthology.orchestra.run.smithi137.stdout:(2/4): kernel-core-5.14.0-408.el9.x86_64.rpm 16 MB/s | 21 MB 00:01 2024-01-17T15:55:18.036 INFO:teuthology.orchestra.run.smithi137.stdout:(3/4): kernel-modules-core-5.14.0-408.el9.x86_6 23 MB/s | 33 MB 00:01 2024-01-17T15:55:18.285 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T15:55:18.285 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T15:55:19.027 INFO:teuthology.orchestra.run.smithi137.stdout:(4/4): kernel-modules-5.14.0-408.el9.x86_64.rpm 13 MB/s | 39 MB 00:02 2024-01-17T15:55:19.031 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T15:55:19.031 INFO:teuthology.orchestra.run.smithi137.stdout:Total 34 MB/s | 99 MB 00:02 2024-01-17T15:55:19.031 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T15:55:19.408 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T15:55:19.408 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T15:55:20.420 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T15:55:20.420 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T15:55:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T15:55:21.484 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-modules-core-5.14.0-408.el9.x86_64 1/4 2024-01-17T15:55:21.614 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-core-5.14.0-408.el9.x86_64 2/4 2024-01-17T15:55:22.796 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T15:55:23.453 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-modules-core-5.14.0-408.el9.x86_64 1/4 2024-01-17T15:55:23.586 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-core-5.14.0-408.el9.x86_64 2/4 2024-01-17T15:55:24.539 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-5.14.0-408.el9.x86_64 2/4 2024-01-17T15:55:24.715 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-modules-5.14.0-408.el9.x86_64 3/4 2024-01-17T15:55:26.348 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-5.14.0-408.el9.x86_64 2/4 2024-01-17T15:55:26.529 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-modules-5.14.0-408.el9.x86_64 3/4 2024-01-17T15:55:29.781 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-5.14.0-408.el9.x86_64 3/4 2024-01-17T15:55:29.887 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:55:31.261 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-5.14.0-408.el9.x86_64 3/4 2024-01-17T15:55:31.558 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:55:34.967 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-core-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:55:36.297 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-core-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:56:05.507 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:56:05.507 INFO:teuthology.orchestra.run.smithi137.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-17T15:56:05.507 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T15:56:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:56:05.671 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:56:05.671 INFO:teuthology.orchestra.run.smithi026.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-17T15:56:05.671 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T15:56:05.742 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:56:06.027 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:56:06.027 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-5.14.0-408.el9.x86_64 1/4 2024-01-17T15:56:06.027 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-core-5.14.0-408.el9.x86_64 2/4 2024-01-17T15:56:06.027 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-modules-5.14.0-408.el9.x86_64 3/4 2024-01-17T15:56:06.192 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:56:06.193 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-5.14.0-408.el9.x86_64 1/4 2024-01-17T15:56:06.193 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-core-5.14.0-408.el9.x86_64 2/4 2024-01-17T15:56:06.193 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-modules-5.14.0-408.el9.x86_64 3/4 2024-01-17T15:56:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-modules-core-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:56:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T15:56:06.420 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T15:56:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-5.14.0-408.el9.x86_64 2024-01-17T15:56:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-core-5.14.0-408.el9.x86_64 2024-01-17T15:56:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-5.14.0-408.el9.x86_64 2024-01-17T15:56:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-core-5.14.0-408.el9.x86_64 2024-01-17T15:56:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T15:56:06.420 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T15:56:06.627 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-modules-core-5.14.0-408.el9.x86_64 4/4 2024-01-17T15:56:06.627 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T15:56:06.627 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T15:56:06.627 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-5.14.0-408.el9.x86_64 2024-01-17T15:56:06.627 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-core-5.14.0-408.el9.x86_64 2024-01-17T15:56:06.627 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules-5.14.0-408.el9.x86_64 2024-01-17T15:56:06.627 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules-core-5.14.0-408.el9.x86_64 2024-01-17T15:56:06.627 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T15:56:06.627 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T15:56:06.940 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel | sort -rV | head -n 1 2024-01-17T15:56:07.070 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-5.14.0-408.el9.x86_64 2024-01-17T15:56:07.070 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-408.el9.x86_64 2024-01-17T15:56:07.070 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-408.el9.x86_64 2024-01-17T15:56:07.071 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-17T15:56:07.071 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-17T15:56:07.071 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-01-17T15:56:07.071 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=None, version=distro) 2024-01-17T15:56:07.071 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel | sort -rV | head -n 1 2024-01-17T15:56:07.122 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2024-01-17T15:56:07.179 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-5.14.0-408.el9.x86_64 2024-01-17T15:56:07.180 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-408.el9.x86_64 2024-01-17T15:56:07.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2024-01-17T15:56:07.213 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2024-01-17T15:56:07.213 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2024-01-17T15:56:07.213 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.06 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 68.el9 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Group : Unspecified 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 8264254 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : builder@centos.org 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T15:56:07.214 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-17T15:56:07.215 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-17T15:56:07.215 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-17T15:56:07.215 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2024-01-17T15:56:07.215 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T15:56:07.215 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2024-01-17T15:56:07.215 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-17T15:56:07.216 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 5.14.0-408.el9.x86_64 2024-01-17T15:56:07.216 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-17T15:56:07.303 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-5.14.0-408.el9.x86_64 2024-01-17T15:56:07.303 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-408.el9.x86_64 2024-01-17T15:56:07.304 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-408.el9.x86_64 2024-01-17T15:56:07.304 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-17T15:56:07.304 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-17T15:56:07.304 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-01-17T15:56:07.304 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=None, version=distro) 2024-01-17T15:56:07.304 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2024-01-17T15:56:07.417 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-5.14.0-408.el9.x86_64 2024-01-17T15:56:07.417 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-408.el9.x86_64 2024-01-17T15:56:07.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo rpm -qi grub2-tools 2024-01-17T15:56:07.462 INFO:teuthology.orchestra.run.smithi026.stdout:Name : grub2-tools 2024-01-17T15:56:07.462 INFO:teuthology.orchestra.run.smithi026.stdout:Epoch : 1 2024-01-17T15:56:07.462 INFO:teuthology.orchestra.run.smithi026.stdout:Version : 2.06 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Release : 68.el9 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: x86_64 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Group : Unspecified 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Size : 8264254 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:License : GPLv3+ 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Packager : builder@centos.org 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Vendor : CentOS 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-17T15:56:07.463 INFO:teuthology.orchestra.run.smithi026.stdout:Summary : Support tools for GRUB. 2024-01-17T15:56:07.464 INFO:teuthology.orchestra.run.smithi026.stdout:Description : 2024-01-17T15:56:07.464 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T15:56:07.464 INFO:teuthology.orchestra.run.smithi026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-17T15:56:07.464 INFO:teuthology.orchestra.run.smithi026.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-17T15:56:07.464 INFO:teuthology.orchestra.run.smithi026.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-17T15:56:07.464 INFO:teuthology.orchestra.run.smithi026.stdout:hardware devices. 2024-01-17T15:56:07.464 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T15:56:07.464 INFO:teuthology.orchestra.run.smithi026.stdout:This subpackage provides tools for support of all platforms. 2024-01-17T15:56:07.465 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-17T15:56:07.465 INFO:teuthology.task.kernel:Updating grub on smithi026 to boot 5.14.0-408.el9.x86_64 2024-01-17T15:56:07.465 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-17T15:56:07.823 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-01-17T15:56:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2024-01-17T15:56:09.267 INFO:teuthology.orchestra.run.smithi137.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-17T15:56:09.287 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-01-17T15:56:09.289 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-01-17T15:56:09.305 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.VIVHXqPqPP 2024-01-17T15:56:09.306 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VIVHXqPqPP 2024-01-17T15:56:09.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.VIVHXqPqPP 2024-01-17T15:56:09.446 INFO:teuthology.orchestra.run.smithi026.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-17T15:56:09.484 INFO:teuthology.orchestra.run.smithi026.stderr:done 2024-01-17T15:56:09.486 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-01-17T15:56:09.501 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.TaePsGf0ZR 2024-01-17T15:56:09.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TaePsGf0ZR 2024-01-17T15:56:09.517 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.VIVHXqPqPP is 6KB 2024-01-17T15:56:09.568 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.VIVHXqPqPP 2024-01-17T15:56:09.574 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.TaePsGf0ZR 2024-01-17T15:56:09.582 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2024-01-17T15:56:09.647 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-17T15:56:09.647 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-17T15:56:09.647 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-17T15:56:09.647 INFO:teuthology.orchestra.run.smithi137.stdout:15949e3c88704300882482eddfd7baae-5.14.0-408.el9.x86_64.conf 2024-01-17T15:56:09.649 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-408.el9.x86_64 2024-01-17T15:56:09.722 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.TaePsGf0ZR is 6KB 2024-01-17T15:56:09.772 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.TaePsGf0ZR 2024-01-17T15:56:09.787 DEBUG:teuthology.orchestra.run.smithi026:> sudo /bin/ls /boot/loader/entries || true 2024-01-17T15:56:09.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-01-17T15:56:09.858 INFO:teuthology.orchestra.run.smithi026.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-17T15:56:09.858 INFO:teuthology.orchestra.run.smithi026.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-17T15:56:09.859 INFO:teuthology.orchestra.run.smithi026.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-17T15:56:09.859 INFO:teuthology.orchestra.run.smithi026.stdout:15949e3c88704300882482eddfd7baae-5.14.0-408.el9.x86_64.conf 2024-01-17T15:56:09.860 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-408.el9.x86_64 2024-01-17T15:56:10.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2024-01-17T15:56:39.824 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-01-17T15:56:39.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T15:56:39.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T15:56:40.051 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-17T15:56:40.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-17T15:56:40.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T15:56:58.300 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-17T15:56:58.560 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-01-17T15:57:07.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T15:57:07.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T15:57:07.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-17T15:57:07.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T15:57:10.364 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-17T15:57:22.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T15:57:22.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T15:57:25.948 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-01-17T15:57:37.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-17T15:57:37.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T15:57:38.266 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-01-17T15:57:38.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-17T15:57:38.864 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-408.el9.x86_64"... 2024-01-17T15:57:38.864 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-01-17T15:57:38.878 INFO:teuthology.orchestra.run.smithi026.stdout:5.14.0-408.el9.x86_64 2024-01-17T15:57:38.878 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-408.el9.x86_64 vs 5.14.0-408.el9.x86_64 2024-01-17T15:57:38.878 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-17T15:57:38.879 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-17T15:57:39.880 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-17T15:57:39.880 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-17T15:57:39.957 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2024-01-17T15:57:39.997 DEBUG:teuthology.parallel:result is None 2024-01-17T15:57:54.391 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-01-17T15:57:54.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T15:57:54.771 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-408.el9.x86_64"... 2024-01-17T15:57:54.772 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-01-17T15:57:54.785 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-408.el9.x86_64 2024-01-17T15:57:54.786 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-408.el9.x86_64 vs 5.14.0-408.el9.x86_64 2024-01-17T15:57:54.786 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-17T15:57:54.786 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-17T15:57:55.787 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-01-17T15:57:55.788 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-17T15:57:55.886 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-01-17T15:57:55.922 DEBUG:teuthology.parallel:result is None 2024-01-17T15:57:55.923 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-17T15:57:55.930 INFO:teuthology.task.internal:Creating test directory... 2024-01-17T15:57:55.931 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-17T15:57:55.934 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-17T15:57:55.960 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-17T15:57:55.983 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-17T15:57:56.032 INFO:teuthology.task.internal:Creating archive directory... 2024-01-17T15:57:56.033 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-17T15:57:56.035 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-17T15:57:56.078 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-17T15:57:56.086 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-17T15:57:56.086 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-17T15:57:56.113 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-17T15:57:56.144 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T15:57:56.158 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T15:57:56.193 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T15:57:56.213 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T15:57:56.218 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-17T15:57:56.225 INFO:teuthology.task.internal:Configuring sudo... 2024-01-17T15:57:56.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-17T15:57:56.227 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-17T15:57:56.278 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-17T15:57:56.288 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-17T15:57:56.288 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-17T15:57:56.297 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-17T15:57:56.318 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-17T15:57:56.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-17T15:57:56.442 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-17T15:57:56.526 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-17T15:57:56.568 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T15:57:56.568 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-17T15:57:56.636 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-17T15:57:56.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-17T15:57:56.731 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-17T15:57:56.813 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-17T15:57:56.855 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T15:57:56.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-17T15:57:56.922 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2024-01-17T15:57:56.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-01-17T15:57:56.977 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-17T15:57:57.098 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-17T15:57:57.616 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-17T15:57:57.628 INFO:teuthology.task.internal:Starting timer... 2024-01-17T15:57:57.628 INFO:teuthology.run_tasks:Running task pcp... 2024-01-17T15:57:57.638 INFO:teuthology.run_tasks:Running task selinux... 2024-01-17T15:57:57.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2024-01-17T15:57:57.771 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2024-01-17T15:57:57.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-01-17T15:57:57.829 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-01-17T15:57:57.830 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-17T15:57:57.831 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2024-01-17T15:57:57.858 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2024-01-17T15:57:57.858 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-01-17T15:57:57.901 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-01-17T15:57:57.902 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive'} 2024-01-17T15:57:57.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-17T15:57:57.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T15:57:57.930 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-17T15:57:57.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T15:57:57.968 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-17T15:57:57.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2024-01-17T15:57:58.002 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-01-17T15:57:58.044 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-17T15:57:58.058 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-17T15:57:58.074 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-17T15:57:58.076 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-17T16:02:03.865 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2024-01-17T16:02:03.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-17T16:02:03.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T16:02:03.960 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-01-17T16:02:04.039 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-01-17T16:02:04.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T16:02:04.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T16:02:04.129 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-01-17T16:02:04.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T16:02:04.211 INFO:teuthology.run_tasks:Running task clock... 2024-01-17T16:02:04.221 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-17T16:02:04.221 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-17T16:02:04.222 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-17T16:02:04.224 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-17T16:02:04.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-17T16:02:04.253 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-17T16:02:04.270 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-17T16:02:04.282 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-17T16:02:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-17T16:02:04.299 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2024-01-17T16:02:04.313 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2024-01-17T16:02:04.328 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-01-17T16:02:04.330 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-17T16:02:04.342 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-01-17T16:02:04.346 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-17T16:02:04.358 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-17T16:02:04.375 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-17T16:02:04.407 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-01-17T16:02:04.410 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-17T16:02:04.410 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-01-17T16:02:04.410 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T16:02:04.410 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T16:02:04.410 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T16:02:04.410 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T16:02:04.428 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-01-17T16:02:04.432 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-17T16:02:04.432 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-01-17T16:02:04.432 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T16:02:04.432 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T16:02:04.432 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T16:02:04.432 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T16:02:04.433 INFO:teuthology.run_tasks:Running task install... 2024-01-17T16:02:04.440 DEBUG:teuthology.task.install:project ceph 2024-01-17T16:02:04.440 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f'}} 2024-01-17T16:02:04.441 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f'} 2024-01-17T16:02:04.441 INFO:teuthology.task.install:Using flavor: crimson 2024-01-17T16:02:04.446 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-17T16:02:04.446 INFO:teuthology.task.install:extra packages: [] 2024-01-17T16:02:04.447 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f', 'tag': None, 'wait_for_package': False} 2024-01-17T16:02:04.447 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=cecb6cb5cdba1d67db289980b0e46cfe0334a30f 2024-01-17T16:02:04.449 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f', 'tag': None, 'wait_for_package': False} 2024-01-17T16:02:04.450 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=cecb6cb5cdba1d67db289980b0e46cfe0334a30f 2024-01-17T16:02:04.718 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-17.1-crimson-only/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/centos/9/flavors/crimson/ 2024-01-17T16:02:04.718 INFO:teuthology.task.install.rpm:Package version is 19.0.0-720.gcecb6cb5 2024-01-17T16:02:04.722 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-17.1-crimson-only/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/centos/9/flavors/crimson/ 2024-01-17T16:02:04.722 INFO:teuthology.task.install.rpm:Package version is 19.0.0-720.gcecb6cb5 2024-01-17T16:02:04.993 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-17.1-crimson-only/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-17.1-crimson-only/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-17.1-crimson-only/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-17T16:02:04.993 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:02:04.993 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-17T16:02:05.001 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-17.1-crimson-only/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-17.1-crimson-only/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-17.1-crimson-only/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-17T16:02:05.001 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:02:05.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-17T16:02:05.023 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-01-17T16:02:05.023 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-17T16:02:05.030 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-01-17T16:02:05.030 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cecb6cb5cdba1d67db289980b0e46cfe0334a30f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-17T16:02:05.092 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-17T16:02:05.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-17T16:02:05.173 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-17T16:02:05.180 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-17T16:02:05.240 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2024-01-17T16:02:05.242 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2024-01-17T16:02:05.246 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-01-17T16:02:05.248 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-01-17T16:02:05.487 INFO:teuthology.orchestra.run.smithi026.stdout:73 files removed 2024-01-17T16:02:05.488 INFO:teuthology.orchestra.run.smithi137.stdout:73 files removed 2024-01-17T16:02:05.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw 2024-01-17T16:02:05.515 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw 2024-01-17T16:02:06.478 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 130 kB/s | 83 kB 00:00 2024-01-17T16:02:06.700 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 97 kB/s | 83 kB 00:00 2024-01-17T16:02:06.970 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 21 kB/s | 9.5 kB 00:00 2024-01-17T16:02:07.159 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2024-01-17T16:02:07.804 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-01-17T16:02:07.993 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-01-17T16:02:08.357 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2024-01-17T16:02:08.537 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2024-01-17T16:02:09.832 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2024-01-17T16:02:10.096 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2024-01-17T16:02:12.420 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.0 MB 00:01 2024-01-17T16:02:12.606 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.0 MB 00:02 2024-01-17T16:02:15.354 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-01-17T16:02:20.905 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 5.9 MB 00:01 2024-01-17T16:02:22.322 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 15 kB 00:00 2024-01-17T16:02:24.773 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 20 MB 00:02 2024-01-17T16:02:26.722 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 19 MB 00:13 2024-01-17T16:02:29.790 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-01-17T16:02:31.498 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 5.9 MB 00:01 2024-01-17T16:02:32.427 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:02:32.436 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:02:32.436 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:02:32.436 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:02:32.436 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 8.4 M 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 3.1 M 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 3.1 M 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 5.1 M 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 18 M 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 25 k 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 752 k 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-17T16:02:32.437 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 497 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 4.5 M 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 45 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 130 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 162 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 321 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 298 k 2024-01-17T16:02:32.438 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 100 k 2024-01-17T16:02:32.439 INFO:teuthology.orchestra.run.smithi026.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-17T16:02:32.439 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-17T16:02:32.439 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:02:32.439 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:02:32.439 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:02:32.439 INFO:teuthology.orchestra.run.smithi026.stdout:Install 27 Packages 2024-01-17T16:02:32.439 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 2 Packages 2024-01-17T16:02:32.439 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:02:32.439 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 53 M 2024-01-17T16:02:32.440 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:02:33.374 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-01-17T16:02:34.719 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2024-01-17T16:02:35.332 INFO:teuthology.orchestra.run.smithi026.stdout:(1/29): ceph-base-19.0.0-720.gcecb6cb5.el9.x86_ 2.1 MB/s | 5.1 MB 00:02 2024-01-17T16:02:35.441 INFO:teuthology.orchestra.run.smithi026.stdout:(2/29): ceph-selinux-19.0.0-720.gcecb6cb5.el9.x 233 kB/s | 25 kB 00:00 2024-01-17T16:02:35.716 INFO:teuthology.orchestra.run.smithi026.stdout:(3/29): libcephfs2-19.0.0-720.gcecb6cb5.el9.x86 2.7 MB/s | 752 kB 00:00 2024-01-17T16:02:35.941 INFO:teuthology.orchestra.run.smithi026.stdout:(4/29): libradosstriper1-19.0.0-720.gcecb6cb5.e 2.2 MB/s | 497 kB 00:00 2024-01-17T16:02:37.483 INFO:teuthology.orchestra.run.smithi026.stdout:(5/29): librgw2-19.0.0-720.gcecb6cb5.el9.x86_64 2.9 MB/s | 4.5 MB 00:01 2024-01-17T16:02:37.609 INFO:teuthology.orchestra.run.smithi026.stdout:(6/29): python3-ceph-argparse-19.0.0-720.gcecb6 361 kB/s | 45 kB 00:00 2024-01-17T16:02:37.717 INFO:teuthology.orchestra.run.smithi026.stdout:(7/29): python3-ceph-common-19.0.0-720.gcecb6cb 1.2 MB/s | 130 kB 00:00 2024-01-17T16:02:37.834 INFO:teuthology.orchestra.run.smithi026.stdout:(8/29): python3-cephfs-19.0.0-720.gcecb6cb5.el9 1.4 MB/s | 162 kB 00:00 2024-01-17T16:02:38.034 INFO:teuthology.orchestra.run.smithi026.stdout:(9/29): python3-rados-19.0.0-720.gcecb6cb5.el9. 1.6 MB/s | 321 kB 00:00 2024-01-17T16:02:38.176 INFO:teuthology.orchestra.run.smithi026.stdout:(10/29): ceph-radosgw-19.0.0-720.gcecb6cb5.el9. 1.6 MB/s | 8.4 MB 00:05 2024-01-17T16:02:38.268 INFO:teuthology.orchestra.run.smithi026.stdout:(11/29): python3-rbd-19.0.0-720.gcecb6cb5.el9.x 1.2 MB/s | 298 kB 00:00 2024-01-17T16:02:38.293 INFO:teuthology.orchestra.run.smithi026.stdout:(12/29): python3-rgw-19.0.0-720.gcecb6cb5.el9.x 854 kB/s | 100 kB 00:00 2024-01-17T16:02:38.535 INFO:teuthology.orchestra.run.smithi026.stdout:(13/29): boost-program-options-1.75.0-8.el9.x86 396 kB/s | 106 kB 00:00 2024-01-17T16:02:38.619 INFO:teuthology.orchestra.run.smithi026.stdout:(14/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 531 kB/s | 44 kB 00:00 2024-01-17T16:02:38.644 INFO:teuthology.orchestra.run.smithi026.stdout:(15/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 454 kB/s | 159 kB 00:00 2024-01-17T16:02:38.761 INFO:teuthology.orchestra.run.smithi026.stdout:(16/29): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 661 kB 00:00 2024-01-17T16:02:38.786 INFO:teuthology.orchestra.run.smithi026.stdout:(17/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 282 kB 00:00 2024-01-17T16:02:38.828 INFO:teuthology.orchestra.run.smithi026.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 623 kB/s | 41 kB 00:00 2024-01-17T16:02:39.062 INFO:teuthology.orchestra.run.smithi026.stdout:(19/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-01-17T16:02:39.154 INFO:teuthology.orchestra.run.smithi026.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 284 kB/s | 26 kB 00:00 2024-01-17T16:02:39.229 INFO:teuthology.orchestra.run.smithi026.stdout:(21/29): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-01-17T16:02:39.254 INFO:teuthology.orchestra.run.smithi026.stdout:(22/29): liboath-2.6.7-2.el9.x86_64.rpm 497 kB/s | 49 kB 00:00 2024-01-17T16:02:39.279 INFO:teuthology.orchestra.run.smithi026.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-01-17T16:02:39.373 INFO:teuthology.orchestra.run.smithi026.stdout:(24/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2024-01-17T16:02:39.397 INFO:teuthology.orchestra.run.smithi026.stdout:(25/29): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-01-17T16:02:39.514 INFO:teuthology.orchestra.run.smithi026.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-01-17T16:02:39.675 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 7.9 kB/s | 1.7 kB 00:00 2024-01-17T16:02:41.230 INFO:teuthology.orchestra.run.smithi026.stdout:(27/29): librados2-19.0.0-720.gcecb6cb5.el9.x86 1.7 MB/s | 3.1 MB 00:01 2024-01-17T16:02:41.765 INFO:teuthology.orchestra.run.smithi026.stdout:(28/29): librbd1-19.0.0-720.gcecb6cb5.el9.x86_6 1.4 MB/s | 3.1 MB 00:02 2024-01-17T16:02:42.235 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:02:42.246 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:02:42.246 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:02:42.246 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:02:42.246 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 8.4 M 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 3.1 M 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 3.1 M 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 5.1 M 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 18 M 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 25 k 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 752 k 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-17T16:02:42.247 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 497 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 4.5 M 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 45 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 130 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 162 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 321 k 2024-01-17T16:02:42.248 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 298 k 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 100 k 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout:Install 27 Packages 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 2 Packages 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:02:42.249 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 53 M 2024-01-17T16:02:42.250 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:02:44.801 INFO:teuthology.orchestra.run.smithi137.stdout:(1/29): ceph-base-19.0.0-720.gcecb6cb5.el9.x86_ 2.2 MB/s | 5.1 MB 00:02 2024-01-17T16:02:44.901 INFO:teuthology.orchestra.run.smithi137.stdout:(2/29): ceph-selinux-19.0.0-720.gcecb6cb5.el9.x 252 kB/s | 25 kB 00:00 2024-01-17T16:02:45.202 INFO:teuthology.orchestra.run.smithi137.stdout:(3/29): libcephfs2-19.0.0-720.gcecb6cb5.el9.x86 2.4 MB/s | 752 kB 00:00 2024-01-17T16:02:45.419 INFO:teuthology.orchestra.run.smithi137.stdout:(4/29): libradosstriper1-19.0.0-720.gcecb6cb5.e 2.2 MB/s | 497 kB 00:00 2024-01-17T16:02:47.094 INFO:teuthology.orchestra.run.smithi137.stdout:(5/29): ceph-radosgw-19.0.0-720.gcecb6cb5.el9.x 1.8 MB/s | 8.4 MB 00:04 2024-01-17T16:02:47.219 INFO:teuthology.orchestra.run.smithi137.stdout:(6/29): python3-ceph-argparse-19.0.0-720.gcecb6 362 kB/s | 45 kB 00:00 2024-01-17T16:02:47.336 INFO:teuthology.orchestra.run.smithi137.stdout:(7/29): python3-ceph-common-19.0.0-720.gcecb6cb 1.1 MB/s | 130 kB 00:00 2024-01-17T16:02:47.478 INFO:teuthology.orchestra.run.smithi137.stdout:(8/29): librgw2-19.0.0-720.gcecb6cb5.el9.x86_64 2.2 MB/s | 4.5 MB 00:02 2024-01-17T16:02:47.703 INFO:teuthology.orchestra.run.smithi137.stdout:(9/29): python3-rados-19.0.0-720.gcecb6cb5.el9. 1.4 MB/s | 321 kB 00:00 2024-01-17T16:02:47.870 INFO:teuthology.orchestra.run.smithi137.stdout:(10/29): python3-rbd-19.0.0-720.gcecb6cb5.el9.x 1.7 MB/s | 298 kB 00:00 2024-01-17T16:02:47.970 INFO:teuthology.orchestra.run.smithi137.stdout:(11/29): python3-rgw-19.0.0-720.gcecb6cb5.el9.x 998 kB/s | 100 kB 00:00 2024-01-17T16:02:48.070 INFO:teuthology.orchestra.run.smithi137.stdout:(12/29): boost-program-options-1.75.0-8.el9.x86 1.0 MB/s | 106 kB 00:00 2024-01-17T16:02:48.120 INFO:teuthology.orchestra.run.smithi137.stdout:(13/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-01-17T16:02:48.154 INFO:teuthology.orchestra.run.smithi137.stdout:(14/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-01-17T16:02:48.229 INFO:teuthology.orchestra.run.smithi137.stdout:(15/29): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-01-17T16:02:48.255 INFO:teuthology.orchestra.run.smithi137.stdout:(16/29): python3-cephfs-19.0.0-720.gcecb6cb5.el 176 kB/s | 162 kB 00:00 2024-01-17T16:02:48.280 INFO:teuthology.orchestra.run.smithi137.stdout:(17/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-01-17T16:02:48.330 INFO:teuthology.orchestra.run.smithi137.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 551 kB/s | 41 kB 00:00 2024-01-17T16:02:48.773 INFO:teuthology.orchestra.run.smithi137.stdout:(19/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 628 kB/s | 309 kB 00:00 2024-01-17T16:02:48.847 INFO:teuthology.orchestra.run.smithi137.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-01-17T16:02:48.931 INFO:teuthology.orchestra.run.smithi137.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 584 kB/s | 49 kB 00:00 2024-01-17T16:02:49.090 INFO:teuthology.orchestra.run.smithi137.stdout:(22/29): libarrow-9.0.0-10.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-01-17T16:02:49.115 INFO:teuthology.orchestra.run.smithi137.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 367 kB/s | 67 kB 00:00 2024-01-17T16:02:49.240 INFO:teuthology.orchestra.run.smithi137.stdout:(24/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.5 MB/s | 838 kB 00:00 2024-01-17T16:02:49.265 INFO:teuthology.orchestra.run.smithi137.stdout:(25/29): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-01-17T16:02:49.349 INFO:teuthology.orchestra.run.smithi137.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-01-17T16:02:51.658 INFO:teuthology.orchestra.run.smithi137.stdout:(27/29): librados2-19.0.0-720.gcecb6cb5.el9.x86 1.3 MB/s | 3.1 MB 00:02 2024-01-17T16:02:53.041 INFO:teuthology.orchestra.run.smithi137.stdout:(28/29): ceph-common-19.0.0-720.gcecb6cb5.el9.x 1.7 MB/s | 18 MB 00:10 2024-01-17T16:02:55.866 INFO:teuthology.orchestra.run.smithi137.stdout:(29/29): librbd1-19.0.0-720.gcecb6cb5.el9.x86_6 484 kB/s | 3.1 MB 00:06 2024-01-17T16:02:55.871 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:02:55.871 INFO:teuthology.orchestra.run.smithi137.stdout:Total 3.9 MB/s | 53 MB 00:13 2024-01-17T16:02:55.872 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:02:55.906 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:02:55.906 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:02:56.351 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:02:56.351 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:02:57.754 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:02:58.099 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2024-01-17T16:02:58.176 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/31 2024-01-17T16:02:58.251 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/31 2024-01-17T16:02:58.341 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:19.0.0-720.gcecb6cb5.el9.x86_64 3/31 2024-01-17T16:02:58.369 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 4/31 2024-01-17T16:02:58.434 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 4/31 2024-01-17T16:02:58.464 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/31 2024-01-17T16:02:58.490 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/31 2024-01-17T16:02:58.519 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/31 2024-01-17T16:02:58.563 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:19.0.0-720.gcecb6cb5.el9.x 8/31 2024-01-17T16:02:58.639 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:19.0.0-720.gcecb6cb5.el9.x86_64 9/31 2024-01-17T16:02:58.664 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/31 2024-01-17T16:02:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/31 2024-01-17T16:02:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/31 2024-01-17T16:02:58.893 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2024-01-17T16:02:58.931 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2024-01-17T16:02:58.979 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2024-01-17T16:02:59.020 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2024-01-17T16:02:59.049 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2024-01-17T16:02:59.082 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2024-01-17T16:02:59.412 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2024-01-17T16:02:59.436 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 19/31 2024-01-17T16:02:59.510 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 19/31 2024-01-17T16:02:59.549 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 20/31 2024-01-17T16:02:59.586 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2024-01-17T16:03:00.019 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2024-01-17T16:03:00.047 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:19.0.0-720.gcecb6cb5.el9.x86_64 23/31 2024-01-17T16:03:00.119 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:19.0.0-720.gcecb6cb5.el9.x86_64 23/31 2024-01-17T16:03:00.186 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 24/31 2024-01-17T16:03:00.216 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86 25/31 2024-01-17T16:03:00.446 INFO:teuthology.orchestra.run.smithi026.stdout:(29/29): ceph-common-19.0.0-720.gcecb6cb5.el9.x 655 kB/s | 18 MB 00:27 2024-01-17T16:03:00.452 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:03:00.452 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.9 MB/s | 53 MB 00:28 2024-01-17T16:03:00.453 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:03:00.493 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:03:00.493 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:03:00.945 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:03:00.946 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:03:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:03:02.333 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 26/31 2024-01-17T16:03:02.372 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 26/31 2024-01-17T16:03:02.680 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2024-01-17T16:03:02.809 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/31 2024-01-17T16:03:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 26/31 2024-01-17T16:03:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 27/31 2024-01-17T16:03:03.009 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/31 2024-01-17T16:03:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 27/31 2024-01-17T16:03:03.045 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-17T16:03:03.046 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-17T16:03:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:03:03.084 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:19.0.0-720.gcecb6cb5.el9.x86_64 28/31 2024-01-17T16:03:03.101 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:19.0.0-720.gcecb6cb5.el9.x86_64 3/31 2024-01-17T16:03:03.133 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 4/31 2024-01-17T16:03:03.202 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 4/31 2024-01-17T16:03:03.228 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/31 2024-01-17T16:03:03.254 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/31 2024-01-17T16:03:03.284 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/31 2024-01-17T16:03:03.328 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:19.0.0-720.gcecb6cb5.el9.x 8/31 2024-01-17T16:03:03.406 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:19.0.0-720.gcecb6cb5.el9.x86_64 9/31 2024-01-17T16:03:03.436 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/31 2024-01-17T16:03:03.525 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/31 2024-01-17T16:03:03.560 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/31 2024-01-17T16:03:03.671 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2024-01-17T16:03:03.703 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2024-01-17T16:03:03.743 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2024-01-17T16:03:03.775 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2024-01-17T16:03:03.805 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2024-01-17T16:03:03.837 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2024-01-17T16:03:04.174 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2024-01-17T16:03:04.209 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 19/31 2024-01-17T16:03:04.299 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 19/31 2024-01-17T16:03:04.330 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 20/31 2024-01-17T16:03:04.367 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2024-01-17T16:03:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2024-01-17T16:03:04.853 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:19.0.0-720.gcecb6cb5.el9.x86_64 23/31 2024-01-17T16:03:04.924 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:19.0.0-720.gcecb6cb5.el9.x86_64 23/31 2024-01-17T16:03:05.003 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 24/31 2024-01-17T16:03:05.047 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86 25/31 2024-01-17T16:03:07.201 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 26/31 2024-01-17T16:03:07.235 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 26/31 2024-01-17T16:03:07.811 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 26/31 2024-01-17T16:03:07.855 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 27/31 2024-01-17T16:03:07.973 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 27/31 2024-01-17T16:03:07.973 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-17T16:03:07.973 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-17T16:03:07.973 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:03:08.014 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:19.0.0-720.gcecb6cb5.el9.x86_64 28/31 2024-01-17T16:03:12.529 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:19.0.0-720.gcecb6cb5.el9.x86_64 28/31 2024-01-17T16:03:12.529 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-01-17T16:03:12.529 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-01-17T16:03:12.530 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-01-17T16:03:12.530 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-01-17T16:03:12.530 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-01-17T16:03:12.530 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-01-17T16:03:12.530 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-01-17T16:03:12.530 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:03:13.375 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 29/31 2024-01-17T16:03:13.399 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 29/31 2024-01-17T16:03:13.399 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:03:13.399 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-17T16:03:13.399 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-17T16:03:13.399 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-17T16:03:13.399 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:03:13.401 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-01-17T16:03:13.469 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-01-17T16:03:13.469 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2024-01-17T16:03:14.652 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 3/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:19.0.0-720.gcecb6cb5.el9.x86_64 4/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 5/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:19.0.0-720.gcecb6cb5.el9.x86_64 6/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:19.0.0-720.gcecb6cb5.el9.x86_64 7/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:19.0.0-720.gcecb6cb5.el9.x 8/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86 9/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:19.0.0-720.gcecb6cb5.el9.x86_64 11/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 12/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 13/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2024-01-17T16:03:14.653 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2024-01-17T16:03:14.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2024-01-17T16:03:14.655 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 28/31 2024-01-17T16:03:14.655 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2024-01-17T16:03:14.655 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 30/31 2024-01-17T16:03:15.753 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-17T16:03:15.754 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-17T16:03:15.755 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.756 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.756 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:15.756 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-3.el9.x86_64 2024-01-17T16:03:15.756 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-17T16:03:15.756 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:03:15.756 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:03:16.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-test 2024-01-17T16:03:16.563 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:00:37 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:03:16.727 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 119 M 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: libasan x86_64 11.4.1-3.el9 CentOS-AppStream 417 k 2024-01-17T16:03:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 158 k 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: libubsan x86_64 11.4.1-3.el9 CentOS-AppStream 186 k 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout:Install 10 Packages 2024-01-17T16:03:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:03:16.730 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 122 M 2024-01-17T16:03:16.730 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 1.1 G 2024-01-17T16:03:16.730 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:03:17.217 INFO:teuthology.orchestra.run.smithi137.stdout:(1/10): libasan-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 417 kB 00:00 2024-01-17T16:03:17.276 INFO:teuthology.orchestra.run.smithi137.stdout:(2/10): libubsan-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2024-01-17T16:03:17.351 INFO:teuthology.orchestra.run.smithi137.stdout:(3/10): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-01-17T16:03:17.401 INFO:teuthology.orchestra.run.smithi137.stdout:(4/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-01-17T16:03:17.460 INFO:teuthology.orchestra.run.smithi137.stdout:(5/10): jq-1.6-16.el9.x86_64.rpm 3.1 MB/s | 186 kB 00:00 2024-01-17T16:03:17.518 INFO:teuthology.orchestra.run.smithi137.stdout:(6/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2024-01-17T16:03:17.599 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:19.0.0-720.gcecb6cb5.el9.x86_64 28/31 2024-01-17T16:03:17.600 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2024-01-17T16:03:17.600 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2024-01-17T16:03:17.600 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2024-01-17T16:03:17.600 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2024-01-17T16:03:17.600 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2024-01-17T16:03:17.600 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /root 2024-01-17T16:03:17.600 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2024-01-17T16:03:17.600 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:03:17.927 INFO:teuthology.orchestra.run.smithi137.stdout:(7/10): cryptopp-8.6.0-1.el9.x86_64.rpm 3.1 MB/s | 1.3 MB 00:00 2024-01-17T16:03:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:(8/10): libcephsqlite-19.0.0-720.gcecb6cb5.el9. 162 kB/s | 158 kB 00:00 2024-01-17T16:03:18.002 INFO:teuthology.orchestra.run.smithi137.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2024-01-17T16:03:18.480 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 29/31 2024-01-17T16:03:18.504 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 29/31 2024-01-17T16:03:18.505 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:03:18.505 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-17T16:03:18.505 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-17T16:03:18.505 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-17T16:03:18.505 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:03:18.507 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-01-17T16:03:18.591 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-01-17T16:03:18.591 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 3/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:19.0.0-720.gcecb6cb5.el9.x86_64 4/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 5/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:19.0.0-720.gcecb6cb5.el9.x86_64 6/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:19.0.0-720.gcecb6cb5.el9.x86_64 7/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:19.0.0-720.gcecb6cb5.el9.x 8/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86 9/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/31 2024-01-17T16:03:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:19.0.0-720.gcecb6cb5.el9.x86_64 11/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 12/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 13/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2024-01-17T16:03:19.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2024-01-17T16:03:19.699 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2024-01-17T16:03:19.699 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 28/31 2024-01-17T16:03:19.699 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2024-01-17T16:03:19.699 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 30/31 2024-01-17T16:03:20.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2024-01-17T16:03:20.584 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-17T16:03:20.585 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:03:20.586 INFO:teuthology.orchestra.run.smithi026.stdout: re2-1:20211101-3.el9.x86_64 2024-01-17T16:03:20.587 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-17T16:03:20.587 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:03:20.587 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:03:20.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-test 2024-01-17T16:03:21.563 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:52 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:03:21.729 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:03:21.730 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:03:21.730 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:03:21.730 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:03:21.730 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 119 M 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: libasan x86_64 11.4.1-3.el9 CentOS-AppStream 417 k 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 158 k 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: libubsan x86_64 11.4.1-3.el9 CentOS-AppStream 186 k 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:03:21.731 INFO:teuthology.orchestra.run.smithi026.stdout:Install 10 Packages 2024-01-17T16:03:21.732 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:03:21.732 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 122 M 2024-01-17T16:03:21.732 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 1.1 G 2024-01-17T16:03:21.732 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:03:21.955 INFO:teuthology.orchestra.run.smithi026.stdout:(1/10): libasan-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 417 kB 00:00 2024-01-17T16:03:21.997 INFO:teuthology.orchestra.run.smithi026.stdout:(2/10): libubsan-11.4.1-3.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-01-17T16:03:22.039 INFO:teuthology.orchestra.run.smithi026.stdout:(3/10): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-01-17T16:03:22.072 INFO:teuthology.orchestra.run.smithi026.stdout:(4/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-01-17T16:03:22.114 INFO:teuthology.orchestra.run.smithi026.stdout:(5/10): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-01-17T16:03:22.156 INFO:teuthology.orchestra.run.smithi026.stdout:(6/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-01-17T16:03:22.673 INFO:teuthology.orchestra.run.smithi026.stdout:(7/10): libcephsqlite-19.0.0-720.gcecb6cb5.el9. 178 kB/s | 158 kB 00:00 2024-01-17T16:03:23.032 INFO:teuthology.orchestra.run.smithi026.stdout:(8/10): cryptopp-8.6.0-1.el9.x86_64.rpm 1.4 MB/s | 1.3 MB 00:00 2024-01-17T16:03:23.190 INFO:teuthology.orchestra.run.smithi026.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 236 kB/s | 122 kB 00:00 2024-01-17T16:05:28.108 INFO:teuthology.orchestra.run.smithi026.stdout:(10/10): ceph-test-19.0.0-720.gcecb6cb5.el9.x86 968 kB/s | 119 MB 02:06 2024-01-17T16:05:28.112 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:05:28.112 INFO:teuthology.orchestra.run.smithi026.stdout:Total 991 kB/s | 122 MB 02:06 2024-01-17T16:05:28.113 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:05:28.137 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:05:28.137 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:05:29.014 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:05:29.015 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:05:30.204 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:05:30.297 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2024-01-17T16:05:30.333 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2024-01-17T16:05:30.364 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/10 2024-01-17T16:05:30.399 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : jq-1.6-16.el9.x86_64 4/10 2024-01-17T16:05:30.453 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2024-01-17T16:05:30.485 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 6/10 2024-01-17T16:05:30.518 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 7/10 2024-01-17T16:05:30.560 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libasan-11.4.1-3.el9.x86_64 8/10 2024-01-17T16:05:30.587 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:19.0.0-720.gcecb6cb5.el9.x86_64 9/10 2024-01-17T16:05:47.965 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:19.0.0-720.gcecb6cb5.el9.x86_64 9/10 2024-01-17T16:05:48.045 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/10 2024-01-17T16:05:56.435 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-test-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/10 2024-01-17T16:05:56.435 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/10 2024-01-17T16:05:56.435 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/10 2024-01-17T16:05:56.435 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libasan-11.4.1-3.el9.x86_64 3/10 2024-01-17T16:05:56.435 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 4/10 2024-01-17T16:05:56.435 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/10 2024-01-17T16:05:56.435 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/10 2024-01-17T16:05:56.436 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : jq-1.6-16.el9.x86_64 7/10 2024-01-17T16:05:56.436 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 8/10 2024-01-17T16:05:56.436 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2024-01-17T16:05:56.852 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2024-01-17T16:05:56.852 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:05:56.852 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:05:56.852 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:19.0.0-720.gcecb6cb5.el9.x86_64 cryptopp-8.6.0-1.el9.x86_64 2024-01-17T16:05:56.852 INFO:teuthology.orchestra.run.smithi026.stdout: jq-1.6-16.el9.x86_64 libasan-11.4.1-3.el9.x86_64 2024-01-17T16:05:56.852 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:19.0.0-720.gcecb6cb5.el9.x86_64 libubsan-11.4.1-3.el9.x86_64 2024-01-17T16:05:56.852 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma-6.9.6-1.el9.5.x86_64 socat-1.7.4.1-5.el9.x86_64 2024-01-17T16:05:56.852 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el9.x86_64 yaml-cpp-0.6.3-5.el9.x86_64 2024-01-17T16:05:56.852 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:05:56.853 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:05:57.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph 2024-01-17T16:05:57.754 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:03:28 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:05:57.917 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:05:57.920 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================== 2024-01-17T16:05:57.920 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:05:57.920 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================== 2024-01-17T16:05:57.920 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:05:57.920 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 6.5 k 2024-01-17T16:05:57.920 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-01-17T16:05:57.920 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 2.0 M 2024-01-17T16:05:57.921 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 1.5 M 2024-01-17T16:05:57.921 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 245 k 2024-01-17T16:05:57.921 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 4.9 M 2024-01-17T16:05:57.921 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 117 M 2024-01-17T16:05:57.921 INFO:teuthology.orchestra.run.smithi026.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-17T16:05:57.921 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-17T16:05:57.921 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-17T16:05:57.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-17T16:05:57.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-17T16:05:57.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-17T16:05:57.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-17T16:05:57.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-17T16:05:57.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-17T16:05:57.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-17T16:05:57.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-17T16:05:57.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-17T16:05:57.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-17T16:05:57.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-17T16:05:57.924 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-17T16:05:57.924 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-17T16:05:57.924 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-17T16:05:57.924 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-17T16:05:57.924 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-17T16:05:57.924 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-17T16:05:57.924 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-17T16:05:57.924 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:05:57.924 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:05:57.925 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================== 2024-01-17T16:05:57.925 INFO:teuthology.orchestra.run.smithi026.stdout:Install 36 Packages 2024-01-17T16:05:57.925 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:05:57.925 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 129 M 2024-01-17T16:05:57.926 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 1.4 G 2024-01-17T16:05:57.926 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:05:58.777 INFO:teuthology.orchestra.run.smithi026.stdout:(1/36): ceph-19.0.0-720.gcecb6cb5.el9.x86_64.rp 13 kB/s | 6.5 kB 00:00 2024-01-17T16:05:59.560 INFO:teuthology.orchestra.run.smithi026.stdout:(2/36): ceph-mgr-19.0.0-720.gcecb6cb5.el9.x86_6 1.2 MB/s | 1.5 MB 00:01 2024-01-17T16:06:01.193 INFO:teuthology.orchestra.run.smithi026.stdout:(3/36): ceph-mds-19.0.0-720.gcecb6cb5.el9.x86_6 716 kB/s | 2.0 MB 00:02 2024-01-17T16:06:01.493 INFO:teuthology.orchestra.run.smithi026.stdout:(4/36): ceph-mgr-modules-core-19.0.0-720.gcecb6 816 kB/s | 245 kB 00:00 2024-01-17T16:06:01.660 INFO:teuthology.orchestra.run.smithi026.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-01-17T16:06:01.710 INFO:teuthology.orchestra.run.smithi026.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-01-17T16:06:01.744 INFO:teuthology.orchestra.run.smithi026.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 952 kB/s | 32 kB 00:00 2024-01-17T16:06:01.786 INFO:teuthology.orchestra.run.smithi026.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-01-17T16:06:01.828 INFO:teuthology.orchestra.run.smithi026.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 927 kB/s | 39 kB 00:00 2024-01-17T16:06:01.878 INFO:teuthology.orchestra.run.smithi026.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-01-17T16:06:01.987 INFO:teuthology.orchestra.run.smithi026.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 11 MB/s | 1.1 MB 00:00 2024-01-17T16:06:02.029 INFO:teuthology.orchestra.run.smithi026.stdout:(12/36): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 103 kB 00:00 2024-01-17T16:06:02.062 INFO:teuthology.orchestra.run.smithi026.stdout:(13/36): python3-pycparser-2.20-6.el9.noarch.rp 3.7 MB/s | 124 kB 00:00 2024-01-17T16:06:02.104 INFO:teuthology.orchestra.run.smithi026.stdout:(14/36): python3-requests-2.25.1-7.el9.noarch.r 2.6 MB/s | 113 kB 00:00 2024-01-17T16:06:02.163 INFO:teuthology.orchestra.run.smithi026.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.1 MB/s | 187 kB 00:00 2024-01-17T16:06:02.330 INFO:teuthology.orchestra.run.smithi026.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 134 kB/s | 22 kB 00:00 2024-01-17T16:06:02.730 INFO:teuthology.orchestra.run.smithi026.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 378 kB/s | 151 kB 00:00 2024-01-17T16:06:02.814 INFO:teuthology.orchestra.run.smithi026.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 521 kB/s | 43 kB 00:00 2024-01-17T16:06:03.023 INFO:teuthology.orchestra.run.smithi026.stdout:(19/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 825 kB/s | 172 kB 00:00 2024-01-17T16:06:03.265 INFO:teuthology.orchestra.run.smithi026.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-01-17T16:06:03.332 INFO:teuthology.orchestra.run.smithi026.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 161 kB/s | 11 kB 00:00 2024-01-17T16:06:03.415 INFO:teuthology.orchestra.run.smithi026.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 212 kB/s | 18 kB 00:00 2024-01-17T16:06:03.499 INFO:teuthology.orchestra.run.smithi026.stdout:(23/36): python3-jaraco-collections-3.0.0-8.el9 278 kB/s | 23 kB 00:00 2024-01-17T16:06:03.582 INFO:teuthology.orchestra.run.smithi026.stdout:(24/36): python3-jaraco-functools-3.5.0-2.el9.n 234 kB/s | 19 kB 00:00 2024-01-17T16:06:03.666 INFO:teuthology.orchestra.run.smithi026.stdout:(25/36): python3-jaraco-text-3.2.0-6.el9.noarch 236 kB/s | 20 kB 00:00 2024-01-17T16:06:03.766 INFO:teuthology.orchestra.run.smithi026.stdout:(26/36): python3-logutils-0.3.5-21.el9.noarch.r 463 kB/s | 46 kB 00:00 2024-01-17T16:06:03.841 INFO:teuthology.orchestra.run.smithi026.stdout:(27/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-01-17T16:06:03.992 INFO:teuthology.orchestra.run.smithi026.stdout:(28/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-01-17T16:06:04.050 INFO:teuthology.orchestra.run.smithi026.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 282 kB/s | 16 kB 00:00 2024-01-17T16:06:04.126 INFO:teuthology.orchestra.run.smithi026.stdout:(30/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-01-17T16:06:04.193 INFO:teuthology.orchestra.run.smithi026.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 536 kB/s | 36 kB 00:00 2024-01-17T16:06:04.293 INFO:teuthology.orchestra.run.smithi026.stdout:(32/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-01-17T16:06:04.519 INFO:teuthology.orchestra.run.smithi026.stdout:(33/36): ceph-mon-19.0.0-720.gcecb6cb5.el9.x86_ 865 kB/s | 4.9 MB 00:05 2024-01-17T16:06:04.552 INFO:teuthology.orchestra.run.smithi026.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.6 MB/s | 427 kB 00:00 2024-01-17T16:06:04.844 INFO:teuthology.orchestra.run.smithi026.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 61 kB/s | 20 kB 00:00 2024-01-17T16:06:20.118 INFO:teuthology.orchestra.run.smithi137.stdout:(10/10): ceph-test-19.0.0-720.gcecb6cb5.el9.x86 668 kB/s | 119 MB 03:03 2024-01-17T16:06:20.121 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:06:20.121 INFO:teuthology.orchestra.run.smithi137.stdout:Total 683 kB/s | 122 MB 03:03 2024-01-17T16:06:20.121 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:06:20.138 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:06:20.139 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:06:20.988 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:06:20.989 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:06:22.118 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:06:22.220 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2024-01-17T16:06:22.251 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2024-01-17T16:06:22.283 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/10 2024-01-17T16:06:22.317 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : jq-1.6-16.el9.x86_64 4/10 2024-01-17T16:06:22.362 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2024-01-17T16:06:22.398 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 6/10 2024-01-17T16:06:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 7/10 2024-01-17T16:06:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libasan-11.4.1-3.el9.x86_64 8/10 2024-01-17T16:06:22.498 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:19.0.0-720.gcecb6cb5.el9.x86_64 9/10 2024-01-17T16:06:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:19.0.0-720.gcecb6cb5.el9.x86_64 9/10 2024-01-17T16:06:39.112 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-test-2:19.0.0-720.gcecb6cb5.el9.x86_64 10/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libasan-11.4.1-3.el9.x86_64 3/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 4/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : jq-1.6-16.el9.x86_64 7/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 8/10 2024-01-17T16:06:47.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2024-01-17T16:06:47.728 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2024-01-17T16:06:47.728 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:06:47.728 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:06:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:19.0.0-720.gcecb6cb5.el9.x86_64 cryptopp-8.6.0-1.el9.x86_64 2024-01-17T16:06:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: jq-1.6-16.el9.x86_64 libasan-11.4.1-3.el9.x86_64 2024-01-17T16:06:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:19.0.0-720.gcecb6cb5.el9.x86_64 libubsan-11.4.1-3.el9.x86_64 2024-01-17T16:06:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma-6.9.6-1.el9.5.x86_64 socat-1.7.4.1-5.el9.x86_64 2024-01-17T16:06:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 yaml-cpp-0.6.3-5.el9.x86_64 2024-01-17T16:06:47.729 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:06:47.729 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:06:48.015 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph 2024-01-17T16:06:48.573 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:04:09 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:06:48.737 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:06:48.740 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================== 2024-01-17T16:06:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:06:48.740 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================== 2024-01-17T16:06:48.740 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:06:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 6.5 k 2024-01-17T16:06:48.740 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-01-17T16:06:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 2.0 M 2024-01-17T16:06:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 1.5 M 2024-01-17T16:06:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 245 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 4.9 M 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 117 M 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-17T16:06:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-17T16:06:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-17T16:06:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:06:48.743 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:06:48.743 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================== 2024-01-17T16:06:48.743 INFO:teuthology.orchestra.run.smithi137.stdout:Install 36 Packages 2024-01-17T16:06:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:06:48.743 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 129 M 2024-01-17T16:06:48.743 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 1.4 G 2024-01-17T16:06:48.744 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:06:49.537 INFO:teuthology.orchestra.run.smithi137.stdout:(1/36): ceph-19.0.0-720.gcecb6cb5.el9.x86_64.rp 13 kB/s | 6.5 kB 00:00 2024-01-17T16:06:51.104 INFO:teuthology.orchestra.run.smithi137.stdout:(2/36): ceph-mgr-19.0.0-720.gcecb6cb5.el9.x86_6 726 kB/s | 1.5 MB 00:02 2024-01-17T16:06:52.746 INFO:teuthology.orchestra.run.smithi137.stdout:(3/36): ceph-mds-19.0.0-720.gcecb6cb5.el9.x86_6 559 kB/s | 2.0 MB 00:03 2024-01-17T16:06:53.279 INFO:teuthology.orchestra.run.smithi137.stdout:(4/36): ceph-mgr-modules-core-19.0.0-720.gcecb6 459 kB/s | 245 kB 00:00 2024-01-17T16:06:53.538 INFO:teuthology.orchestra.run.smithi137.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 723 kB/s | 187 kB 00:00 2024-01-17T16:06:53.605 INFO:teuthology.orchestra.run.smithi137.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-01-17T16:06:53.655 INFO:teuthology.orchestra.run.smithi137.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 633 kB/s | 32 kB 00:00 2024-01-17T16:06:53.706 INFO:teuthology.orchestra.run.smithi137.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 943 kB/s | 47 kB 00:00 2024-01-17T16:06:53.764 INFO:teuthology.orchestra.run.smithi137.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 663 kB/s | 39 kB 00:00 2024-01-17T16:06:53.848 INFO:teuthology.orchestra.run.smithi137.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-01-17T16:06:54.056 INFO:teuthology.orchestra.run.smithi137.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 5.5 MB/s | 1.1 MB 00:00 2024-01-17T16:06:54.140 INFO:teuthology.orchestra.run.smithi137.stdout:(12/36): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-01-17T16:06:54.215 INFO:teuthology.orchestra.run.smithi137.stdout:(13/36): python3-pycparser-2.20-6.el9.noarch.rp 1.6 MB/s | 124 kB 00:00 2024-01-17T16:06:54.274 INFO:teuthology.orchestra.run.smithi137.stdout:(14/36): python3-requests-2.25.1-7.el9.noarch.r 1.9 MB/s | 113 kB 00:00 2024-01-17T16:06:54.341 INFO:teuthology.orchestra.run.smithi137.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.7 MB/s | 187 kB 00:00 2024-01-17T16:06:54.599 INFO:teuthology.orchestra.run.smithi137.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 86 kB/s | 22 kB 00:00 2024-01-17T16:06:54.708 INFO:teuthology.orchestra.run.smithi137.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-01-17T16:06:54.750 INFO:teuthology.orchestra.run.smithi137.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-01-17T16:06:54.800 INFO:teuthology.orchestra.run.smithi137.stdout:(19/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-01-17T16:06:54.859 INFO:teuthology.orchestra.run.smithi137.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 6.0 MB/s | 358 kB 00:00 2024-01-17T16:06:54.900 INFO:teuthology.orchestra.run.smithi137.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 257 kB/s | 11 kB 00:00 2024-01-17T16:06:54.943 INFO:teuthology.orchestra.run.smithi137.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 423 kB/s | 18 kB 00:00 2024-01-17T16:06:54.984 INFO:teuthology.orchestra.run.smithi137.stdout:(23/36): python3-jaraco-collections-3.0.0-8.el9 560 kB/s | 23 kB 00:00 2024-01-17T16:06:55.026 INFO:teuthology.orchestra.run.smithi137.stdout:(24/36): python3-jaraco-functools-3.5.0-2.el9.n 467 kB/s | 19 kB 00:00 2024-01-17T16:06:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:(25/36): python3-jaraco-text-3.2.0-6.el9.noarch 473 kB/s | 20 kB 00:00 2024-01-17T16:06:55.110 INFO:teuthology.orchestra.run.smithi137.stdout:(26/36): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-01-17T16:06:55.152 INFO:teuthology.orchestra.run.smithi137.stdout:(27/36): python3-more-itertools-8.12.0-2.el9.no 1.9 MB/s | 79 kB 00:00 2024-01-17T16:06:55.269 INFO:teuthology.orchestra.run.smithi137.stdout:(28/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-01-17T16:06:55.311 INFO:teuthology.orchestra.run.smithi137.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 394 kB/s | 16 kB 00:00 2024-01-17T16:06:55.345 INFO:teuthology.orchestra.run.smithi137.stdout:(30/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.6 MB/s | 90 kB 00:00 2024-01-17T16:06:55.378 INFO:teuthology.orchestra.run.smithi137.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2024-01-17T16:06:55.420 INFO:teuthology.orchestra.run.smithi137.stdout:(32/36): python3-webob-1.8.7-6.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-01-17T16:06:55.471 INFO:teuthology.orchestra.run.smithi137.stdout:(33/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 8.4 MB/s | 427 kB 00:00 2024-01-17T16:06:55.504 INFO:teuthology.orchestra.run.smithi137.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 600 kB/s | 20 kB 00:00 2024-01-17T16:06:56.221 INFO:teuthology.orchestra.run.smithi137.stdout:(35/36): ceph-mon-19.0.0-720.gcecb6cb5.el9.x86_ 743 kB/s | 4.9 MB 00:06 2024-01-17T16:07:07.381 INFO:teuthology.orchestra.run.smithi026.stdout:(36/36): ceph-osd-19.0.0-720.gcecb6cb5.el9.x86_ 1.7 MB/s | 117 MB 01:07 2024-01-17T16:07:07.385 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:07:07.385 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.9 MB/s | 129 MB 01:09 2024-01-17T16:07:07.401 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:07:07.443 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:07:07.443 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:07:08.487 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:07:08.487 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:07:10.415 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:07:10.483 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-01-17T16:07:10.525 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-01-17T16:07:10.553 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-01-17T16:07:10.627 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-01-17T16:07:10.669 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-01-17T16:07:10.701 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-01-17T16:07:10.798 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-01-17T16:07:10.883 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-01-17T16:07:10.929 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-01-17T16:07:11.006 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-01-17T16:07:11.055 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-01-17T16:07:11.093 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 12/36 2024-01-17T16:07:11.151 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-01-17T16:07:11.221 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-01-17T16:07:11.416 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-01-17T16:07:11.464 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-01-17T16:07:11.502 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-01-17T16:07:11.537 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-01-17T16:07:11.576 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-01-17T16:07:11.656 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-01-17T16:07:11.686 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-01-17T16:07:11.711 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-01-17T16:07:11.752 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-01-17T16:07:11.795 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-01-17T16:07:11.829 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-01-17T16:07:11.915 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-01-17T16:07:11.952 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-01-17T16:07:12.028 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-01-17T16:07:12.167 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-01-17T16:07:12.293 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-01-17T16:07:12.461 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-720.gcecb6cb5.el9.n 31/36 2024-01-17T16:07:12.481 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 32/36 2024-01-17T16:07:12.504 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 32/36 2024-01-17T16:07:12.504 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:07:12.504 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-17T16:07:12.505 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-17T16:07:12.505 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-17T16:07:12.505 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:31.980 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:19.0.0-720.gcecb6cb5.el9.x86_64 33/36 2024-01-17T16:07:32.005 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:19.0.0-720.gcecb6cb5.el9.x86_64 33/36 2024-01-17T16:07:32.005 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:07:32.005 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-17T16:07:32.005 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-17T16:07:32.005 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-17T16:07:32.006 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:32.497 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:19.0.0-720.gcecb6cb5.el9.x86_64 34/36 2024-01-17T16:07:32.519 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:19.0.0-720.gcecb6cb5.el9.x86_64 34/36 2024-01-17T16:07:32.520 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:07:32.520 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-17T16:07:32.520 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-17T16:07:32.520 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-17T16:07:32.520 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:32.731 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:19.0.0-720.gcecb6cb5.el9.x86_64 35/36 2024-01-17T16:07:32.753 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:19.0.0-720.gcecb6cb5.el9.x86_64 35/36 2024-01-17T16:07:32.753 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:07:32.754 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-17T16:07:32.754 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-17T16:07:32.754 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-17T16:07:32.754 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:32.823 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:19.0.0-720.gcecb6cb5.el9.x86_64 36/36 2024-01-17T16:07:42.765 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-2:19.0.0-720.gcecb6cb5.el9.x86_64 36/36 2024-01-17T16:07:42.765 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/36 2024-01-17T16:07:42.765 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 3/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:19.0.0-720.gcecb6cb5.el9.x86_64 4/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:19.0.0-720.gcecb6cb5.el9.x86_64 5/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-720.gcecb6cb5.el9.n 6/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 17/36 2024-01-17T16:07:42.766 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-01-17T16:07:42.767 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-01-17T16:07:42.768 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-01-17T16:07:42.768 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-01-17T16:07:42.768 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-01-17T16:07:42.768 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-01-17T16:07:42.768 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-01-17T16:07:42.768 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-01-17T16:07:43.745 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-01-17T16:07:43.745 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:43.745 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:07:43.745 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:07:43.745 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:07:43.745 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:07:43.745 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:07:43.745 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:07:43.745 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: lua-5.4.4-4.el9.x86_64 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-17T16:07:43.746 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply-3.11-14.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-17T16:07:43.747 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:43.748 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:07:43.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-base 2024-01-17T16:07:44.570 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:15 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:07:44.674 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:07:44.728 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:07:44.730 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-01-17T16:07:44.730 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:07:44.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install cephadm 2024-01-17T16:07:45.362 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:16 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:07:45.516 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:07:45.517 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:07:45.517 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:07:45.517 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:07:45.517 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:07:45.518 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 742 k 2024-01-17T16:07:45.518 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:45.518 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:07:45.518 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:07:45.518 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-01-17T16:07:45.518 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:45.518 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 742 k 2024-01-17T16:07:45.518 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 748 k 2024-01-17T16:07:45.518 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:07:46.838 INFO:teuthology.orchestra.run.smithi026.stdout:cephadm-19.0.0-720.gcecb6cb5.el9.noarch.rpm 562 kB/s | 742 kB 00:01 2024-01-17T16:07:46.839 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:07:46.840 INFO:teuthology.orchestra.run.smithi026.stdout:Total 561 kB/s | 742 kB 00:01 2024-01-17T16:07:46.840 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:07:46.846 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:07:46.846 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:07:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:07:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:07:46.927 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:07:47.427 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:07:47.529 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:07:47.987 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:07:48.315 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:07:48.315 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:48.315 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:07:48.315 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:07:48.315 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:48.315 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:07:48.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-immutable-object-cache 2024-01-17T16:07:49.112 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:20 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:07:49.272 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 147 k 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:49.273 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 147 k 2024-01-17T16:07:49.274 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 481 k 2024-01-17T16:07:49.274 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:07:50.035 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-immutable-object-cache-19.0.0-720.gcecb6cb 193 kB/s | 147 kB 00:00 2024-01-17T16:07:50.036 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:07:50.036 INFO:teuthology.orchestra.run.smithi026.stdout:Total 193 kB/s | 147 kB 00:00 2024-01-17T16:07:50.036 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:07:50.045 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:07:50.045 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:07:50.102 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:07:50.102 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:07:50.251 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:07:50.319 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-720.gcecb6cb5.e 1/1 2024-01-17T16:07:50.344 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-720.gcecb6cb5.e 1/1 2024-01-17T16:07:50.344 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:07:50.344 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-17T16:07:50.344 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:51.436 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-720.gcecb6cb5.e 1/1 2024-01-17T16:07:51.436 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:51.436 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:07:51.436 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:07:51.436 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:51.436 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:07:51.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr 2024-01-17T16:07:52.256 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:23 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:07:52.360 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:07:52.413 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:07:52.414 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-01-17T16:07:52.415 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:07:52.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-dashboard 2024-01-17T16:07:53.049 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:24 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:07:53.203 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:07:53.204 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:07:53.204 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:07:53.204 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:07:53.204 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:07:53.204 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 1.7 M 2024-01-17T16:07:53.204 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-01-17T16:07:53.204 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 28 k 2024-01-17T16:07:53.204 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 15 k 2024-01-17T16:07:53.204 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-17T16:07:53.205 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-17T16:07:53.205 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:53.205 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:07:53.205 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:07:53.205 INFO:teuthology.orchestra.run.smithi026.stdout:Install 5 Packages 2024-01-17T16:07:53.205 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:53.205 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 2.0 M 2024-01-17T16:07:53.205 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 8.4 M 2024-01-17T16:07:53.206 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:07:53.966 INFO:teuthology.orchestra.run.smithi026.stdout:(1/5): ceph-grafana-dashboards-19.0.0-720.gcecb 55 kB/s | 28 kB 00:00 2024-01-17T16:07:54.016 INFO:teuthology.orchestra.run.smithi026.stdout:(2/5): ceph-prometheus-alerts-19.0.0-720.gcecb6 27 kB/s | 15 kB 00:00 2024-01-17T16:07:55.041 INFO:teuthology.orchestra.run.smithi026.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 29 kB/s | 31 kB 00:01 2024-01-17T16:07:55.633 INFO:teuthology.orchestra.run.smithi026.stdout:(4/5): ceph-mgr-dashboard-19.0.0-720.gcecb6cb5. 818 kB/s | 1.7 MB 00:02 2024-01-17T16:07:55.658 INFO:teuthology.orchestra.run.smithi026.stdout:(5/5): python3-routes-2.5.1-5.el9.noarch.rpm 115 kB/s | 188 kB 00:01 2024-01-17T16:07:55.662 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:07:55.662 INFO:teuthology.orchestra.run.smithi026.stdout:Total 831 kB/s | 2.0 MB 00:02 2024-01-17T16:07:55.662 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:07:55.671 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:07:55.671 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:07:55.741 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:07:55.742 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:07:56.110 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:07:56.215 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-01-17T16:07:56.245 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-01-17T16:07:56.276 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-720.gcecb6cb5.el9.no 3/5 2024-01-17T16:07:56.521 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-720.gcecb6cb5.el9.n 4/5 2024-01-17T16:07:56.552 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-720.gcecb6cb5.el9.noarch 5/5 2024-01-17T16:07:57.217 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-720.gcecb6cb5.el9.noarch 5/5 2024-01-17T16:07:57.217 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-720.gcecb6cb5.el9.n 1/5 2024-01-17T16:07:57.217 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-720.gcecb6cb5.el9.noarch 2/5 2024-01-17T16:07:57.217 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-720.gcecb6cb5.el9.no 3/5 2024-01-17T16:07:57.217 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-01-17T16:07:57.507 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-01-17T16:07:57.507 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:57.507 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:07:57.507 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:07:57.507 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:07:57.507 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:07:57.507 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-17T16:07:57.508 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-17T16:07:57.508 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:57.508 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:07:57.751 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-diskprediction-local 2024-01-17T16:07:58.321 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:29 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:07:58.480 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:07:58.481 INFO:teuthology.orchestra.run.smithi026.stdout:=========================================================================================== 2024-01-17T16:07:58.481 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:07:58.481 INFO:teuthology.orchestra.run.smithi026.stdout:=========================================================================================== 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 7.4 M 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-17T16:07:58.482 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-17T16:07:58.483 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-17T16:07:58.483 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-17T16:07:58.483 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-17T16:07:58.483 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:58.483 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:07:58.483 INFO:teuthology.orchestra.run.smithi026.stdout:=========================================================================================== 2024-01-17T16:07:58.483 INFO:teuthology.orchestra.run.smithi026.stdout:Install 12 Packages 2024-01-17T16:07:58.483 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:07:58.483 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 37 M 2024-01-17T16:07:58.484 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 209 M 2024-01-17T16:07:58.484 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:07:58.681 INFO:teuthology.orchestra.run.smithi026.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 32 kB 00:00 2024-01-17T16:07:58.714 INFO:teuthology.orchestra.run.smithi026.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 518 kB/s | 17 kB 00:00 2024-01-17T16:07:58.756 INFO:teuthology.orchestra.run.smithi026.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 819 kB/s | 34 kB 00:00 2024-01-17T16:07:58.956 INFO:teuthology.orchestra.run.smithi026.stdout:(4/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2024-01-17T16:07:59.123 INFO:teuthology.orchestra.run.smithi026.stdout:(5/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-01-17T16:07:59.182 INFO:teuthology.orchestra.run.smithi026.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.7 MB/s | 3.0 MB 00:00 2024-01-17T16:07:59.207 INFO:teuthology.orchestra.run.smithi026.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.6 MB/s | 217 kB 00:00 2024-01-17T16:07:59.374 INFO:teuthology.orchestra.run.smithi026.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 802 kB 00:00 2024-01-17T16:07:59.649 INFO:teuthology.orchestra.run.smithi026.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-01-17T16:07:59.675 INFO:teuthology.orchestra.run.smithi026.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 652 kB/s | 194 kB 00:00 2024-01-17T16:07:59.983 INFO:teuthology.orchestra.run.smithi026.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 737 kB/s | 245 kB 00:00 2024-01-17T16:08:01.558 INFO:teuthology.orchestra.run.smithi026.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-7 2.5 MB/s | 7.4 MB 00:03 2024-01-17T16:08:01.561 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:01.561 INFO:teuthology.orchestra.run.smithi026.stdout:Total 12 MB/s | 37 MB 00:03 2024-01-17T16:08:01.576 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:01.603 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:01.603 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:02.002 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:02.003 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:02.728 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:02.810 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-01-17T16:08:02.846 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-01-17T16:08:02.944 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-01-17T16:08:02.982 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-01-17T16:08:03.166 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-01-17T16:08:03.206 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-01-17T16:08:03.287 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-01-17T16:08:03.988 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-01-17T16:08:04.105 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-01-17T16:08:05.429 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-01-17T16:08:06.498 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-01-17T16:08:06.531 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-720.gcecb6c 12/12 2024-01-17T16:08:09.062 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-720.gcecb6c 12/12 2024-01-17T16:08:09.062 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-720.gcecb6c 1/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-01-17T16:08:09.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-01-17T16:08:09.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-01-17T16:08:09.503 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:09.503 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:09.503 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:09.504 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:09.863 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-rook 2024-01-17T16:08:10.434 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:41 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:10.593 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:10.594 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 50 k 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:2.26.0-1.el9 epel 202 k 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-17T16:08:10.595 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout:Install 13 Packages 2024-01-17T16:08:10.596 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:10.597 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 2.0 M 2024-01-17T16:08:10.597 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 26 M 2024-01-17T16:08:10.597 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:08:10.831 INFO:teuthology.orchestra.run.smithi026.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 134 kB/s | 24 kB 00:00 2024-01-17T16:08:10.856 INFO:teuthology.orchestra.run.smithi026.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 87 kB/s | 18 kB 00:00 2024-01-17T16:08:10.906 INFO:teuthology.orchestra.run.smithi026.stdout:(3/13): ceph-mgr-rook-19.0.0-720.gcecb6cb5.el9. 196 kB/s | 50 kB 00:00 2024-01-17T16:08:10.973 INFO:teuthology.orchestra.run.smithi026.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 174 kB 00:00 2024-01-17T16:08:10.998 INFO:teuthology.orchestra.run.smithi026.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 931 kB/s | 132 kB 00:00 2024-01-17T16:08:11.024 INFO:teuthology.orchestra.run.smithi026.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 211 kB 00:00 2024-01-17T16:08:11.057 INFO:teuthology.orchestra.run.smithi026.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 736 kB/s | 43 kB 00:00 2024-01-17T16:08:11.324 INFO:teuthology.orchestra.run.smithi026.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 99 kB/s | 32 kB 00:00 2024-01-17T16:08:11.349 INFO:teuthology.orchestra.run.smithi026.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 46 kB/s | 15 kB 00:00 2024-01-17T16:08:11.549 INFO:teuthology.orchestra.run.smithi026.stdout:(10/13): python3-google-auth-2.26.0-1.el9.noarc 410 kB/s | 202 kB 00:00 2024-01-17T16:08:11.591 INFO:teuthology.orchestra.run.smithi026.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 244 kB/s | 59 kB 00:00 2024-01-17T16:08:11.825 INFO:teuthology.orchestra.run.smithi026.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 326 kB/s | 90 kB 00:00 2024-01-17T16:08:12.108 INFO:teuthology.orchestra.run.smithi026.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.3 MB/s | 1.0 MB 00:00 2024-01-17T16:08:12.114 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:12.114 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.3 MB/s | 2.0 MB 00:01 2024-01-17T16:08:12.114 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:12.130 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:12.130 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:12.241 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:12.242 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:12.882 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:13.047 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-01-17T16:08:13.102 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-01-17T16:08:13.158 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-01-17T16:08:13.194 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-01-17T16:08:13.236 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-01-17T16:08:13.333 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-01-17T16:08:13.443 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:2.26.0-1.el9.noarch 7/13 2024-01-17T16:08:13.496 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-01-17T16:08:14.265 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-01-17T16:08:14.326 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-01-17T16:08:14.359 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-01-17T16:08:14.408 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-01-17T16:08:14.437 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:19.0.0-720.gcecb6cb5.el9.noarch 13/13 2024-01-17T16:08:15.222 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-720.gcecb6cb5.el9.noarch 13/13 2024-01-17T16:08:15.223 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:19.0.0-720.gcecb6cb5.el9.noarch 1/13 2024-01-17T16:08:15.223 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-01-17T16:08:15.223 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-01-17T16:08:15.223 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-01-17T16:08:15.223 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-01-17T16:08:15.223 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-01-17T16:08:15.223 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-01-17T16:08:15.224 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-01-17T16:08:15.224 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-01-17T16:08:15.224 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:2.26.0-1.el9.noarch 10/13 2024-01-17T16:08:15.224 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-01-17T16:08:15.224 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-01-17T16:08:15.659 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-01-17T16:08:15.660 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:15.660 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:15.660 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:08:15.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-17T16:08:15.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-17T16:08:15.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:2.26.0-1.el9.noarch 2024-01-17T16:08:15.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-17T16:08:15.660 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-17T16:08:15.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-17T16:08:15.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-17T16:08:15.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-17T16:08:15.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-17T16:08:15.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-17T16:08:15.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-17T16:08:15.661 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-17T16:08:15.661 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:15.661 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:15.916 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-cephadm 2024-01-17T16:08:16.490 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:47 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:16.646 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:16.647 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-01-17T16:08:16.647 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:08:16.647 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-01-17T16:08:16.647 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:08:16.648 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 133 k 2024-01-17T16:08:16.648 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-01-17T16:08:16.648 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-17T16:08:16.648 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-17T16:08:16.648 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-17T16:08:16.648 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-17T16:08:16.648 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-17T16:08:16.648 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:16.648 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:08:16.649 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-01-17T16:08:16.649 INFO:teuthology.orchestra.run.smithi026.stdout:Install 6 Packages 2024-01-17T16:08:16.649 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:16.649 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 6.8 M 2024-01-17T16:08:16.650 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 33 M 2024-01-17T16:08:16.650 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:08:17.219 INFO:teuthology.orchestra.run.smithi026.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.2 MB/s | 228 kB 00:00 2024-01-17T16:08:17.428 INFO:teuthology.orchestra.run.smithi026.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2024-01-17T16:08:17.545 INFO:teuthology.orchestra.run.smithi026.stdout:(3/6): ceph-mgr-cephadm-19.0.0-720.gcecb6cb5.el 257 kB/s | 133 kB 00:00 2024-01-17T16:08:18.612 INFO:teuthology.orchestra.run.smithi026.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 50 kB/s | 58 kB 00:01 2024-01-17T16:08:18.695 INFO:teuthology.orchestra.run.smithi026.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 44 kB/s | 51 kB 00:01 2024-01-17T16:08:19.096 INFO:teuthology.orchestra.run.smithi026.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 292 kB/s | 548 kB 00:01 2024-01-17T16:08:19.100 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:19.101 INFO:teuthology.orchestra.run.smithi026.stdout:Total 2.8 MB/s | 6.8 MB 00:02 2024-01-17T16:08:19.101 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:19.112 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:19.112 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:19.211 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:19.212 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:19.526 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:19.724 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-01-17T16:08:19.775 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-01-17T16:08:20.324 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-01-17T16:08:20.403 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-01-17T16:08:20.471 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2024-01-17T16:08:20.501 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 6/6 2024-01-17T16:08:21.307 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 6/6 2024-01-17T16:08:21.307 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/6 2024-01-17T16:08:21.307 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-01-17T16:08:21.307 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2024-01-17T16:08:21.307 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-01-17T16:08:21.307 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-01-17T16:08:21.632 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-01-17T16:08:21.632 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:21.633 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:21.633 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:08:21.633 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-17T16:08:21.633 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-17T16:08:21.633 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-17T16:08:21.633 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-17T16:08:21.633 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-17T16:08:21.633 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:21.633 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:21.751 INFO:teuthology.orchestra.run.smithi137.stdout:(36/36): ceph-osd-19.0.0-720.gcecb6cb5.el9.x86_ 1.3 MB/s | 117 MB 01:30 2024-01-17T16:08:21.754 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:21.754 INFO:teuthology.orchestra.run.smithi137.stdout:Total 1.4 MB/s | 129 MB 01:33 2024-01-17T16:08:21.773 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:08:21.811 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:08:21.811 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:08:21.898 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-fuse 2024-01-17T16:08:22.475 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:53 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:22.633 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:22.634 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:22.634 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:08:22.634 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:22.634 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:08:22.634 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 858 k 2024-01-17T16:08:22.634 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-01-17T16:08:22.635 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-17T16:08:22.635 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:22.635 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:08:22.635 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:22.635 INFO:teuthology.orchestra.run.smithi026.stdout:Install 2 Packages 2024-01-17T16:08:22.635 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:22.635 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 937 k 2024-01-17T16:08:22.635 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 3.1 M 2024-01-17T16:08:22.635 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:08:22.830 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:08:22.830 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:08:22.847 INFO:teuthology.orchestra.run.smithi026.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 370 kB/s | 79 kB 00:00 2024-01-17T16:08:23.597 INFO:teuthology.orchestra.run.smithi026.stdout:(2/2): ceph-fuse-19.0.0-720.gcecb6cb5.el9.x86_6 892 kB/s | 858 kB 00:00 2024-01-17T16:08:23.599 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:23.599 INFO:teuthology.orchestra.run.smithi026.stdout:Total 971 kB/s | 937 kB 00:00 2024-01-17T16:08:23.600 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:23.624 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:23.624 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:23.706 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:23.707 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:23.906 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:24.046 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-01-17T16:08:24.116 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/2 2024-01-17T16:08:24.745 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:08:24.797 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/2 2024-01-17T16:08:24.797 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/2 2024-01-17T16:08:24.812 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-01-17T16:08:24.861 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-01-17T16:08:24.892 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-01-17T16:08:24.962 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-01-17T16:08:24.999 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-01-17T16:08:25.032 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-01-17T16:08:25.096 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-01-17T16:08:25.096 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:25.096 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:25.097 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-01-17T16:08:25.097 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:25.097 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-01-17T16:08:25.193 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-01-17T16:08:25.235 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-01-17T16:08:25.306 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-01-17T16:08:25.368 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-01-17T16:08:25.394 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-volume 2024-01-17T16:08:25.407 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 12/36 2024-01-17T16:08:25.464 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-01-17T16:08:25.531 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-01-17T16:08:25.722 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-01-17T16:08:25.770 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-01-17T16:08:25.800 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-01-17T16:08:25.834 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-01-17T16:08:25.864 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-01-17T16:08:25.940 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-01-17T16:08:25.967 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:56 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:25.975 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-01-17T16:08:26.008 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-01-17T16:08:26.058 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-01-17T16:08:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-01-17T16:08:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:26.127 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-01-17T16:08:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:08:26.127 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 262 k 2024-01-17T16:08:26.127 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:08:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-01-17T16:08:26.128 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:26.128 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-01-17T16:08:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 262 k 2024-01-17T16:08:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 1.2 M 2024-01-17T16:08:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:08:26.215 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-01-17T16:08:26.250 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-01-17T16:08:26.330 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-01-17T16:08:26.368 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-volume-19.0.0-720.gcecb6cb5.el9.noarch.rpm 1.1 MB/s | 262 kB 00:00 2024-01-17T16:08:26.369 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:26.370 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.1 MB/s | 262 kB 00:00 2024-01-17T16:08:26.370 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:26.378 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:26.378 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:26.409 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:26.410 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:26.466 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-01-17T16:08:26.592 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-01-17T16:08:26.642 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:26.771 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:08:26.777 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-720.gcecb6cb5.el9.n 31/36 2024-01-17T16:08:26.786 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:08:26.787 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:08:26.787 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-17T16:08:26.787 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:26.805 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 32/36 2024-01-17T16:08:26.829 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 32/36 2024-01-17T16:08:26.829 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:08:26.829 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-17T16:08:26.829 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-17T16:08:26.829 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-17T16:08:26.829 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:08:27.862 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:08:27.862 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:27.862 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:27.862 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:08:27.862 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:27.863 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:28.148 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librados-devel 2024-01-17T16:08:28.727 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:05:59 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:28.889 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 127 k 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-01-17T16:08:28.890 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:28.891 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 127 k 2024-01-17T16:08:28.891 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 457 k 2024-01-17T16:08:28.891 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:08:29.324 INFO:teuthology.orchestra.run.smithi026.stdout:librados-devel-19.0.0-720.gcecb6cb5.el9.x86_64. 293 kB/s | 127 kB 00:00 2024-01-17T16:08:29.324 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:29.325 INFO:teuthology.orchestra.run.smithi026.stdout:Total 292 kB/s | 127 kB 00:00 2024-01-17T16:08:29.325 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:29.330 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:29.331 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:29.389 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:29.390 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:29.531 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:29.625 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:30.077 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:30.372 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:30.372 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:30.372 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:30.372 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:30.372 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:30.373 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:30.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs2 2024-01-17T16:08:31.221 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:02 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:31.325 INFO:teuthology.orchestra.run.smithi026.stdout:Package libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:08:31.379 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:31.381 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-01-17T16:08:31.381 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:31.450 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs-devel 2024-01-17T16:08:32.023 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:03 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:32.181 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 31 k 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-01-17T16:08:32.182 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:32.183 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 31 k 2024-01-17T16:08:32.183 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 140 k 2024-01-17T16:08:32.183 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:08:32.343 INFO:teuthology.orchestra.run.smithi026.stdout:libcephfs-devel-19.0.0-720.gcecb6cb5.el9.x86_64 194 kB/s | 31 kB 00:00 2024-01-17T16:08:32.344 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:32.344 INFO:teuthology.orchestra.run.smithi026.stdout:Total 192 kB/s | 31 kB 00:00 2024-01-17T16:08:32.344 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:32.348 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:32.348 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:32.376 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:32.376 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:32.471 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:32.602 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:32.943 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:33.221 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:33.221 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:33.221 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:33.221 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:33.221 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:33.221 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:33.412 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librados2 2024-01-17T16:08:33.985 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:04 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:34.088 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:08:34.143 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:34.144 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-01-17T16:08:34.144 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:34.216 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librbd1 2024-01-17T16:08:34.791 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:05 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:34.894 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:08:34.951 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:34.952 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-01-17T16:08:34.952 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:35.029 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rados 2024-01-17T16:08:35.599 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:06 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:35.701 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rados-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:08:35.755 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:35.756 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-01-17T16:08:35.756 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:35.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rgw 2024-01-17T16:08:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:07 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:36.498 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:08:36.552 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:36.553 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-01-17T16:08:36.553 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:36.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-cephfs 2024-01-17T16:08:37.192 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:08 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:37.296 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-cephfs-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:08:37.350 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:37.351 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-01-17T16:08:37.352 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:37.427 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rbd 2024-01-17T16:08:37.998 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:08 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:38.102 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:08:38.156 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:38.157 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-01-17T16:08:38.157 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:38.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-fuse 2024-01-17T16:08:38.806 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:09 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:38.963 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:38.964 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:38.964 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-01-17T16:08:38.964 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 86 k 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 86 k 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 256 k 2024-01-17T16:08:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:08:39.472 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-fuse-19.0.0-720.gcecb6cb5.el9.x86_64.rpm 169 kB/s | 86 kB 00:00 2024-01-17T16:08:39.473 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:39.473 INFO:teuthology.orchestra.run.smithi026.stdout:Total 169 kB/s | 86 kB 00:00 2024-01-17T16:08:39.473 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:39.480 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:39.480 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:39.537 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:39.537 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:39.675 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:39.772 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:40.187 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:40.461 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:40.462 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:40.462 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:40.462 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:40.462 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:40.462 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:40.751 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-mirror 2024-01-17T16:08:41.322 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:12 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:41.481 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:41.481 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:41.481 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2024-01-17T16:08:41.482 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:41.482 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:08:41.482 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 3.0 M 2024-01-17T16:08:41.482 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:41.482 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:08:41.482 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:41.482 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-01-17T16:08:41.482 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:41.483 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 3.0 M 2024-01-17T16:08:41.483 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 14 M 2024-01-17T16:08:41.483 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:08:42.075 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-mirror-19.0.0-720.gcecb6cb5.el9.x86_64.rpm 5.1 MB/s | 3.0 MB 00:00 2024-01-17T16:08:42.075 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:42.075 INFO:teuthology.orchestra.run.smithi026.stdout:Total 5.1 MB/s | 3.0 MB 00:00 2024-01-17T16:08:42.076 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:42.085 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:42.086 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:42.161 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:42.161 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:42.626 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:42.692 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:42.716 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:42.716 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:08:42.716 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-17T16:08:42.716 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T16:08:42.716 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T16:08:42.716 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:43.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:43.882 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:43.883 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:43.883 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:43.883 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:43.883 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:44.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-nbd 2024-01-17T16:08:44.723 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:06:15 ago on Wed 17 Jan 2024 04:02:29 PM UTC. 2024-01-17T16:08:44.881 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-01-17T16:08:44.882 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:44.882 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-01-17T16:08:44.882 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:44.882 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-01-17T16:08:44.882 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 169 k 2024-01-17T16:08:44.882 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:44.882 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-01-17T16:08:44.882 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-01-17T16:08:44.883 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-01-17T16:08:44.883 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:44.883 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 169 k 2024-01-17T16:08:44.883 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 537 k 2024-01-17T16:08:44.883 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-01-17T16:08:45.271 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:19.0.0-720.gcecb6cb5.el9.x86_64 33/36 2024-01-17T16:08:45.299 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:19.0.0-720.gcecb6cb5.el9.x86_64 33/36 2024-01-17T16:08:45.299 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:08:45.299 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-17T16:08:45.299 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-17T16:08:45.299 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-17T16:08:45.300 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:08:45.495 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-nbd-19.0.0-720.gcecb6cb5.el9.x86_64.rpm 276 kB/s | 169 kB 00:00 2024-01-17T16:08:45.496 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:45.496 INFO:teuthology.orchestra.run.smithi026.stdout:Total 275 kB/s | 169 kB 00:00 2024-01-17T16:08:45.496 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-01-17T16:08:45.505 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-01-17T16:08:45.505 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-01-17T16:08:45.564 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-01-17T16:08:45.565 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-01-17T16:08:45.719 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-01-17T16:08:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:19.0.0-720.gcecb6cb5.el9.x86_64 34/36 2024-01-17T16:08:45.785 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:19.0.0-720.gcecb6cb5.el9.x86_64 34/36 2024-01-17T16:08:45.785 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:08:45.785 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-17T16:08:45.785 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-17T16:08:45.785 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-17T16:08:45.786 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:08:45.821 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:45.989 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:19.0.0-720.gcecb6cb5.el9.x86_64 35/36 2024-01-17T16:08:46.011 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:19.0.0-720.gcecb6cb5.el9.x86_64 35/36 2024-01-17T16:08:46.011 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:08:46.011 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-17T16:08:46.011 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-17T16:08:46.011 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-17T16:08:46.011 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:08:46.070 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:19.0.0-720.gcecb6cb5.el9.x86_64 36/36 2024-01-17T16:08:46.274 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-nbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:46.578 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:08:46.578 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:46.578 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-01-17T16:08:46.578 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:46.578 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:08:46.578 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-01-17T16:08:46.891 DEBUG:teuthology.parallel:result is None 2024-01-17T16:08:55.707 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-2:19.0.0-720.gcecb6cb5.el9.x86_64 36/36 2024-01-17T16:08:55.707 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/36 2024-01-17T16:08:55.707 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/36 2024-01-17T16:08:55.707 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 3/36 2024-01-17T16:08:55.707 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:19.0.0-720.gcecb6cb5.el9.x86_64 4/36 2024-01-17T16:08:55.707 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:19.0.0-720.gcecb6cb5.el9.x86_64 5/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-720.gcecb6cb5.el9.n 6/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 17/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-01-17T16:08:55.708 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-01-17T16:08:55.709 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-01-17T16:08:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-01-17T16:08:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: lua-5.4.4-4.el9.x86_64 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-17T16:08:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-17T16:08:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-17T16:08:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-17T16:08:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-17T16:08:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-17T16:08:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-17T16:08:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-17T16:08:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-17T16:08:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-17T16:08:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:08:56.749 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:08:57.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-base 2024-01-17T16:08:57.577 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:18 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:08:57.678 INFO:teuthology.orchestra.run.smithi137.stdout:Package ceph-base-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:08:57.728 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:08:57.729 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-01-17T16:08:57.729 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:08:57.797 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install cephadm 2024-01-17T16:08:58.357 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:19 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:08:58.507 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:08:58.508 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:08:58.508 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:08:58.508 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:08:58.508 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:08:58.509 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 742 k 2024-01-17T16:08:58.509 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:08:58.509 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:08:58.509 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:08:58.509 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-01-17T16:08:58.509 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:08:58.509 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 742 k 2024-01-17T16:08:58.509 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 748 k 2024-01-17T16:08:58.509 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:08:58.870 INFO:teuthology.orchestra.run.smithi137.stdout:cephadm-19.0.0-720.gcecb6cb5.el9.noarch.rpm 2.0 MB/s | 742 kB 00:00 2024-01-17T16:08:58.870 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:08:58.871 INFO:teuthology.orchestra.run.smithi137.stdout:Total 2.0 MB/s | 742 kB 00:00 2024-01-17T16:08:58.871 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:08:58.876 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:08:58.876 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:08:58.882 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:08:58.882 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:08:58.957 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:08:59.415 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:08:59.499 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:08:59.893 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:09:00.196 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:09:00.197 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:00.197 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:00.197 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:09:00.197 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:00.197 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:00.416 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-immutable-object-cache 2024-01-17T16:09:00.991 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:21 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:01.143 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2024-01-17T16:09:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:01.143 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 147 k 2024-01-17T16:09:01.143 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:01.143 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-01-17T16:09:01.143 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 147 k 2024-01-17T16:09:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 481 k 2024-01-17T16:09:01.144 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:01.369 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-immutable-object-cache-19.0.0-720.gcecb6cb 655 kB/s | 147 kB 00:00 2024-01-17T16:09:01.369 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:01.370 INFO:teuthology.orchestra.run.smithi137.stdout:Total 650 kB/s | 147 kB 00:00 2024-01-17T16:09:01.370 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:01.377 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:01.377 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:01.430 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:01.430 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:01.571 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:01.636 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-720.gcecb6cb5.e 1/1 2024-01-17T16:09:01.660 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-720.gcecb6cb5.e 1/1 2024-01-17T16:09:01.661 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:09:01.661 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-17T16:09:01.661 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:02.649 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-720.gcecb6cb5.e 1/1 2024-01-17T16:09:02.649 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:02.649 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:02.649 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:09:02.649 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:02.649 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:02.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr 2024-01-17T16:09:03.460 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:24 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:03.561 INFO:teuthology.orchestra.run.smithi137.stdout:Package ceph-mgr-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:09:03.612 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:03.613 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-01-17T16:09:03.613 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:03.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-dashboard 2024-01-17T16:09:04.240 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:25 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:04.388 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:04.389 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:04.389 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:09:04.389 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:04.389 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 1.7 M 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 28 k 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 15 k 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout:Install 5 Packages 2024-01-17T16:09:04.390 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:04.391 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 2.0 M 2024-01-17T16:09:04.391 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 8.4 M 2024-01-17T16:09:04.391 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:05.139 INFO:teuthology.orchestra.run.smithi137.stdout:(1/5): ceph-prometheus-alerts-19.0.0-720.gcecb6 90 kB/s | 15 kB 00:00 2024-01-17T16:09:05.307 INFO:teuthology.orchestra.run.smithi137.stdout:(2/5): ceph-grafana-dashboards-19.0.0-720.gcecb 84 kB/s | 28 kB 00:00 2024-01-17T16:09:05.556 INFO:teuthology.orchestra.run.smithi137.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 74 kB/s | 31 kB 00:00 2024-01-17T16:09:05.681 INFO:teuthology.orchestra.run.smithi137.stdout:(4/5): ceph-mgr-dashboard-19.0.0-720.gcecb6cb5. 2.4 MB/s | 1.7 MB 00:00 2024-01-17T16:09:05.956 INFO:teuthology.orchestra.run.smithi137.stdout:(5/5): python3-routes-2.5.1-5.el9.noarch.rpm 290 kB/s | 188 kB 00:00 2024-01-17T16:09:05.959 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:05.959 INFO:teuthology.orchestra.run.smithi137.stdout:Total 1.3 MB/s | 2.0 MB 00:01 2024-01-17T16:09:05.959 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:05.966 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:05.966 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:06.029 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:06.029 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:06.275 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:06.362 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-01-17T16:09:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-01-17T16:09:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-720.gcecb6cb5.el9.no 3/5 2024-01-17T16:09:06.665 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-720.gcecb6cb5.el9.n 4/5 2024-01-17T16:09:06.701 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-720.gcecb6cb5.el9.noarch 5/5 2024-01-17T16:09:07.273 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-720.gcecb6cb5.el9.noarch 5/5 2024-01-17T16:09:07.273 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-720.gcecb6cb5.el9.n 1/5 2024-01-17T16:09:07.273 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-720.gcecb6cb5.el9.noarch 2/5 2024-01-17T16:09:07.274 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-720.gcecb6cb5.el9.no 3/5 2024-01-17T16:09:07.274 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-01-17T16:09:07.577 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-01-17T16:09:07.578 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:07.578 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:07.578 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:09:07.578 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:09:07.578 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:09:07.578 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-17T16:09:07.578 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-17T16:09:07.578 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:07.578 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:07.826 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-diskprediction-local 2024-01-17T16:09:08.387 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:29 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:08.540 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:08.542 INFO:teuthology.orchestra.run.smithi137.stdout:=========================================================================================== 2024-01-17T16:09:08.542 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:09:08.542 INFO:teuthology.orchestra.run.smithi137.stdout:=========================================================================================== 2024-01-17T16:09:08.542 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:08.542 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 7.4 M 2024-01-17T16:09:08.542 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-01-17T16:09:08.542 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-17T16:09:08.542 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-17T16:09:08.542 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:08.543 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:08.544 INFO:teuthology.orchestra.run.smithi137.stdout:=========================================================================================== 2024-01-17T16:09:08.544 INFO:teuthology.orchestra.run.smithi137.stdout:Install 12 Packages 2024-01-17T16:09:08.544 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:08.544 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 37 M 2024-01-17T16:09:08.544 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 209 M 2024-01-17T16:09:08.545 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:09.162 INFO:teuthology.orchestra.run.smithi137.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 169 kB/s | 32 kB 00:00 2024-01-17T16:09:09.221 INFO:teuthology.orchestra.run.smithi137.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 294 kB/s | 17 kB 00:00 2024-01-17T16:09:09.312 INFO:teuthology.orchestra.run.smithi137.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 373 kB/s | 34 kB 00:00 2024-01-17T16:09:09.596 INFO:teuthology.orchestra.run.smithi137.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.8 MB/s | 3.0 MB 00:00 2024-01-17T16:09:09.897 INFO:teuthology.orchestra.run.smithi137.stdout:(5/12): ceph-mgr-diskprediction-local-19.0.0-72 8.0 MB/s | 7.4 MB 00:00 2024-01-17T16:09:10.505 INFO:teuthology.orchestra.run.smithi137.stdout:(6/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 358 kB/s | 217 kB 00:00 2024-01-17T16:09:11.964 INFO:teuthology.orchestra.run.smithi137.stdout:(7/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 1.8 MB/s | 4.7 MB 00:02 2024-01-17T16:09:12.464 INFO:teuthology.orchestra.run.smithi137.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.7 MB/s | 4.8 MB 00:02 2024-01-17T16:09:12.531 INFO:teuthology.orchestra.run.smithi137.stdout:(9/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 802 kB 00:00 2024-01-17T16:09:12.814 INFO:teuthology.orchestra.run.smithi137.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 556 kB/s | 194 kB 00:00 2024-01-17T16:09:13.181 INFO:teuthology.orchestra.run.smithi137.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 378 kB/s | 245 kB 00:00 2024-01-17T16:09:13.973 INFO:teuthology.orchestra.run.smithi137.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.5 MB/s | 16 MB 00:03 2024-01-17T16:09:13.976 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:13.976 INFO:teuthology.orchestra.run.smithi137.stdout:Total 6.8 MB/s | 37 MB 00:05 2024-01-17T16:09:13.991 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:14.017 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:14.017 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:14.414 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:14.414 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:15.117 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:15.202 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-01-17T16:09:15.235 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-01-17T16:09:15.328 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-01-17T16:09:15.372 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-01-17T16:09:15.548 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-01-17T16:09:15.579 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-01-17T16:09:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-01-17T16:09:16.334 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-01-17T16:09:16.449 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-01-17T16:09:17.687 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-01-17T16:09:18.717 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-01-17T16:09:18.746 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-720.gcecb6c 12/12 2024-01-17T16:09:21.217 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-720.gcecb6c 12/12 2024-01-17T16:09:21.217 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-720.gcecb6c 1/12 2024-01-17T16:09:21.217 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-01-17T16:09:21.217 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-01-17T16:09:21.217 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-01-17T16:09:21.217 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-01-17T16:09:21.218 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-01-17T16:09:21.218 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-01-17T16:09:21.218 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-01-17T16:09:21.218 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-01-17T16:09:21.218 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-01-17T16:09:21.218 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-01-17T16:09:21.600 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-17T16:09:21.601 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-17T16:09:21.602 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-17T16:09:21.602 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-17T16:09:21.602 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-17T16:09:21.602 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:21.602 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:21.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-rook 2024-01-17T16:09:22.527 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:43 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:22.680 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:22.681 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-01-17T16:09:22.681 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:09:22.682 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-01-17T16:09:22.682 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:22.682 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 50 k 2024-01-17T16:09:22.682 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-01-17T16:09:22.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-17T16:09:22.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-17T16:09:22.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.26.0-1.el9 epel 202 k 2024-01-17T16:09:22.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-17T16:09:22.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:22.683 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-01-17T16:09:22.684 INFO:teuthology.orchestra.run.smithi137.stdout:Install 13 Packages 2024-01-17T16:09:22.684 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:22.684 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 2.0 M 2024-01-17T16:09:22.685 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 26 M 2024-01-17T16:09:22.685 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:23.187 INFO:teuthology.orchestra.run.smithi137.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 169 kB/s | 24 kB 00:00 2024-01-17T16:09:23.211 INFO:teuthology.orchestra.run.smithi137.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 107 kB/s | 18 kB 00:00 2024-01-17T16:09:23.287 INFO:teuthology.orchestra.run.smithi137.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 174 kB 00:00 2024-01-17T16:09:23.312 INFO:teuthology.orchestra.run.smithi137.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 132 kB 00:00 2024-01-17T16:09:23.346 INFO:teuthology.orchestra.run.smithi137.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.5 MB/s | 211 kB 00:00 2024-01-17T16:09:23.363 INFO:teuthology.orchestra.run.smithi137.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 852 kB/s | 43 kB 00:00 2024-01-17T16:09:23.388 INFO:teuthology.orchestra.run.smithi137.stdout:(7/13): ceph-mgr-rook-19.0.0-720.gcecb6cb5.el9. 146 kB/s | 50 kB 00:00 2024-01-17T16:09:23.505 INFO:teuthology.orchestra.run.smithi137.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 105 kB/s | 15 kB 00:00 2024-01-17T16:09:23.530 INFO:teuthology.orchestra.run.smithi137.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 175 kB/s | 32 kB 00:00 2024-01-17T16:09:23.664 INFO:teuthology.orchestra.run.smithi137.stdout:(10/13): python3-google-auth-2.26.0-1.el9.noarc 732 kB/s | 202 kB 00:00 2024-01-17T16:09:23.689 INFO:teuthology.orchestra.run.smithi137.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 373 kB/s | 59 kB 00:00 2024-01-17T16:09:23.756 INFO:teuthology.orchestra.run.smithi137.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 976 kB/s | 90 kB 00:00 2024-01-17T16:09:23.814 INFO:teuthology.orchestra.run.smithi137.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.3 MB/s | 1.0 MB 00:00 2024-01-17T16:09:23.816 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:23.816 INFO:teuthology.orchestra.run.smithi137.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-01-17T16:09:23.817 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:23.829 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:23.830 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:23.930 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:23.931 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:24.486 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:24.663 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-01-17T16:09:24.715 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-01-17T16:09:24.780 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-01-17T16:09:24.817 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-01-17T16:09:24.858 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-01-17T16:09:24.951 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-01-17T16:09:25.052 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.26.0-1.el9.noarch 7/13 2024-01-17T16:09:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-01-17T16:09:25.830 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-01-17T16:09:25.881 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-01-17T16:09:25.916 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-01-17T16:09:25.963 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-01-17T16:09:25.985 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:19.0.0-720.gcecb6cb5.el9.noarch 13/13 2024-01-17T16:09:26.787 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-720.gcecb6cb5.el9.noarch 13/13 2024-01-17T16:09:26.787 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:19.0.0-720.gcecb6cb5.el9.noarch 1/13 2024-01-17T16:09:26.787 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-01-17T16:09:26.787 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-01-17T16:09:26.787 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-01-17T16:09:26.787 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-01-17T16:09:26.787 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-01-17T16:09:26.787 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-01-17T16:09:26.787 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-01-17T16:09:26.788 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-01-17T16:09:26.788 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.26.0-1.el9.noarch 10/13 2024-01-17T16:09:26.788 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-01-17T16:09:26.788 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-01-17T16:09:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.26.0-1.el9.noarch 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-17T16:09:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-17T16:09:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-17T16:09:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-17T16:09:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-17T16:09:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:27.169 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:27.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-cephadm 2024-01-17T16:09:28.012 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:49 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:28.175 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:28.175 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-01-17T16:09:28.175 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:09:28.175 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-01-17T16:09:28.175 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:28.175 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 133 k 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout:Install 6 Packages 2024-01-17T16:09:28.176 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:28.177 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 6.8 M 2024-01-17T16:09:28.177 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 33 M 2024-01-17T16:09:28.177 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:28.675 INFO:teuthology.orchestra.run.smithi137.stdout:(1/6): ceph-mgr-cephadm-19.0.0-720.gcecb6cb5.el 494 kB/s | 133 kB 00:00 2024-01-17T16:09:28.776 INFO:teuthology.orchestra.run.smithi137.stdout:(2/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 619 kB/s | 228 kB 00:00 2024-01-17T16:09:28.926 INFO:teuthology.orchestra.run.smithi137.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 387 kB/s | 58 kB 00:00 2024-01-17T16:09:29.001 INFO:teuthology.orchestra.run.smithi137.stdout:(4/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.7 MB/s | 5.8 MB 00:00 2024-01-17T16:09:29.026 INFO:teuthology.orchestra.run.smithi137.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.5 MB/s | 548 kB 00:00 2024-01-17T16:09:29.052 INFO:teuthology.orchestra.run.smithi137.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 413 kB/s | 51 kB 00:00 2024-01-17T16:09:29.056 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:29.056 INFO:teuthology.orchestra.run.smithi137.stdout:Total 7.7 MB/s | 6.8 MB 00:00 2024-01-17T16:09:29.056 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:29.064 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:29.064 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:29.153 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:29.153 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:29.611 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-01-17T16:09:29.662 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-01-17T16:09:30.165 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-01-17T16:09:30.246 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-01-17T16:09:30.308 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2024-01-17T16:09:30.332 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 6/6 2024-01-17T16:09:31.164 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 6/6 2024-01-17T16:09:31.164 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 1/6 2024-01-17T16:09:31.164 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-01-17T16:09:31.164 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2024-01-17T16:09:31.164 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-01-17T16:09:31.164 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-01-17T16:09:31.490 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:31.491 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:31.739 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-fuse 2024-01-17T16:09:32.298 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:53 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:32.448 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:32.448 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:32.448 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 858 k 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout:Install 2 Packages 2024-01-17T16:09:32.449 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:32.450 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 937 k 2024-01-17T16:09:32.450 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 3.1 M 2024-01-17T16:09:32.450 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:32.628 INFO:teuthology.orchestra.run.smithi137.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 441 kB/s | 79 kB 00:00 2024-01-17T16:09:32.795 INFO:teuthology.orchestra.run.smithi137.stdout:(2/2): ceph-fuse-19.0.0-720.gcecb6cb5.el9.x86_6 2.4 MB/s | 858 kB 00:00 2024-01-17T16:09:32.796 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:32.796 INFO:teuthology.orchestra.run.smithi137.stdout:Total 2.6 MB/s | 937 kB 00:00 2024-01-17T16:09:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:32.816 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:32.816 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:32.890 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:32.890 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:33.085 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:33.222 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-01-17T16:09:33.286 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/2 2024-01-17T16:09:33.983 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 2/2 2024-01-17T16:09:33.983 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/2 2024-01-17T16:09:34.277 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-01-17T16:09:34.277 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:34.278 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:34.278 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-01-17T16:09:34.278 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:34.278 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:34.525 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-volume 2024-01-17T16:09:35.100 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:56 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:35.250 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:35.251 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:35.251 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:19.0.0-720.gcecb6cb5.el9 ceph-noarch 262 k 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 262 k 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 1.2 M 2024-01-17T16:09:35.252 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:35.907 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-volume-19.0.0-720.gcecb6cb5.el9.noarch.rpm 401 kB/s | 262 kB 00:00 2024-01-17T16:09:35.908 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:35.908 INFO:teuthology.orchestra.run.smithi137.stdout:Total 400 kB/s | 262 kB 00:00 2024-01-17T16:09:35.908 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:35.916 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:35.916 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:35.954 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:35.955 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:36.165 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:36.234 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:09:36.250 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:09:36.250 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:09:36.250 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-17T16:09:36.250 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:37.316 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:19.0.0-720.gcecb6cb5.el9.noarch 1/1 2024-01-17T16:09:37.316 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:37.316 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:37.316 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:19.0.0-720.gcecb6cb5.el9.noarch 2024-01-17T16:09:37.317 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:37.317 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:37.620 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librados-devel 2024-01-17T16:09:38.196 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:06:59 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:38.352 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 127 k 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-01-17T16:09:38.353 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:38.354 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 127 k 2024-01-17T16:09:38.354 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 457 k 2024-01-17T16:09:38.354 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:38.587 INFO:teuthology.orchestra.run.smithi137.stdout:librados-devel-19.0.0-720.gcecb6cb5.el9.x86_64. 543 kB/s | 127 kB 00:00 2024-01-17T16:09:38.589 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:38.589 INFO:teuthology.orchestra.run.smithi137.stdout:Total 539 kB/s | 127 kB 00:00 2024-01-17T16:09:38.589 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:38.594 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:38.594 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:38.649 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:38.649 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:38.803 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:38.895 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:39.371 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:39.654 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:39.654 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:39.655 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:39.655 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:09:39.655 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:39.655 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:39.917 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install libcephfs2 2024-01-17T16:09:40.494 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:01 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:40.600 INFO:teuthology.orchestra.run.smithi137.stdout:Package libcephfs2-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:09:40.654 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:40.655 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-01-17T16:09:40.655 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:40.735 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install libcephfs-devel 2024-01-17T16:09:41.297 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:02 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:41.451 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:41.451 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:41.451 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2024-01-17T16:09:41.451 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:41.451 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:41.452 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 31 k 2024-01-17T16:09:41.452 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:41.452 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:41.452 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:41.452 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-01-17T16:09:41.452 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:41.452 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 31 k 2024-01-17T16:09:41.453 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 140 k 2024-01-17T16:09:41.453 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:41.691 INFO:teuthology.orchestra.run.smithi137.stdout:libcephfs-devel-19.0.0-720.gcecb6cb5.el9.x86_64 131 kB/s | 31 kB 00:00 2024-01-17T16:09:41.691 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:41.692 INFO:teuthology.orchestra.run.smithi137.stdout:Total 130 kB/s | 31 kB 00:00 2024-01-17T16:09:41.692 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:41.695 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:41.695 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:41.722 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:41.723 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:41.811 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:41.914 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:42.341 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:42.640 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:09:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:42.640 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:42.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librados2 2024-01-17T16:09:43.410 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:04 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:43.511 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:09:43.561 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:43.562 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-01-17T16:09:43.563 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:43.640 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librbd1 2024-01-17T16:09:44.205 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:05 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:44.304 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:09:44.356 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:44.357 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-01-17T16:09:44.357 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:44.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rados 2024-01-17T16:09:45.001 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:06 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:45.102 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rados-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:09:45.153 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:45.154 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-01-17T16:09:45.154 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:45.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rgw 2024-01-17T16:09:45.794 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:06 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:45.894 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rgw-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:09:45.945 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:45.946 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-01-17T16:09:45.946 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:46.024 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-cephfs 2024-01-17T16:09:46.584 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:07 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:46.684 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-cephfs-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:09:46.735 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:46.736 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-01-17T16:09:46.736 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:46.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rbd 2024-01-17T16:09:47.379 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:08 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:47.480 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 is already installed. 2024-01-17T16:09:47.533 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:47.534 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-01-17T16:09:47.534 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:47.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-fuse 2024-01-17T16:09:48.185 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:09 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:48.335 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:48.336 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:48.336 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-01-17T16:09:48.336 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:48.336 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:48.336 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 86 k 2024-01-17T16:09:48.336 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:48.336 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:48.336 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:48.337 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-01-17T16:09:48.337 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:48.337 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 86 k 2024-01-17T16:09:48.337 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 256 k 2024-01-17T16:09:48.337 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:48.819 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-fuse-19.0.0-720.gcecb6cb5.el9.x86_64.rpm 178 kB/s | 86 kB 00:00 2024-01-17T16:09:48.819 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:48.820 INFO:teuthology.orchestra.run.smithi137.stdout:Total 178 kB/s | 86 kB 00:00 2024-01-17T16:09:48.820 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:48.826 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:48.827 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:48.881 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:48.882 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:49.865 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:49.865 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:49.865 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:49.865 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:09:49.865 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:49.866 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:50.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-mirror 2024-01-17T16:09:50.722 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:11 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:50.878 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2024-01-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 3.0 M 2024-01-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-01-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 3.0 M 2024-01-17T16:09:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 14 M 2024-01-17T16:09:50.880 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:51.430 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-mirror-19.0.0-720.gcecb6cb5.el9.x86_64.rpm 5.5 MB/s | 3.0 MB 00:00 2024-01-17T16:09:51.430 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:51.431 INFO:teuthology.orchestra.run.smithi137.stdout:Total 5.5 MB/s | 3.0 MB 00:00 2024-01-17T16:09:51.431 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:51.440 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:51.440 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:51.511 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:51.511 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:51.937 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:51.980 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:52.005 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:52.005 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-17T16:09:52.005 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-17T16:09:52.005 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T16:09:52.005 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T16:09:52.005 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:53.173 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:09:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:53.173 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:53.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-nbd 2024-01-17T16:09:54.012 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:07:15 ago on Wed 17 Jan 2024 04:02:39 PM UTC. 2024-01-17T16:09:54.164 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:19.0.0-720.gcecb6cb5.el9 ceph 169 k 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 169 k 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 537 k 2024-01-17T16:09:54.165 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-01-17T16:09:54.400 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-nbd-19.0.0-720.gcecb6cb5.el9.x86_64.rpm 720 kB/s | 169 kB 00:00 2024-01-17T16:09:54.401 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-01-17T16:09:54.401 INFO:teuthology.orchestra.run.smithi137.stdout:Total 715 kB/s | 169 kB 00:00 2024-01-17T16:09:54.401 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-01-17T16:09:54.409 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-01-17T16:09:54.409 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-01-17T16:09:54.463 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-01-17T16:09:54.464 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-01-17T16:09:54.611 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-01-17T16:09:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-nbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:55.505 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 1/1 2024-01-17T16:09:55.505 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:55.505 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-01-17T16:09:55.505 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:19.0.0-720.gcecb6cb5.el9.x86_64 2024-01-17T16:09:55.505 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:55.505 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-01-17T16:09:55.738 DEBUG:teuthology.parallel:result is None 2024-01-17T16:09:55.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=cecb6cb5cdba1d67db289980b0e46cfe0334a30f 2024-01-17T16:09:55.971 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-17T16:09:55.995 INFO:teuthology.orchestra.run.smithi026.stdout:19.0.0-720.gcecb6cb5.el9 2024-01-17T16:09:55.996 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-720.gcecb6cb5.el9 2024-01-17T16:09:55.996 INFO:teuthology.task.install:The correct ceph version 19.0.0-720.gcecb6cb5 is installed. 2024-01-17T16:09:55.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=cecb6cb5cdba1d67db289980b0e46cfe0334a30f 2024-01-17T16:09:56.221 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-17T16:09:56.242 INFO:teuthology.orchestra.run.smithi137.stdout:19.0.0-720.gcecb6cb5.el9 2024-01-17T16:09:56.242 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-720.gcecb6cb5.el9 2024-01-17T16:09:56.242 INFO:teuthology.task.install:The correct ceph version 19.0.0-720.gcecb6cb5 is installed. 2024-01-17T16:09:56.243 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-17T16:09:56.244 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:56.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-17T16:09:56.277 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:09:56.277 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-17T16:09:56.309 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-17T16:09:56.309 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:56.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2024-01-17T16:09:56.348 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-17T16:09:56.417 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:09:56.417 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-01-17T16:09:56.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-17T16:09:56.511 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-17T16:09:56.511 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:56.511 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-17T16:09:56.540 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-17T16:09:56.609 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:09:56.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-17T16:09:56.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-17T16:09:56.702 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-17T16:09:56.703 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:56.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2024-01-17T16:09:56.729 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-17T16:09:56.796 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:09:56.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-01-17T16:09:56.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-17T16:09:56.890 INFO:teuthology.run_tasks:Running task ceph... 2024-01-17T16:09:56.966 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-17T16:09:56.966 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2024-01-17T16:09:56.968 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-01-17T16:09:56.994 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-17T16:09:56.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-17T16:09:57.035 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-17T16:09:57.061 INFO:tasks.ceph:Creating extra log directories... 2024-01-17T16:09:57.061 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-17T16:09:57.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-17T16:09:57.139 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-17T16:09:57.139 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-17T16:09:57.139 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842', 'branch': 'wip-matanb-crimson-testing-17.1-crimson-only', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7518842', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-17.1-crimson-only'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f'}}, 'workunit': {'branch': 'wip-matanb-crimson-testing-17.1-crimson-only', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1084, 'sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'wip-matanb-crimson-testing-17.1-crimson-only', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f', 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9JHUYiSDs+eSJB6N1t8wuVYL+5hSY92TdMf7FvQqEhqcWBcU7htAr3e5uOAqTL8Yhx/VWVDzw/xRMP3kqmD3A=', 'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7QE6FHsWHdnD+uknp03lBjueOu1SCwS8NyzbAI3HVm4iE3fkdCMErhNAuToijZjx9u++5PGRc0taKSsUXGSdo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-17_15:47:21', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-17T16:09:57.140 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-17T16:09:57.171 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-17T16:09:57.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2024-01-17T16:09:57.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-01-17T16:09:57.252 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:57.253 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2024-01-17T16:09:57.305 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-17T16:09:57.305 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2024-01-17T16:09:57.359 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-17T16:09:57.359 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T16:09:57.359 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-01-17T16:09:57.359 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T16:09:57.360 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-01-17T16:09:57.360 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-01-17 16:08:42.982251669 +0000 2024-01-17T16:09:57.360 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-01-17 16:01:41.807089404 +0000 2024-01-17T16:09:57.360 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-01-17 16:01:41.807089404 +0000 2024-01-17T16:09:57.360 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-01-17 16:01:41.807089404 +0000 2024-01-17T16:09:57.360 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-17T16:09:57.423 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-01-17T16:09:57.424 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-01-17T16:09:57.424 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.2139e-05 s, 5.6 MB/s 2024-01-17T16:09:57.425 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-17T16:09:57.480 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2024-01-17T16:09:57.534 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-17T16:09:57.534 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T16:09:57.534 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-01-17T16:09:57.534 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T16:09:57.534 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-01-17T16:09:57.534 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-01-17 16:08:42.982251669 +0000 2024-01-17T16:09:57.534 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-01-17 16:01:42.150084065 +0000 2024-01-17T16:09:57.535 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-01-17 16:01:42.150084065 +0000 2024-01-17T16:09:57.535 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-01-17 16:01:42.150084065 +0000 2024-01-17T16:09:57.535 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-17T16:09:57.598 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-01-17T16:09:57.599 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-01-17T16:09:57.599 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.36e-05 s, 5.5 MB/s 2024-01-17T16:09:57.600 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-17T16:09:57.655 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2024-01-17T16:09:57.709 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-17T16:09:57.709 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T16:09:57.709 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-01-17T16:09:57.709 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T16:09:57.709 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-01-17T16:09:57.709 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-01-17 16:08:42.982251669 +0000 2024-01-17T16:09:57.709 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-01-17 16:01:42.491078756 +0000 2024-01-17T16:09:57.710 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-01-17 16:01:42.491078756 +0000 2024-01-17T16:09:57.710 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-01-17 16:01:42.491078756 +0000 2024-01-17T16:09:57.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-17T16:09:57.774 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-01-17T16:09:57.774 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-01-17T16:09:57.774 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.73e-05 s, 5.3 MB/s 2024-01-17T16:09:57.775 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-17T16:09:57.831 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2024-01-17T16:09:57.885 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-17T16:09:57.885 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T16:09:57.885 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-01-17T16:09:57.885 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T16:09:57.885 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-01-17T16:09:57.885 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-01-17 16:08:42.983251654 +0000 2024-01-17T16:09:57.885 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-01-17 16:01:42.832073447 +0000 2024-01-17T16:09:57.885 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-01-17 16:01:42.832073447 +0000 2024-01-17T16:09:57.885 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-01-17 16:01:42.832073447 +0000 2024-01-17T16:09:57.886 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-17T16:09:57.950 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-01-17T16:09:57.950 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-01-17T16:09:57.950 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.409e-05 s, 5.4 MB/s 2024-01-17T16:09:57.951 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-17T16:09:58.006 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-01-17T16:09:58.006 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:09:58.006 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-01-17T16:09:58.021 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-17T16:09:58.021 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-01-17T16:09:58.076 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-17T16:09:58.076 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T16:09:58.076 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-01-17T16:09:58.076 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T16:09:58.076 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-01-17T16:09:58.076 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-01-17 16:09:52.265314580 +0000 2024-01-17T16:09:58.076 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-01-17 16:01:38.272407018 +0000 2024-01-17T16:09:58.076 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-01-17 16:01:38.272407018 +0000 2024-01-17T16:09:58.077 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-01-17 16:01:38.272407018 +0000 2024-01-17T16:09:58.077 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-17T16:09:58.142 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-01-17T16:09:58.142 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-01-17T16:09:58.142 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000185046 s, 2.8 MB/s 2024-01-17T16:09:58.143 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-17T16:09:58.200 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-01-17T16:09:58.254 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-17T16:09:58.255 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T16:09:58.255 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-01-17T16:09:58.255 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T16:09:58.255 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-01-17T16:09:58.255 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-01-17 16:09:52.265314580 +0000 2024-01-17T16:09:58.255 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-01-17 16:01:38.626400656 +0000 2024-01-17T16:09:58.255 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-01-17 16:01:38.626400656 +0000 2024-01-17T16:09:58.255 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-01-17 16:01:38.626400656 +0000 2024-01-17T16:09:58.255 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-17T16:09:58.320 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-01-17T16:09:58.320 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-01-17T16:09:58.320 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000205027 s, 2.5 MB/s 2024-01-17T16:09:58.321 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-17T16:09:58.377 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-01-17T16:09:58.431 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-17T16:09:58.431 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T16:09:58.432 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-01-17T16:09:58.432 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T16:09:58.432 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-01-17T16:09:58.432 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-01-17 16:09:52.265314580 +0000 2024-01-17T16:09:58.432 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-01-17 16:01:38.967394527 +0000 2024-01-17T16:09:58.432 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-01-17 16:01:38.967394527 +0000 2024-01-17T16:09:58.432 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-01-17 16:01:38.967394527 +0000 2024-01-17T16:09:58.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-17T16:09:58.497 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-01-17T16:09:58.498 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-01-17T16:09:58.498 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000199794 s, 2.6 MB/s 2024-01-17T16:09:58.499 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-17T16:09:58.554 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-01-17T16:09:58.608 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-17T16:09:58.608 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T16:09:58.609 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-01-17T16:09:58.609 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T16:09:58.609 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-01-17T16:09:58.609 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-01-17 16:09:52.266314562 +0000 2024-01-17T16:09:58.609 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-01-17 16:01:39.290388722 +0000 2024-01-17T16:09:58.609 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-01-17 16:01:39.290388722 +0000 2024-01-17T16:09:58.609 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-01-17 16:01:39.290388722 +0000 2024-01-17T16:09:58.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-17T16:09:58.674 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-01-17T16:09:58.674 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-01-17T16:09:58.674 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000228136 s, 2.2 MB/s 2024-01-17T16:09:58.675 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-17T16:09:58.731 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-01-17T16:09:58.731 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-01-17T16:09:58.731 INFO:tasks.ceph:Generating config... 2024-01-17T16:09:58.732 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-01-17T16:09:58.732 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-01-17T16:09:58.733 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-01-17T16:09:58.733 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-01-17T16:09:58.733 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-01-17T16:09:58.733 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-17T16:09:58.733 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-17T16:09:58.733 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-17T16:09:58.733 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-01-17T16:09:58.733 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-01-17T16:09:58.733 INFO:tasks.ceph:[osd] debug monc = 20 2024-01-17T16:09:58.733 INFO:tasks.ceph:[osd] crimson seastar smp = 3 2024-01-17T16:09:58.733 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-17T16:09:58.733 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-17T16:09:58.733 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-01-17T16:09:58.733 INFO:tasks.ceph:[osd] osd class default list = * 2024-01-17T16:09:58.734 INFO:tasks.ceph:[osd] osd class load list = * 2024-01-17T16:09:58.734 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-01-17T16:09:58.734 INFO:tasks.ceph:[client] debug ms = 1 2024-01-17T16:09:58.734 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-01-17T16:09:58.734 INFO:tasks.ceph:[global] ms client mode = crc 2024-01-17T16:09:58.734 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-01-17T16:09:58.734 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-01-17T16:09:58.734 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-01-17T16:09:58.734 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-01-17T16:09:58.734 INFO:tasks.ceph:[global] ms service mode = crc 2024-01-17T16:09:58.734 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-17T16:09:58.734 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-17T16:09:58.734 INFO:tasks.ceph:Setting up mon.a... 2024-01-17T16:09:58.735 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-17T16:09:58.794 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2024-01-17T16:09:58.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-17T16:09:58.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-17T16:09:58.876 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26')] 2024-01-17T16:09:58.877 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}} 2024-01-17T16:09:58.877 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:58.877 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-17T16:09:58.931 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --print /home/ubuntu/cephtest/ceph.monmap 2024-01-17T16:09:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:09:59.016+0000 7fc74025be80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:09:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:09:59.016+0000 7fc74025be80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:09:59.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:09:59.017+0000 7fc74025be80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:09:59.015 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid d5f7e2df-0606-4200-a4cf-99b4ea90cbfe 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = quincy 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:fsid d5f7e2df-0606-4200-a4cf-99b4ea90cbfe 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2024-01-17T16:09:59.017576+0000 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-01-17T16:09:59.017576+0000 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 17 (quincy) 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2024-01-17T16:09:59.016 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-01-17T16:09:59.017 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-17T16:09:59.031 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d5f7e2df-0606-4200-a4cf-99b4ea90cbfe... 2024-01-17T16:09:59.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-17T16:09:59.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-17T16:09:59.121 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2024-01-17T16:09:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2024-01-17T16:09:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-17T16:09:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2024-01-17T16:09:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2024-01-17T16:09:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2024-01-17T16:09:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2024-01-17T16:09:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = 172.21.15.26 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: ms client mode = crc 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: ms cluster mode = crc 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: ms mon client mode = crc 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: ms mon cluster mode = crc 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: ms mon service mode = crc 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: ms service mode = crc 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = d5f7e2df-0606-4200-a4cf-99b4ea90cbfe 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.124 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug trim objects = true 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: debug monc = 20 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: crimson seastar smp = 3 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: osd blocked scrub grace period = 3600 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: osd class default list = * 2024-01-17T16:09:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: osd class load list = * 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: osd shutdown pgref assert = True 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-01-17T16:09:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2024-01-17T16:09:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: mon min osdmap epochs = 50 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: mon osdmap full prune interval = 2 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: mon osdmap full prune min = 15 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: mon osdmap full prune txsize = 2 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: paxos service trim min = 10 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on pool no app = False 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default crimson = True 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-17T16:09:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-01-17T16:09:59.130 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-01-17T16:09:59.131 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.132 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = 172.21.15.26 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: ms client mode = crc 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: ms cluster mode = crc 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: ms mon client mode = crc 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: ms mon cluster mode = crc 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: ms mon service mode = crc 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: ms service mode = crc 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = d5f7e2df-0606-4200-a4cf-99b4ea90cbfe 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-01-17T16:09:59.133 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-01-17T16:09:59.134 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: debug monc = 20 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: crimson seastar smp = 3 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: osd blocked scrub grace period = 3600 2024-01-17T16:09:59.135 INFO:teuthology.orchestra.run.smithi137.stdout: osd class default list = * 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: osd class load list = * 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: osd shutdown pgref assert = True 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-01-17T16:09:59.136 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-17T16:09:59.137 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: mon min osdmap epochs = 50 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: mon osdmap full prune interval = 2 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: mon osdmap full prune min = 15 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: mon osdmap full prune txsize = 2 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: paxos service trim min = 10 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on pool no app = False 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default crimson = True 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-01-17T16:09:59.138 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-01-17T16:09:59.139 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-17T16:09:59.139 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-17T16:09:59.139 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-01-17T16:09:59.139 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-01-17T16:09:59.140 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-17T16:09:59.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-17T16:09:59.241 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-17T16:09:59.241 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:59.242 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-17T16:09:59.256 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:59.256 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-17T16:09:59.310 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2024-01-17T16:09:59.310 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:59.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-17T16:09:59.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-17T16:09:59.389 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:09:59.389 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-17T16:09:59.444 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T16:09:59.444 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:09:59.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-17T16:09:59.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-17T16:09:59.483 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:09:59.483 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-17T16:09:59.537 INFO:tasks.ceph:Setting up mon nodes... 2024-01-17T16:09:59.537 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-17T16:09:59.538 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-17T16:09:59.641 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-17T16:09:59.644 INFO:tasks.ceph:Setting up mds nodes... 2024-01-17T16:09:59.644 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-17T16:09:59.645 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-17T16:09:59.692 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-17T16:09:59.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-17T16:09:59.755 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-17T16:09:59.770 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-17T16:09:59.770 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-01-17T16:09:59.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-17T16:09:59.797 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-01-17T16:09:59.797 INFO:tasks.ceph:role: osd.0 2024-01-17T16:09:59.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2024-01-17T16:09:59.797 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T16:09:59.863 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T16:09:59.895 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-01-17T16:09:59.896 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-01-17T16:09:59.897 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-17T16:09:59.967 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-17T16:10:00.039 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-17T16:10:00.107 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-01-17T16:10:00.107 INFO:tasks.ceph:role: osd.1 2024-01-17T16:10:00.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2024-01-17T16:10:00.107 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T16:10:00.173 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T16:10:00.205 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-01-17T16:10:00.207 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-01-17T16:10:00.207 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-17T16:10:00.277 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-17T16:10:00.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T16:10:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:WARNING: debug mode. Not for benchmarking or production 2024-01-17T16:10:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:00,879 seastar - Reactor backend: linux-aio 2024-01-17T16:10:00.897 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:00,898 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2024-01-17T16:10:00.897 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:00,898 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2024-01-17T16:10:00.897 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:00,898 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2024-01-17T16:10:00.897 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:00,898 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2024-01-17T16:10:00.899 INFO:teuthology.orchestra.run.smithi026.stderr:==27947==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-01-17T16:10:00.905 INFO:teuthology.orchestra.run.smithi026.stderr:==27947==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffd879b0000; bottom 0x7fe18753c000; size: 0x001c00474000 (120263753728) 2024-01-17T16:10:00.905 INFO:teuthology.orchestra.run.smithi026.stderr:False positive error reports may follow 2024-01-17T16:10:00.905 INFO:teuthology.orchestra.run.smithi026.stderr:For details see https://github.com/google/sanitizers/issues/189 2024-01-17T16:10:00.942 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:00,944 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2024-01-17T16:10:00.942 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:00,944 [shard 0] osd - get_early_config: set --smp 3 2024-01-17T16:10:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:----------------------------------------------------- 2024-01-17T16:10:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:Suppressions used: 2024-01-17T16:10:01.447 INFO:teuthology.orchestra.run.smithi026.stderr: count bytes template 2024-01-17T16:10:01.447 INFO:teuthology.orchestra.run.smithi026.stderr: 1 8 MallocExtension::Register 2024-01-17T16:10:01.447 INFO:teuthology.orchestra.run.smithi026.stderr:----------------------------------------------------- 2024-01-17T16:10:01.448 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-01-17T16:10:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:WARNING: debug mode. Not for benchmarking or production 2024-01-17T16:10:01.505 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:01,507 seastar - Reactor backend: linux-aio 2024-01-17T16:10:01.523 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:01,525 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2024-01-17T16:10:01.523 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:01,525 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2024-01-17T16:10:01.523 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:01,525 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2024-01-17T16:10:01.531 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:01,533 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2024-01-17T16:10:01.533 INFO:teuthology.orchestra.run.smithi026.stderr:==27945==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-01-17T16:10:01.539 INFO:teuthology.orchestra.run.smithi026.stderr:==27945==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffd879b0000; bottom 0x7fe185325000; size: 0x001c0268b000 (120299499520) 2024-01-17T16:10:01.539 INFO:teuthology.orchestra.run.smithi026.stderr:False positive error reports may follow 2024-01-17T16:10:01.539 INFO:teuthology.orchestra.run.smithi026.stderr:For details see https://github.com/google/sanitizers/issues/189 2024-01-17T16:10:01.623 INFO:teuthology.orchestra.run.smithi026.stderr:Reactor stalled for 33 ms on shard 0. Backtrace: 0x45d5d 0x2e7e3e3c 0x2e7e51ea 0x2e7e671c 0x2e7e6aa0 0x2e7e6bea 0x2e7e7040 0x54daf 0x588c4 0xdb9f8 0x277ddf6c 0x277e3194 0x277e59f9 0x275ff1f1 0x1f965014 0x1f6e1e98 0x1f80d0cf 0x2eb8ec03 2024-01-17T16:10:01.623 INFO:teuthology.orchestra.run.smithi026.stderr:kernel callstack: 2024-01-17T16:10:04.615 INFO:teuthology.orchestra.run.smithi026.stderr:----------------------------------------------------- 2024-01-17T16:10:04.616 INFO:teuthology.orchestra.run.smithi026.stderr:Suppressions used: 2024-01-17T16:10:04.616 INFO:teuthology.orchestra.run.smithi026.stderr: count bytes template 2024-01-17T16:10:04.616 INFO:teuthology.orchestra.run.smithi026.stderr: 1 8 MallocExtension::Register 2024-01-17T16:10:04.616 INFO:teuthology.orchestra.run.smithi026.stderr:----------------------------------------------------- 2024-01-17T16:10:04.616 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-01-17T16:10:04.616 INFO:teuthology.orchestra.run.smithi026.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid d5f7e2df-0606-4200-a4cf-99b4ea90cbfe 2024-01-17T16:10:04.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-17T16:10:04.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T16:10:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:WARNING: debug mode. Not for benchmarking or production 2024-01-17T16:10:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,210 seastar - Reactor backend: linux-aio 2024-01-17T16:10:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,225 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2024-01-17T16:10:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,225 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2024-01-17T16:10:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,225 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2024-01-17T16:10:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,225 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2024-01-17T16:10:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:==28755==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-01-17T16:10:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:==28755==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffe78a1f000; bottom 0x7f9e41318000; size: 0x006037707000 (413246976000) 2024-01-17T16:10:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:False positive error reports may follow 2024-01-17T16:10:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:For details see https://github.com/google/sanitizers/issues/189 2024-01-17T16:10:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2e7e3e3c 0x2e7e51ea 0x2e7e671c 0x2e7e6aa0 0x2e7e6bea 0x2e7e7040 0x54daf 0x240cf13d 0x24166fc5 0x2416dbb9 0x23f34c62 0x23fb7181 0x25e7d3ec 0x25e84f20 0x25e8786d 0x25e88a32 0x23a93c5d 0x23ab0bc4 0x23b25235 0x2e7567f5 0x2e7b9a26 0x2ea5fbab 0x2ea619f5 0x2e412ca4 0x2e414bad 0x1f908005 0x1f90eaad 0x1f6e5eb6 0x3feaf 0x3ff5f 0x1f2a6a54 2024-01-17T16:10:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:kernel callstack: 2024-01-17T16:10:05.269 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,271 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2024-01-17T16:10:05.269 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,271 [shard 0] osd - get_early_config: set --smp 3 2024-01-17T16:10:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:----------------------------------------------------- 2024-01-17T16:10:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:Suppressions used: 2024-01-17T16:10:05.753 INFO:teuthology.orchestra.run.smithi026.stderr: count bytes template 2024-01-17T16:10:05.753 INFO:teuthology.orchestra.run.smithi026.stderr: 1 8 MallocExtension::Register 2024-01-17T16:10:05.753 INFO:teuthology.orchestra.run.smithi026.stderr:----------------------------------------------------- 2024-01-17T16:10:05.753 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-01-17T16:10:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:WARNING: debug mode. Not for benchmarking or production 2024-01-17T16:10:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,806 seastar - Reactor backend: linux-aio 2024-01-17T16:10:05.830 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,832 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2024-01-17T16:10:05.830 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,832 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2024-01-17T16:10:05.830 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,832 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2024-01-17T16:10:05.830 INFO:teuthology.orchestra.run.smithi026.stderr:INFO 2024-01-17 16:10:05,832 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2024-01-17T16:10:05.840 INFO:teuthology.orchestra.run.smithi026.stderr:==28753==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-01-17T16:10:05.846 INFO:teuthology.orchestra.run.smithi026.stderr:==28753==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffe78a1f000; bottom 0x7f9e3f102000; size: 0x00603991d000 (413282717696) 2024-01-17T16:10:05.846 INFO:teuthology.orchestra.run.smithi026.stderr:False positive error reports may follow 2024-01-17T16:10:05.846 INFO:teuthology.orchestra.run.smithi026.stderr:For details see https://github.com/google/sanitizers/issues/189 2024-01-17T16:10:05.930 INFO:teuthology.orchestra.run.smithi026.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2e7e3e3c 0x2e7e51ea 0x2e7e671c 0x2e7e6aa0 0x2e7e6bea 0x2e7e7040 0x54daf 0xce1ca 0x588c4 0xdb9f8 0x277ddf6c 0x277e3194 0x277e59f9 0x275ff1f1 0x1f965014 0x1f6e1e98 0x1f80d0cf 0x2eb8ec03 2024-01-17T16:10:05.930 INFO:teuthology.orchestra.run.smithi026.stderr:kernel callstack: 2024-01-17T16:10:08.919 INFO:teuthology.orchestra.run.smithi026.stderr:----------------------------------------------------- 2024-01-17T16:10:08.920 INFO:teuthology.orchestra.run.smithi026.stderr:Suppressions used: 2024-01-17T16:10:08.920 INFO:teuthology.orchestra.run.smithi026.stderr: count bytes template 2024-01-17T16:10:08.920 INFO:teuthology.orchestra.run.smithi026.stderr: 1 8 MallocExtension::Register 2024-01-17T16:10:08.920 INFO:teuthology.orchestra.run.smithi026.stderr:----------------------------------------------------- 2024-01-17T16:10:08.920 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-01-17T16:10:08.920 INFO:teuthology.orchestra.run.smithi026.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid d5f7e2df-0606-4200-a4cf-99b4ea90cbfe 2024-01-17T16:10:08.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-17T16:10:08.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-17T16:10:09.021 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-01-17T16:10:09.021 INFO:tasks.ceph:role: osd.2 2024-01-17T16:10:09.021 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T16:10:09.021 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-17T16:10:09.098 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T16:10:09.098 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T16:10:09.098 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T16:10:09.098 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-17T16:10:09.098 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T16:10:09.098 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-01-17T16:10:09.098 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T16:10:09.099 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-17T16:10:09.099 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T16:10:09.099 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T16:10:09.612 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-01-17T16:10:09.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-01-17T16:10:09.614 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-01-17T16:10:09.765 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-17T16:10:09.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-17T16:10:09.871 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-01-17T16:10:09.871 INFO:tasks.ceph:role: osd.3 2024-01-17T16:10:09.872 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T16:10:09.872 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-17T16:10:09.947 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T16:10:09.947 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T16:10:09.947 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T16:10:09.947 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-17T16:10:09.948 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T16:10:09.948 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-01-17T16:10:09.948 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T16:10:09.948 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-17T16:10:09.948 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T16:10:09.948 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T16:10:10.387 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-01-17T16:10:10.390 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-01-17T16:10:10.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-01-17T16:10:10.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-17T16:10:10.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T16:10:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:WARNING: debug mode. Not for benchmarking or production 2024-01-17T16:10:11.090 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,092 seastar - Reactor backend: linux-aio 2024-01-17T16:10:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,104 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2024-01-17T16:10:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,104 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2024-01-17T16:10:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,104 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2024-01-17T16:10:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,104 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2024-01-17T16:10:11.104 INFO:teuthology.orchestra.run.smithi137.stderr:==27932==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-01-17T16:10:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:==27932==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffcef68c000; bottom 0x7f2d46105000; size: 0x00cfa9587000 (891899375616) 2024-01-17T16:10:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:False positive error reports may follow 2024-01-17T16:10:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:For details see https://github.com/google/sanitizers/issues/189 2024-01-17T16:10:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,147 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2024-01-17T16:10:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,147 [shard 0] osd - get_early_config: set --smp 3 2024-01-17T16:10:11.646 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-01-17T16:10:11.647 INFO:teuthology.orchestra.run.smithi137.stderr:Suppressions used: 2024-01-17T16:10:11.647 INFO:teuthology.orchestra.run.smithi137.stderr: count bytes template 2024-01-17T16:10:11.647 INFO:teuthology.orchestra.run.smithi137.stderr: 1 8 MallocExtension::Register 2024-01-17T16:10:11.647 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-01-17T16:10:11.647 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-01-17T16:10:11.702 INFO:teuthology.orchestra.run.smithi137.stderr:WARNING: debug mode. Not for benchmarking or production 2024-01-17T16:10:11.702 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,704 seastar - Reactor backend: linux-aio 2024-01-17T16:10:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,722 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2024-01-17T16:10:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,722 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2024-01-17T16:10:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,722 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2024-01-17T16:10:11.728 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:11,730 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2024-01-17T16:10:11.730 INFO:teuthology.orchestra.run.smithi137.stderr:==27930==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-01-17T16:10:11.736 INFO:teuthology.orchestra.run.smithi137.stderr:==27930==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffcef68c000; bottom 0x7f2d43eee000; size: 0x00cfab79e000 (891935121408) 2024-01-17T16:10:11.736 INFO:teuthology.orchestra.run.smithi137.stderr:False positive error reports may follow 2024-01-17T16:10:11.736 INFO:teuthology.orchestra.run.smithi137.stderr:For details see https://github.com/google/sanitizers/issues/189 2024-01-17T16:10:14.822 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-01-17T16:10:14.823 INFO:teuthology.orchestra.run.smithi137.stderr:Suppressions used: 2024-01-17T16:10:14.823 INFO:teuthology.orchestra.run.smithi137.stderr: count bytes template 2024-01-17T16:10:14.823 INFO:teuthology.orchestra.run.smithi137.stderr: 1 8 MallocExtension::Register 2024-01-17T16:10:14.823 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-01-17T16:10:14.823 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-01-17T16:10:14.823 INFO:teuthology.orchestra.run.smithi137.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid d5f7e2df-0606-4200-a4cf-99b4ea90cbfe 2024-01-17T16:10:14.862 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-17T16:10:14.888 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T16:10:15.409 INFO:teuthology.orchestra.run.smithi137.stderr:WARNING: debug mode. Not for benchmarking or production 2024-01-17T16:10:15.409 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:15,411 seastar - Reactor backend: linux-aio 2024-01-17T16:10:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:15,427 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2024-01-17T16:10:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:15,427 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2024-01-17T16:10:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:15,427 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2024-01-17T16:10:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:15,427 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2024-01-17T16:10:15.428 INFO:teuthology.orchestra.run.smithi137.stderr:==28741==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-01-17T16:10:15.433 INFO:teuthology.orchestra.run.smithi137.stderr:==28741==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fff4f248000; bottom 0x7f73216c3000; size: 0x008c2db85000 (602062475264) 2024-01-17T16:10:15.433 INFO:teuthology.orchestra.run.smithi137.stderr:False positive error reports may follow 2024-01-17T16:10:15.434 INFO:teuthology.orchestra.run.smithi137.stderr:For details see https://github.com/google/sanitizers/issues/189 2024-01-17T16:10:15.469 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:15,470 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2024-01-17T16:10:15.469 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:15,470 [shard 0] osd - get_early_config: set --smp 3 2024-01-17T16:10:15.935 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-01-17T16:10:15.936 INFO:teuthology.orchestra.run.smithi137.stderr:Suppressions used: 2024-01-17T16:10:15.936 INFO:teuthology.orchestra.run.smithi137.stderr: count bytes template 2024-01-17T16:10:15.936 INFO:teuthology.orchestra.run.smithi137.stderr: 1 8 MallocExtension::Register 2024-01-17T16:10:15.936 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-01-17T16:10:15.936 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-01-17T16:10:15.986 INFO:teuthology.orchestra.run.smithi137.stderr:WARNING: debug mode. Not for benchmarking or production 2024-01-17T16:10:15.987 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:15,989 seastar - Reactor backend: linux-aio 2024-01-17T16:10:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:16,016 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2024-01-17T16:10:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:16,016 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2024-01-17T16:10:16.015 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:16,016 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2024-01-17T16:10:16.022 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-01-17 16:10:16,024 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2024-01-17T16:10:16.024 INFO:teuthology.orchestra.run.smithi137.stderr:==28739==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-01-17T16:10:16.030 INFO:teuthology.orchestra.run.smithi137.stderr:==28739==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fff4f248000; bottom 0x7f731f4ac000; size: 0x008c2fd9c000 (602098221056) 2024-01-17T16:10:16.030 INFO:teuthology.orchestra.run.smithi137.stderr:False positive error reports may follow 2024-01-17T16:10:16.030 INFO:teuthology.orchestra.run.smithi137.stderr:For details see https://github.com/google/sanitizers/issues/189 2024-01-17T16:10:19.112 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-01-17T16:10:19.113 INFO:teuthology.orchestra.run.smithi137.stderr:Suppressions used: 2024-01-17T16:10:19.113 INFO:teuthology.orchestra.run.smithi137.stderr: count bytes template 2024-01-17T16:10:19.113 INFO:teuthology.orchestra.run.smithi137.stderr: 1 8 MallocExtension::Register 2024-01-17T16:10:19.113 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-01-17T16:10:19.113 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-01-17T16:10:19.113 INFO:teuthology.orchestra.run.smithi137.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid d5f7e2df-0606-4200-a4cf-99b4ea90cbfe 2024-01-17T16:10:19.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-17T16:10:19.179 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-17T16:10:19.179 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:10:19.179 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-17T16:10:19.211 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:10:19.211 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-17T16:10:19.282 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:10:19.282 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-17T16:10:19.309 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:10:19.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-17T16:10:19.376 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:10:19.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-17T16:10:19.442 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:10:19.442 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-17T16:10:19.459 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:10:19.460 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-17T16:10:19.497 INFO:tasks.ceph:Adding keys to all mons... 2024-01-17T16:10:19.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-17T16:10:19.529 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2024-01-17T16:10:19.529 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDZ+6dlHrBUIxAA73uvmVR0n42PhbUN1C+wjw== 2024-01-17T16:10:19.529 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2024-01-17T16:10:19.529 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDd+6dl4fmUNRAADJpYcpWY9ytScjJAawEr8g== 2024-01-17T16:10:19.529 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2024-01-17T16:10:19.529 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDX+6dlxStjJhAAnsAJ28CxFBmrtcz67MBbxA== 2024-01-17T16:10:19.529 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2024-01-17T16:10:19.530 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDj+6dlL/GVLxAA5xT6g+WfmU2cxXT50ZaMiA== 2024-01-17T16:10:19.530 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2024-01-17T16:10:19.530 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDo+6dldUbnBRAAV+M+RVqgseqgrP0FnR3lGw== 2024-01-17T16:10:19.530 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2024-01-17T16:10:19.530 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDX+6dlQDpkKRAAmMGDessYPnYEaUbF+90M5Q== 2024-01-17T16:10:19.530 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2024-01-17T16:10:19.530 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDX+6dloWgmLRAAUUlP+XA73QqCNP8qqenA0g== 2024-01-17T16:10:19.531 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T16:10:19.636 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T16:10:19.696 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-17T16:10:19.754 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T16:10:19.811 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T16:10:19.868 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-17T16:10:19.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-17T16:10:19.988 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-17T16:10:19.989 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-17T16:10:20.015 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-17T16:10:20.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.112+0000 7f896062a9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.112+0000 7f896062a9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.123 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-17T16:10:20.150 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-17T16:10:20.204 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-17T16:10:20.204 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-17T16:10:20.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-17T16:10:20.246 INFO:tasks.ceph.mon.a:Started 2024-01-17T16:10:20.246 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-17T16:10:20.247 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-17T16:10:20.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-17T16:10:20.249 INFO:tasks.ceph.mgr.x:Started 2024-01-17T16:10:20.249 INFO:tasks.ceph:Setting crush tunables to default 2024-01-17T16:10:20.249 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2024-01-17T16:10:20.324 INFO:tasks.ceph.mon.a.smithi026.stderr:2024-01-17T16:10:20.324+0000 7fc2ede579c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.324 INFO:tasks.ceph.mon.a.smithi026.stderr:2024-01-17T16:10:20.324+0000 7fc2ede579c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.324 INFO:tasks.ceph.mon.a.smithi026.stderr:2024-01-17T16:10:20.325+0000 7fc2ede579c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.341 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:20.342+0000 7fa00236af00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.350+0000 7ff81f715640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.356+0000 7ff81f715640 1 Processor -- start 2024-01-17T16:10:20.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.356+0000 7ff81f715640 1 -- start start 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81f715640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 0x7ff81809c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81f715640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81809df70 con 0x7ff81809fff0 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81f715640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81809d5e0 con 0x7ff81809d9d0 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81d4b1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 0x7ff81809c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81d4b1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 0x7ff81809c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49316/0 (socket says 172.21.15.26:49316) 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81d4b1640 1 -- 172.21.15.26:0/3464953996 learned_addr learned my addr 172.21.15.26:0/3464953996 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81ccb0640 1 --1- 172.21.15.26:0/3464953996 >> v1:172.21.15.26:6789/0 conn(0x7ff81809fff0 0x7ff8180a0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37998/0 (socket says 172.21.15.26:37998) 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81d4b1640 1 -- 172.21.15.26:0/3464953996 >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 msgr2=0x7ff81809c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81d4b1640 1 -- 172.21.15.26:0/3464953996 >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 msgr2=0x7ff81809c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81d4b1640 1 --2- 172.21.15.26:0/3464953996 >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 0x7ff81809c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T16:10:20.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.357+0000 7ff81d4b1640 1 --2- 172.21.15.26:0/3464953996 >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 0x7ff81809c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T16:10:20.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004701762 0 0) 0x7ff81809df70 con 0x7ff81809fff0 2024-01-17T16:10:20.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8040034f0 con 0x7ff81809fff0 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755889967 0 0) 0x7ff8040034f0 con 0x7ff81809fff0 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 msgr2=0x7ff81809c170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 --2- 172.21.15.26:0/3464953996 >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 0x7ff81809c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180a1180 con 0x7ff81809fff0 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 1013270433 0 0) 0x7ff8140015a0 con 0x7ff81809fff0 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 >> v1:172.21.15.26:6789/0 conn(0x7ff81809fff0 legacy=0x7ff8180a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 --2- 172.21.15.26:0/3464953996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff804003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.372+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81809d5e0 con 0x7ff804003940 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.373+0000 7ff81d4b1640 1 --2- 172.21.15.26:0/3464953996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff804003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:20.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.373+0000 7ff81d4b1640 1 -- 172.21.15.26:0/3464953996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8040034f0 con 0x7ff804003940 2024-01-17T16:10:20.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.374+0000 7ff81d4b1640 1 --2- 172.21.15.26:0/3464953996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff804003d90 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b7a53c62a7219f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:20.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.374+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff80c009600 con 0x7ff804003940 2024-01-17T16:10:20.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.374+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ff80c00c040 con 0x7ff804003940 2024-01-17T16:10:20.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.374+0000 7ff80bfff640 1 -- 172.21.15.26:0/3464953996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff80c009ca0 con 0x7ff804003940 2024-01-17T16:10:20.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.375+0000 7ff81f715640 1 -- 172.21.15.26:0/3464953996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 msgr2=0x7ff804003d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:20.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.375+0000 7ff81f715640 1 --2- 172.21.15.26:0/3464953996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff804003d90 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:20.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.375+0000 7ff81f715640 1 -- 172.21.15.26:0/3464953996 shutdown_connections 2024-01-17T16:10:20.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.375+0000 7ff81f715640 1 --2- 172.21.15.26:0/3464953996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff804003d90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:20.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.375+0000 7ff81f715640 1 --2- 172.21.15.26:0/3464953996 >> v2:172.21.15.26:3300/0 conn(0x7ff81809d9d0 0x7ff81809c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:20.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.375+0000 7ff81f715640 1 -- 172.21.15.26:0/3464953996 >> 172.21.15.26:0/3464953996 conn(0x7ff8180a2340 msgr2=0x7ff8180a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:20.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.375+0000 7ff81f715640 1 -- 172.21.15.26:0/3464953996 shutdown_connections 2024-01-17T16:10:20.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.375+0000 7ff81f715640 1 -- 172.21.15.26:0/3464953996 wait complete. 2024-01-17T16:10:20.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.376+0000 7ff81f715640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.376 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:20.376+0000 7fa00236af00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.376 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:20.377+0000 7fa00236af00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.377+0000 7ff81f715640 1 Processor -- start 2024-01-17T16:10:20.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.377+0000 7ff81f715640 1 -- start start 2024-01-17T16:10:20.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.377+0000 7ff81f715640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff8181a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:20.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.377+0000 7ff81f715640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8181a75c0 con 0x7ff804003940 2024-01-17T16:10:20.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.377+0000 7ff81d4b1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff8181a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:20.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.377+0000 7ff81d4b1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff8181a35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49336/0 (socket says 172.21.15.26:49336) 2024-01-17T16:10:20.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.377+0000 7ff81d4b1640 1 -- 172.21.15.26:0/2682874133 learned_addr learned my addr 172.21.15.26:0/2682874133 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:20.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.378+0000 7ff81d4b1640 1 -- 172.21.15.26:0/2682874133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8181a59b0 con 0x7ff804003940 2024-01-17T16:10:20.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.378+0000 7ff81d4b1640 1 --2- 172.21.15.26:0/2682874133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff8181a35e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:20.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.378+0000 7ff809ffb640 1 -- 172.21.15.26:0/2682874133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff80c014eb0 con 0x7ff804003940 2024-01-17T16:10:20.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.378+0000 7ff809ffb640 1 -- 172.21.15.26:0/2682874133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ff80c009b70 con 0x7ff804003940 2024-01-17T16:10:20.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.378+0000 7ff809ffb640 1 -- 172.21.15.26:0/2682874133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff80c016430 con 0x7ff804003940 2024-01-17T16:10:20.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.378+0000 7ff81f715640 1 -- 172.21.15.26:0/2682874133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8181a6120 con 0x7ff804003940 2024-01-17T16:10:20.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.378+0000 7ff809ffb640 1 -- 172.21.15.26:0/2682874133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (crc 0 0 0) 0x7ff80c0165e0 con 0x7ff804003940 2024-01-17T16:10:20.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.378+0000 7ff81f715640 1 -- 172.21.15.26:0/2682874133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8181b64e0 con 0x7ff804003940 2024-01-17T16:10:20.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.378+0000 7ff809ffb640 1 -- 172.21.15.26:0/2682874133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (crc 0 0 0) 0x7ff80c01b040 con 0x7ff804003940 2024-01-17T16:10:20.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.379+0000 7ff81f715640 1 -- 172.21.15.26:0/2682874133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8181a7700 con 0x7ff804003940 2024-01-17T16:10:20.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.381+0000 7ff809ffb640 1 -- 172.21.15.26:0/2682874133 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (crc 0 0 0) 0x7ff80c00f040 con 0x7ff804003940 2024-01-17T16:10:20.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.447+0000 7ff81f715640 1 -- 172.21.15.26:0/2682874133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff8181b6670 con 0x7ff804003940 2024-01-17T16:10:20.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.448+0000 7ff809ffb640 1 -- 172.21.15.26:0/2682874133 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (crc 0 0 0) 0x7ff80c016e50 con 0x7ff804003940 2024-01-17T16:10:20.448 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2024-01-17T16:10:20.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.449+0000 7ff81f715640 1 -- 172.21.15.26:0/2682874133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 msgr2=0x7ff8181a35e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:20.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.449+0000 7ff81f715640 1 --2- 172.21.15.26:0/2682874133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff8181a35e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:20.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.449+0000 7ff81f715640 1 -- 172.21.15.26:0/2682874133 shutdown_connections 2024-01-17T16:10:20.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.449+0000 7ff81f715640 1 --2- 172.21.15.26:0/2682874133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff804003940 0x7ff8181a35e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:20.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.449+0000 7ff81f715640 1 -- 172.21.15.26:0/2682874133 >> 172.21.15.26:0/2682874133 conn(0x7ff8180a2340 msgr2=0x7ff8181b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:20.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.449+0000 7ff81f715640 1 -- 172.21.15.26:0/2682874133 shutdown_connections 2024-01-17T16:10:20.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.449+0000 7ff81f715640 1 -- 172.21.15.26:0/2682874133 wait complete. 2024-01-17T16:10:20.459 INFO:tasks.ceph:check_enable_crimson: True 2024-01-17T16:10:20.459 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-01-17T16:10:20.459 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-01-17T16:10:20.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.559+0000 7f1b4b99e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.564+0000 7f1b4b99e640 1 Processor -- start 2024-01-17T16:10:20.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.565+0000 7f1b4b99e640 1 -- start start 2024-01-17T16:10:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.565+0000 7f1b4b99e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b4409a890 0x7f1b44135480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.565+0000 7f1b4b99e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4406db00 con 0x7f1b44099d70 2024-01-17T16:10:20.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.565+0000 7f1b4b99e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4406e7a0 con 0x7f1b4409a890 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.565+0000 7f1b48f39640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b4409a890 0x7f1b44135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.565+0000 7f1b4973a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1b44099d70 0x7f1b4409a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38008/0 (socket says 172.21.15.26:38008) 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.565+0000 7f1b4973a640 1 -- 172.21.15.26:0/1155093213 learned_addr learned my addr 172.21.15.26:0/1155093213 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.566+0000 7f1b48f39640 1 -- 172.21.15.26:0/1155093213 >> v1:172.21.15.26:6789/0 conn(0x7f1b44099d70 legacy=0x7f1b4409a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.566+0000 7f1b48f39640 1 -- 172.21.15.26:0/1155093213 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b440a1b90 con 0x7f1b4409a890 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.566+0000 7f1b3bfff640 1 -- 172.21.15.26:0/1155093213 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394539972 0 0) 0x7f1b4406db00 con 0x7f1b44099d70 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.566+0000 7f1b48f39640 1 --2- 172.21.15.26:0/1155093213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b4409a890 0x7f1b44135480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19c97165896a152 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.566+0000 7f1b3bfff640 1 -- 172.21.15.26:0/1155093213 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f1b34009ce0 con 0x7f1b4409a890 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.566+0000 7f1b3bfff640 1 -- 172.21.15.26:0/1155093213 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f1b34009e40 con 0x7f1b4409a890 2024-01-17T16:10:20.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.566+0000 7f1b3bfff640 1 -- 172.21.15.26:0/1155093213 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f1b3400e360 con 0x7f1b4409a890 2024-01-17T16:10:20.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.567+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1155093213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b4409a890 msgr2=0x7f1b44135480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:20.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.567+0000 7f1b4b99e640 1 --2- 172.21.15.26:0/1155093213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b4409a890 0x7f1b44135480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:20.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.567+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1155093213 shutdown_connections 2024-01-17T16:10:20.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.567+0000 7f1b4b99e640 1 --2- 172.21.15.26:0/1155093213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b4409a890 0x7f1b44135480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.567+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1155093213 >> 172.21.15.26:0/1155093213 conn(0x7f1b440a0ed0 msgr2=0x7f1b440a12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.567+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1155093213 shutdown_connections 2024-01-17T16:10:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.567+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1155093213 wait complete. 2024-01-17T16:10:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.567+0000 7f1b4b99e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.568+0000 7f1b4b99e640 1 Processor -- start 2024-01-17T16:10:20.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.568+0000 7f1b4b99e640 1 -- start start 2024-01-17T16:10:20.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b4b99e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b44099d70 0x7f1b44129f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b4b99e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4412b4d0 con 0x7f1b44099d70 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b4973a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b44099d70 0x7f1b44129f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b4973a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b44099d70 0x7f1b44129f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49362/0 (socket says 172.21.15.26:49362) 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b4973a640 1 -- 172.21.15.26:0/1328338512 learned_addr learned my addr 172.21.15.26:0/1328338512 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b4973a640 1 -- 172.21.15.26:0/1328338512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b44129bf0 con 0x7f1b44099d70 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b4973a640 1 --2- 172.21.15.26:0/1328338512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b44099d70 0x7f1b44129f90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b39ffb640 1 -- 172.21.15.26:0/1328338512 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f1b3c004e70 con 0x7f1b44099d70 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b39ffb640 1 -- 172.21.15.26:0/1328338512 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f1b3c00c870 con 0x7f1b44099d70 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1328338512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4412d030 con 0x7f1b44099d70 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b39ffb640 1 -- 172.21.15.26:0/1328338512 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f1b3c00cb10 con 0x7f1b44099d70 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1328338512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4412bb90 con 0x7f1b44099d70 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.569+0000 7f1b39ffb640 1 -- 172.21.15.26:0/1328338512 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (crc 0 0 0) 0x7f1b3c0074a0 con 0x7f1b44099d70 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.570+0000 7f1b39ffb640 1 -- 172.21.15.26:0/1328338512 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (crc 0 0 0) 0x7f1b3c00ed70 con 0x7f1b44099d70 2024-01-17T16:10:20.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.570+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1328338512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4412d220 con 0x7f1b44099d70 2024-01-17T16:10:20.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.572+0000 7f1b39ffb640 1 -- 172.21.15.26:0/1328338512 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (crc 0 0 0) 0x7f1b3c00ccc0 con 0x7f1b44099d70 2024-01-17T16:10:20.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:20.648+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1328338512 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b44075220 con 0x7f1b44099d70 2024-01-17T16:10:20.647 INFO:tasks.ceph.mon.a.smithi026.stderr:2024-01-17T16:10:20.648+0000 7fc2e51f1640 -1 WARNING: experimental feature 'crimson' is enabled 2024-01-17T16:10:20.647 INFO:tasks.ceph.mon.a.smithi026.stderr:Please be aware that this feature is experimental, untested, 2024-01-17T16:10:20.647 INFO:tasks.ceph.mon.a.smithi026.stderr:unsupported, and may result in data corruption, data loss, 2024-01-17T16:10:20.648 INFO:tasks.ceph.mon.a.smithi026.stderr:and/or irreparable damage to your cluster. Do not use 2024-01-17T16:10:20.648 INFO:tasks.ceph.mon.a.smithi026.stderr:feature with important data. 2024-01-17T16:10:20.648 INFO:tasks.ceph.mon.a.smithi026.stderr: 2024-01-17T16:10:20.814 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:20.815+0000 7fa00236af00 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-17T16:10:20.866 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:20.867+0000 7fa00236af00 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-17T16:10:21.375 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.376+0000 7fa00236af00 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-17T16:10:21.426 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.427+0000 7fa00236af00 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-17T16:10:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:21.449+0000 7f1b39ffb640 1 -- 172.21.15.26:0/1328338512 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) v1 ==== 99+0+0 (crc 0 0 0) 0x7f1b3c00e1c0 con 0x7f1b44099d70 2024-01-17T16:10:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:21.450+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1328338512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b44099d70 msgr2=0x7f1b44129f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:21.450+0000 7f1b4b99e640 1 --2- 172.21.15.26:0/1328338512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b44099d70 0x7f1b44129f90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:21.450+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1328338512 shutdown_connections 2024-01-17T16:10:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:21.450+0000 7f1b4b99e640 1 --2- 172.21.15.26:0/1328338512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b44099d70 0x7f1b44129f90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:21.450+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1328338512 >> 172.21.15.26:0/1328338512 conn(0x7f1b440a0ed0 msgr2=0x7f1b4406fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:21.450+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1328338512 shutdown_connections 2024-01-17T16:10:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:21.450+0000 7f1b4b99e640 1 -- 172.21.15.26:0/1328338512 wait complete. 2024-01-17T16:10:21.464 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-17T16:10:21.464 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:10:21.464 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-17T16:10:21.471 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.472+0000 7fa00236af00 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-17T16:10:21.494 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:10:21.494 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-17T16:10:21.523 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.524+0000 7fa00236af00 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-17T16:10:21.564 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:10:21.564 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-17T16:10:21.564 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.565+0000 7fa00236af00 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-17T16:10:21.591 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T16:10:21.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-17T16:10:21.657 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 962c3041-4072-4f7b-a1a8-01ec8a6a82c7 0 2024-01-17T16:10:21.671 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.672+0000 7fa00236af00 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-17T16:10:21.745 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.746+0000 7fa00236af00 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-17T16:10:21.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.771+0000 7f624135e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:21.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.777+0000 7f624135e640 1 Processor -- start 2024-01-17T16:10:21.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.777+0000 7f624135e640 1 -- start start 2024-01-17T16:10:21.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.777+0000 7f624135e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f623c118af0 0x7f623c11af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:21.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.777+0000 7f624135e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623c11b4e0 con 0x7f623c115cf0 2024-01-17T16:10:21.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.777+0000 7f624135e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c11c680 con 0x7f623c118af0 2024-01-17T16:10:21.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.778+0000 7f6233fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f623c118af0 0x7f623c11af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:21.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.778+0000 7f6233fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f623c118af0 0x7f623c11af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.137:54818/0 (socket says 172.21.15.137:54818) 2024-01-17T16:10:21.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.778+0000 7f6233fff640 1 -- 172.21.15.137:0/2604810324 learned_addr learned my addr 172.21.15.137:0/2604810324 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T16:10:21.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.778+0000 7f623affd640 1 --1- 172.21.15.137:0/2604810324 >> v1:172.21.15.26:6789/0 conn(0x7f623c115cf0 0x7f623c116100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.137:35808/0 (socket says 172.21.15.137:35808) 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.778+0000 7f6233fff640 1 -- 172.21.15.137:0/2604810324 >> v1:172.21.15.26:6789/0 conn(0x7f623c115cf0 legacy=0x7f623c116100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.778+0000 7f6233fff640 1 -- 172.21.15.137:0/2604810324 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c11c7f0 con 0x7f623c118af0 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.778+0000 7f6233fff640 1 --2- 172.21.15.137:0/2604810324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c118af0 0x7f623c11af10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183e91af86a345c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.778+0000 7f623a7fc640 1 -- 172.21.15.137:0/2604810324 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6224009dd0 con 0x7f623c118af0 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.779+0000 7f623a7fc640 1 -- 172.21.15.137:0/2604810324 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f622400e230 con 0x7f623c118af0 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.779+0000 7f623a7fc640 1 -- 172.21.15.137:0/2604810324 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f622400e4d0 con 0x7f623c118af0 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.779+0000 7f624135e640 1 -- 172.21.15.137:0/2604810324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c118af0 msgr2=0x7f623c11af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.779+0000 7f624135e640 1 --2- 172.21.15.137:0/2604810324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c118af0 0x7f623c11af10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.779+0000 7f624135e640 1 -- 172.21.15.137:0/2604810324 shutdown_connections 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.779+0000 7f624135e640 1 --2- 172.21.15.137:0/2604810324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c118af0 0x7f623c11af10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.779+0000 7f624135e640 1 -- 172.21.15.137:0/2604810324 >> 172.21.15.137:0/2604810324 conn(0x7f623c070dc0 msgr2=0x7f623c0711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.779+0000 7f624135e640 1 -- 172.21.15.137:0/2604810324 shutdown_connections 2024-01-17T16:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.779+0000 7f624135e640 1 -- 172.21.15.137:0/2604810324 wait complete. 2024-01-17T16:10:21.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.780+0000 7f624135e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.780+0000 7f624135e640 1 Processor -- start 2024-01-17T16:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.780+0000 7f624135e640 1 -- start start 2024-01-17T16:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.780+0000 7f624135e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c115cf0 0x7f623c1a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.780+0000 7f624135e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c1a50a0 con 0x7f623c115cf0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.781+0000 7f623affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c115cf0 0x7f623c1a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.781+0000 7f623affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c115cf0 0x7f623c1a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.137:54826/0 (socket says 172.21.15.137:54826) 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.781+0000 7f623affd640 1 -- 172.21.15.137:0/3373281861 learned_addr learned my addr 172.21.15.137:0/3373281861 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.781+0000 7f623affd640 1 -- 172.21.15.137:0/3373281861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c1a51e0 con 0x7f623c115cf0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.781+0000 7f623affd640 1 --2- 172.21.15.137:0/3373281861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c115cf0 0x7f623c1a4ad0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.781+0000 7f62337fe640 1 -- 172.21.15.137:0/3373281861 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f622c0071e0 con 0x7f623c115cf0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.781+0000 7f62337fe640 1 -- 172.21.15.137:0/3373281861 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f622c007340 con 0x7f623c115cf0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.781+0000 7f62337fe640 1 -- 172.21.15.137:0/3373281861 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f622c0075e0 con 0x7f623c115cf0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.782+0000 7f624135e640 1 -- 172.21.15.137:0/3373281861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c1a5490 con 0x7f623c115cf0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.782+0000 7f624135e640 1 -- 172.21.15.137:0/3373281861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c1a91d0 con 0x7f623c115cf0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.782+0000 7f62337fe640 1 -- 172.21.15.137:0/3373281861 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (crc 0 0 0) 0x7f622c005b60 con 0x7f623c115cf0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.782+0000 7f62337fe640 1 -- 172.21.15.137:0/3373281861 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 747+0+0 (crc 0 0 0) 0x7f622c00f940 con 0x7f623c115cf0 2024-01-17T16:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.782+0000 7f624135e640 1 -- 172.21.15.137:0/3373281861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c068020 con 0x7f623c115cf0 2024-01-17T16:10:21.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.785+0000 7f62337fe640 1 -- 172.21.15.137:0/3373281861 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (crc 0 0 0) 0x7f622c00fba0 con 0x7f623c115cf0 2024-01-17T16:10:21.793 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.794+0000 7fa00236af00 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-17T16:10:21.846 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.847+0000 7fa00236af00 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-17T16:10:21.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.857+0000 7f624135e640 1 -- 172.21.15.137:0/3373281861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "962c3041-4072-4f7b-a1a8-01ec8a6a82c7", "id": 0} v 0) v1 -- 0x7f623c118bc0 con 0x7f623c115cf0 2024-01-17T16:10:21.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.859+0000 7f62337fe640 1 -- 172.21.15.137:0/3373281861 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "962c3041-4072-4f7b-a1a8-01ec8a6a82c7", "id": 0}]=0 v4) v1 ==== 112+0+2 (crc 0 0 0) 0x7f622c00fe10 con 0x7f623c115cf0 2024-01-17T16:10:21.858 INFO:teuthology.orchestra.run.smithi137.stdout:0 2024-01-17T16:10:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.860+0000 7f624135e640 1 -- 172.21.15.137:0/3373281861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c115cf0 msgr2=0x7f623c1a4ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.860+0000 7f624135e640 1 --2- 172.21.15.137:0/3373281861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c115cf0 0x7f623c1a4ad0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.860+0000 7f624135e640 1 -- 172.21.15.137:0/3373281861 shutdown_connections 2024-01-17T16:10:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.860+0000 7f624135e640 1 --2- 172.21.15.137:0/3373281861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623c115cf0 0x7f623c1a4ad0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.860+0000 7f624135e640 1 -- 172.21.15.137:0/3373281861 >> 172.21.15.137:0/3373281861 conn(0x7f623c070dc0 msgr2=0x7f623c1191c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.860+0000 7f624135e640 1 -- 172.21.15.137:0/3373281861 shutdown_connections 2024-01-17T16:10:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.860+0000 7f624135e640 1 -- 172.21.15.137:0/3373281861 wait complete. 2024-01-17T16:10:21.869 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 6ef04b5d-3b99-4602-a313-1efc0680f12b 1 2024-01-17T16:10:21.896 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:21.898+0000 7fa00236af00 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-17T16:10:21.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.970+0000 7f990f46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:21.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.976+0000 7f990f46d640 1 Processor -- start 2024-01-17T16:10:21.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.976+0000 7f990f46d640 1 -- start start 2024-01-17T16:10:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.976+0000 7f990f46d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f990811ad10 0x7f990811d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.976+0000 7f990f46d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990811d760 con 0x7f9908117f90 2024-01-17T16:10:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.976+0000 7f990f46d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990811e920 con 0x7f990811ad10 2024-01-17T16:10:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.976+0000 7f990ca08640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f990811ad10 0x7f990811d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.977+0000 7f990ca08640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f990811ad10 0x7f990811d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.137:54842/0 (socket says 172.21.15.137:54842) 2024-01-17T16:10:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.977+0000 7f990d209640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9908117f90 0x7f99081183a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.137:35820/0 (socket says 172.21.15.137:35820) 2024-01-17T16:10:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.977+0000 7f990ca08640 1 -- 172.21.15.137:0/4110855552 learned_addr learned my addr 172.21.15.137:0/4110855552 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T16:10:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.977+0000 7f990ca08640 1 -- 172.21.15.137:0/4110855552 >> v1:172.21.15.26:6789/0 conn(0x7f9908117f90 legacy=0x7f99081183a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.977+0000 7f990ca08640 1 -- 172.21.15.137:0/4110855552 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990811ea90 con 0x7f990811ad10 2024-01-17T16:10:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.977+0000 7f990ca08640 1 --2- 172.21.15.137:0/4110855552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f990811ad10 0x7f990811d130 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942af0f24db82120 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.977+0000 7f98fffff640 1 -- 172.21.15.137:0/4110855552 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9904009dd0 con 0x7f990811ad10 2024-01-17T16:10:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.977+0000 7f98fffff640 1 -- 172.21.15.137:0/4110855552 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f990400e230 con 0x7f990811ad10 2024-01-17T16:10:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.977+0000 7f98fffff640 1 -- 172.21.15.137:0/4110855552 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f990400e4d0 con 0x7f990811ad10 2024-01-17T16:10:21.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.978+0000 7f990f46d640 1 -- 172.21.15.137:0/4110855552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f990811ad10 msgr2=0x7f990811d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:21.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.978+0000 7f990f46d640 1 --2- 172.21.15.137:0/4110855552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f990811ad10 0x7f990811d130 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.978+0000 7f990f46d640 1 -- 172.21.15.137:0/4110855552 shutdown_connections 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.978+0000 7f990f46d640 1 --2- 172.21.15.137:0/4110855552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f990811ad10 0x7f990811d130 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.978+0000 7f990f46d640 1 -- 172.21.15.137:0/4110855552 >> 172.21.15.137:0/4110855552 conn(0x7f990810dd30 msgr2=0x7f9908110150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.978+0000 7f990f46d640 1 -- 172.21.15.137:0/4110855552 shutdown_connections 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.978+0000 7f990f46d640 1 -- 172.21.15.137:0/4110855552 wait complete. 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.978+0000 7f990f46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.979+0000 7f990f46d640 1 Processor -- start 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.979+0000 7f990f46d640 1 -- start start 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.979+0000 7f990f46d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9908117f90 0x7f99081a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.979+0000 7f990f46d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99081a7280 con 0x7f9908117f90 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.979+0000 7f990d209640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9908117f90 0x7f99081a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.979+0000 7f990d209640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9908117f90 0x7f99081a6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.137:54856/0 (socket says 172.21.15.137:54856) 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.979+0000 7f990d209640 1 -- 172.21.15.137:0/3386504220 learned_addr learned my addr 172.21.15.137:0/3386504220 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T16:10:21.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.980+0000 7f990d209640 1 -- 172.21.15.137:0/3386504220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99081a73c0 con 0x7f9908117f90 2024-01-17T16:10:21.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.980+0000 7f990d209640 1 --2- 172.21.15.137:0/3386504220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9908117f90 0x7f99081a6cb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:21.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.980+0000 7f98fdffb640 1 -- 172.21.15.137:0/3386504220 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f98f80071e0 con 0x7f9908117f90 2024-01-17T16:10:21.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.980+0000 7f98fdffb640 1 -- 172.21.15.137:0/3386504220 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f98f8007340 con 0x7f9908117f90 2024-01-17T16:10:21.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.980+0000 7f990f46d640 1 -- 172.21.15.137:0/3386504220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99081a7670 con 0x7f9908117f90 2024-01-17T16:10:21.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.980+0000 7f98fdffb640 1 -- 172.21.15.137:0/3386504220 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f98f80075e0 con 0x7f9908117f90 2024-01-17T16:10:21.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.980+0000 7f990f46d640 1 -- 172.21.15.137:0/3386504220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99081ab420 con 0x7f9908117f90 2024-01-17T16:10:21.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.980+0000 7f98fdffb640 1 -- 172.21.15.137:0/3386504220 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (crc 0 0 0) 0x7f98f8005b60 con 0x7f9908117f90 2024-01-17T16:10:21.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.980+0000 7f98fdffb640 1 -- 172.21.15.137:0/3386504220 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 862+0+0 (crc 0 0 0) 0x7f98f800ea70 con 0x7f9908117f90 2024-01-17T16:10:21.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.981+0000 7f990f46d640 1 -- 172.21.15.137:0/3386504220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9908068020 con 0x7f9908117f90 2024-01-17T16:10:21.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:21.984+0000 7f98fdffb640 1 -- 172.21.15.137:0/3386504220 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (crc 0 0 0) 0x7f98f800ec30 con 0x7f9908117f90 2024-01-17T16:10:22.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.055+0000 7f990f46d640 1 -- 172.21.15.137:0/3386504220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6ef04b5d-3b99-4602-a313-1efc0680f12b", "id": 1} v 0) v1 -- 0x7f990811aea0 con 0x7f9908117f90 2024-01-17T16:10:22.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.057+0000 7f98fdffb640 1 -- 172.21.15.137:0/3386504220 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ef04b5d-3b99-4602-a313-1efc0680f12b", "id": 1}]=0 v5) v1 ==== 112+0+2 (crc 0 0 0) 0x7f98f800ee50 con 0x7f9908117f90 2024-01-17T16:10:22.056 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-01-17T16:10:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.057+0000 7f990f46d640 1 -- 172.21.15.137:0/3386504220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9908117f90 msgr2=0x7f99081a6cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.057+0000 7f990f46d640 1 --2- 172.21.15.137:0/3386504220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9908117f90 0x7f99081a6cb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.058+0000 7f990f46d640 1 -- 172.21.15.137:0/3386504220 shutdown_connections 2024-01-17T16:10:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.058+0000 7f990f46d640 1 --2- 172.21.15.137:0/3386504220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9908117f90 0x7f99081a6cb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.058+0000 7f990f46d640 1 -- 172.21.15.137:0/3386504220 >> 172.21.15.137:0/3386504220 conn(0x7f990810dd30 msgr2=0x7f9908110150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.058+0000 7f990f46d640 1 -- 172.21.15.137:0/3386504220 shutdown_connections 2024-01-17T16:10:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.058+0000 7f990f46d640 1 -- 172.21.15.137:0/3386504220 wait complete. 2024-01-17T16:10:22.067 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 411712be-64b5-4d81-8730-9c2a26df76ec 2 2024-01-17T16:10:22.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.209+0000 7f5b9602d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:22.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.215+0000 7f5b9602d640 1 Processor -- start 2024-01-17T16:10:22.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.215+0000 7f5b9602d640 1 -- start start 2024-01-17T16:10:22.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.215+0000 7f5b9602d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b9011ace0 0x7f5b9011d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:22.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.215+0000 7f5b9602d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9011d6d0 con 0x7f5b90117f00 2024-01-17T16:10:22.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.215+0000 7f5b9602d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9011e890 con 0x7f5b9011ace0 2024-01-17T16:10:22.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.215+0000 7f5b8effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b9011ace0 0x7f5b9011d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:22.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.215+0000 7f5b8effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b9011ace0 0x7f5b9011d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.137:54864/0 (socket says 172.21.15.137:54864) 2024-01-17T16:10:22.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.216+0000 7f5b8effd640 1 -- 172.21.15.137:0/1284982750 learned_addr learned my addr 172.21.15.137:0/1284982750 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T16:10:22.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.216+0000 7f5b8f7fe640 1 --1- 172.21.15.137:0/1284982750 >> v1:172.21.15.26:6789/0 conn(0x7f5b90117f00 0x7f5b90118310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.137:35822/0 (socket says 172.21.15.137:35822) 2024-01-17T16:10:22.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.216+0000 7f5b8effd640 1 -- 172.21.15.137:0/1284982750 >> v1:172.21.15.26:6789/0 conn(0x7f5b90117f00 legacy=0x7f5b90118310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.216+0000 7f5b8e7fc640 1 -- 172.21.15.137:0/1284982750 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625544271 0 0) 0x7f5b9011d6d0 con 0x7f5b90117f00 2024-01-17T16:10:22.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.216+0000 7f5b8effd640 1 -- 172.21.15.137:0/1284982750 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9011ea00 con 0x7f5b9011ace0 2024-01-17T16:10:22.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.216+0000 7f5b8effd640 1 --2- 172.21.15.137:0/1284982750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b9011ace0 0x7f5b9011d100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f4c18ed5ce36b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:22.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.216+0000 7f5b8e7fc640 1 -- 172.21.15.137:0/1284982750 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5b84009dd0 con 0x7f5b9011ace0 2024-01-17T16:10:22.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.216+0000 7f5b8e7fc640 1 -- 172.21.15.137:0/1284982750 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5b8400e230 con 0x7f5b9011ace0 2024-01-17T16:10:22.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.216+0000 7f5b8e7fc640 1 -- 172.21.15.137:0/1284982750 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5b8400e4d0 con 0x7f5b9011ace0 2024-01-17T16:10:22.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.217+0000 7f5b9602d640 1 -- 172.21.15.137:0/1284982750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b9011ace0 msgr2=0x7f5b9011d100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.217+0000 7f5b9602d640 1 --2- 172.21.15.137:0/1284982750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b9011ace0 0x7f5b9011d100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.217+0000 7f5b9602d640 1 -- 172.21.15.137:0/1284982750 shutdown_connections 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.217+0000 7f5b9602d640 1 --2- 172.21.15.137:0/1284982750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b9011ace0 0x7f5b9011d100 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.217+0000 7f5b9602d640 1 -- 172.21.15.137:0/1284982750 >> 172.21.15.137:0/1284982750 conn(0x7f5b9010dd30 msgr2=0x7f5b90110150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.217+0000 7f5b9602d640 1 -- 172.21.15.137:0/1284982750 shutdown_connections 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.217+0000 7f5b9602d640 1 -- 172.21.15.137:0/1284982750 wait complete. 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.217+0000 7f5b9602d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.218+0000 7f5b9602d640 1 Processor -- start 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.218+0000 7f5b9602d640 1 -- start start 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.218+0000 7f5b9602d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b90117f00 0x7f5b901a6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.218+0000 7f5b9602d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b901a7150 con 0x7f5b90117f00 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.218+0000 7f5b8f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b90117f00 0x7f5b901a6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.218+0000 7f5b8f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b90117f00 0x7f5b901a6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.137:54876/0 (socket says 172.21.15.137:54876) 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.218+0000 7f5b8f7fe640 1 -- 172.21.15.137:0/1381237148 learned_addr learned my addr 172.21.15.137:0/1381237148 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T16:10:22.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.219+0000 7f5b8f7fe640 1 -- 172.21.15.137:0/1381237148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b901a7290 con 0x7f5b90117f00 2024-01-17T16:10:22.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.219+0000 7f5b8f7fe640 1 --2- 172.21.15.137:0/1381237148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b90117f00 0x7f5b901a6b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:22.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.219+0000 7f5b77fff640 1 -- 172.21.15.137:0/1381237148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5b80004bd0 con 0x7f5b90117f00 2024-01-17T16:10:22.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.219+0000 7f5b77fff640 1 -- 172.21.15.137:0/1381237148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5b80004d30 con 0x7f5b90117f00 2024-01-17T16:10:22.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.219+0000 7f5b9602d640 1 -- 172.21.15.137:0/1381237148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b901a7540 con 0x7f5b90117f00 2024-01-17T16:10:22.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.219+0000 7f5b77fff640 1 -- 172.21.15.137:0/1381237148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5b80007120 con 0x7f5b90117f00 2024-01-17T16:10:22.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.219+0000 7f5b9602d640 1 -- 172.21.15.137:0/1381237148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b901ab280 con 0x7f5b90117f00 2024-01-17T16:10:22.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.219+0000 7f5b77fff640 1 -- 172.21.15.137:0/1381237148 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (crc 0 0 0) 0x7f5b8000c550 con 0x7f5b90117f00 2024-01-17T16:10:22.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.219+0000 7f5b77fff640 1 -- 172.21.15.137:0/1381237148 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 977+0+0 (crc 0 0 0) 0x7f5b8000f230 con 0x7f5b90117f00 2024-01-17T16:10:22.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.220+0000 7f5b9602d640 1 -- 172.21.15.137:0/1381237148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b90068020 con 0x7f5b90117f00 2024-01-17T16:10:22.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.222+0000 7f5b77fff640 1 -- 172.21.15.137:0/1381237148 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (crc 0 0 0) 0x7f5b8000c800 con 0x7f5b90117f00 2024-01-17T16:10:22.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.294+0000 7f5b9602d640 1 -- 172.21.15.137:0/1381237148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "411712be-64b5-4d81-8730-9c2a26df76ec", "id": 2} v 0) v1 -- 0x7f5b9011ace0 con 0x7f5b90117f00 2024-01-17T16:10:22.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.296+0000 7f5b77fff640 1 -- 172.21.15.137:0/1381237148 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "411712be-64b5-4d81-8730-9c2a26df76ec", "id": 2}]=0 v6) v1 ==== 112+0+2 (crc 0 0 0) 0x7f5b8000c9a0 con 0x7f5b90117f00 2024-01-17T16:10:22.295 INFO:teuthology.orchestra.run.smithi137.stdout:2 2024-01-17T16:10:22.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.297+0000 7f5b9602d640 1 -- 172.21.15.137:0/1381237148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b90117f00 msgr2=0x7f5b901a6b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.297+0000 7f5b9602d640 1 --2- 172.21.15.137:0/1381237148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b90117f00 0x7f5b901a6b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.297+0000 7f5b9602d640 1 -- 172.21.15.137:0/1381237148 shutdown_connections 2024-01-17T16:10:22.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.297+0000 7f5b9602d640 1 --2- 172.21.15.137:0/1381237148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b90117f00 0x7f5b901a6b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.297+0000 7f5b9602d640 1 -- 172.21.15.137:0/1381237148 >> 172.21.15.137:0/1381237148 conn(0x7f5b9010dd30 msgr2=0x7f5b9011b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:22.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.297+0000 7f5b9602d640 1 -- 172.21.15.137:0/1381237148 shutdown_connections 2024-01-17T16:10:22.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.297+0000 7f5b9602d640 1 -- 172.21.15.137:0/1381237148 wait complete. 2024-01-17T16:10:22.297 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:22.298+0000 7fa00236af00 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-17T16:10:22.306 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 00b912e3-7d85-49b5-9652-ba999cad12e1 3 2024-01-17T16:10:22.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.408+0000 7f82c7c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:22.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.413+0000 7f82c7c2d640 1 Processor -- start 2024-01-17T16:10:22.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.414+0000 7f82c7c2d640 1 -- start start 2024-01-17T16:10:22.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.414+0000 7f82c7c2d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82c011ad00 0x7f82c011d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:22.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.414+0000 7f82c7c2d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c011d720 con 0x7f82c0117f60 2024-01-17T16:10:22.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.414+0000 7f82c7c2d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c011e8e0 con 0x7f82c011ad00 2024-01-17T16:10:22.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.414+0000 7f82c51c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82c011ad00 0x7f82c011d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:22.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.414+0000 7f82c51c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82c011ad00 0x7f82c011d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.137:54892/0 (socket says 172.21.15.137:54892) 2024-01-17T16:10:22.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.414+0000 7f82c59c9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f82c0117f60 0x7f82c0118370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.137:35826/0 (socket says 172.21.15.137:35826) 2024-01-17T16:10:22.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.414+0000 7f82c51c8640 1 -- 172.21.15.137:0/3213105271 learned_addr learned my addr 172.21.15.137:0/3213105271 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T16:10:22.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.415+0000 7f82c51c8640 1 -- 172.21.15.137:0/3213105271 >> v1:172.21.15.26:6789/0 conn(0x7f82c0117f60 legacy=0x7f82c0118370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.415+0000 7f82c51c8640 1 -- 172.21.15.137:0/3213105271 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c011ea50 con 0x7f82c011ad00 2024-01-17T16:10:22.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.415+0000 7f82c51c8640 1 --2- 172.21.15.137:0/3213105271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c011ad00 0x7f82c011d120 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35916e7ce794a161 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:22.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.415+0000 7f82c49c7640 1 -- 172.21.15.137:0/3213105271 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f82b0009dd0 con 0x7f82c011ad00 2024-01-17T16:10:22.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.415+0000 7f82c49c7640 1 -- 172.21.15.137:0/3213105271 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f82b000e230 con 0x7f82c011ad00 2024-01-17T16:10:22.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.415+0000 7f82c49c7640 1 -- 172.21.15.137:0/3213105271 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f82b000e4d0 con 0x7f82c011ad00 2024-01-17T16:10:22.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.416+0000 7f82c7c2d640 1 -- 172.21.15.137:0/3213105271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c011ad00 msgr2=0x7f82c011d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.416+0000 7f82c7c2d640 1 --2- 172.21.15.137:0/3213105271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c011ad00 0x7f82c011d120 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.416+0000 7f82c7c2d640 1 -- 172.21.15.137:0/3213105271 shutdown_connections 2024-01-17T16:10:22.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.416+0000 7f82c7c2d640 1 --2- 172.21.15.137:0/3213105271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c011ad00 0x7f82c011d120 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.416+0000 7f82c7c2d640 1 -- 172.21.15.137:0/3213105271 >> 172.21.15.137:0/3213105271 conn(0x7f82c010dd30 msgr2=0x7f82c0110150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.416+0000 7f82c7c2d640 1 -- 172.21.15.137:0/3213105271 shutdown_connections 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.416+0000 7f82c7c2d640 1 -- 172.21.15.137:0/3213105271 wait complete. 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.416+0000 7f82c7c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.417+0000 7f82c7c2d640 1 Processor -- start 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.417+0000 7f82c7c2d640 1 -- start start 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.417+0000 7f82c7c2d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c0117f60 0x7f82c01a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.417+0000 7f82c7c2d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c01a7270 con 0x7f82c0117f60 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.417+0000 7f82c59c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c0117f60 0x7f82c01a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.417+0000 7f82c59c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c0117f60 0x7f82c01a6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.137:54898/0 (socket says 172.21.15.137:54898) 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.417+0000 7f82c59c9640 1 -- 172.21.15.137:0/2555083761 learned_addr learned my addr 172.21.15.137:0/2555083761 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.418+0000 7f82c59c9640 1 -- 172.21.15.137:0/2555083761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c01a73b0 con 0x7f82c0117f60 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.418+0000 7f82c59c9640 1 --2- 172.21.15.137:0/2555083761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c0117f60 0x7f82c01a6ca0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.418+0000 7f82b67fc640 1 -- 172.21.15.137:0/2555083761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f82bc0071e0 con 0x7f82c0117f60 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.418+0000 7f82b67fc640 1 -- 172.21.15.137:0/2555083761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f82bc007340 con 0x7f82c0117f60 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.418+0000 7f82c7c2d640 1 -- 172.21.15.137:0/2555083761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c01a7660 con 0x7f82c0117f60 2024-01-17T16:10:22.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.418+0000 7f82b67fc640 1 -- 172.21.15.137:0/2555083761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f82bc0075e0 con 0x7f82c0117f60 2024-01-17T16:10:22.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.418+0000 7f82c7c2d640 1 -- 172.21.15.137:0/2555083761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c01ab410 con 0x7f82c0117f60 2024-01-17T16:10:22.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.418+0000 7f82b67fc640 1 -- 172.21.15.137:0/2555083761 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (crc 0 0 0) 0x7f82bc005b60 con 0x7f82c0117f60 2024-01-17T16:10:22.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.418+0000 7f82b67fc640 1 -- 172.21.15.137:0/2555083761 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1092+0+0 (crc 0 0 0) 0x7f82bc00faf0 con 0x7f82c0117f60 2024-01-17T16:10:22.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.419+0000 7f82c7c2d640 1 -- 172.21.15.137:0/2555083761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c0068020 con 0x7f82c0117f60 2024-01-17T16:10:22.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.421+0000 7f82b67fc640 1 -- 172.21.15.137:0/2555083761 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (crc 0 0 0) 0x7f82bc00fd50 con 0x7f82c0117f60 2024-01-17T16:10:22.432 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:22.433+0000 7fa00236af00 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-17T16:10:22.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.493+0000 7f82c7c2d640 1 -- 172.21.15.137:0/2555083761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00b912e3-7d85-49b5-9652-ba999cad12e1", "id": 3} v 0) v1 -- 0x7f82c01ac0c0 con 0x7f82c0117f60 2024-01-17T16:10:22.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.495+0000 7f82b67fc640 1 -- 172.21.15.137:0/2555083761 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00b912e3-7d85-49b5-9652-ba999cad12e1", "id": 3}]=0 v7) v1 ==== 112+0+2 (crc 0 0 0) 0x7f82bc00f640 con 0x7f82c0117f60 2024-01-17T16:10:22.494 INFO:teuthology.orchestra.run.smithi137.stdout:3 2024-01-17T16:10:22.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.496+0000 7f82c7c2d640 1 -- 172.21.15.137:0/2555083761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c0117f60 msgr2=0x7f82c01a6ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.496+0000 7f82c7c2d640 1 --2- 172.21.15.137:0/2555083761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c0117f60 0x7f82c01a6ca0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.496+0000 7f82c7c2d640 1 -- 172.21.15.137:0/2555083761 shutdown_connections 2024-01-17T16:10:22.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.496+0000 7f82c7c2d640 1 --2- 172.21.15.137:0/2555083761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82c0117f60 0x7f82c01a6ca0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.496+0000 7f82c7c2d640 1 -- 172.21.15.137:0/2555083761 >> 172.21.15.137:0/2555083761 conn(0x7f82c010dd30 msgr2=0x7f82c011b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:22.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.496+0000 7f82c7c2d640 1 -- 172.21.15.137:0/2555083761 shutdown_connections 2024-01-17T16:10:22.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T16:10:22.496+0000 7f82c7c2d640 1 -- 172.21.15.137:0/2555083761 wait complete. 2024-01-17T16:10:22.505 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-01-17T16:10:22.542 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-17T16:10:22.542 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-01-17T16:10:22.561 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:22.562+0000 7fa00236af00 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-17T16:10:22.585 INFO:tasks.ceph.osd.0:Started 2024-01-17T16:10:22.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-01-17T16:10:22.605 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:22.606+0000 7fa00236af00 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-17T16:10:22.620 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-17T16:10:22.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-01-17T16:10:22.662 INFO:tasks.ceph.osd.1:Started 2024-01-17T16:10:22.662 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-01-17T16:10:22.695 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-17T16:10:22.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-01-17T16:10:22.706 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:22.707+0000 7fa00236af00 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-17T16:10:22.708 INFO:tasks.ceph.osd.2:Started 2024-01-17T16:10:22.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-01-17T16:10:22.738 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-17T16:10:22.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-01-17T16:10:22.780 INFO:tasks.ceph.osd.3:Started 2024-01-17T16:10:22.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T16:10:22.811 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:22.812+0000 7fa00236af00 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-17T16:10:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.901+0000 7fd2a6224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.906+0000 7fd2a6224640 1 Processor -- start 2024-01-17T16:10:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.906+0000 7fd2a6224640 1 -- start start 2024-01-17T16:10:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.907+0000 7fd2a6224640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2a0136360 0x7fd2a0138780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.907+0000 7fd2a6224640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a009c740 con 0x7fd2a01300d0 2024-01-17T16:10:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.907+0000 7fd2a6224640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a00a5440 con 0x7fd2a0136360 2024-01-17T16:10:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.907+0000 7fd29effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2a0136360 0x7fd2a0138780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.907+0000 7fd29f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd2a01300d0 0x7fd2a01304e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37744/0 (socket says 172.21.15.26:37744) 2024-01-17T16:10:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.907+0000 7fd29f7fe640 1 -- 172.21.15.26:0/2409767497 learned_addr learned my addr 172.21.15.26:0/2409767497 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.908+0000 7fd29effd640 1 -- 172.21.15.26:0/2409767497 >> v1:172.21.15.26:6789/0 conn(0x7fd2a01300d0 legacy=0x7fd2a01304e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.908+0000 7fd29effd640 1 -- 172.21.15.26:0/2409767497 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a009e350 con 0x7fd2a0136360 2024-01-17T16:10:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.908+0000 7fd29effd640 1 --2- 172.21.15.26:0/2409767497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a0136360 0x7fd2a0138780 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f8a93f187c8166 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.908+0000 7fd29e7fc640 1 -- 172.21.15.26:0/2409767497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd294009ce0 con 0x7fd2a0136360 2024-01-17T16:10:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.908+0000 7fd29e7fc640 1 -- 172.21.15.26:0/2409767497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fd294009e40 con 0x7fd2a0136360 2024-01-17T16:10:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.908+0000 7fd29e7fc640 1 -- 172.21.15.26:0/2409767497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd29400e360 con 0x7fd2a0136360 2024-01-17T16:10:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.909+0000 7fd2a6224640 1 -- 172.21.15.26:0/2409767497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a0136360 msgr2=0x7fd2a0138780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.909+0000 7fd2a6224640 1 --2- 172.21.15.26:0/2409767497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a0136360 0x7fd2a0138780 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.909+0000 7fd2a6224640 1 -- 172.21.15.26:0/2409767497 shutdown_connections 2024-01-17T16:10:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.909+0000 7fd2a6224640 1 --2- 172.21.15.26:0/2409767497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a0136360 0x7fd2a0138780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.909+0000 7fd2a6224640 1 -- 172.21.15.26:0/2409767497 >> 172.21.15.26:0/2409767497 conn(0x7fd2a00a3480 msgr2=0x7fd2a00a3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.909+0000 7fd2a6224640 1 -- 172.21.15.26:0/2409767497 shutdown_connections 2024-01-17T16:10:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.909+0000 7fd2a6224640 1 -- 172.21.15.26:0/2409767497 wait complete. 2024-01-17T16:10:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.909+0000 7fd2a6224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.910+0000 7fd2a6224640 1 Processor -- start 2024-01-17T16:10:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.911+0000 7fd2a6224640 1 -- start start 2024-01-17T16:10:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.911+0000 7fd2a6224640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01300d0 0x7fd2a011e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.911+0000 7fd2a6224640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a011f830 con 0x7fd2a01300d0 2024-01-17T16:10:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.911+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01300d0 0x7fd2a011e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.911+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01300d0 0x7fd2a011e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52130/0 (socket says 172.21.15.26:52130) 2024-01-17T16:10:22.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.911+0000 7fd29f7fe640 1 -- 172.21.15.26:0/1019180981 learned_addr learned my addr 172.21.15.26:0/1019180981 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.912+0000 7fd29f7fe640 1 -- 172.21.15.26:0/1019180981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a011f240 con 0x7fd2a01300d0 2024-01-17T16:10:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.912+0000 7fd29f7fe640 1 --2- 172.21.15.26:0/1019180981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01300d0 0x7fd2a011e9a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.912+0000 7fd287fff640 1 -- 172.21.15.26:0/1019180981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd2900059d0 con 0x7fd2a01300d0 2024-01-17T16:10:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.912+0000 7fd287fff640 1 -- 172.21.15.26:0/1019180981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fd290005b30 con 0x7fd2a01300d0 2024-01-17T16:10:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.912+0000 7fd287fff640 1 -- 172.21.15.26:0/1019180981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd290005dd0 con 0x7fd2a01300d0 2024-01-17T16:10:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.912+0000 7fd2a6224640 1 -- 172.21.15.26:0/1019180981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a011dbb0 con 0x7fd2a01300d0 2024-01-17T16:10:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.912+0000 7fd2a6224640 1 -- 172.21.15.26:0/1019180981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a011e3b0 con 0x7fd2a01300d0 2024-01-17T16:10:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.912+0000 7fd287fff640 1 -- 172.21.15.26:0/1019180981 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (crc 0 0 0) 0x7fd290007430 con 0x7fd2a01300d0 2024-01-17T16:10:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.912+0000 7fd287fff640 1 -- 172.21.15.26:0/1019180981 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7fd2900076e0 con 0x7fd2a01300d0 2024-01-17T16:10:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.913+0000 7fd2a6224640 1 -- 172.21.15.26:0/1019180981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a0075220 con 0x7fd2a01300d0 2024-01-17T16:10:22.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.916+0000 7fd287fff640 1 -- 172.21.15.26:0/1019180981 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (crc 0 0 0) 0x7fd29000c730 con 0x7fd2a01300d0 2024-01-17T16:10:22.975 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:22.976+0000 7fa00236af00 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-17T16:10:22.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.979+0000 7fd2a6224640 1 -- 172.21.15.26:0/1019180981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2a0072b70 con 0x7fd2a01300d0 2024-01-17T16:10:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.980+0000 7fd287fff640 1 -- 172.21.15.26:0/1019180981 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4152 (crc 0 0 0) 0x7fd29000c980 con 0x7fd2a01300d0 2024-01-17T16:10:22.979 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:10:22.979 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":7,"fsid":"d5f7e2df-0606-4200-a4cf-99b4ea90cbfe","created":"2024-01-17T16:10:20.366487+0000","modified":"2024-01-17T16:10:22.495426+0000","last_up_change":"0.000000","last_in_change":"2024-01-17T16:10:22.495426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"962c3041-4072-4f7b-a1a8-01ec8a6a82c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ef04b5d-3b99-4602-a313-1efc0680f12b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"411712be-64b5-4d81-8730-9c2a26df76ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00b912e3-7d85-49b5-9652-ba999cad12e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T16:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.981+0000 7fd2a6224640 1 -- 172.21.15.26:0/1019180981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01300d0 msgr2=0x7fd2a011e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.981+0000 7fd2a6224640 1 --2- 172.21.15.26:0/1019180981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01300d0 0x7fd2a011e9a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.981+0000 7fd2a6224640 1 -- 172.21.15.26:0/1019180981 shutdown_connections 2024-01-17T16:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.981+0000 7fd2a6224640 1 --2- 172.21.15.26:0/1019180981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a01300d0 0x7fd2a011e9a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.981+0000 7fd2a6224640 1 -- 172.21.15.26:0/1019180981 >> 172.21.15.26:0/1019180981 conn(0x7fd2a00a3480 msgr2=0x7fd2a0131f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.981+0000 7fd2a6224640 1 -- 172.21.15.26:0/1019180981 shutdown_connections 2024-01-17T16:10:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:22.981+0000 7fd2a6224640 1 -- 172.21.15.26:0/1019180981 wait complete. 2024-01-17T16:10:22.993 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-17T16:10:22.994 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-17T16:10:23.026 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:23.028+0000 7fa00236af00 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-17T16:10:23.189 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:23.190+0000 7fa00236af00 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-17T16:10:23.397 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-17T16:10:23.496 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.493+0000 7fc27811e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:23.496 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.497+0000 7fc27811e640 1 Processor -- start 2024-01-17T16:10:23.496 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.497+0000 7fc27811e640 1 -- start start 2024-01-17T16:10:23.498 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc27811e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc2700a1490 0x7fc270138b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:23.498 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc27811e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27009ed40 con 0x7fc27009c0e0 2024-01-17T16:10:23.498 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc27811e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27009dc00 con 0x7fc2700a1490 2024-01-17T16:10:23.498 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc2756b9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc2700a1490 0x7fc270138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:23.498 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc275eba640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc27009c0e0 0x7fc2700a0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37752/0 (socket says 172.21.15.26:37752) 2024-01-17T16:10:23.498 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc275eba640 1 -- 172.21.15.26:0/1893248650 learned_addr learned my addr 172.21.15.26:0/1893248650 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:23.498 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc2756b9640 1 -- 172.21.15.26:0/1893248650 >> v1:172.21.15.26:6789/0 conn(0x7fc27009c0e0 legacy=0x7fc2700a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:23.498 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc2756b9640 1 -- 172.21.15.26:0/1893248650 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27009d8b0 con 0x7fc2700a1490 2024-01-17T16:10:23.499 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc2756b9640 1 --2- 172.21.15.26:0/1893248650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2700a1490 0x7fc270138b70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f34c201a4a0efe server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:23.499 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc274eb8640 1 -- 172.21.15.26:0/1893248650 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc260009ce0 con 0x7fc2700a1490 2024-01-17T16:10:23.499 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc274eb8640 1 -- 172.21.15.26:0/1893248650 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc260009e40 con 0x7fc2700a1490 2024-01-17T16:10:23.499 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.498+0000 7fc274eb8640 1 -- 172.21.15.26:0/1893248650 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc26000e360 con 0x7fc2700a1490 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.499+0000 7fc27811e640 1 -- 172.21.15.26:0/1893248650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2700a1490 msgr2=0x7fc270138b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.499+0000 7fc27811e640 1 --2- 172.21.15.26:0/1893248650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2700a1490 0x7fc270138b70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.499+0000 7fc27811e640 1 -- 172.21.15.26:0/1893248650 shutdown_connections 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.499+0000 7fc27811e640 1 --2- 172.21.15.26:0/1893248650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2700a1490 0x7fc270138b70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.499+0000 7fc27811e640 1 -- 172.21.15.26:0/1893248650 >> 172.21.15.26:0/1893248650 conn(0x7fc27006c940 msgr2=0x7fc27006cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.499+0000 7fc27811e640 1 -- 172.21.15.26:0/1893248650 shutdown_connections 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.499+0000 7fc27811e640 1 -- 172.21.15.26:0/1893248650 wait complete. 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.499+0000 7fc27811e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.500+0000 7fc27811e640 1 Processor -- start 2024-01-17T16:10:23.500 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.500+0000 7fc27811e640 1 -- start start 2024-01-17T16:10:23.502 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.501+0000 7fc27811e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc27009c0e0 0x7fc2701a3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:23.502 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.501+0000 7fc27811e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2701a5910 con 0x7fc27009c0e0 2024-01-17T16:10:23.502 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.501+0000 7fc275eba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc27009c0e0 0x7fc2701a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:23.502 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.501+0000 7fc275eba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc27009c0e0 0x7fc2701a3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52160/0 (socket says 172.21.15.26:52160) 2024-01-17T16:10:23.502 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.501+0000 7fc275eba640 1 -- 172.21.15.26:0/4105442691 learned_addr learned my addr 172.21.15.26:0/4105442691 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.501+0000 7fc275eba640 1 -- 172.21.15.26:0/4105442691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2701a5d20 con 0x7fc27009c0e0 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.502+0000 7fc275eba640 1 --2- 172.21.15.26:0/4105442691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc27009c0e0 0x7fc2701a3320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.502+0000 7fc2667fc640 1 -- 172.21.15.26:0/4105442691 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc26c0059d0 con 0x7fc27009c0e0 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.502+0000 7fc2667fc640 1 -- 172.21.15.26:0/4105442691 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc26c005b30 con 0x7fc27009c0e0 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.502+0000 7fc27811e640 1 -- 172.21.15.26:0/4105442691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2701a70c0 con 0x7fc27009c0e0 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.502+0000 7fc2667fc640 1 -- 172.21.15.26:0/4105442691 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc26c005dd0 con 0x7fc27009c0e0 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.502+0000 7fc27811e640 1 -- 172.21.15.26:0/4105442691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2701a73c0 con 0x7fc27009c0e0 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.502+0000 7fc2667fc640 1 -- 172.21.15.26:0/4105442691 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (crc 0 0 0) 0x7fc26c007430 con 0x7fc27009c0e0 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.502+0000 7fc2667fc640 1 -- 172.21.15.26:0/4105442691 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7fc26c00fac0 con 0x7fc27009c0e0 2024-01-17T16:10:23.503 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.503+0000 7fc27811e640 1 -- 172.21.15.26:0/4105442691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc270075220 con 0x7fc27009c0e0 2024-01-17T16:10:23.504 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.505+0000 7fc2667fc640 1 -- 172.21.15.26:0/4105442691 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (crc 0 0 0) 0x7fc26c00fd20 con 0x7fc27009c0e0 2024-01-17T16:10:23.623 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.624+0000 7fc27811e640 1 -- 172.21.15.26:0/4105442691 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2701a6c60 con 0x7fc27009c0e0 2024-01-17T16:10:23.624 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.625+0000 7fc2667fc640 1 -- 172.21.15.26:0/4105442691 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4152 (crc 0 0 0) 0x7fc26c00f5a0 con 0x7fc27009c0e0 2024-01-17T16:10:23.624 INFO:teuthology.misc.health.smithi026.stdout: 2024-01-17T16:10:23.624 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":7,"fsid":"d5f7e2df-0606-4200-a4cf-99b4ea90cbfe","created":"2024-01-17T16:10:20.366487+0000","modified":"2024-01-17T16:10:22.495426+0000","last_up_change":"0.000000","last_in_change":"2024-01-17T16:10:22.495426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"962c3041-4072-4f7b-a1a8-01ec8a6a82c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ef04b5d-3b99-4602-a313-1efc0680f12b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"411712be-64b5-4d81-8730-9c2a26df76ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00b912e3-7d85-49b5-9652-ba999cad12e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T16:10:23.625 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.625+0000 7fc27811e640 1 -- 172.21.15.26:0/4105442691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc27009c0e0 msgr2=0x7fc2701a3320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:23.625 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.625+0000 7fc27811e640 1 --2- 172.21.15.26:0/4105442691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc27009c0e0 0x7fc2701a3320 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:23.625 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.626+0000 7fc27811e640 1 -- 172.21.15.26:0/4105442691 shutdown_connections 2024-01-17T16:10:23.625 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.626+0000 7fc27811e640 1 --2- 172.21.15.26:0/4105442691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc27009c0e0 0x7fc2701a3320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:23.625 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.626+0000 7fc27811e640 1 -- 172.21.15.26:0/4105442691 >> 172.21.15.26:0/4105442691 conn(0x7fc27006c940 msgr2=0x7fc2700a3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:23.625 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.626+0000 7fc27811e640 1 -- 172.21.15.26:0/4105442691 shutdown_connections 2024-01-17T16:10:23.625 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:23.626+0000 7fc27811e640 1 -- 172.21.15.26:0/4105442691 wait complete. 2024-01-17T16:10:23.634 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-01-17T16:10:24.196 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:24.197+0000 7fa00236af00 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-17T16:10:24.647 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:24.648+0000 7fa00236af00 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-17T16:10:24.733 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:24.734+0000 7fa00236af00 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-17T16:10:24.909 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:24.910+0000 7fa00236af00 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-17T16:10:25.930 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:10:25.931+0000 7f9fa1ff0640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-01-17T16:10:30.038 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-17T16:10:30.141 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.139+0000 7f6cfd55e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:30.142 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.143+0000 7f6cfd55e640 1 Processor -- start 2024-01-17T16:10:30.142 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.143+0000 7f6cfd55e640 1 -- start start 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6cfd55e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6cf8132790 0x7f6cf8134bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6cfd55e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf8099e50 con 0x7f6cf8098c40 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6cfd55e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf809a220 con 0x7f6cf8132790 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6ceffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6cf8132790 0x7f6cf8134bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6cf6ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6cf8098c40 0x7f6cf8099050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37766/0 (socket says 172.21.15.26:37766) 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6ceffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6cf8132790 0x7f6cf8134bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52174/0 (socket says 172.21.15.26:52174) 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6cf6ffd640 1 -- 172.21.15.26:0/772665275 learned_addr learned my addr 172.21.15.26:0/772665275 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6ceffff640 1 -- 172.21.15.26:0/772665275 >> v1:172.21.15.26:6789/0 conn(0x7f6cf8098c40 legacy=0x7f6cf8099050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6ceffff640 1 -- 172.21.15.26:0/772665275 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8099ba0 con 0x7f6cf8132790 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6cf67fc640 1 -- 172.21.15.26:0/772665275 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965133676 0 0) 0x7f6cf8099e50 con 0x7f6cf8098c40 2024-01-17T16:10:30.144 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6ceffff640 1 --2- 172.21.15.26:0/772665275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8132790 0x7f6cf8134bb0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a92db31549f1450 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:30.145 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6cf67fc640 1 -- 172.21.15.26:0/772665275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6ce000d450 con 0x7f6cf8132790 2024-01-17T16:10:30.145 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6cf67fc640 1 -- 172.21.15.26:0/772665275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6ce000d5b0 con 0x7f6cf8132790 2024-01-17T16:10:30.145 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.144+0000 7f6cf67fc640 1 -- 172.21.15.26:0/772665275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6ce000d850 con 0x7f6cf8132790 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.145+0000 7f6cfd55e640 1 -- 172.21.15.26:0/772665275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8132790 msgr2=0x7f6cf8134bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.145+0000 7f6cfd55e640 1 --2- 172.21.15.26:0/772665275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8132790 0x7f6cf8134bb0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.145+0000 7f6cfd55e640 1 -- 172.21.15.26:0/772665275 shutdown_connections 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.145+0000 7f6cfd55e640 1 --2- 172.21.15.26:0/772665275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8132790 0x7f6cf8134bb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.145+0000 7f6cfd55e640 1 -- 172.21.15.26:0/772665275 >> 172.21.15.26:0/772665275 conn(0x7f6cf809e1d0 msgr2=0x7f6cf809b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.145+0000 7f6cfd55e640 1 -- 172.21.15.26:0/772665275 shutdown_connections 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.145+0000 7f6cfd55e640 1 -- 172.21.15.26:0/772665275 wait complete. 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.145+0000 7f6cfd55e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.146+0000 7f6cfd55e640 1 Processor -- start 2024-01-17T16:10:30.146 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.146+0000 7f6cfd55e640 1 -- start start 2024-01-17T16:10:30.148 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.147+0000 7f6cfd55e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8098c40 0x7f6cf8070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:30.148 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.147+0000 7f6cfd55e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf81279b0 con 0x7f6cf8098c40 2024-01-17T16:10:30.148 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.147+0000 7f6cf6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8098c40 0x7f6cf8070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:30.148 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.147+0000 7f6cf6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8098c40 0x7f6cf8070bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52190/0 (socket says 172.21.15.26:52190) 2024-01-17T16:10:30.148 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.147+0000 7f6cf6ffd640 1 -- 172.21.15.26:0/1093575404 learned_addr learned my addr 172.21.15.26:0/1093575404 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:30.148 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.147+0000 7f6cf6ffd640 1 -- 172.21.15.26:0/1093575404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8127680 con 0x7f6cf8098c40 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.147+0000 7f6cf6ffd640 1 --2- 172.21.15.26:0/1093575404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8098c40 0x7f6cf8070bd0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.148+0000 7f6cef7fe640 1 -- 172.21.15.26:0/1093575404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6ce8004af0 con 0x7f6cf8098c40 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.148+0000 7f6cef7fe640 1 -- 172.21.15.26:0/1093575404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6ce8004c50 con 0x7f6cf8098c40 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.148+0000 7f6cef7fe640 1 -- 172.21.15.26:0/1093575404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6ce8007120 con 0x7f6cf8098c40 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.148+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf8126090 con 0x7f6cf8098c40 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.148+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf812ccc0 con 0x7f6cf8098c40 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.148+0000 7f6cef7fe640 1 -- 172.21.15.26:0/1093575404 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 44853+0+0 (crc 0 0 0) 0x7f6ce80072d0 con 0x7f6cf8098c40 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.149+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf8075220 con 0x7f6cf8098c40 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.149+0000 7f6cef7fe640 1 --2- 172.21.15.26:0/1093575404 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6cd80379b0 0x7f6cd8039ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.149+0000 7f6cef7fe640 1 -- 172.21.15.26:0/1093575404 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f6ce8046d20 con 0x7f6cf8098c40 2024-01-17T16:10:30.149 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.149+0000 7f6ceffff640 1 --2- 172.21.15.26:0/1093575404 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6cd80379b0 0x7f6cd8039ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:30.150 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.150+0000 7f6ceffff640 1 --2- 172.21.15.26:0/1093575404 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6cd80379b0 0x7f6cd8039ec0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:30.153 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.154+0000 7f6cef7fe640 1 -- 172.21.15.26:0/1093575404 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7f6ce800a940 con 0x7f6cf8098c40 2024-01-17T16:10:30.330 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.331+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cf8067440 con 0x7f6cf8098c40 2024-01-17T16:10:30.331 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.332+0000 7f6cef7fe640 1 -- 172.21.15.26:0/1093575404 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6889 (crc 0 0 0) 0x7f6ce800a530 con 0x7f6cf8098c40 2024-01-17T16:10:30.331 INFO:teuthology.misc.health.smithi026.stdout: 2024-01-17T16:10:30.331 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":12,"fsid":"d5f7e2df-0606-4200-a4cf-99b4ea90cbfe","created":"2024-01-17T16:10:20.366487+0000","modified":"2024-01-17T16:10:29.467912+0000","last_up_change":"2024-01-17T16:10:26.455461+0000","last_in_change":"2024-01-17T16:10:22.495426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T16:10:26.968949+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"962c3041-4072-4f7b-a1a8-01ec8a6a82c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3620705959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":3620705959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":3620705959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3620705959}]},"public_addr":"172.21.15.26:6800/3620705959","cluster_addr":"172.21.15.26:6801/3620705959","heartbeat_back_addr":"172.21.15.26:6805/3620705959","heartbeat_front_addr":"172.21.15.26:6804/3620705959","state":["exists","up"]},{"osd":1,"uuid":"6ef04b5d-3b99-4602-a313-1efc0680f12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6803","nonce":610003912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":610003912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":610003912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":610003912}]},"public_addr":"172.21.15.26:6803/610003912","cluster_addr":"172.21.15.26:6802/610003912","heartbeat_back_addr":"172.21.15.26:6807/610003912","heartbeat_front_addr":"172.21.15.26:6806/610003912","state":["exists","up"]},{"osd":2,"uuid":"411712be-64b5-4d81-8730-9c2a26df76ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":3231779754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3231779754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":3231779754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3231779754}]},"public_addr":"172.21.15.137:6803/3231779754","cluster_addr":"172.21.15.137:6802/3231779754","heartbeat_back_addr":"172.21.15.137:6807/3231779754","heartbeat_front_addr":"172.21.15.137:6806/3231779754","state":["exists","up"]},{"osd":3,"uuid":"00b912e3-7d85-49b5-9652-ba999cad12e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":608198496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":608198496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":608198496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":608198496}]},"public_addr":"172.21.15.137:6805/608198496","cluster_addr":"172.21.15.137:6804/608198496","heartbeat_back_addr":"172.21.15.137:6809/608198496","heartbeat_front_addr":"172.21.15.137:6808/608198496","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T16:10:30.333 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.333+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6cd80379b0 msgr2=0x7f6cd8039ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:30.333 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.333+0000 7f6cfd55e640 1 --2- 172.21.15.26:0/1093575404 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6cd80379b0 0x7f6cd8039ec0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:30.333 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.333+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8098c40 msgr2=0x7f6cf8070bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:30.333 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.333+0000 7f6cfd55e640 1 --2- 172.21.15.26:0/1093575404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8098c40 0x7f6cf8070bd0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:30.333 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.333+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 shutdown_connections 2024-01-17T16:10:30.333 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.333+0000 7f6cfd55e640 1 --2- 172.21.15.26:0/1093575404 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6cd80379b0 0x7f6cd8039ec0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:30.334 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.333+0000 7f6cfd55e640 1 --2- 172.21.15.26:0/1093575404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cf8098c40 0x7f6cf8070bd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:30.334 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.334+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 >> 172.21.15.26:0/1093575404 conn(0x7f6cf809e1d0 msgr2=0x7f6cf8097710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:30.334 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.334+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 shutdown_connections 2024-01-17T16:10:30.334 INFO:teuthology.misc.health.smithi026.stderr:2024-01-17T16:10:30.334+0000 7f6cfd55e640 1 -- 172.21.15.26:0/1093575404 wait complete. 2024-01-17T16:10:30.342 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-01-17T16:10:30.342 INFO:tasks.ceph:Creating RBD pool 2024-01-17T16:10:30.342 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool create rbd 8 2024-01-17T16:10:30.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.443+0000 7f348ed9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:30.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.450+0000 7f348ed9e640 1 Processor -- start 2024-01-17T16:10:30.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.450+0000 7f348ed9e640 1 -- start start 2024-01-17T16:10:30.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.450+0000 7f348ed9e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f348809c170 0x7f34880a0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:30.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.450+0000 7f348ed9e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348809df70 con 0x7f348809d9d0 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.450+0000 7f348ed9e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348809c580 con 0x7f348809c170 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.450+0000 7f3487fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f348809c170 0x7f34880a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.450+0000 7f348cb3a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f348809d9d0 0x7f348809fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37780/0 (socket says 172.21.15.26:37780) 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.450+0000 7f348cb3a640 1 -- 172.21.15.26:0/3133044305 learned_addr learned my addr 172.21.15.26:0/3133044305 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.451+0000 7f3487fff640 1 -- 172.21.15.26:0/3133044305 >> v1:172.21.15.26:6789/0 conn(0x7f348809d9d0 legacy=0x7f348809fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.451+0000 7f34877fe640 1 -- 172.21.15.26:0/3133044305 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810682128 0 0) 0x7f348809df70 con 0x7f348809d9d0 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.451+0000 7f3487fff640 1 -- 172.21.15.26:0/3133044305 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348809d5e0 con 0x7f348809c170 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.451+0000 7f3487fff640 1 --2- 172.21.15.26:0/3133044305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 0x7f34880a0700 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b8e9ee452a0c0c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.451+0000 7f34877fe640 1 -- 172.21.15.26:0/3133044305 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f347c009ce0 con 0x7f348809c170 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.451+0000 7f34877fe640 1 -- 172.21.15.26:0/3133044305 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f347c009e40 con 0x7f348809c170 2024-01-17T16:10:30.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.451+0000 7f34877fe640 1 -- 172.21.15.26:0/3133044305 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f347c00e360 con 0x7f348809c170 2024-01-17T16:10:30.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.452+0000 7f348ed9e640 1 -- 172.21.15.26:0/3133044305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 msgr2=0x7f34880a0700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:30.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.452+0000 7f348ed9e640 1 --2- 172.21.15.26:0/3133044305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 0x7f34880a0700 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:30.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.452+0000 7f348ed9e640 1 -- 172.21.15.26:0/3133044305 shutdown_connections 2024-01-17T16:10:30.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.452+0000 7f348ed9e640 1 --2- 172.21.15.26:0/3133044305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 0x7f34880a0700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:30.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.452+0000 7f348ed9e640 1 -- 172.21.15.26:0/3133044305 >> 172.21.15.26:0/3133044305 conn(0x7f34880a2340 msgr2=0x7f34880a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:30.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.452+0000 7f348ed9e640 1 -- 172.21.15.26:0/3133044305 shutdown_connections 2024-01-17T16:10:30.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.452+0000 7f348ed9e640 1 -- 172.21.15.26:0/3133044305 wait complete. 2024-01-17T16:10:30.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.452+0000 7f348ed9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:30.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.453+0000 7f348ed9e640 1 Processor -- start 2024-01-17T16:10:30.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.453+0000 7f348ed9e640 1 -- start start 2024-01-17T16:10:30.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f348ed9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 0x7f34881ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:30.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f348ed9e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34881c46e0 con 0x7f348809c170 2024-01-17T16:10:30.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f348cb3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 0x7f34881ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:30.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f348cb3a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 0x7f34881ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52196/0 (socket says 172.21.15.26:52196) 2024-01-17T16:10:30.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f348cb3a640 1 -- 172.21.15.26:0/1582925966 learned_addr learned my addr 172.21.15.26:0/1582925966 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:30.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f348cb3a640 1 -- 172.21.15.26:0/1582925966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34881abf50 con 0x7f348809c170 2024-01-17T16:10:30.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f348cb3a640 1 --2- 172.21.15.26:0/1582925966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 0x7f34881ab1a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f34857fa640 1 -- 172.21.15.26:0/1582925966 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f34800070b0 con 0x7f348809c170 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f34857fa640 1 -- 172.21.15.26:0/1582925966 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3480007210 con 0x7f348809c170 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f34857fa640 1 -- 172.21.15.26:0/1582925966 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f34800074b0 con 0x7f348809c170 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34881c4910 con 0x7f348809c170 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.454+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34881aaa30 con 0x7f348809c170 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.455+0000 7f34857fa640 1 -- 172.21.15.26:0/1582925966 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 44853+0+0 (crc 0 0 0) 0x7f3480007660 con 0x7f348809c170 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.455+0000 7f34857fa640 1 --2- 172.21.15.26:0/1582925966 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f34740379b0 0x7f3474039ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.455+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3488075220 con 0x7f348809c170 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.456+0000 7f34857fa640 1 -- 172.21.15.26:0/1582925966 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f34800477c0 con 0x7f348809c170 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.456+0000 7f3487fff640 1 --2- 172.21.15.26:0/1582925966 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f34740379b0 0x7f3474039ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:30.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.456+0000 7f3487fff640 1 --2- 172.21.15.26:0/1582925966 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f34740379b0 0x7f3474039ec0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:30.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.460+0000 7f34857fa640 1 -- 172.21.15.26:0/1582925966 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7f34800092e0 con 0x7f348809c170 2024-01-17T16:10:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:30.636+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f34880a0c10 con 0x7f348809c170 2024-01-17T16:10:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.473+0000 7f34857fa640 1 -- 172.21.15.26:0/1582925966 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (crc 0 0 0) 0x7f34800090b0 con 0x7f348809c170 2024-01-17T16:10:31.473 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'rbd' created 2024-01-17T16:10:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.476+0000 7f34857fa640 1 -- 172.21.15.26:0/1582925966 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f3480007910 con 0x7f348809c170 2024-01-17T16:10:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.476+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f34740379b0 msgr2=0x7f3474039ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.476+0000 7f348ed9e640 1 --2- 172.21.15.26:0/1582925966 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f34740379b0 0x7f3474039ec0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.476+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 msgr2=0x7f34881ab1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.476+0000 7f348ed9e640 1 --2- 172.21.15.26:0/1582925966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 0x7f34881ab1a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.477+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 shutdown_connections 2024-01-17T16:10:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.477+0000 7f348ed9e640 1 --2- 172.21.15.26:0/1582925966 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f34740379b0 0x7f3474039ec0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.477+0000 7f348ed9e640 1 --2- 172.21.15.26:0/1582925966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f348809c170 0x7f34881ab1a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.477+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 >> 172.21.15.26:0/1582925966 conn(0x7f34880a2340 msgr2=0x7f3488099ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:31.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.477+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 shutdown_connections 2024-01-17T16:10:31.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.477+0000 7f348ed9e640 1 -- 172.21.15.26:0/1582925966 wait complete. 2024-01-17T16:10:31.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-01-17T16:10:31.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.605+0000 7f7db9460640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:31.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.614+0000 7f7db9460640 1 Processor -- start 2024-01-17T16:10:31.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.614+0000 7f7db9460640 1 -- start start 2024-01-17T16:10:31.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db9460640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7db4098f20 0x7f7db4099330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:31.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db9460640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db406e260 con 0x7f7db4099870 2024-01-17T16:10:31.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db9460640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db409a450 con 0x7f7db4098f20 2024-01-17T16:10:31.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db2ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7db4098f20 0x7f7db4099330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:31.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7dabfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7db4099870 0x7f7db412f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57534/0 (socket says 172.21.15.26:57534) 2024-01-17T16:10:31.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7dabfff640 1 -- 172.21.15.26:0/2786599052 learned_addr learned my addr 172.21.15.26:0/2786599052 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:31.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db2ffd640 1 -- 172.21.15.26:0/2786599052 >> v1:172.21.15.26:6789/0 conn(0x7f7db4099870 legacy=0x7f7db412f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:31.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db27fc640 1 -- 172.21.15.26:0/2786599052 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884447691 0 0) 0x7f7db406e260 con 0x7f7db4099870 2024-01-17T16:10:31.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db2ffd640 1 -- 172.21.15.26:0/2786599052 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db4099c80 con 0x7f7db4098f20 2024-01-17T16:10:31.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db2ffd640 1 --2- 172.21.15.26:0/2786599052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 0x7f7db4099330 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf05883d0c53ab69 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:31.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db27fc640 1 -- 172.21.15.26:0/2786599052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7da400ac70 con 0x7f7db4098f20 2024-01-17T16:10:31.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db27fc640 1 -- 172.21.15.26:0/2786599052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7da400add0 con 0x7f7db4098f20 2024-01-17T16:10:31.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.615+0000 7f7db27fc640 1 -- 172.21.15.26:0/2786599052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7da400f470 con 0x7f7db4098f20 2024-01-17T16:10:31.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.616+0000 7f7db9460640 1 -- 172.21.15.26:0/2786599052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 msgr2=0x7f7db4099330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:31.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.616+0000 7f7db9460640 1 --2- 172.21.15.26:0/2786599052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 0x7f7db4099330 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:31.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.616+0000 7f7db9460640 1 -- 172.21.15.26:0/2786599052 shutdown_connections 2024-01-17T16:10:31.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.616+0000 7f7db9460640 1 --2- 172.21.15.26:0/2786599052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 0x7f7db4099330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.616+0000 7f7db9460640 1 -- 172.21.15.26:0/2786599052 >> 172.21.15.26:0/2786599052 conn(0x7f7db409f090 msgr2=0x7f7db409f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.616+0000 7f7db9460640 1 -- 172.21.15.26:0/2786599052 shutdown_connections 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.616+0000 7f7db9460640 1 -- 172.21.15.26:0/2786599052 wait complete. 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.617+0000 7f7db9460640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.617+0000 7f7db9460640 1 Processor -- start 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.617+0000 7f7db9460640 1 -- start start 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.618+0000 7f7db9460640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 0x7f7db408b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.618+0000 7f7db9460640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db408cd30 con 0x7f7db4098f20 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.618+0000 7f7db2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 0x7f7db408b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.618+0000 7f7db2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 0x7f7db408b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39302/0 (socket says 172.21.15.26:39302) 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.618+0000 7f7db2ffd640 1 -- 172.21.15.26:0/3873753456 learned_addr learned my addr 172.21.15.26:0/3873753456 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.618+0000 7f7db2ffd640 1 -- 172.21.15.26:0/3873753456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db408ac60 con 0x7f7db4098f20 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.619+0000 7f7db2ffd640 1 --2- 172.21.15.26:0/3873753456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 0x7f7db408b1b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.619+0000 7f7dab7fe640 1 -- 172.21.15.26:0/3873753456 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7da400fda0 con 0x7f7db4098f20 2024-01-17T16:10:31.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.619+0000 7f7dab7fe640 1 -- 172.21.15.26:0/3873753456 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7da4012430 con 0x7f7db4098f20 2024-01-17T16:10:31.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.619+0000 7f7dab7fe640 1 -- 172.21.15.26:0/3873753456 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7da40126d0 con 0x7f7db4098f20 2024-01-17T16:10:31.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.619+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db408a950 con 0x7f7db4098f20 2024-01-17T16:10:31.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.619+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db408dc60 con 0x7f7db4098f20 2024-01-17T16:10:31.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.620+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db4075220 con 0x7f7db4098f20 2024-01-17T16:10:31.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.620+0000 7f7dab7fe640 1 -- 172.21.15.26:0/3873753456 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f7da4012880 con 0x7f7db4098f20 2024-01-17T16:10:31.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.620+0000 7f7dab7fe640 1 --2- 172.21.15.26:0/3873753456 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f7d94037a40 0x7f7d94039f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:31.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.620+0000 7f7dab7fe640 1 -- 172.21.15.26:0/3873753456 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2661+0+0 (crc 0 0 0) 0x7f7da4047e50 con 0x7f7db4098f20 2024-01-17T16:10:31.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.620+0000 7f7dabfff640 1 --2- 172.21.15.26:0/3873753456 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f7d94037a40 0x7f7d94039f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:31.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.621+0000 7f7dabfff640 1 --2- 172.21.15.26:0/3873753456 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f7d94037a40 0x7f7d94039f50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:31.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.625+0000 7f7dab7fe640 1 -- 172.21.15.26:0/3873753456 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7f7da400cad0 con 0x7f7db4098f20 2024-01-17T16:10:31.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:31.805+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7db4097e30 con 0x7f7db4098f20 2024-01-17T16:10:32.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.474+0000 7f7dab7fe640 1 -- 172.21.15.26:0/3873753456 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (crc 0 0 0) 0x7f7da400c6c0 con 0x7f7db4098f20 2024-01-17T16:10:32.474 INFO:teuthology.orchestra.run.smithi026.stderr:enabled application 'rbd' on pool 'rbd' 2024-01-17T16:10:32.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f7d94037a40 msgr2=0x7f7d94039f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:32.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 --2- 172.21.15.26:0/3873753456 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f7d94037a40 0x7f7d94039f50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 msgr2=0x7f7db408b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 --2- 172.21.15.26:0/3873753456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 0x7f7db408b1b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 shutdown_connections 2024-01-17T16:10:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 --2- 172.21.15.26:0/3873753456 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f7d94037a40 0x7f7d94039f50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 --2- 172.21.15.26:0/3873753456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7db4098f20 0x7f7db408b1b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 >> 172.21.15.26:0/3873753456 conn(0x7f7db409f090 msgr2=0x7f7db412a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 shutdown_connections 2024-01-17T16:10:32.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.477+0000 7f7db9460640 1 -- 172.21.15.26:0/3873753456 wait complete. 2024-01-17T16:10:32.491 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-17T16:10:32.491 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-17T16:10:32.491 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-17T16:10:32.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-17T16:10:32.492 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-17T16:10:32.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.622+0000 7fc5e1d9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:32.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.626+0000 7fc5e1d9e640 1 Processor -- start 2024-01-17T16:10:32.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.626+0000 7fc5e1d9e640 1 -- start start 2024-01-17T16:10:32.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.627+0000 7fc5e1d9e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc5dc09b130 0x7fc5dc070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:32.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.627+0000 7fc5e1d9e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc09b5f0 con 0x7fc5dc071500 2024-01-17T16:10:32.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.627+0000 7fc5e1d9e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0681f0 con 0x7fc5dc09b130 2024-01-17T16:10:32.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.627+0000 7fc5db7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc5dc09b130 0x7fc5dc070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:32.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.627+0000 7fc5daffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc5dc071500 0x7fc5dc130e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57544/0 (socket says 172.21.15.26:57544) 2024-01-17T16:10:32.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.627+0000 7fc5daffd640 1 -- 172.21.15.26:0/2476578873 learned_addr learned my addr 172.21.15.26:0/2476578873 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:32.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.627+0000 7fc5db7fe640 1 -- 172.21.15.26:0/2476578873 >> v1:172.21.15.26:6789/0 conn(0x7fc5dc071500 legacy=0x7fc5dc130e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:32.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.627+0000 7fc5da7fc640 1 -- 172.21.15.26:0/2476578873 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150129203 0 0) 0x7fc5dc09b5f0 con 0x7fc5dc071500 2024-01-17T16:10:32.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.627+0000 7fc5db7fe640 1 -- 172.21.15.26:0/2476578873 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc09c040 con 0x7fc5dc09b130 2024-01-17T16:10:32.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5db7fe640 1 --2- 172.21.15.26:0/2476578873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc09b130 0x7fc5dc070fc0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd51949e78a4e0b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:32.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5da7fc640 1 -- 172.21.15.26:0/2476578873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc5cc009ce0 con 0x7fc5dc09b130 2024-01-17T16:10:32.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5da7fc640 1 -- 172.21.15.26:0/2476578873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc5cc009e40 con 0x7fc5dc09b130 2024-01-17T16:10:32.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5da7fc640 1 -- 172.21.15.26:0/2476578873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc5cc00e360 con 0x7fc5dc09b130 2024-01-17T16:10:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/2476578873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc09b130 msgr2=0x7fc5dc070fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5e1d9e640 1 --2- 172.21.15.26:0/2476578873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc09b130 0x7fc5dc070fc0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/2476578873 shutdown_connections 2024-01-17T16:10:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5e1d9e640 1 --2- 172.21.15.26:0/2476578873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc09b130 0x7fc5dc070fc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/2476578873 >> 172.21.15.26:0/2476578873 conn(0x7fc5dc0a0310 msgr2=0x7fc5dc0a0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/2476578873 shutdown_connections 2024-01-17T16:10:32.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.628+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/2476578873 wait complete. 2024-01-17T16:10:32.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.629+0000 7fc5e1d9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:32.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.630+0000 7fc5e1d9e640 1 Processor -- start 2024-01-17T16:10:32.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.630+0000 7fc5e1d9e640 1 -- start start 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.630+0000 7fc5e1d9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc071500 0x7fc5dc1c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.630+0000 7fc5e1d9e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc122280 con 0x7fc5dc071500 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.630+0000 7fc5db7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc071500 0x7fc5dc1c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.630+0000 7fc5db7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc071500 0x7fc5dc1c2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39322/0 (socket says 172.21.15.26:39322) 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.630+0000 7fc5db7fe640 1 -- 172.21.15.26:0/4167186529 learned_addr learned my addr 172.21.15.26:0/4167186529 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.631+0000 7fc5db7fe640 1 -- 172.21.15.26:0/4167186529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc1c20c0 con 0x7fc5dc071500 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.631+0000 7fc5db7fe640 1 --2- 172.21.15.26:0/4167186529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc071500 0x7fc5dc1c2690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.631+0000 7fc5c3fff640 1 -- 172.21.15.26:0/4167186529 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc5cc014620 con 0x7fc5dc071500 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.631+0000 7fc5c3fff640 1 -- 172.21.15.26:0/4167186529 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc5cc014780 con 0x7fc5dc071500 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.631+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc1c22f0 con 0x7fc5dc071500 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.631+0000 7fc5c3fff640 1 -- 172.21.15.26:0/4167186529 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc5cc014a20 con 0x7fc5dc071500 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.631+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc123200 con 0x7fc5dc071500 2024-01-17T16:10:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.632+0000 7fc5c3fff640 1 -- 172.21.15.26:0/4167186529 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7fc5cc014bd0 con 0x7fc5dc071500 2024-01-17T16:10:32.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.632+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc1c24e0 con 0x7fc5dc071500 2024-01-17T16:10:32.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.632+0000 7fc5c3fff640 1 --2- 172.21.15.26:0/4167186529 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc5c8037a90 0x7fc5c8039fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:32.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.632+0000 7fc5c3fff640 1 -- 172.21.15.26:0/4167186529 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fc5cc019040 con 0x7fc5dc071500 2024-01-17T16:10:32.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.633+0000 7fc5daffd640 1 --2- 172.21.15.26:0/4167186529 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc5c8037a90 0x7fc5c8039fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:32.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.633+0000 7fc5daffd640 1 --2- 172.21.15.26:0/4167186529 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc5c8037a90 0x7fc5c8039fa0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.637+0000 7fc5c3fff640 1 -- 172.21.15.26:0/4167186529 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7fc5cc00ee30 con 0x7fc5dc071500 2024-01-17T16:10:32.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.862+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc5dc075220 con 0x7fc5dc071500 2024-01-17T16:10:32.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.864+0000 7fc5c3fff640 1 -- 172.21.15.26:0/4167186529 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86116 (crc 0 0 0) 0x7fc5cc00ea20 con 0x7fc5dc071500 2024-01-17T16:10:32.864 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:10:32.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc5c8037a90 msgr2=0x7fc5c8039fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:32.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 --2- 172.21.15.26:0/4167186529 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc5c8037a90 0x7fc5c8039fa0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc071500 msgr2=0x7fc5dc1c2690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:32.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 --2- 172.21.15.26:0/4167186529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc071500 0x7fc5dc1c2690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 shutdown_connections 2024-01-17T16:10:32.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 --2- 172.21.15.26:0/4167186529 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc5c8037a90 0x7fc5c8039fa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 --2- 172.21.15.26:0/4167186529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5dc071500 0x7fc5dc1c2690 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 >> 172.21.15.26:0/4167186529 conn(0x7fc5dc0a0310 msgr2=0x7fc5dc119b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:32.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 shutdown_connections 2024-01-17T16:10:32.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.866+0000 7fc5e1d9e640 1 -- 172.21.15.26:0/4167186529 wait complete. 2024-01-17T16:10:32.876 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2728392908},{"type":"v1","addr":"172.21.15.137:6801","nonce":2728392908}]},"active_addr":"172.21.15.137:6801/2728392908","active_change":"2024-01-17T16:10:24.924074+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3910241263}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":115070037}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1489727458}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":4004418183}]}]} 2024-01-17T16:10:32.877 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-17T16:10:32.878 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-17T16:10:32.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T16:10:32.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.981+0000 7f662799e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:32.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.985+0000 7f662799e640 1 Processor -- start 2024-01-17T16:10:32.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.985+0000 7f662799e640 1 -- start start 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f662799e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f662009dcc0 0x7f662009e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f662799e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6620068020 con 0x7f66200989e0 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f662799e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662009a5f0 con 0x7f662009dcc0 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f662573a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f662009dcc0 0x7f662009e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f6624f39640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f66200989e0 0x7f6620098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57556/0 (socket says 172.21.15.26:57556) 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f6624f39640 1 -- 172.21.15.26:0/3356469337 learned_addr learned my addr 172.21.15.26:0/3356469337 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f662573a640 1 -- 172.21.15.26:0/3356469337 >> v1:172.21.15.26:6789/0 conn(0x7f66200989e0 legacy=0x7f6620098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f6617fff640 1 -- 172.21.15.26:0/3356469337 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578416509 0 0) 0x7f6620068020 con 0x7f66200989e0 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f662573a640 1 -- 172.21.15.26:0/3356469337 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662009b6c0 con 0x7f662009dcc0 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f662573a640 1 --2- 172.21.15.26:0/3356469337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662009dcc0 0x7f662009e0d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc15ba781ccfd21 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:32.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f6617fff640 1 -- 172.21.15.26:0/3356469337 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f661c009ce0 con 0x7f662009dcc0 2024-01-17T16:10:32.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f6617fff640 1 -- 172.21.15.26:0/3356469337 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f661c009e40 con 0x7f662009dcc0 2024-01-17T16:10:32.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.986+0000 7f6617fff640 1 -- 172.21.15.26:0/3356469337 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f661c00e360 con 0x7f662009dcc0 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.987+0000 7f662799e640 1 -- 172.21.15.26:0/3356469337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662009dcc0 msgr2=0x7f662009e0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.987+0000 7f662799e640 1 --2- 172.21.15.26:0/3356469337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662009dcc0 0x7f662009e0d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.987+0000 7f662799e640 1 -- 172.21.15.26:0/3356469337 shutdown_connections 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.987+0000 7f662799e640 1 --2- 172.21.15.26:0/3356469337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662009dcc0 0x7f662009e0d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.987+0000 7f662799e640 1 -- 172.21.15.26:0/3356469337 >> 172.21.15.26:0/3356469337 conn(0x7f66200a0310 msgr2=0x7f66200a0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.987+0000 7f662799e640 1 -- 172.21.15.26:0/3356469337 shutdown_connections 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.987+0000 7f662799e640 1 -- 172.21.15.26:0/3356469337 wait complete. 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.987+0000 7f662799e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.988+0000 7f662799e640 1 Processor -- start 2024-01-17T16:10:32.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.988+0000 7f662799e640 1 -- start start 2024-01-17T16:10:32.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.989+0000 7f662799e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66200989e0 0x7f66201c1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:32.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.989+0000 7f662799e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662011e200 con 0x7f66200989e0 2024-01-17T16:10:32.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.989+0000 7f662573a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66200989e0 0x7f66201c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:32.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.989+0000 7f662573a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66200989e0 0x7f66201c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39352/0 (socket says 172.21.15.26:39352) 2024-01-17T16:10:32.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.989+0000 7f662573a640 1 -- 172.21.15.26:0/1143314510 learned_addr learned my addr 172.21.15.26:0/1143314510 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:32.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.989+0000 7f662573a640 1 -- 172.21.15.26:0/1143314510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662011eae0 con 0x7f66200989e0 2024-01-17T16:10:32.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.989+0000 7f662573a640 1 --2- 172.21.15.26:0/1143314510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66200989e0 0x7f66201c1880 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:32.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.989+0000 7f6615ffb640 1 -- 172.21.15.26:0/1143314510 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f661c018040 con 0x7f66200989e0 2024-01-17T16:10:32.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.990+0000 7f6615ffb640 1 -- 172.21.15.26:0/1143314510 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f661c00e640 con 0x7f66200989e0 2024-01-17T16:10:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.990+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66201c14e0 con 0x7f66200989e0 2024-01-17T16:10:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.990+0000 7f6615ffb640 1 -- 172.21.15.26:0/1143314510 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f661c00e8e0 con 0x7f66200989e0 2024-01-17T16:10:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.990+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662011f300 con 0x7f66200989e0 2024-01-17T16:10:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.990+0000 7f6615ffb640 1 -- 172.21.15.26:0/1143314510 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f661c01b040 con 0x7f66200989e0 2024-01-17T16:10:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.990+0000 7f6615ffb640 1 --2- 172.21.15.26:0/1143314510 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6604037a40 0x7f6604039f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.991+0000 7f6615ffb640 1 -- 172.21.15.26:0/1143314510 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f661c04a190 con 0x7f66200989e0 2024-01-17T16:10:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.991+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66201c16d0 con 0x7f66200989e0 2024-01-17T16:10:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.991+0000 7f6624f39640 1 --2- 172.21.15.26:0/1143314510 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6604037a40 0x7f6604039f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.991+0000 7f6624f39640 1 --2- 172.21.15.26:0/1143314510 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6604037a40 0x7f6604039f50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:32.996+0000 7f6615ffb640 1 -- 172.21.15.26:0/1143314510 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7f661c0185b0 con 0x7f66200989e0 2024-01-17T16:10:33.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.173+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6620099b80 con 0x7f66200989e0 2024-01-17T16:10:33.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.174+0000 7f6615ffb640 1 -- 172.21.15.26:0/1143314510 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8657 (crc 0 0 0) 0x7f661c012520 con 0x7f66200989e0 2024-01-17T16:10:33.173 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:10:33.173 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":14,"fsid":"d5f7e2df-0606-4200-a4cf-99b4ea90cbfe","created":"2024-01-17T16:10:20.366487+0000","modified":"2024-01-17T16:10:32.474817+0000","last_up_change":"2024-01-17T16:10:26.455461+0000","last_in_change":"2024-01-17T16:10:22.495426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T16:10:26.968949+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-17T16:10:30.655906+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"962c3041-4072-4f7b-a1a8-01ec8a6a82c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3620705959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":3620705959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":3620705959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3620705959}]},"public_addr":"172.21.15.26:6800/3620705959","cluster_addr":"172.21.15.26:6801/3620705959","heartbeat_back_addr":"172.21.15.26:6805/3620705959","heartbeat_front_addr":"172.21.15.26:6804/3620705959","state":["exists","up"]},{"osd":1,"uuid":"6ef04b5d-3b99-4602-a313-1efc0680f12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6803","nonce":610003912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":610003912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":610003912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":610003912}]},"public_addr":"172.21.15.26:6803/610003912","cluster_addr":"172.21.15.26:6802/610003912","heartbeat_back_addr":"172.21.15.26:6807/610003912","heartbeat_front_addr":"172.21.15.26:6806/610003912","state":["exists","up"]},{"osd":2,"uuid":"411712be-64b5-4d81-8730-9c2a26df76ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":3231779754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3231779754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":3231779754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3231779754}]},"public_addr":"172.21.15.137:6803/3231779754","cluster_addr":"172.21.15.137:6802/3231779754","heartbeat_back_addr":"172.21.15.137:6807/3231779754","heartbeat_front_addr":"172.21.15.137:6806/3231779754","state":["exists","up"]},{"osd":3,"uuid":"00b912e3-7d85-49b5-9652-ba999cad12e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":608198496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":608198496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":608198496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":608198496}]},"public_addr":"172.21.15.137:6805/608198496","cluster_addr":"172.21.15.137:6804/608198496","heartbeat_back_addr":"172.21.15.137:6809/608198496","heartbeat_front_addr":"172.21.15.137:6808/608198496","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6604037a40 msgr2=0x7f6604039f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 --2- 172.21.15.26:0/1143314510 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6604037a40 0x7f6604039f50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66200989e0 msgr2=0x7f66201c1880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 --2- 172.21.15.26:0/1143314510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66200989e0 0x7f66201c1880 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 shutdown_connections 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 --2- 172.21.15.26:0/1143314510 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f6604037a40 0x7f6604039f50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 --2- 172.21.15.26:0/1143314510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66200989e0 0x7f66201c1880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 >> 172.21.15.26:0/1143314510 conn(0x7f66200a0310 msgr2=0x7f662006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 shutdown_connections 2024-01-17T16:10:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.176+0000 7f662799e640 1 -- 172.21.15.26:0/1143314510 wait complete. 2024-01-17T16:10:33.185 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-17T16:10:33.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T16:10:33.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.289+0000 7f8f2139e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.293+0000 7f8f2139e640 1 Processor -- start 2024-01-17T16:10:33.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.293+0000 7f8f2139e640 1 -- start start 2024-01-17T16:10:33.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.294+0000 7f8f2139e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f1c09e0d0 0x7f8f1c0990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.294+0000 7f8f2139e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c068020 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.294+0000 7f8f2139e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c09a5f0 con 0x7f8f1c09e0d0 2024-01-17T16:10:33.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.294+0000 7f8f1a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8f1c09e0d0 0x7f8f1c0990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.294+0000 7f8f1affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8f1c09dcc0 0x7f8f1c0989e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57560/0 (socket says 172.21.15.26:57560) 2024-01-17T16:10:33.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.294+0000 7f8f1affd640 1 -- 172.21.15.26:0/537418630 learned_addr learned my addr 172.21.15.26:0/537418630 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:33.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.294+0000 7f8f1a7fc640 1 -- 172.21.15.26:0/537418630 >> v1:172.21.15.26:6789/0 conn(0x7f8f1c09dcc0 legacy=0x7f8f1c0989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.294+0000 7f8f1a7fc640 1 -- 172.21.15.26:0/537418630 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c09e4e0 con 0x7f8f1c09e0d0 2024-01-17T16:10:33.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.294+0000 7f8f1a7fc640 1 --2- 172.21.15.26:0/537418630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09e0d0 0x7f8f1c0990f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18eef8fbfe7d4812 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f19ffb640 1 -- 172.21.15.26:0/537418630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8f04009ce0 con 0x7f8f1c09e0d0 2024-01-17T16:10:33.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f19ffb640 1 -- 172.21.15.26:0/537418630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8f04009e40 con 0x7f8f1c09e0d0 2024-01-17T16:10:33.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f19ffb640 1 -- 172.21.15.26:0/537418630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8f0400e360 con 0x7f8f1c09e0d0 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f2139e640 1 -- 172.21.15.26:0/537418630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09e0d0 msgr2=0x7f8f1c0990f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f2139e640 1 --2- 172.21.15.26:0/537418630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09e0d0 0x7f8f1c0990f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f2139e640 1 -- 172.21.15.26:0/537418630 shutdown_connections 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f2139e640 1 --2- 172.21.15.26:0/537418630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09e0d0 0x7f8f1c0990f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f2139e640 1 -- 172.21.15.26:0/537418630 >> 172.21.15.26:0/537418630 conn(0x7f8f1c0a0310 msgr2=0x7f8f1c0a0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f2139e640 1 -- 172.21.15.26:0/537418630 shutdown_connections 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f2139e640 1 -- 172.21.15.26:0/537418630 wait complete. 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.295+0000 7f8f2139e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.297+0000 7f8f2139e640 1 Processor -- start 2024-01-17T16:10:33.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.297+0000 7f8f2139e640 1 -- start start 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f2139e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09dcc0 0x7f8f1c11e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f2139e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c1308e0 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f1affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09dcc0 0x7f8f1c11e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f1affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09dcc0 0x7f8f1c11e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39366/0 (socket says 172.21.15.26:39366) 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f1affd640 1 -- 172.21.15.26:0/1660860112 learned_addr learned my addr 172.21.15.26:0/1660860112 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f1affd640 1 -- 172.21.15.26:0/1660860112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0718c0 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f1affd640 1 --2- 172.21.15.26:0/1660860112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09dcc0 0x7f8f1c11e920 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f137fe640 1 -- 172.21.15.26:0/1660860112 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8f140059d0 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f137fe640 1 -- 172.21.15.26:0/1660860112 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8f14005b30 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c130b10 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f137fe640 1 -- 172.21.15.26:0/1660860112 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8f14005dd0 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.298+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c1204a0 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.299+0000 7f8f137fe640 1 -- 172.21.15.26:0/1660860112 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f8f140070b0 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.299+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c075220 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.299+0000 7f8f137fe640 1 --2- 172.21.15.26:0/1660860112 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f8efc037a40 0x7f8efc039f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.299+0000 7f8f137fe640 1 -- 172.21.15.26:0/1660860112 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f8f14046e20 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.300+0000 7f8f1a7fc640 1 --2- 172.21.15.26:0/1660860112 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f8efc037a40 0x7f8efc039f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.300+0000 7f8f1a7fc640 1 --2- 172.21.15.26:0/1660860112 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f8efc037a40 0x7f8efc039f50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.304+0000 7f8f137fe640 1 -- 172.21.15.26:0/1660860112 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7f8f1400d330 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.488+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f1c09af90 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.489+0000 7f8f137fe640 1 -- 172.21.15.26:0/1660860112 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8648 (crc 0 0 0) 0x7f8f1400d150 con 0x7f8f1c09dcc0 2024-01-17T16:10:33.488 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:10:33.488 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":15,"fsid":"d5f7e2df-0606-4200-a4cf-99b4ea90cbfe","created":"2024-01-17T16:10:20.366487+0000","modified":"2024-01-17T16:10:33.478584+0000","last_up_change":"2024-01-17T16:10:26.455461+0000","last_in_change":"2024-01-17T16:10:22.495426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T16:10:26.968949+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-17T16:10:30.655906+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"962c3041-4072-4f7b-a1a8-01ec8a6a82c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3620705959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6801","nonce":3620705959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6805","nonce":3620705959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3620705959}]},"public_addr":"172.21.15.26:6800/3620705959","cluster_addr":"172.21.15.26:6801/3620705959","heartbeat_back_addr":"172.21.15.26:6805/3620705959","heartbeat_front_addr":"172.21.15.26:6804/3620705959","state":["exists","up"]},{"osd":1,"uuid":"6ef04b5d-3b99-4602-a313-1efc0680f12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6803","nonce":610003912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":610003912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":610003912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":610003912}]},"public_addr":"172.21.15.26:6803/610003912","cluster_addr":"172.21.15.26:6802/610003912","heartbeat_back_addr":"172.21.15.26:6807/610003912","heartbeat_front_addr":"172.21.15.26:6806/610003912","state":["exists","up"]},{"osd":2,"uuid":"411712be-64b5-4d81-8730-9c2a26df76ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":3231779754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3231779754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":3231779754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3231779754}]},"public_addr":"172.21.15.137:6803/3231779754","cluster_addr":"172.21.15.137:6802/3231779754","heartbeat_back_addr":"172.21.15.137:6807/3231779754","heartbeat_front_addr":"172.21.15.137:6806/3231779754","state":["exists","up"]},{"osd":3,"uuid":"00b912e3-7d85-49b5-9652-ba999cad12e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":608198496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":608198496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6809","nonce":608198496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":608198496}]},"public_addr":"172.21.15.137:6805/608198496","cluster_addr":"172.21.15.137:6804/608198496","heartbeat_back_addr":"172.21.15.137:6809/608198496","heartbeat_front_addr":"172.21.15.137:6808/608198496","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T16:10:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f8efc037a40 msgr2=0x7f8efc039f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 --2- 172.21.15.26:0/1660860112 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f8efc037a40 0x7f8efc039f50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09dcc0 msgr2=0x7f8f1c11e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 --2- 172.21.15.26:0/1660860112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09dcc0 0x7f8f1c11e920 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 shutdown_connections 2024-01-17T16:10:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 --2- 172.21.15.26:0/1660860112 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f8efc037a40 0x7f8efc039f50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 --2- 172.21.15.26:0/1660860112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f1c09dcc0 0x7f8f1c11e920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 >> 172.21.15.26:0/1660860112 conn(0x7f8f1c0a0310 msgr2=0x7f8f1c06fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 shutdown_connections 2024-01-17T16:10:33.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.491+0000 7f8f2139e640 1 -- 172.21.15.26:0/1660860112 wait complete. 2024-01-17T16:10:33.501 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-17T16:10:33.501 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-17T16:10:33.501 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-17T16:10:33.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-17T16:10:33.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.615+0000 7f4d9e06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.615+0000 7f12f5f9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.615+0000 7fb51966d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.615+0000 7fd709f15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.620+0000 7f4d9e06d640 1 Processor -- start 2024-01-17T16:10:33.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.620+0000 7f4d9e06d640 1 -- start start 2024-01-17T16:10:33.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.620+0000 7fb51966d640 1 Processor -- start 2024-01-17T16:10:33.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.620+0000 7fb51966d640 1 -- start start 2024-01-17T16:10:33.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7f12f5f9e640 1 Processor -- start 2024-01-17T16:10:33.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7f12f5f9e640 1 -- start start 2024-01-17T16:10:33.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7fd709f15640 1 Processor -- start 2024-01-17T16:10:33.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7fd709f15640 1 -- start start 2024-01-17T16:10:33.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7f4d9e06d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d98131350 0x7f4d98131760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7f4d9e06d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d98099d00 con 0x7f4d9809eb50 2024-01-17T16:10:33.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7f4d9e06d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d98070050 con 0x7f4d98131350 2024-01-17T16:10:33.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7fb51966d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb51409f660 0x7fb514131560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7fb51966d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51406ee90 con 0x7fb51409f250 2024-01-17T16:10:33.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7fb51966d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51409ecd0 con 0x7fb51409f660 2024-01-17T16:10:33.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7f4d977fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4d98131350 0x7f4d98131760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7f4d96ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4d9809eb50 0x7f4d9809ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57576/0 (socket says 172.21.15.26:57576) 2024-01-17T16:10:33.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7f4d96ffd640 1 -- 172.21.15.26:0/1005672238 learned_addr learned my addr 172.21.15.26:0/1005672238 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:33.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7fb50bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb51409f660 0x7fb514131560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7fb50bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb51409f660 0x7fb514131560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39378/0 (socket says 172.21.15.26:39378) 2024-01-17T16:10:33.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7fb50bfff640 1 -- 172.21.15.26:0/723865572 learned_addr learned my addr 172.21.15.26:0/723865572 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.621+0000 7fb512ffd640 1 --1- 172.21.15.26:0/723865572 >> v1:172.21.15.26:6789/0 conn(0x7fb51409f250 0x7fb514130e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57590/0 (socket says 172.21.15.26:57590) 2024-01-17T16:10:33.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f12f5f9e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f12f0097520 0x7f12f0097930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f12f5f9e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f006d980 con 0x7f12f0098c60 2024-01-17T16:10:33.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f12f5f9e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f0072a50 con 0x7f12f0097520 2024-01-17T16:10:33.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fb50bfff640 1 -- 172.21.15.26:0/723865572 >> v1:172.21.15.26:6789/0 conn(0x7fb51409f250 legacy=0x7fb514130e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fb50bfff640 1 -- 172.21.15.26:0/723865572 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51409bda0 con 0x7fb51409f660 2024-01-17T16:10:33.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f4d967fc640 1 -- 172.21.15.26:0/1005672238 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245913333 0 0) 0x7f4d98099d00 con 0x7f4d9809eb50 2024-01-17T16:10:33.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f4d967fc640 1 -- 172.21.15.26:0/1005672238 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d800034f0 con 0x7f4d9809eb50 2024-01-17T16:10:33.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f4d977fe640 1 -- 172.21.15.26:0/1005672238 >> v1:172.21.15.26:6789/0 conn(0x7f4d9809eb50 legacy=0x7f4d9809ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f4d977fe640 1 -- 172.21.15.26:0/1005672238 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98130e70 con 0x7f4d98131350 2024-01-17T16:10:33.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fb50bfff640 1 --2- 172.21.15.26:0/723865572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f660 0x7fb514131560 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fc9e7bf822abba server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f12eeffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f12f0098c60 0x7f12f0099070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57604/0 (socket says 172.21.15.26:57604) 2024-01-17T16:10:33.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f12eeffd640 1 -- 172.21.15.26:0/2558200988 learned_addr learned my addr 172.21.15.26:0/2558200988 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:33.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fd709f15640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd7040a1360 0x7fd704136430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f12ef7fe640 1 --2- 172.21.15.26:0/2558200988 >> v2:172.21.15.26:3300/0 conn(0x7f12f0097520 0x7f12f0097930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fd709f15640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd704099900 con 0x7fd7040a0840 2024-01-17T16:10:33.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fd709f15640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd704098a50 con 0x7fd7040a1360 2024-01-17T16:10:33.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fd7037fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd7040a0840 0x7fd7040a0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57610/0 (socket says 172.21.15.26:57610) 2024-01-17T16:10:33.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fd7037fe640 1 -- 172.21.15.26:0/671137323 learned_addr learned my addr 172.21.15.26:0/671137323 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fb5127fc640 1 -- 172.21.15.26:0/723865572 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb4fc009dd0 con 0x7fb51409f660 2024-01-17T16:10:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fb5127fc640 1 -- 172.21.15.26:0/723865572 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fb4fc00e230 con 0x7fb51409f660 2024-01-17T16:10:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fb5127fc640 1 -- 172.21.15.26:0/723865572 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb4fc00e4d0 con 0x7fb51409f660 2024-01-17T16:10:33.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7fd702ffd640 1 --2- 172.21.15.26:0/671137323 >> v2:172.21.15.26:3300/0 conn(0x7fd7040a1360 0x7fd704136430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f12ee7fc640 1 -- 172.21.15.26:0/2558200988 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869633513 0 0) 0x7f12f006d980 con 0x7f12f0098c60 2024-01-17T16:10:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f12ee7fc640 1 -- 172.21.15.26:0/2558200988 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d8005700 con 0x7f12f0098c60 2024-01-17T16:10:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.622+0000 7f4d977fe640 1 --2- 172.21.15.26:0/1005672238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d98131350 0x7f4d98131760 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4a49cf05411337 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f12ef7fe640 1 -- 172.21.15.26:0/2558200988 >> v1:172.21.15.26:6789/0 conn(0x7f12f0098c60 legacy=0x7f12f0099070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f12ef7fe640 1 -- 172.21.15.26:0/2558200988 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0097e70 con 0x7f12f0097520 2024-01-17T16:10:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fd7027fc640 1 -- 172.21.15.26:0/671137323 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682386397 0 0) 0x7fd704099900 con 0x7fd7040a0840 2024-01-17T16:10:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fd7027fc640 1 -- 172.21.15.26:0/671137323 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ec0034f0 con 0x7fd7040a0840 2024-01-17T16:10:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f4d967fc640 1 -- 172.21.15.26:0/1005672238 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4d88009ce0 con 0x7f4d98131350 2024-01-17T16:10:33.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fd702ffd640 1 -- 172.21.15.26:0/671137323 >> v1:172.21.15.26:6789/0 conn(0x7fd7040a0840 legacy=0x7fd7040a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f12ef7fe640 1 --2- 172.21.15.26:0/2558200988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 0x7f12f0097930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87504700318bdc57 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fd702ffd640 1 -- 172.21.15.26:0/671137323 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7040995f0 con 0x7fd7040a1360 2024-01-17T16:10:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f4d967fc640 1 -- 172.21.15.26:0/1005672238 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4d88009e40 con 0x7f4d98131350 2024-01-17T16:10:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f4d967fc640 1 -- 172.21.15.26:0/1005672238 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4d8800e360 con 0x7f4d98131350 2024-01-17T16:10:33.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f12ee7fc640 1 -- 172.21.15.26:0/2558200988 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f12e0009ce0 con 0x7f12f0097520 2024-01-17T16:10:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fd702ffd640 1 --2- 172.21.15.26:0/671137323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a1360 0x7fd704136430 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effa1599d75bd4cf server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f12ee7fc640 1 -- 172.21.15.26:0/2558200988 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f12e0009e40 con 0x7f12f0097520 2024-01-17T16:10:33.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7f12ee7fc640 1 -- 172.21.15.26:0/2558200988 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f12e000e360 con 0x7f12f0097520 2024-01-17T16:10:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fd7027fc640 1 -- 172.21.15.26:0/671137323 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd6f8009ce0 con 0x7fd7040a1360 2024-01-17T16:10:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fd7027fc640 1 -- 172.21.15.26:0/671137323 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fd6f8009e40 con 0x7fd7040a1360 2024-01-17T16:10:33.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fd7027fc640 1 -- 172.21.15.26:0/671137323 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd6f800e360 con 0x7fd7040a1360 2024-01-17T16:10:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fb51966d640 1 -- 172.21.15.26:0/723865572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f660 msgr2=0x7fb514131560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.623+0000 7fb51966d640 1 --2- 172.21.15.26:0/723865572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f660 0x7fb514131560 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fb51966d640 1 -- 172.21.15.26:0/723865572 shutdown_connections 2024-01-17T16:10:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fb51966d640 1 --2- 172.21.15.26:0/723865572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f660 0x7fb514131560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fb51966d640 1 -- 172.21.15.26:0/723865572 >> 172.21.15.26:0/723865572 conn(0x7fb514098b80 msgr2=0x7fb514098f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fb51966d640 1 -- 172.21.15.26:0/723865572 shutdown_connections 2024-01-17T16:10:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fb51966d640 1 -- 172.21.15.26:0/723865572 wait complete. 2024-01-17T16:10:33.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fb51966d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f4d9e06d640 1 -- 172.21.15.26:0/1005672238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d98131350 msgr2=0x7f4d98131760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f4d9e06d640 1 --2- 172.21.15.26:0/1005672238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d98131350 0x7f4d98131760 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f12f5f9e640 1 -- 172.21.15.26:0/2558200988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 msgr2=0x7f12f0097930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f12f5f9e640 1 --2- 172.21.15.26:0/2558200988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 0x7f12f0097930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f12f5f9e640 1 -- 172.21.15.26:0/2558200988 shutdown_connections 2024-01-17T16:10:33.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f12f5f9e640 1 --2- 172.21.15.26:0/2558200988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 0x7f12f0097930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f4d9e06d640 1 -- 172.21.15.26:0/1005672238 shutdown_connections 2024-01-17T16:10:33.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f4d9e06d640 1 --2- 172.21.15.26:0/1005672238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d98131350 0x7f4d98131760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f4d9e06d640 1 -- 172.21.15.26:0/1005672238 >> 172.21.15.26:0/1005672238 conn(0x7f4d980989e0 msgr2=0x7f4d98098df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f12f5f9e640 1 -- 172.21.15.26:0/2558200988 >> 172.21.15.26:0/2558200988 conn(0x7f12f00a0ed0 msgr2=0x7f12f00a12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f4d9e06d640 1 -- 172.21.15.26:0/1005672238 shutdown_connections 2024-01-17T16:10:33.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fd709f15640 1 -- 172.21.15.26:0/671137323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a1360 msgr2=0x7fd704136430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fd709f15640 1 --2- 172.21.15.26:0/671137323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a1360 0x7fd704136430 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f12f5f9e640 1 -- 172.21.15.26:0/2558200988 shutdown_connections 2024-01-17T16:10:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f4d9e06d640 1 -- 172.21.15.26:0/1005672238 wait complete. 2024-01-17T16:10:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f12f5f9e640 1 -- 172.21.15.26:0/2558200988 wait complete. 2024-01-17T16:10:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fd709f15640 1 -- 172.21.15.26:0/671137323 shutdown_connections 2024-01-17T16:10:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fd709f15640 1 --2- 172.21.15.26:0/671137323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a1360 0x7fd704136430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fd709f15640 1 -- 172.21.15.26:0/671137323 >> 172.21.15.26:0/671137323 conn(0x7fd70409e5d0 msgr2=0x7fd70409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fd709f15640 1 -- 172.21.15.26:0/671137323 shutdown_connections 2024-01-17T16:10:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7fd709f15640 1 -- 172.21.15.26:0/671137323 wait complete. 2024-01-17T16:10:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f12f5f9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.624+0000 7f4d9e06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.625+0000 7fd709f15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.625+0000 7fb51966d640 1 Processor -- start 2024-01-17T16:10:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.625+0000 7fb51966d640 1 -- start start 2024-01-17T16:10:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.625+0000 7fd709f15640 1 Processor -- start 2024-01-17T16:10:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7fd709f15640 1 -- start start 2024-01-17T16:10:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7f4d9e06d640 1 Processor -- start 2024-01-17T16:10:33.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7f12f5f9e640 1 Processor -- start 2024-01-17T16:10:33.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7fb51966d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f250 0x7fb51411a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7fb51966d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51411d9d0 con 0x7fb51409f250 2024-01-17T16:10:33.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7f4d9e06d640 1 -- start start 2024-01-17T16:10:33.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7fb512ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f250 0x7fb51411a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7fb512ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f250 0x7fb51411a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39408/0 (socket says 172.21.15.26:39408) 2024-01-17T16:10:33.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7f12f5f9e640 1 -- start start 2024-01-17T16:10:33.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7fb512ffd640 1 -- 172.21.15.26:0/3151893476 learned_addr learned my addr 172.21.15.26:0/3151893476 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7fd709f15640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a0840 0x7fd7041c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.626+0000 7fd709f15640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70409b790 con 0x7fd7040a0840 2024-01-17T16:10:33.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fb512ffd640 1 -- 172.21.15.26:0/3151893476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51411c8f0 con 0x7fb51409f250 2024-01-17T16:10:33.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fd7037fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a0840 0x7fd7041c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fb512ffd640 1 --2- 172.21.15.26:0/3151893476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f250 0x7fb51411a370 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fd7037fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a0840 0x7fd7041c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39424/0 (socket says 172.21.15.26:39424) 2024-01-17T16:10:33.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fd7037fe640 1 -- 172.21.15.26:0/3444676685 learned_addr learned my addr 172.21.15.26:0/3444676685 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fb50b7fe640 1 -- 172.21.15.26:0/3151893476 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb5040070b0 con 0x7fb51409f250 2024-01-17T16:10:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fb50b7fe640 1 -- 172.21.15.26:0/3151893476 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fb504007210 con 0x7fb51409f250 2024-01-17T16:10:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fb50b7fe640 1 -- 172.21.15.26:0/3151893476 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb5040074b0 con 0x7fb51409f250 2024-01-17T16:10:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51411e370 con 0x7fb51409f250 2024-01-17T16:10:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fd7037fe640 1 -- 172.21.15.26:0/3444676685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7041c46b0 con 0x7fd7040a0840 2024-01-17T16:10:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51411b6e0 con 0x7fb51409f250 2024-01-17T16:10:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7f4d9e06d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9809eb50 0x7f4d9811a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7f4d9e06d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9806de20 con 0x7f4d9809eb50 2024-01-17T16:10:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f4d977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9809eb50 0x7f4d9811a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fd7037fe640 1 --2- 172.21.15.26:0/3444676685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a0840 0x7fd7041c4cf0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fd6ebfff640 1 -- 172.21.15.26:0/3444676685 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd6f4004bd0 con 0x7fd7040a0840 2024-01-17T16:10:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.627+0000 7fd6ebfff640 1 -- 172.21.15.26:0/3444676685 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fd6f4004d30 con 0x7fd7040a0840 2024-01-17T16:10:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7fd6ebfff640 1 -- 172.21.15.26:0/3444676685 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd6f4007120 con 0x7fd7040a0840 2024-01-17T16:10:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7041c4950 con 0x7fd7040a0840 2024-01-17T16:10:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7041aaab0 con 0x7fd7040a0840 2024-01-17T16:10:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f4d977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9809eb50 0x7f4d9811a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39432/0 (socket says 172.21.15.26:39432) 2024-01-17T16:10:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f4d977fe640 1 -- 172.21.15.26:0/2547921526 learned_addr learned my addr 172.21.15.26:0/2547921526 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f12f5f9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 0x7f12f0127010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f12f5f9e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0128440 con 0x7f12f0097520 2024-01-17T16:10:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 0x7f12f0127010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 0x7f12f0127010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39442/0 (socket says 172.21.15.26:39442) 2024-01-17T16:10:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f12ef7fe640 1 -- 172.21.15.26:0/3099489990 learned_addr learned my addr 172.21.15.26:0/3099489990 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb51409d5d0 con 0x7fb51409f250 2024-01-17T16:10:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f4d977fe640 1 -- 172.21.15.26:0/2547921526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9812e4e0 con 0x7f4d9809eb50 2024-01-17T16:10:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f12ef7fe640 1 -- 172.21.15.26:0/3099489990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0129310 con 0x7f12f0097520 2024-01-17T16:10:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7f4d977fe640 1 --2- 172.21.15.26:0/2547921526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9809eb50 0x7f4d9811a480 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.628+0000 7fb50b7fe640 1 -- 172.21.15.26:0/3151893476 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7fb5040057e0 con 0x7fb51409f250 2024-01-17T16:10:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7041abfc0 con 0x7fd7040a0840 2024-01-17T16:10:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f12ef7fe640 1 --2- 172.21.15.26:0/3099489990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 0x7f12f0127010 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fb50b7fe640 1 --2- 172.21.15.26:0/3151893476 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fb4f4037a90 0x7fb4f4039fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f4d7ffff640 1 -- 172.21.15.26:0/2547921526 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4d88014540 con 0x7f4d9809eb50 2024-01-17T16:10:33.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f4d9e06d640 1 -- 172.21.15.26:0/2547921526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9811c050 con 0x7f4d9809eb50 2024-01-17T16:10:33.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f4d7ffff640 1 -- 172.21.15.26:0/2547921526 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4d880146a0 con 0x7f4d9809eb50 2024-01-17T16:10:33.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fd6ebfff640 1 -- 172.21.15.26:0/3444676685 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7fd6f40072d0 con 0x7fd7040a0840 2024-01-17T16:10:33.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f12d7fff640 1 -- 172.21.15.26:0/3099489990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f12e0014540 con 0x7f12f0097520 2024-01-17T16:10:33.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fb50b7fe640 1 -- 172.21.15.26:0/3151893476 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fb504046e20 con 0x7fb51409f250 2024-01-17T16:10:33.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fb50b7fe640 1 --2- 172.21.15.26:0/3151893476 >> v2:172.21.15.137:6803/3231779754 conn(0x7fb4f403ca30 0x7fb4f403eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fb50b7fe640 1 -- 172.21.15.26:0/3151893476 --> v2:172.21.15.137:6803/3231779754 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4f403f550 con 0x7fb4f403ca30 2024-01-17T16:10:33.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f12d7fff640 1 -- 172.21.15.26:0/3099489990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f12e00146a0 con 0x7f12f0097520 2024-01-17T16:10:33.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f0126c70 con 0x7f12f0097520 2024-01-17T16:10:33.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f12d7fff640 1 -- 172.21.15.26:0/3099489990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f12e0014940 con 0x7f12f0097520 2024-01-17T16:10:33.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fb50b7fe640 1 -- 172.21.15.26:0/3151893476 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7fb50400c7b0 con 0x7fb51409f250 2024-01-17T16:10:33.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f012a500 con 0x7f12f0097520 2024-01-17T16:10:33.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fd6ebfff640 1 --2- 172.21.15.26:0/3444676685 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fd6f0037a40 0x7fd6f0039f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fd6ebfff640 1 -- 172.21.15.26:0/3444676685 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fd6f40470b0 con 0x7fd7040a0840 2024-01-17T16:10:33.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fb50bfff640 1 --2- 172.21.15.26:0/3151893476 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fb4f4037a90 0x7fb4f4039fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fd6ebfff640 1 --2- 172.21.15.26:0/3444676685 >> v2:172.21.15.137:6805/608198496 conn(0x7fd6f003c9e0 0x7fd6f003ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fd6ebfff640 1 -- 172.21.15.26:0/3444676685 --> v2:172.21.15.137:6805/608198496 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6f003f500 con 0x7fd6f003c9e0 2024-01-17T16:10:33.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fd6ebfff640 1 -- 172.21.15.26:0/3444676685 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7fd6f400f230 con 0x7fd7040a0840 2024-01-17T16:10:33.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7f4d7ffff640 1 -- 172.21.15.26:0/2547921526 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4d88014940 con 0x7f4d9809eb50 2024-01-17T16:10:33.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.629+0000 7fd702ffd640 1 --2- 172.21.15.26:0/3444676685 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fd6f0037a40 0x7fd6f0039f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.630+0000 7f4d9e06d640 1 -- 172.21.15.26:0/2547921526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9811cfb0 con 0x7f4d9809eb50 2024-01-17T16:10:33.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.630+0000 7fd703fff640 1 --2- 172.21.15.26:0/3444676685 >> v2:172.21.15.137:6805/608198496 conn(0x7fd6f003c9e0 0x7fd6f003ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-17T16:10:33.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.630+0000 7f4d7ffff640 1 -- 172.21.15.26:0/2547921526 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f4d88011380 con 0x7f4d9809eb50 2024-01-17T16:10:33.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.630+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12f012aa60 con 0x7f12f0097520 2024-01-17T16:10:33.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.630+0000 7fd702ffd640 1 --2- 172.21.15.26:0/3444676685 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fd6f0037a40 0x7fd6f0039f50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.630+0000 7f12d7fff640 1 -- 172.21.15.26:0/3099489990 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f12e0014aa0 con 0x7f12f0097520 2024-01-17T16:10:33.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.630+0000 7f4d7ffff640 1 --2- 172.21.15.26:0/2547921526 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d84037a90 0x7f4d84039fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.630+0000 7fb50bfff640 1 --2- 172.21.15.26:0/3151893476 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fb4f4037a90 0x7fb4f4039fa0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.630+0000 7f4d7ffff640 1 -- 172.21.15.26:0/2547921526 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f4d88019040 con 0x7f4d9809eb50 2024-01-17T16:10:33.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f4d96ffd640 1 --2- 172.21.15.26:0/2547921526 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d84037a90 0x7f4d84039fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f12d7fff640 1 --2- 172.21.15.26:0/3099489990 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f12dc037ac0 0x7f12dc039fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f12d7fff640 1 -- 172.21.15.26:0/3099489990 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f12e0019040 con 0x7f12f0097520 2024-01-17T16:10:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f12eeffd640 1 --2- 172.21.15.26:0/3099489990 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f12dc037ac0 0x7f12dc039fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f12d7fff640 1 --2- 172.21.15.26:0/3099489990 >> v2:172.21.15.26:6800/3620705959 conn(0x7f12dc03ca60 0x7f12dc03eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f4d9e06d640 1 --2- 172.21.15.26:0/2547921526 >> v2:172.21.15.26:6803/610003912 conn(0x7f4d98131350 0x7f4d981b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f12d7fff640 1 -- 172.21.15.26:0/3099489990 --> v2:172.21.15.26:6800/3620705959 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12dc03f580 con 0x7f12dc03ca60 2024-01-17T16:10:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f12d7fff640 1 -- 172.21.15.26:0/3099489990 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7f12e004a5c0 con 0x7f12f0097520 2024-01-17T16:10:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f4d9e06d640 1 -- 172.21.15.26:0/2547921526 --> v2:172.21.15.26:6803/610003912 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d98070850 con 0x7f4d98131350 2024-01-17T16:10:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f4d96ffd640 1 --2- 172.21.15.26:0/2547921526 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d84037a90 0x7f4d84039fa0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f12eeffd640 1 --2- 172.21.15.26:0/3099489990 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f12dc037ac0 0x7f12dc039fd0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.631+0000 7f4d97fff640 1 --2- 172.21.15.26:0/2547921526 >> v2:172.21.15.26:6803/610003912 conn(0x7f4d98131350 0x7f4d981b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-17T16:10:33.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.633+0000 7fd703fff640 1 --2- 172.21.15.26:0/3444676685 >> v2:172.21.15.137:6805/608198496 conn(0x7fd6f003c9e0 0x7fd6f003ee70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.634+0000 7f4d97fff640 1 --2- 172.21.15.26:0/2547921526 >> v2:172.21.15.26:6803/610003912 conn(0x7f4d98131350 0x7f4d981b9720 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.634+0000 7fd6ebfff640 1 -- 172.21.15.26:0/3444676685 <== osd.3 v2:172.21.15.137:6805/608198496 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5172 (crc 0 0 0) 0x7fd6f003f500 con 0x7fd6f003c9e0 2024-01-17T16:10:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.634+0000 7fb5137fe640 1 --2- 172.21.15.26:0/3151893476 >> v2:172.21.15.137:6803/3231779754 conn(0x7fb4f403ca30 0x7fb4f403eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-17T16:10:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.635+0000 7f4d7ffff640 1 -- 172.21.15.26:0/2547921526 <== osd.1 v2:172.21.15.26:6803/610003912 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5172 (crc 0 0 0) 0x7f4d9000a820 con 0x7f4d98131350 2024-01-17T16:10:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.635+0000 7f12effff640 1 --2- 172.21.15.26:0/3099489990 >> v2:172.21.15.26:6800/3620705959 conn(0x7f12dc03ca60 0x7f12dc03eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-17T16:10:33.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.637+0000 7fb5137fe640 1 --2- 172.21.15.26:0/3151893476 >> v2:172.21.15.137:6803/3231779754 conn(0x7fb4f403ca30 0x7fb4f403eec0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.637+0000 7f12effff640 1 --2- 172.21.15.26:0/3099489990 >> v2:172.21.15.26:6800/3620705959 conn(0x7f12dc03ca60 0x7f12dc03eef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.638+0000 7f12d7fff640 1 -- 172.21.15.26:0/3099489990 <== osd.0 v2:172.21.15.26:6800/3620705959 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5172 (crc 0 0 0) 0x7f12dc03f580 con 0x7f12dc03ca60 2024-01-17T16:10:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.638+0000 7fb50b7fe640 1 -- 172.21.15.26:0/3151893476 <== osd.2 v2:172.21.15.137:6803/3231779754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5172 (crc 0 0 0) 0x7fb4f403f550 con 0x7fb4f403ca30 2024-01-17T16:10:33.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.641+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 --> v2:172.21.15.137:6805/608198496 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7040669b0 con 0x7fd6f003c9e0 2024-01-17T16:10:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.641+0000 7f4d9e06d640 1 -- 172.21.15.26:0/2547921526 --> v2:172.21.15.26:6803/610003912 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d98099910 con 0x7f4d98131350 2024-01-17T16:10:33.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd6ebfff640 1 -- 172.21.15.26:0/3444676685 <== osd.3 v2:172.21.15.137:6805/608198496 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6fc00a820 con 0x7fd6f003c9e0 2024-01-17T16:10:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 >> v2:172.21.15.137:6805/608198496 conn(0x7fd6f003c9e0 msgr2=0x7fd6f003ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 --2- 172.21.15.26:0/3444676685 >> v2:172.21.15.137:6805/608198496 conn(0x7fd6f003c9e0 0x7fd6f003ee70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fd6f0037a40 msgr2=0x7fd6f0039f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 --2- 172.21.15.26:0/3444676685 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fd6f0037a40 0x7fd6f0039f50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a0840 msgr2=0x7fd7041c4cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 --2- 172.21.15.26:0/3444676685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a0840 0x7fd7041c4cf0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 shutdown_connections 2024-01-17T16:10:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 --2- 172.21.15.26:0/3444676685 >> v2:172.21.15.137:6805/608198496 conn(0x7fd6f003c9e0 0x7fd6f003ee70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 --2- 172.21.15.26:0/3444676685 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fd6f0037a40 0x7fd6f0039f50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 --2- 172.21.15.26:0/3444676685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7040a0840 0x7fd7041c4cf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 >> 172.21.15.26:0/3444676685 conn(0x7fd70409e5d0 msgr2=0x7fd70419eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7f4d7ffff640 1 -- 172.21.15.26:0/2547921526 <== osd.1 v2:172.21.15.26:6803/610003912 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d9000ad10 con 0x7f4d98131350 2024-01-17T16:10:33.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 shutdown_connections 2024-01-17T16:10:33.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.642+0000 7fd709f15640 1 -- 172.21.15.26:0/3444676685 wait complete. 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 -- 172.21.15.26:0/2547921526 >> v2:172.21.15.26:6803/610003912 conn(0x7f4d98131350 msgr2=0x7f4d981b9720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 --2- 172.21.15.26:0/2547921526 >> v2:172.21.15.26:6803/610003912 conn(0x7f4d98131350 0x7f4d981b9720 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 -- 172.21.15.26:0/2547921526 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d84037a90 msgr2=0x7f4d84039fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 --2- 172.21.15.26:0/2547921526 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d84037a90 0x7f4d84039fa0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 -- 172.21.15.26:0/2547921526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9809eb50 msgr2=0x7f4d9811a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 --2- 172.21.15.26:0/2547921526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9809eb50 0x7f4d9811a480 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 -- 172.21.15.26:0/2547921526 shutdown_connections 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 --2- 172.21.15.26:0/2547921526 >> v2:172.21.15.26:6803/610003912 conn(0x7f4d98131350 0x7f4d981b9720 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 --2- 172.21.15.26:0/2547921526 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d84037a90 0x7f4d84039fa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 --2- 172.21.15.26:0/2547921526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9809eb50 0x7f4d9811a480 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 -- 172.21.15.26:0/2547921526 >> 172.21.15.26:0/2547921526 conn(0x7f4d980989e0 msgr2=0x7f4d981b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 -- 172.21.15.26:0/2547921526 shutdown_connections 2024-01-17T16:10:33.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.643+0000 7f4d7dffb640 1 -- 172.21.15.26:0/2547921526 wait complete. 2024-01-17T16:10:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.646+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 --> v2:172.21.15.137:6803/3231779754 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb51409b9c0 con 0x7fb4f403ca30 2024-01-17T16:10:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.646+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 --> v2:172.21.15.26:6800/3620705959 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f12f00965f0 con 0x7f12dc03ca60 2024-01-17T16:10:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7fb50b7fe640 1 -- 172.21.15.26:0/3151893476 <== osd.2 v2:172.21.15.137:6803/3231779754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb50c00a820 con 0x7fb4f403ca30 2024-01-17T16:10:33.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12d7fff640 1 -- 172.21.15.26:0/3099489990 <== osd.0 v2:172.21.15.26:6800/3620705959 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f12f00965f0 con 0x7f12dc03ca60 2024-01-17T16:10:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 >> v2:172.21.15.26:6800/3620705959 conn(0x7f12dc03ca60 msgr2=0x7f12dc03eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 --2- 172.21.15.26:0/3099489990 >> v2:172.21.15.26:6800/3620705959 conn(0x7f12dc03ca60 0x7f12dc03eef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 >> v2:172.21.15.137:6803/3231779754 conn(0x7fb4f403ca30 msgr2=0x7fb4f403eec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7fb51966d640 1 --2- 172.21.15.26:0/3151893476 >> v2:172.21.15.137:6803/3231779754 conn(0x7fb4f403ca30 0x7fb4f403eec0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f12dc037ac0 msgr2=0x7f12dc039fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 --2- 172.21.15.26:0/3099489990 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f12dc037ac0 0x7f12dc039fd0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fb4f4037a90 msgr2=0x7fb4f4039fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7fb51966d640 1 --2- 172.21.15.26:0/3151893476 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fb4f4037a90 0x7fb4f4039fa0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 msgr2=0x7f12f0127010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 --2- 172.21.15.26:0/3099489990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 0x7f12f0127010 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f250 msgr2=0x7fb51411a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7fb51966d640 1 --2- 172.21.15.26:0/3151893476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f250 0x7fb51411a370 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 shutdown_connections 2024-01-17T16:10:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 --2- 172.21.15.26:0/3099489990 >> v2:172.21.15.26:6800/3620705959 conn(0x7f12dc03ca60 0x7f12dc03eef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 --2- 172.21.15.26:0/3099489990 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f12dc037ac0 0x7f12dc039fd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 --2- 172.21.15.26:0/3099489990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12f0097520 0x7f12f0127010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.647+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 >> 172.21.15.26:0/3099489990 conn(0x7f12f00a0ed0 msgr2=0x7f12f009d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.648+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 shutdown_connections 2024-01-17T16:10:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.648+0000 7f12f5f9e640 1 -- 172.21.15.26:0/3099489990 wait complete. 2024-01-17T16:10:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.648+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 shutdown_connections 2024-01-17T16:10:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.648+0000 7fb51966d640 1 --2- 172.21.15.26:0/3151893476 >> v2:172.21.15.137:6803/3231779754 conn(0x7fb4f403ca30 0x7fb4f403eec0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.648+0000 7fb51966d640 1 --2- 172.21.15.26:0/3151893476 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fb4f4037a90 0x7fb4f4039fa0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.648+0000 7fb51966d640 1 --2- 172.21.15.26:0/3151893476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb51409f250 0x7fb51411a370 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.648+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 >> 172.21.15.26:0/3151893476 conn(0x7fb514098b80 msgr2=0x7fb5141b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.648+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 shutdown_connections 2024-01-17T16:10:33.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.648+0000 7fb51966d640 1 -- 172.21.15.26:0/3151893476 wait complete. 2024-01-17T16:10:33.676 INFO:teuthology.orchestra.run.smithi026.stdout:38654705671 2024-01-17T16:10:33.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-17T16:10:33.677 INFO:teuthology.orchestra.run.smithi026.stdout:38654705671 2024-01-17T16:10:33.678 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-17T16:10:33.678 INFO:teuthology.orchestra.run.smithi026.stdout:38654705671 2024-01-17T16:10:33.679 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-17T16:10:33.679 INFO:teuthology.orchestra.run.smithi026.stdout:38654705671 2024-01-17T16:10:33.680 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-17T16:10:33.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.831+0000 7f2d10464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.831+0000 7f30bf55e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.831+0000 7f54ee613640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.831+0000 7fcd8f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.836+0000 7f30bf55e640 1 Processor -- start 2024-01-17T16:10:33.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.836+0000 7f54ee613640 1 Processor -- start 2024-01-17T16:10:33.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.836+0000 7f54ee613640 1 -- start start 2024-01-17T16:10:33.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.836+0000 7f30bf55e640 1 -- start start 2024-01-17T16:10:33.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.836+0000 7fcd8f02d640 1 Processor -- start 2024-01-17T16:10:33.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.836+0000 7f2d10464640 1 Processor -- start 2024-01-17T16:10:33.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7fcd8f02d640 1 -- start start 2024-01-17T16:10:33.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7f2d10464640 1 -- start start 2024-01-17T16:10:33.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7f30bf55e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30b806fb90 0x7f30b806ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7fcd8f02d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd88097520 0x7fcd88097930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7fcd8f02d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8806d980 con 0x7fcd88098c60 2024-01-17T16:10:33.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7fcd8f02d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd88072a50 con 0x7fcd88097520 2024-01-17T16:10:33.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7f30bf55e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b8071620 con 0x7f30b80704e0 2024-01-17T16:10:33.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7f30bf55e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b806d090 con 0x7f30b806fb90 2024-01-17T16:10:33.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7fcd8cdc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd88097520 0x7fcd88097930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f30bd2fa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30b806fb90 0x7f30b806ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f54ee613640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54e8099d70 0x7f54e809a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7fcd87fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcd88098c60 0x7fcd88099070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57616/0 (socket says 172.21.15.26:57616) 2024-01-17T16:10:33.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7fcd87fff640 1 -- 172.21.15.26:0/1241830551 learned_addr learned my addr 172.21.15.26:0/1241830551 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:33.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.837+0000 7fcd8cdc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd88097520 0x7fcd88097930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39452/0 (socket says 172.21.15.26:39452) 2024-01-17T16:10:33.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f30bd2fa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f30b806fb90 0x7f30b806ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39444/0 (socket says 172.21.15.26:39444) 2024-01-17T16:10:33.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f30bd2fa640 1 -- 172.21.15.26:0/2563210346 learned_addr learned my addr 172.21.15.26:0/2563210346 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f30bcaf9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f30b80704e0 0x7f30b8097040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57614/0 (socket says 172.21.15.26:57614) 2024-01-17T16:10:33.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f54ee613640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e806db00 con 0x7f54e809a6c0 2024-01-17T16:10:33.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f54ee613640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e806e7a0 con 0x7f54e8099d70 2024-01-17T16:10:33.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f54e7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54e8099d70 0x7f54e809a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7fcd877fe640 1 -- 172.21.15.26:0/1241830551 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881775861 0 0) 0x7fcd8806d980 con 0x7fcd88098c60 2024-01-17T16:10:33.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7fcd8cdc9640 1 -- 172.21.15.26:0/1241830551 >> v1:172.21.15.26:6789/0 conn(0x7fcd88098c60 legacy=0x7fcd88099070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7fcd8cdc9640 1 -- 172.21.15.26:0/1241830551 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88097e70 con 0x7fcd88097520 2024-01-17T16:10:33.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f2d10464640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d081340e0 0x7f2d08136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f54e7fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54e8099d70 0x7f54e809a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39462/0 (socket says 172.21.15.26:39462) 2024-01-17T16:10:33.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f54e7fff640 1 -- 172.21.15.26:0/2893001047 learned_addr learned my addr 172.21.15.26:0/2893001047 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f2d10464640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d08099d00 con 0x7f2d08131350 2024-01-17T16:10:33.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f2d10464640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d08070050 con 0x7f2d081340e0 2024-01-17T16:10:33.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f30bd2fa640 1 -- 172.21.15.26:0/2563210346 >> v1:172.21.15.26:6789/0 conn(0x7f30b80704e0 legacy=0x7f30b8097040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f2d0e200640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2d08131350 0x7f2d08131760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57656/0 (socket says 172.21.15.26:57656) 2024-01-17T16:10:33.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f2d0e200640 1 -- 172.21.15.26:0/3461030211 learned_addr learned my addr 172.21.15.26:0/3461030211 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:33.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f2d0d9ff640 1 --2- 172.21.15.26:0/3461030211 >> v2:172.21.15.26:3300/0 conn(0x7f2d081340e0 0x7f2d08136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7fcd8cdc9640 1 --2- 172.21.15.26:0/1241830551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 0x7fcd88097930 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea56434ce1639dc4 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f54e7fff640 1 -- 172.21.15.26:0/2893001047 >> v1:172.21.15.26:6789/0 conn(0x7f54e809a6c0 legacy=0x7f54e8097040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f54e7fff640 1 -- 172.21.15.26:0/2893001047 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e809aad0 con 0x7f54e8099d70 2024-01-17T16:10:33.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f30bd2fa640 1 -- 172.21.15.26:0/2563210346 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b80984e0 con 0x7f30b806fb90 2024-01-17T16:10:33.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699232257 0 0) 0x7f2d08099d00 con 0x7f2d08131350 2024-01-17T16:10:33.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7fcd877fe640 1 -- 172.21.15.26:0/1241830551 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcd7c00d450 con 0x7fcd88097520 2024-01-17T16:10:33.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f54e7fff640 1 --2- 172.21.15.26:0/2893001047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 0x7f54e809a180 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a663d50f2ee4fb33 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.838+0000 7f30bd2fa640 1 --2- 172.21.15.26:0/2563210346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 0x7f30b806ffa0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6408157b0d55d568 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf40034f0 con 0x7f2d08131350 2024-01-17T16:10:33.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7fcd877fe640 1 -- 172.21.15.26:0/1241830551 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fcd7c00d5b0 con 0x7fcd88097520 2024-01-17T16:10:33.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f30affff640 1 -- 172.21.15.26:0/2563210346 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f30b4009dd0 con 0x7f30b806fb90 2024-01-17T16:10:33.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f54e6ffd640 1 -- 172.21.15.26:0/2893001047 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f54d8009dd0 con 0x7f54e8099d70 2024-01-17T16:10:33.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f30affff640 1 -- 172.21.15.26:0/2563210346 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f30b400e230 con 0x7f30b806fb90 2024-01-17T16:10:33.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f30affff640 1 -- 172.21.15.26:0/2563210346 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f30b400e4d0 con 0x7f30b806fb90 2024-01-17T16:10:33.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2734007654 0 0) 0x7f2cf40034f0 con 0x7f2d08131350 2024-01-17T16:10:33.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 >> v2:172.21.15.26:3300/0 conn(0x7f2d081340e0 msgr2=0x7f2d08136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T16:10:33.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0d1fe640 1 --2- 172.21.15.26:0/3461030211 >> v2:172.21.15.26:3300/0 conn(0x7f2d081340e0 0x7f2d08136500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08130e70 con 0x7f2d08131350 2024-01-17T16:10:33.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 1013270433 0 0) 0x7f2d040015a0 con 0x7f2d08131350 2024-01-17T16:10:33.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 >> v1:172.21.15.26:6789/0 conn(0x7f2d08131350 legacy=0x7f2d08131760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f54e6ffd640 1 -- 172.21.15.26:0/2893001047 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f54d800e230 con 0x7f54e8099d70 2024-01-17T16:10:33.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0d1fe640 1 --2- 172.21.15.26:0/3461030211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2cf4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f54e6ffd640 1 -- 172.21.15.26:0/2893001047 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f54d800e4d0 con 0x7f54e8099d70 2024-01-17T16:10:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4004460 con 0x7f2cf40039b0 2024-01-17T16:10:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0e200640 1 --2- 172.21.15.26:0/3461030211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2cf4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7fcd877fe640 1 -- 172.21.15.26:0/1241830551 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcd7c00d850 con 0x7fcd88097520 2024-01-17T16:10:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.839+0000 7f2d0e200640 1 -- 172.21.15.26:0/3461030211 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08099d00 con 0x7f2cf40039b0 2024-01-17T16:10:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f2d0e200640 1 --2- 172.21.15.26:0/3461030211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2cf4003e40 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9593ceabe31cab server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2d04007c10 con 0x7f2cf40039b0 2024-01-17T16:10:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f2d040049a0 con 0x7f2cf40039b0 2024-01-17T16:10:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f2d0d1fe640 1 -- 172.21.15.26:0/3461030211 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2d04004c40 con 0x7f2cf40039b0 2024-01-17T16:10:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f54ee613640 1 -- 172.21.15.26:0/2893001047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 msgr2=0x7f54e809a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f54ee613640 1 --2- 172.21.15.26:0/2893001047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 0x7f54e809a180 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f30bf55e640 1 -- 172.21.15.26:0/2563210346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 msgr2=0x7f30b806ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f54ee613640 1 -- 172.21.15.26:0/2893001047 shutdown_connections 2024-01-17T16:10:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f30bf55e640 1 --2- 172.21.15.26:0/2563210346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 0x7f30b806ffa0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f54ee613640 1 --2- 172.21.15.26:0/2893001047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 0x7f54e809a180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f30bf55e640 1 -- 172.21.15.26:0/2563210346 shutdown_connections 2024-01-17T16:10:33.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7fcd8f02d640 1 -- 172.21.15.26:0/1241830551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 msgr2=0x7fcd88097930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f54ee613640 1 -- 172.21.15.26:0/2893001047 >> 172.21.15.26:0/2893001047 conn(0x7f54e80a0ed0 msgr2=0x7f54e80a12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f54ee613640 1 -- 172.21.15.26:0/2893001047 shutdown_connections 2024-01-17T16:10:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f30bf55e640 1 --2- 172.21.15.26:0/2563210346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 0x7f30b806ffa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7fcd8f02d640 1 --2- 172.21.15.26:0/1241830551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 0x7fcd88097930 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f54ee613640 1 -- 172.21.15.26:0/2893001047 wait complete. 2024-01-17T16:10:33.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f30bf55e640 1 -- 172.21.15.26:0/2563210346 >> 172.21.15.26:0/2563210346 conn(0x7f30b80a0ed0 msgr2=0x7f30b80a12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7fcd8f02d640 1 -- 172.21.15.26:0/1241830551 shutdown_connections 2024-01-17T16:10:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7fcd8f02d640 1 --2- 172.21.15.26:0/1241830551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 0x7fcd88097930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7fcd8f02d640 1 -- 172.21.15.26:0/1241830551 >> 172.21.15.26:0/1241830551 conn(0x7fcd880a0ed0 msgr2=0x7fcd880a12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f30bf55e640 1 -- 172.21.15.26:0/2563210346 shutdown_connections 2024-01-17T16:10:33.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7fcd8f02d640 1 -- 172.21.15.26:0/1241830551 shutdown_connections 2024-01-17T16:10:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f54ee613640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.840+0000 7f30bf55e640 1 -- 172.21.15.26:0/2563210346 wait complete. 2024-01-17T16:10:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7fcd8f02d640 1 -- 172.21.15.26:0/1241830551 wait complete. 2024-01-17T16:10:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f2d10464640 1 -- 172.21.15.26:0/3461030211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 msgr2=0x7f2cf4003e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f2d10464640 1 --2- 172.21.15.26:0/3461030211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2cf4003e40 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f30bf55e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7fcd8f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f2d10464640 1 -- 172.21.15.26:0/3461030211 shutdown_connections 2024-01-17T16:10:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f2d10464640 1 --2- 172.21.15.26:0/3461030211 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2cf4003e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f2d10464640 1 --2- 172.21.15.26:0/3461030211 >> v2:172.21.15.26:3300/0 conn(0x7f2d081340e0 0x7f2d08136500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f2d10464640 1 -- 172.21.15.26:0/3461030211 >> 172.21.15.26:0/3461030211 conn(0x7f2d080989e0 msgr2=0x7f2d08098df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f2d10464640 1 -- 172.21.15.26:0/3461030211 shutdown_connections 2024-01-17T16:10:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f2d10464640 1 -- 172.21.15.26:0/3461030211 wait complete. 2024-01-17T16:10:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.841+0000 7f2d10464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.842+0000 7f30bf55e640 1 Processor -- start 2024-01-17T16:10:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.842+0000 7fcd8f02d640 1 Processor -- start 2024-01-17T16:10:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.842+0000 7f54ee613640 1 Processor -- start 2024-01-17T16:10:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.842+0000 7fcd8f02d640 1 -- start start 2024-01-17T16:10:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.842+0000 7f30bf55e640 1 -- start start 2024-01-17T16:10:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.842+0000 7f54ee613640 1 -- start start 2024-01-17T16:10:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.842+0000 7f2d10464640 1 Processor -- start 2024-01-17T16:10:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.842+0000 7f2d10464640 1 -- start start 2024-01-17T16:10:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f30bf55e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 0x7f30b81c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f30bf55e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b8130db0 con 0x7f30b806fb90 2024-01-17T16:10:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7fcd8f02d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 0x7fcd881c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f30bd2fa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 0x7f30b81c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f54ee613640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 0x7f54e8128db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f30bd2fa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 0x7f30b81c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39496/0 (socket says 172.21.15.26:39496) 2024-01-17T16:10:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f30bd2fa640 1 -- 172.21.15.26:0/2262879422 learned_addr learned my addr 172.21.15.26:0/2262879422 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f54ee613640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e812bef0 con 0x7f54e8099d70 2024-01-17T16:10:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7fcd8f02d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd881286f0 con 0x7fcd88097520 2024-01-17T16:10:33.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f2d10464640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2d0806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7fcd8cdc9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 0x7fcd881c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7fcd8cdc9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 0x7fcd881c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39512/0 (socket says 172.21.15.26:39512) 2024-01-17T16:10:33.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f54e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 0x7f54e8128db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f54e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 0x7f54e8128db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39522/0 (socket says 172.21.15.26:39522) 2024-01-17T16:10:33.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f2d10464640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08120580 con 0x7f2cf40039b0 2024-01-17T16:10:33.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f54e7fff640 1 -- 172.21.15.26:0/4069317518 learned_addr learned my addr 172.21.15.26:0/4069317518 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7fcd8cdc9640 1 -- 172.21.15.26:0/2338137255 learned_addr learned my addr 172.21.15.26:0/2338137255 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f2d0e200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2d0806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f2d0e200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2d0806c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39530/0 (socket says 172.21.15.26:39530) 2024-01-17T16:10:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f2d0e200640 1 -- 172.21.15.26:0/3622756697 learned_addr learned my addr 172.21.15.26:0/3622756697 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f30bd2fa640 1 -- 172.21.15.26:0/2262879422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b8072e10 con 0x7f30b806fb90 2024-01-17T16:10:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f54e7fff640 1 -- 172.21.15.26:0/4069317518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e812abf0 con 0x7f54e8099d70 2024-01-17T16:10:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f54e7fff640 1 --2- 172.21.15.26:0/4069317518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 0x7f54e8128db0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7f30bd2fa640 1 --2- 172.21.15.26:0/2262879422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 0x7f30b81c8440 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.843+0000 7fcd8cdc9640 1 -- 172.21.15.26:0/2338137255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88072e80 con 0x7fcd88097520 2024-01-17T16:10:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f54e4ff9640 1 -- 172.21.15.26:0/4069317518 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f54d8014410 con 0x7f54e8099d70 2024-01-17T16:10:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7fcd8cdc9640 1 --2- 172.21.15.26:0/2338137255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 0x7fcd881c3800 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e812a810 con 0x7f54e8099d70 2024-01-17T16:10:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f2d0e200640 1 -- 172.21.15.26:0/3622756697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d081c4830 con 0x7f2cf40039b0 2024-01-17T16:10:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e812b060 con 0x7f54e8099d70 2024-01-17T16:10:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f54e4ff9640 1 -- 172.21.15.26:0/4069317518 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f54d8014570 con 0x7f54e8099d70 2024-01-17T16:10:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f54e4ff9640 1 -- 172.21.15.26:0/4069317518 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f54d8014810 con 0x7f54e8099d70 2024-01-17T16:10:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f30adffb640 1 -- 172.21.15.26:0/2262879422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f30b4014410 con 0x7f30b806fb90 2024-01-17T16:10:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f30adffb640 1 -- 172.21.15.26:0/2262879422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f30b4014570 con 0x7f30b806fb90 2024-01-17T16:10:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f30adffb640 1 -- 172.21.15.26:0/2262879422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f30b4014810 con 0x7f30b806fb90 2024-01-17T16:10:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f2d0e200640 1 --2- 172.21.15.26:0/3622756697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2d0806c9c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7fcd857fa640 1 -- 172.21.15.26:0/2338137255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcd7c00ca20 con 0x7fcd88097520 2024-01-17T16:10:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7fcd857fa640 1 -- 172.21.15.26:0/2338137255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fcd7c00cb80 con 0x7fcd88097520 2024-01-17T16:10:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7fcd857fa640 1 -- 172.21.15.26:0/2338137255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcd7c00ce20 con 0x7fcd88097520 2024-01-17T16:10:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd88129c10 con 0x7fcd88097520 2024-01-17T16:10:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b808b800 con 0x7f30b806fb90 2024-01-17T16:10:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd88128c80 con 0x7fcd88097520 2024-01-17T16:10:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.844+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b808d050 con 0x7f30b806fb90 2024-01-17T16:10:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7f54e4ff9640 1 -- 172.21.15.26:0/4069317518 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f54d80149c0 con 0x7f54e8099d70 2024-01-17T16:10:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7f30adffb640 1 -- 172.21.15.26:0/2262879422 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f30b4014970 con 0x7f30b806fb90 2024-01-17T16:10:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.846+0000 7f30adffb640 1 --2- 172.21.15.26:0/2262879422 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f309c037b10 0x7f309c03a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.846+0000 7f30adffb640 1 -- 172.21.15.26:0/2262879422 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f30b4048830 con 0x7f30b806fb90 2024-01-17T16:10:33.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7f54e4ff9640 1 --2- 172.21.15.26:0/4069317518 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f54d4037a40 0x7f54d4039f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7f54e4ff9640 1 -- 172.21.15.26:0/4069317518 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f54d8019040 con 0x7f54e8099d70 2024-01-17T16:10:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.846+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e8075220 con 0x7f54e8099d70 2024-01-17T16:10:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7fcd857fa640 1 -- 172.21.15.26:0/2338137255 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7fcd7c017430 con 0x7fcd88097520 2024-01-17T16:10:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd88075220 con 0x7fcd88097520 2024-01-17T16:10:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.846+0000 7fcd857fa640 1 --2- 172.21.15.26:0/2338137255 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fcd6c037b10 0x7fcd6c03a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.846+0000 7fcd857fa640 1 -- 172.21.15.26:0/2338137255 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fcd7c012040 con 0x7fcd88097520 2024-01-17T16:10:33.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7f2cfaffd640 1 -- 172.21.15.26:0/3622756697 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2d04007be0 con 0x7f2cf40039b0 2024-01-17T16:10:33.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.846+0000 7f54e77fe640 1 --2- 172.21.15.26:0/4069317518 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f54d4037a40 0x7f54d4039f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7f2cfaffd640 1 -- 172.21.15.26:0/3622756697 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f2d04001430 con 0x7f2cf40039b0 2024-01-17T16:10:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0811f5f0 con 0x7f2cf40039b0 2024-01-17T16:10:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d08120dd0 con 0x7f2cf40039b0 2024-01-17T16:10:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.845+0000 7f2cfaffd640 1 -- 172.21.15.26:0/3622756697 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f2d04000ed0 con 0x7f2cf40039b0 2024-01-17T16:10:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.846+0000 7f30bcaf9640 1 --2- 172.21.15.26:0/2262879422 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f309c037b10 0x7f309c03a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7f54e77fe640 1 --2- 172.21.15.26:0/4069317518 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f54d4037a40 0x7f54d4039f50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7fcd87fff640 1 --2- 172.21.15.26:0/2338137255 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fcd6c037b10 0x7fcd6c03a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7f2cfaffd640 1 -- 172.21.15.26:0/3622756697 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f2d04016420 con 0x7f2cf40039b0 2024-01-17T16:10:33.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7f2cfaffd640 1 --2- 172.21.15.26:0/3622756697 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f2cec0402f0 0x7f2cec042800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:33.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7f30bcaf9640 1 --2- 172.21.15.26:0/2262879422 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f309c037b10 0x7f309c03a020 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7f2cfaffd640 1 -- 172.21.15.26:0/3622756697 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f2d04048190 con 0x7f2cf40039b0 2024-01-17T16:10:33.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b8075220 con 0x7f30b806fb90 2024-01-17T16:10:33.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0005050 con 0x7f2cf40039b0 2024-01-17T16:10:33.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7f2d0d9ff640 1 --2- 172.21.15.26:0/3622756697 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f2cec0402f0 0x7f2cec042800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:33.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.847+0000 7fcd87fff640 1 --2- 172.21.15.26:0/2338137255 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fcd6c037b10 0x7fcd6c03a020 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.848+0000 7f2d0d9ff640 1 --2- 172.21.15.26:0/3622756697 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f2cec0402f0 0x7f2cec042800 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:33.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.851+0000 7f54e4ff9640 1 -- 172.21.15.26:0/4069317518 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7f54d800fb20 con 0x7f54e8099d70 2024-01-17T16:10:33.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.855+0000 7fcd857fa640 1 -- 172.21.15.26:0/2338137255 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7fcd7c013e40 con 0x7fcd88097520 2024-01-17T16:10:33.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.861+0000 7f2cfaffd640 1 -- 172.21.15.26:0/3622756697 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7f2d040136c0 con 0x7f2cf40039b0 2024-01-17T16:10:33.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:33.864+0000 7f30adffb640 1 -- 172.21.15.26:0/2262879422 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7f30b400fce0 con 0x7f30b806fb90 2024-01-17T16:10:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.030+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f54e812cc60 con 0x7f54e8099d70 2024-01-17T16:10:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.030+0000 7f54e4ff9640 1 -- 172.21.15.26:0/4069317518 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f54d800f710 con 0x7f54e8099d70 2024-01-17T16:10:34.030 INFO:teuthology.orchestra.run.smithi026.stdout:38654705671 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f54d4037a40 msgr2=0x7f54d4039f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 --2- 172.21.15.26:0/4069317518 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f54d4037a40 0x7f54d4039f50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 msgr2=0x7f54e8128db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 --2- 172.21.15.26:0/4069317518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 0x7f54e8128db0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 shutdown_connections 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 --2- 172.21.15.26:0/4069317518 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f54d4037a40 0x7f54d4039f50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 --2- 172.21.15.26:0/4069317518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54e8099d70 0x7f54e8128db0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 >> 172.21.15.26:0/4069317518 conn(0x7f54e80a0ed0 msgr2=0x7f54e809b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 shutdown_connections 2024-01-17T16:10:34.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.033+0000 7f54ee613640 1 -- 172.21.15.26:0/4069317518 wait complete. 2024-01-17T16:10:34.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.040+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcd88072e80 con 0x7fcd88097520 2024-01-17T16:10:34.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.040+0000 7fcd857fa640 1 -- 172.21.15.26:0/2338137255 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7fcd88072e80 con 0x7fcd88097520 2024-01-17T16:10:34.039 INFO:teuthology.orchestra.run.smithi026.stdout:38654705671 2024-01-17T16:10:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.043+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fcd6c037b10 msgr2=0x7fcd6c03a020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.043+0000 7fcd8f02d640 1 --2- 172.21.15.26:0/2338137255 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fcd6c037b10 0x7fcd6c03a020 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.043+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 msgr2=0x7fcd881c3800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.043+0000 7fcd8f02d640 1 --2- 172.21.15.26:0/2338137255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 0x7fcd881c3800 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.044+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 shutdown_connections 2024-01-17T16:10:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.044+0000 7fcd8f02d640 1 --2- 172.21.15.26:0/2338137255 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fcd6c037b10 0x7fcd6c03a020 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.044+0000 7fcd8f02d640 1 --2- 172.21.15.26:0/2338137255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd88097520 0x7fcd881c3800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.044+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 >> 172.21.15.26:0/2338137255 conn(0x7fcd880a0ed0 msgr2=0x7fcd8809d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.044+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2cf0005300 con 0x7f2cf40039b0 2024-01-17T16:10:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.044+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 shutdown_connections 2024-01-17T16:10:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.044+0000 7fcd8f02d640 1 -- 172.21.15.26:0/2338137255 wait complete. 2024-01-17T16:10:34.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.044+0000 7f2cfaffd640 1 -- 172.21.15.26:0/3622756697 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f2d040122c0 con 0x7f2cf40039b0 2024-01-17T16:10:34.045 INFO:teuthology.orchestra.run.smithi026.stdout:38654705671 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f2cec0402f0 msgr2=0x7f2cec042800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 --2- 172.21.15.26:0/3622756697 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f2cec0402f0 0x7f2cec042800 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 msgr2=0x7f2d0806c9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 --2- 172.21.15.26:0/3622756697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2d0806c9c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 shutdown_connections 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 --2- 172.21.15.26:0/3622756697 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f2cec0402f0 0x7f2cec042800 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 --2- 172.21.15.26:0/3622756697 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cf40039b0 0x7f2d0806c9c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 >> 172.21.15.26:0/3622756697 conn(0x7f2d080989e0 msgr2=0x7f2d0809da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 shutdown_connections 2024-01-17T16:10:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.046+0000 7f2d10464640 1 -- 172.21.15.26:0/3622756697 wait complete. 2024-01-17T16:10:34.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-01-17T16:10:34.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.047+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f30b808d370 con 0x7f30b806fb90 2024-01-17T16:10:34.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.047+0000 7f30adffb640 1 -- 172.21.15.26:0/2262879422 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f30b400f2a0 con 0x7f30b806fb90 2024-01-17T16:10:34.048 DEBUG:teuthology.parallel:result is None 2024-01-17T16:10:34.048 INFO:teuthology.orchestra.run.smithi026.stdout:38654705671 2024-01-17T16:10:34.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f309c037b10 msgr2=0x7f309c03a020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 --2- 172.21.15.26:0/2262879422 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f309c037b10 0x7f309c03a020 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 msgr2=0x7f30b81c8440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 --2- 172.21.15.26:0/2262879422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 0x7f30b81c8440 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 shutdown_connections 2024-01-17T16:10:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 --2- 172.21.15.26:0/2262879422 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f309c037b10 0x7f309c03a020 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 --2- 172.21.15.26:0/2262879422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b806fb90 0x7f30b81c8440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 >> 172.21.15.26:0/2262879422 conn(0x7f30b80a0ed0 msgr2=0x7f30b8131620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 shutdown_connections 2024-01-17T16:10:34.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.050+0000 7f30bf55e640 1 -- 172.21.15.26:0/2262879422 wait complete. 2024-01-17T16:10:34.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-01-17T16:10:34.057 DEBUG:teuthology.parallel:result is None 2024-01-17T16:10:34.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2024-01-17T16:10:34.059 DEBUG:teuthology.parallel:result is None 2024-01-17T16:10:34.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-01-17T16:10:34.061 DEBUG:teuthology.parallel:result is None 2024-01-17T16:10:34.061 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-17T16:10:34.061 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T16:10:34.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.205+0000 7f5fffaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:34.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.209+0000 7f5fffaad640 1 Processor -- start 2024-01-17T16:10:34.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.209+0000 7f5fffaad640 1 -- start start 2024-01-17T16:10:34.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5fffaad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ff806fb90 0x7f5ff806ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5fffaad640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff8071620 con 0x7f5ff80704e0 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5fffaad640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff806d090 con 0x7f5ff806fb90 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5ffd849640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ff806fb90 0x7f5ff806ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5ffd048640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5ff80704e0 0x7f5ff8097040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57666/0 (socket says 172.21.15.26:57666) 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5ffd048640 1 -- 172.21.15.26:0/1679887922 learned_addr learned my addr 172.21.15.26:0/1679887922 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5ffd849640 1 -- 172.21.15.26:0/1679887922 >> v1:172.21.15.26:6789/0 conn(0x7f5ff80704e0 legacy=0x7f5ff8097040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5ffd849640 1 -- 172.21.15.26:0/1679887922 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80984e0 con 0x7f5ff806fb90 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5ffd849640 1 --2- 172.21.15.26:0/1679887922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 0x7f5ff806ffa0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01394910ab27a6d server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5ffc847640 1 -- 172.21.15.26:0/1679887922 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5ff4009ce0 con 0x7f5ff806fb90 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5ffc847640 1 -- 172.21.15.26:0/1679887922 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5ff4009e40 con 0x7f5ff806fb90 2024-01-17T16:10:34.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.210+0000 7f5ffc847640 1 -- 172.21.15.26:0/1679887922 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5ff400e360 con 0x7f5ff806fb90 2024-01-17T16:10:34.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.211+0000 7f5fffaad640 1 -- 172.21.15.26:0/1679887922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 msgr2=0x7f5ff806ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.211+0000 7f5fffaad640 1 --2- 172.21.15.26:0/1679887922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 0x7f5ff806ffa0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.211+0000 7f5fffaad640 1 -- 172.21.15.26:0/1679887922 shutdown_connections 2024-01-17T16:10:34.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.211+0000 7f5fffaad640 1 --2- 172.21.15.26:0/1679887922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 0x7f5ff806ffa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.211+0000 7f5fffaad640 1 -- 172.21.15.26:0/1679887922 >> 172.21.15.26:0/1679887922 conn(0x7f5ff80a0ed0 msgr2=0x7f5ff80a12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:34.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.211+0000 7f5fffaad640 1 -- 172.21.15.26:0/1679887922 shutdown_connections 2024-01-17T16:10:34.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.211+0000 7f5fffaad640 1 -- 172.21.15.26:0/1679887922 wait complete. 2024-01-17T16:10:34.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.211+0000 7f5fffaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:34.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.212+0000 7f5fffaad640 1 Processor -- start 2024-01-17T16:10:34.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.212+0000 7f5fffaad640 1 -- start start 2024-01-17T16:10:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5fffaad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 0x7f5ff81301d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5fffaad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff812dcb0 con 0x7f5ff806fb90 2024-01-17T16:10:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5ffd849640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 0x7f5ff81301d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5ffd849640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 0x7f5ff81301d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39550/0 (socket says 172.21.15.26:39550) 2024-01-17T16:10:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5ffd849640 1 -- 172.21.15.26:0/4243170725 learned_addr learned my addr 172.21.15.26:0/4243170725 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:34.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5ffd849640 1 -- 172.21.15.26:0/4243170725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff812ffa0 con 0x7f5ff806fb90 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5ffd849640 1 --2- 172.21.15.26:0/4243170725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 0x7f5ff81301d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5fee7fc640 1 -- 172.21.15.26:0/4243170725 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5ff4014540 con 0x7f5ff806fb90 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5fee7fc640 1 -- 172.21.15.26:0/4243170725 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5ff40146a0 con 0x7f5ff806fb90 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff812da10 con 0x7f5ff806fb90 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5fee7fc640 1 -- 172.21.15.26:0/4243170725 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5ff4014940 con 0x7f5ff806fb90 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.213+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff812e660 con 0x7f5ff806fb90 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.214+0000 7f5fee7fc640 1 -- 172.21.15.26:0/4243170725 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f5ff4014aa0 con 0x7f5ff806fb90 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.214+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff8075220 con 0x7f5ff806fb90 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.215+0000 7f5fee7fc640 1 --2- 172.21.15.26:0/4243170725 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f5fdc037a40 0x7f5fdc039f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.215+0000 7f5fee7fc640 1 -- 172.21.15.26:0/4243170725 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f5ff4019040 con 0x7f5ff806fb90 2024-01-17T16:10:34.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.215+0000 7f5ffd048640 1 --2- 172.21.15.26:0/4243170725 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f5fdc037a40 0x7f5fdc039f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:34.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.215+0000 7f5ffd048640 1 --2- 172.21.15.26:0/4243170725 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f5fdc037a40 0x7f5fdc039f50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:34.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.219+0000 7f5fee7fc640 1 -- 172.21.15.26:0/4243170725 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7f5ff4018bd0 con 0x7f5ff806fb90 2024-01-17T16:10:34.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.393+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 --> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ff812e910 con 0x7f5fdc037a40 2024-01-17T16:10:34.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.395+0000 7f5fee7fc640 1 -- 172.21.15.26:0/4243170725 <== mgr.4099 v2:172.21.15.137:6800/2728392908 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30051 (crc 0 0 0) 0x7f5fe8001200 con 0x7f5fdc037a40 2024-01-17T16:10:34.395 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:10:34.395 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-01-17T16:10:34.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f5fdc037a40 msgr2=0x7f5fdc039f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 --2- 172.21.15.26:0/4243170725 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f5fdc037a40 0x7f5fdc039f50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 msgr2=0x7f5ff81301d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 --2- 172.21.15.26:0/4243170725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 0x7f5ff81301d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 shutdown_connections 2024-01-17T16:10:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 --2- 172.21.15.26:0/4243170725 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f5fdc037a40 0x7f5fdc039f50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 --2- 172.21.15.26:0/4243170725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ff806fb90 0x7f5ff81301d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 >> 172.21.15.26:0/4243170725 conn(0x7f5ff80a0ed0 msgr2=0x7f5ff81b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 shutdown_connections 2024-01-17T16:10:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.397+0000 7f5fffaad640 1 -- 172.21.15.26:0/4243170725 wait complete. 2024-01-17T16:10:34.406 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-01-17T16:10:33.648634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109560,"kb_used_data":1624,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320840,"statfs":{"total":429496729600,"available":429384540160,"internally_reserved":0,"allocated":1662976,"data_stored":1299744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.572268+0000","last_change":"2024-01-17T16:10:32.572972+0000","last_active":"2024-01-17T16:10:32.572268+0000","last_peered":"2024-01-17T16:10:32.572268+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.565848+0000","last_became_peered":"2024-01-17T16:10:32.565848+0000","last_unstale":"2024-01-17T16:10:32.572268+0000","last_undegraded":"2024-01-17T16:10:32.572268+0000","last_fullsized":"2024-01-17T16:10:32.572268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-01-17T16:10:33.490171+0000","last_change":"2024-01-17T16:10:32.561893+0000","last_active":"2024-01-17T16:10:33.490171+0000","last_peered":"2024-01-17T16:10:33.490171+0000","last_clean":"2024-01-17T16:10:33.490171+0000","last_became_active":"2024-01-17T16:10:32.559204+0000","last_became_peered":"2024-01-17T16:10:32.559204+0000","last_unstale":"2024-01-17T16:10:33.490171+0000","last_undegraded":"2024-01-17T16:10:33.490171+0000","last_fullsized":"2024-01-17T16:10:33.490171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.541978+0000","last_change":"2024-01-17T16:10:32.542341+0000","last_active":"2024-01-17T16:10:32.541978+0000","last_peered":"2024-01-17T16:10:32.541978+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.539577+0000","last_became_peered":"2024-01-17T16:10:32.539577+0000","last_unstale":"2024-01-17T16:10:32.541978+0000","last_undegraded":"2024-01-17T16:10:32.541978+0000","last_fullsized":"2024-01-17T16:10:32.541978+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-01-17T16:10:33.489387+0000","last_change":"2024-01-17T16:10:32.539735+0000","last_active":"2024-01-17T16:10:33.489387+0000","last_peered":"2024-01-17T16:10:33.489387+0000","last_clean":"2024-01-17T16:10:33.489387+0000","last_became_active":"2024-01-17T16:10:32.526584+0000","last_became_peered":"2024-01-17T16:10:32.526584+0000","last_unstale":"2024-01-17T16:10:33.489387+0000","last_undegraded":"2024-01-17T16:10:33.489387+0000","last_fullsized":"2024-01-17T16:10:33.489387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.553024+0000","last_change":"2024-01-17T16:10:32.553566+0000","last_active":"2024-01-17T16:10:32.553024+0000","last_peered":"2024-01-17T16:10:32.553024+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.544751+0000","last_became_peered":"2024-01-17T16:10:32.544751+0000","last_unstale":"2024-01-17T16:10:32.553024+0000","last_undegraded":"2024-01-17T16:10:32.553024+0000","last_fullsized":"2024-01-17T16:10:32.553024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.528690+0000","last_change":"2024-01-17T16:10:32.529627+0000","last_active":"2024-01-17T16:10:32.528690+0000","last_peered":"2024-01-17T16:10:32.528690+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.525599+0000","last_became_peered":"2024-01-17T16:10:32.525599+0000","last_unstale":"2024-01-17T16:10:32.528690+0000","last_undegraded":"2024-01-17T16:10:32.528690+0000","last_fullsized":"2024-01-17T16:10:32.528690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.538321+0000","last_change":"2024-01-17T16:10:32.538736+0000","last_active":"2024-01-17T16:10:32.538321+0000","last_peered":"2024-01-17T16:10:32.538321+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.535559+0000","last_became_peered":"2024-01-17T16:10:32.535559+0000","last_unstale":"2024-01-17T16:10:32.538321+0000","last_undegraded":"2024-01-17T16:10:32.538321+0000","last_fullsized":"2024-01-17T16:10:32.538321+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.544910+0000","last_change":"2024-01-17T16:10:32.545302+0000","last_active":"2024-01-17T16:10:32.544910+0000","last_peered":"2024-01-17T16:10:32.544910+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.542455+0000","last_became_peered":"2024-01-17T16:10:32.542455+0000","last_unstale":"2024-01-17T16:10:32.544910+0000","last_undegraded":"2024-01-17T16:10:32.544910+0000","last_fullsized":"2024-01-17T16:10:32.544910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.482671+0000","last_change":"2024-01-17T16:10:28.510739+0000","last_active":"2024-01-17T16:10:32.482671+0000","last_peered":"2024-01-17T16:10:32.482671+0000","last_clean":"2024-01-17T16:10:32.482671+0000","last_became_active":"2024-01-17T16:10:28.506725+0000","last_became_peered":"2024-01-17T16:10:28.506725+0000","last_unstale":"2024-01-17T16:10:32.482671+0000","last_undegraded":"2024-01-17T16:10:32.482671+0000","last_fullsized":"2024-01-17T16:10:32.482671+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:27.459446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:27.459446+0000","last_clean_scrub_stamp":"2024-01-17T16:10:27.459446+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27648,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":712704,"data_stored":620120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27068,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":118784,"data_stored":29752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27068,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":118784,"data_stored":29752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":712704,"data_stored":620120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2024-01-17T16:10:34.407 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T16:10:34.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.510+0000 7fad72a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:34.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.514+0000 7fad72a2d640 1 Processor -- start 2024-01-17T16:10:34.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.514+0000 7fad72a2d640 1 -- start start 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad72a2d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad6c09a890 0x7fad6c135480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad72a2d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6c06db00 con 0x7fad6c099d70 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad72a2d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c06e7a0 con 0x7fad6c09a890 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad6b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fad6c09a890 0x7fad6c135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad6bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fad6c099d70 0x7fad6c09a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57670/0 (socket says 172.21.15.26:57670) 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad6bfff640 1 -- 172.21.15.26:0/1749848126 learned_addr learned my addr 172.21.15.26:0/1749848126 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad6b7fe640 1 -- 172.21.15.26:0/1749848126 >> v1:172.21.15.26:6789/0 conn(0x7fad6c099d70 legacy=0x7fad6c09a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad6b7fe640 1 -- 172.21.15.26:0/1749848126 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0a1b90 con 0x7fad6c09a890 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad6affd640 1 -- 172.21.15.26:0/1749848126 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398424272 0 0) 0x7fad6c06db00 con 0x7fad6c099d70 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.515+0000 7fad6b7fe640 1 --2- 172.21.15.26:0/1749848126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c09a890 0x7fad6c135480 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76e5a007df70efd server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad6affd640 1 -- 172.21.15.26:0/1749848126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fad60009ce0 con 0x7fad6c09a890 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad6affd640 1 -- 172.21.15.26:0/1749848126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fad60009e40 con 0x7fad6c09a890 2024-01-17T16:10:34.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad6affd640 1 -- 172.21.15.26:0/1749848126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fad6000e360 con 0x7fad6c09a890 2024-01-17T16:10:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad72a2d640 1 -- 172.21.15.26:0/1749848126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c09a890 msgr2=0x7fad6c135480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad72a2d640 1 --2- 172.21.15.26:0/1749848126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c09a890 0x7fad6c135480 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad72a2d640 1 -- 172.21.15.26:0/1749848126 shutdown_connections 2024-01-17T16:10:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad72a2d640 1 --2- 172.21.15.26:0/1749848126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c09a890 0x7fad6c135480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad72a2d640 1 -- 172.21.15.26:0/1749848126 >> 172.21.15.26:0/1749848126 conn(0x7fad6c0a0ed0 msgr2=0x7fad6c0a12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad72a2d640 1 -- 172.21.15.26:0/1749848126 shutdown_connections 2024-01-17T16:10:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad72a2d640 1 -- 172.21.15.26:0/1749848126 wait complete. 2024-01-17T16:10:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.516+0000 7fad72a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:34.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.517+0000 7fad72a2d640 1 Processor -- start 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.518+0000 7fad72a2d640 1 -- start start 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.518+0000 7fad72a2d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c099d70 0x7fad6c12a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.518+0000 7fad72a2d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c12c040 con 0x7fad6c099d70 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.518+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c099d70 0x7fad6c12a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.518+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c099d70 0x7fad6c12a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39578/0 (socket says 172.21.15.26:39578) 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.518+0000 7fad6bfff640 1 -- 172.21.15.26:0/988122923 learned_addr learned my addr 172.21.15.26:0/988122923 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.518+0000 7fad6bfff640 1 -- 172.21.15.26:0/988122923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c12a050 con 0x7fad6c099d70 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.519+0000 7fad6bfff640 1 --2- 172.21.15.26:0/988122923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c099d70 0x7fad6c12a480 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.519+0000 7fad68ff9640 1 -- 172.21.15.26:0/988122923 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fad5c00ebd0 con 0x7fad6c099d70 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.519+0000 7fad68ff9640 1 -- 172.21.15.26:0/988122923 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fad5c00ed30 con 0x7fad6c099d70 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.519+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c12d7a0 con 0x7fad6c099d70 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.519+0000 7fad68ff9640 1 -- 172.21.15.26:0/988122923 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fad5c0047b0 con 0x7fad6c099d70 2024-01-17T16:10:34.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.519+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c129d40 con 0x7fad6c099d70 2024-01-17T16:10:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.520+0000 7fad68ff9640 1 -- 172.21.15.26:0/988122923 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7fad5c004960 con 0x7fad6c099d70 2024-01-17T16:10:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.520+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6c075220 con 0x7fad6c099d70 2024-01-17T16:10:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.520+0000 7fad68ff9640 1 --2- 172.21.15.26:0/988122923 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fad58037a40 0x7fad58039f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.520+0000 7fad68ff9640 1 -- 172.21.15.26:0/988122923 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fad5c049930 con 0x7fad6c099d70 2024-01-17T16:10:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.520+0000 7fad6b7fe640 1 --2- 172.21.15.26:0/988122923 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fad58037a40 0x7fad58039f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:34.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.521+0000 7fad6b7fe640 1 --2- 172.21.15.26:0/988122923 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fad58037a40 0x7fad58039f50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:34.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.524+0000 7fad68ff9640 1 -- 172.21.15.26:0/988122923 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7fad5c001730 con 0x7fad6c099d70 2024-01-17T16:10:34.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.698+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 --> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad6c12d620 con 0x7fad58037a40 2024-01-17T16:10:34.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.700+0000 7fad68ff9640 1 -- 172.21.15.26:0/988122923 <== mgr.4099 v2:172.21.15.137:6800/2728392908 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30051 (crc 0 0 0) 0x7fad600135c0 con 0x7fad58037a40 2024-01-17T16:10:34.700 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:10:34.700 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fad58037a40 msgr2=0x7fad58039f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 --2- 172.21.15.26:0/988122923 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fad58037a40 0x7fad58039f50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c099d70 msgr2=0x7fad6c12a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 --2- 172.21.15.26:0/988122923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c099d70 0x7fad6c12a480 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 shutdown_connections 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 --2- 172.21.15.26:0/988122923 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fad58037a40 0x7fad58039f50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 --2- 172.21.15.26:0/988122923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad6c099d70 0x7fad6c12a480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 >> 172.21.15.26:0/988122923 conn(0x7fad6c0a0ed0 msgr2=0x7fad6c06fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 shutdown_connections 2024-01-17T16:10:34.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.702+0000 7fad72a2d640 1 -- 172.21.15.26:0/988122923 wait complete. 2024-01-17T16:10:34.711 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-01-17T16:10:33.648634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109560,"kb_used_data":1624,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320840,"statfs":{"total":429496729600,"available":429384540160,"internally_reserved":0,"allocated":1662976,"data_stored":1299744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.572268+0000","last_change":"2024-01-17T16:10:32.572972+0000","last_active":"2024-01-17T16:10:32.572268+0000","last_peered":"2024-01-17T16:10:32.572268+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.565848+0000","last_became_peered":"2024-01-17T16:10:32.565848+0000","last_unstale":"2024-01-17T16:10:32.572268+0000","last_undegraded":"2024-01-17T16:10:32.572268+0000","last_fullsized":"2024-01-17T16:10:32.572268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-01-17T16:10:33.490171+0000","last_change":"2024-01-17T16:10:32.561893+0000","last_active":"2024-01-17T16:10:33.490171+0000","last_peered":"2024-01-17T16:10:33.490171+0000","last_clean":"2024-01-17T16:10:33.490171+0000","last_became_active":"2024-01-17T16:10:32.559204+0000","last_became_peered":"2024-01-17T16:10:32.559204+0000","last_unstale":"2024-01-17T16:10:33.490171+0000","last_undegraded":"2024-01-17T16:10:33.490171+0000","last_fullsized":"2024-01-17T16:10:33.490171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.541978+0000","last_change":"2024-01-17T16:10:32.542341+0000","last_active":"2024-01-17T16:10:32.541978+0000","last_peered":"2024-01-17T16:10:32.541978+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.539577+0000","last_became_peered":"2024-01-17T16:10:32.539577+0000","last_unstale":"2024-01-17T16:10:32.541978+0000","last_undegraded":"2024-01-17T16:10:32.541978+0000","last_fullsized":"2024-01-17T16:10:32.541978+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-01-17T16:10:33.489387+0000","last_change":"2024-01-17T16:10:32.539735+0000","last_active":"2024-01-17T16:10:33.489387+0000","last_peered":"2024-01-17T16:10:33.489387+0000","last_clean":"2024-01-17T16:10:33.489387+0000","last_became_active":"2024-01-17T16:10:32.526584+0000","last_became_peered":"2024-01-17T16:10:32.526584+0000","last_unstale":"2024-01-17T16:10:33.489387+0000","last_undegraded":"2024-01-17T16:10:33.489387+0000","last_fullsized":"2024-01-17T16:10:33.489387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.553024+0000","last_change":"2024-01-17T16:10:32.553566+0000","last_active":"2024-01-17T16:10:32.553024+0000","last_peered":"2024-01-17T16:10:32.553024+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.544751+0000","last_became_peered":"2024-01-17T16:10:32.544751+0000","last_unstale":"2024-01-17T16:10:32.553024+0000","last_undegraded":"2024-01-17T16:10:32.553024+0000","last_fullsized":"2024-01-17T16:10:32.553024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.528690+0000","last_change":"2024-01-17T16:10:32.529627+0000","last_active":"2024-01-17T16:10:32.528690+0000","last_peered":"2024-01-17T16:10:32.528690+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.525599+0000","last_became_peered":"2024-01-17T16:10:32.525599+0000","last_unstale":"2024-01-17T16:10:32.528690+0000","last_undegraded":"2024-01-17T16:10:32.528690+0000","last_fullsized":"2024-01-17T16:10:32.528690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.538321+0000","last_change":"2024-01-17T16:10:32.538736+0000","last_active":"2024-01-17T16:10:32.538321+0000","last_peered":"2024-01-17T16:10:32.538321+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.535559+0000","last_became_peered":"2024-01-17T16:10:32.535559+0000","last_unstale":"2024-01-17T16:10:32.538321+0000","last_undegraded":"2024-01-17T16:10:32.538321+0000","last_fullsized":"2024-01-17T16:10:32.538321+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.544910+0000","last_change":"2024-01-17T16:10:32.545302+0000","last_active":"2024-01-17T16:10:32.544910+0000","last_peered":"2024-01-17T16:10:32.544910+0000","last_clean":"2024-01-17T16:10:31.471426+0000","last_became_active":"2024-01-17T16:10:32.542455+0000","last_became_peered":"2024-01-17T16:10:32.542455+0000","last_unstale":"2024-01-17T16:10:32.544910+0000","last_undegraded":"2024-01-17T16:10:32.544910+0000","last_fullsized":"2024-01-17T16:10:32.544910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:31.471426+0000","last_clean_scrub_stamp":"2024-01-17T16:10:31.471426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-01-17T16:10:32.482671+0000","last_change":"2024-01-17T16:10:28.510739+0000","last_active":"2024-01-17T16:10:32.482671+0000","last_peered":"2024-01-17T16:10:32.482671+0000","last_clean":"2024-01-17T16:10:32.482671+0000","last_became_active":"2024-01-17T16:10:28.506725+0000","last_became_peered":"2024-01-17T16:10:28.506725+0000","last_unstale":"2024-01-17T16:10:32.482671+0000","last_undegraded":"2024-01-17T16:10:32.482671+0000","last_fullsized":"2024-01-17T16:10:32.482671+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T16:10:27.459446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T16:10:27.459446+0000","last_clean_scrub_stamp":"2024-01-17T16:10:27.459446+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27648,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":712704,"data_stored":620120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27068,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":118784,"data_stored":29752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27068,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":118784,"data_stored":29752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":712704,"data_stored":620120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2024-01-17T16:10:34.712 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-17T16:10:34.712 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-17T16:10:34.712 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-17T16:10:34.712 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-17T16:10:34.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.815+0000 7fc20e75e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:34.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.818+0000 7fc20e75e640 1 Processor -- start 2024-01-17T16:10:34.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.818+0000 7fc20e75e640 1 -- start start 2024-01-17T16:10:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.819+0000 7fc20e75e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc2080990f0 0x7fc2081364d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.819+0000 7fc20e75e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20806f940 con 0x7fc20806e850 2024-01-17T16:10:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.819+0000 7fc20e75e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20806ec60 con 0x7fc2080990f0 2024-01-17T16:10:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.819+0000 7fc2077fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc2080990f0 0x7fc2081364d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:34.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.819+0000 7fc207fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc20806e850 0x7fc2080989e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57674/0 (socket says 172.21.15.26:57674) 2024-01-17T16:10:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.819+0000 7fc207fff640 1 -- 172.21.15.26:0/3220752226 learned_addr learned my addr 172.21.15.26:0/3220752226 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-01-17T16:10:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.820+0000 7fc2077fe640 1 -- 172.21.15.26:0/3220752226 >> v1:172.21.15.26:6789/0 conn(0x7fc20806e850 legacy=0x7fc2080989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.820+0000 7fc2077fe640 1 -- 172.21.15.26:0/3220752226 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20806ee60 con 0x7fc2080990f0 2024-01-17T16:10:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.820+0000 7fc2077fe640 1 --2- 172.21.15.26:0/3220752226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2080990f0 0x7fc2081364d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30f6d040741439b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.820+0000 7fc206ffd640 1 -- 172.21.15.26:0/3220752226 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc1fc009ce0 con 0x7fc2080990f0 2024-01-17T16:10:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.820+0000 7fc206ffd640 1 -- 172.21.15.26:0/3220752226 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc1fc009e40 con 0x7fc2080990f0 2024-01-17T16:10:34.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.820+0000 7fc206ffd640 1 -- 172.21.15.26:0/3220752226 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc1fc00e360 con 0x7fc2080990f0 2024-01-17T16:10:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.821+0000 7fc20e75e640 1 -- 172.21.15.26:0/3220752226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2080990f0 msgr2=0x7fc2081364d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.821+0000 7fc20e75e640 1 --2- 172.21.15.26:0/3220752226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2080990f0 0x7fc2081364d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.821+0000 7fc20e75e640 1 -- 172.21.15.26:0/3220752226 shutdown_connections 2024-01-17T16:10:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.821+0000 7fc20e75e640 1 --2- 172.21.15.26:0/3220752226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2080990f0 0x7fc2081364d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.821+0000 7fc20e75e640 1 -- 172.21.15.26:0/3220752226 >> 172.21.15.26:0/3220752226 conn(0x7fc20809c2a0 msgr2=0x7fc20809c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.821+0000 7fc20e75e640 1 -- 172.21.15.26:0/3220752226 shutdown_connections 2024-01-17T16:10:34.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.821+0000 7fc20e75e640 1 -- 172.21.15.26:0/3220752226 wait complete. 2024-01-17T16:10:34.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.821+0000 7fc20e75e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:10:34.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.822+0000 7fc20e75e640 1 Processor -- start 2024-01-17T16:10:34.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.822+0000 7fc20e75e640 1 -- start start 2024-01-17T16:10:34.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc20e75e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc20806e850 0x7fc20811daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:34.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc20e75e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20811eb40 con 0x7fc20806e850 2024-01-17T16:10:34.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc207fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc20806e850 0x7fc20811daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:34.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc207fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc20806e850 0x7fc20811daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39598/0 (socket says 172.21.15.26:39598) 2024-01-17T16:10:34.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc207fff640 1 -- 172.21.15.26:0/2955738891 learned_addr learned my addr 172.21.15.26:0/2955738891 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:10:34.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc207fff640 1 -- 172.21.15.26:0/2955738891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208121560 con 0x7fc20806e850 2024-01-17T16:10:34.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc207fff640 1 --2- 172.21.15.26:0/2955738891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc20806e850 0x7fc20811daa0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:34.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc204ff9640 1 -- 172.21.15.26:0/2955738891 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc1f80059d0 con 0x7fc20806e850 2024-01-17T16:10:34.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc204ff9640 1 -- 172.21.15.26:0/2955738891 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc1f8005b30 con 0x7fc20806e850 2024-01-17T16:10:34.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc204ff9640 1 -- 172.21.15.26:0/2955738891 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc1f8005dd0 con 0x7fc20806e850 2024-01-17T16:10:34.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc208120370 con 0x7fc20806e850 2024-01-17T16:10:34.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.823+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc208121b80 con 0x7fc20806e850 2024-01-17T16:10:34.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.824+0000 7fc204ff9640 1 -- 172.21.15.26:0/2955738891 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7fc1f80070b0 con 0x7fc20806e850 2024-01-17T16:10:34.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.824+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc208066f60 con 0x7fc20806e850 2024-01-17T16:10:34.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.825+0000 7fc204ff9640 1 --2- 172.21.15.26:0/2955738891 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc1f4037a40 0x7fc1f4039f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:10:34.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.825+0000 7fc204ff9640 1 -- 172.21.15.26:0/2955738891 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fc1f8046db0 con 0x7fc20806e850 2024-01-17T16:10:34.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.825+0000 7fc2077fe640 1 --2- 172.21.15.26:0/2955738891 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc1f4037a40 0x7fc1f4039f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:10:34.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.825+0000 7fc2077fe640 1 --2- 172.21.15.26:0/2955738891 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc1f4037a40 0x7fc1f4039f50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:10:34.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:34.829+0000 7fc204ff9640 1 -- 172.21.15.26:0/2955738891 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (crc 0 0 0) 0x7fc1f800d330 con 0x7fc20806e850 2024-01-17T16:10:35.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.046+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc208075220 con 0x7fc20806e850 2024-01-17T16:10:35.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.047+0000 7fc204ff9640 1 -- 172.21.15.26:0/2955738891 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (crc 0 0 0) 0x7fc1f800d150 con 0x7fc20806e850 2024-01-17T16:10:35.046 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-01-17T16:10:35.046 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-17T16:10:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.048+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc1f4037a40 msgr2=0x7fc1f4039f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.048+0000 7fc20e75e640 1 --2- 172.21.15.26:0/2955738891 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc1f4037a40 0x7fc1f4039f50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.048+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc20806e850 msgr2=0x7fc20811daa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:10:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.048+0000 7fc20e75e640 1 --2- 172.21.15.26:0/2955738891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc20806e850 0x7fc20811daa0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.048+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 shutdown_connections 2024-01-17T16:10:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.048+0000 7fc20e75e640 1 --2- 172.21.15.26:0/2955738891 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7fc1f4037a40 0x7fc1f4039f50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.048+0000 7fc20e75e640 1 --2- 172.21.15.26:0/2955738891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc20806e850 0x7fc20811daa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:10:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.048+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 >> 172.21.15.26:0/2955738891 conn(0x7fc20809c2a0 msgr2=0x7fc2081b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:10:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.049+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 shutdown_connections 2024-01-17T16:10:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T16:10:35.049+0000 7fc20e75e640 1 -- 172.21.15.26:0/2955738891 wait complete. 2024-01-17T16:10:35.058 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-17T16:10:35.059 INFO:teuthology.run_tasks:Running task workunit... 2024-01-17T16:10:35.070 INFO:tasks.workunit:Pulling workunits from ref cecb6cb5cdba1d67db289980b0e46cfe0334a30f 2024-01-17T16:10:35.071 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-17T16:10:35.071 DEBUG:teuthology.orchestra.run.smithi026:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-17T16:10:35.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T16:10:35.085 INFO:teuthology.orchestra.run.smithi026.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-01-17T16:10:35.085 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-01-17T16:10:35.139 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-01-17T16:10:35.139 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-01-17T16:10:35.193 INFO:tasks.workunit:timeout=3h 2024-01-17T16:10:35.193 INFO:tasks.workunit:cleanup=True 2024-01-17T16:10:35.194 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout cecb6cb5cdba1d67db289980b0e46cfe0334a30f 2024-01-17T16:10:35.248 INFO:tasks.workunit.client.0.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-17T16:12:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 99% (12019/12104) Updating files: 100% (12104/12104) Updating files: 100% (12104/12104), done. 2024-01-17T16:12:02.055 INFO:tasks.workunit.client.0.smithi026.stderr:Note: switching to 'cecb6cb5cdba1d67db289980b0e46cfe0334a30f'. 2024-01-17T16:12:02.055 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-01-17T16:12:02.055 INFO:tasks.workunit.client.0.smithi026.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-17T16:12:02.055 INFO:tasks.workunit.client.0.smithi026.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-17T16:12:02.055 INFO:tasks.workunit.client.0.smithi026.stderr:state without impacting any branches by switching back to a branch. 2024-01-17T16:12:02.055 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-01-17T16:12:02.055 INFO:tasks.workunit.client.0.smithi026.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr: git switch -c 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr:Or undo this operation with: 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr: git switch - 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-01-17T16:12:02.056 INFO:tasks.workunit.client.0.smithi026.stderr:HEAD is now at cecb6cb5cdb test/neorados/misc: Crimson - Skip NeoRadosMisc.WriteSame 2024-01-17T16:12:02.059 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-17T16:12:02.124 INFO:tasks.workunit.client.0.smithi026.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-17T16:12:02.127 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-17T16:12:02.127 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-17T16:12:02.848 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-17T16:12:02.910 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-17T16:12:02.951 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-17T16:12:02.953 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-17T16:12:02.953 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-17T16:12:02.992 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-17T16:12:02.995 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-01-17T16:12:02.996 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-17T16:12:03.051 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-01-17T16:12:03.053 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-01-17T16:12:03.054 DEBUG:teuthology.orchestra.run.smithi026:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cecb6cb5cdba1d67db289980b0e46cfe0334a30f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-01-17T16:12:03.110 INFO:tasks.workunit.client.0.smithi026.stderr:+ parallel=1 2024-01-17T16:12:03.110 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' --crimson = --serial ']' 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ crimson=0 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' --crimson = --crimson ']' 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ parallel=0 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ crimson=1 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ color= 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' -t 1 ']' 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ GTEST_OUTPUT=xml:/home/ubuntu/cephtest/archive/gtest_xml_report 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ declare -A pids 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:12:03.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_aio 2024-01-17T16:12:03.126 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:12:03.126 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 42 tests from 2 test suites. 2024-01-17T16:12:03.126 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:12:03.126 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 26 tests from LibRadosAio 2024-01-17T16:12:03.126 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.TooBig 2024-01-17T16:12:05.388 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.TooBig (2262 ms) 2024-01-17T16:12:05.389 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-01-17T16:12:08.397 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.SimpleWrite (3009 ms) 2024-01-17T16:12:08.397 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-01-17T16:12:11.410 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.WaitForSafe (3012 ms) 2024-01-17T16:12:11.410 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-01-17T16:12:14.421 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTrip (3011 ms) 2024-01-17T16:12:14.421 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-01-17T16:12:17.431 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTrip2 (3010 ms) 2024-01-17T16:12:17.431 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-01-17T16:12:20.438 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTrip3 (3008 ms) 2024-01-17T16:12:20.438 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-01-17T16:12:23.451 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripAppend (3013 ms) 2024-01-17T16:12:23.451 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-01-17T16:12:26.461 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RemoveTest (3010 ms) 2024-01-17T16:12:26.462 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-01-17T16:12:29.473 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3011 ms) 2024-01-17T16:12:29.473 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RmXattr 2024-01-17T16:12:32.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RmXattr (3010 ms) 2024-01-17T16:12:32.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.XattrIter 2024-01-17T16:12:35.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.XattrIter (3010 ms) 2024-01-17T16:12:35.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.IsComplete 2024-01-17T16:12:38.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.IsComplete (3011 ms) 2024-01-17T16:12:38.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.IsSafe 2024-01-17T16:12:41.513 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.IsSafe (3009 ms) 2024-01-17T16:12:41.513 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-01-17T16:12:44.523 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.ReturnValue (3009 ms) 2024-01-17T16:12:44.523 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.Flush 2024-01-17T16:12:47.532 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.Flush (3010 ms) 2024-01-17T16:12:47.532 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-01-17T16:12:50.541 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.FlushAsync (3009 ms) 2024-01-17T16:12:50.541 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-01-17T16:12:53.551 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3010 ms) 2024-01-17T16:12:53.551 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-01-17T16:12:56.561 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3010 ms) 2024-01-17T16:12:56.562 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-01-17T16:12:59.571 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.SimpleStat (3010 ms) 2024-01-17T16:12:59.571 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-01-17T16:13:02.580 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.OperateMtime (3009 ms) 2024-01-17T16:13:02.581 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-01-17T16:13:05.363 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.Operate2Mtime (2783 ms) 2024-01-17T16:13:05.364 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-01-17T16:13:08.372 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.SimpleStatNS (3008 ms) 2024-01-17T16:13:08.372 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.StatRemove 2024-01-17T16:13:11.382 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.StatRemove (3011 ms) 2024-01-17T16:13:11.418 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-01-17T16:13:14.390 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.ExecuteClass (3008 ms) 2024-01-17T16:13:14.390 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-01-17T16:13:17.400 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.MultiWrite (3009 ms) 2024-01-17T16:13:17.400 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-01-17T16:13:20.415 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.AioUnlock (3011 ms) 2024-01-17T16:13:20.415 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 26 tests from LibRadosAio (77284 ms total) 2024-01-17T16:13:20.415 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:13:20.415 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 16 tests from LibRadosAioEC 2024-01-17T16:13:20.415 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-01-17T16:13:20.415 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1100: Skipped 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1132: Skipped 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1149: Skipped 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.416 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1182: Skipped 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1215: Skipped 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1286: Skipped 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1326: Skipped 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1366: Skipped 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.Flush 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1385: Skipped 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.418 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1415: Skipped 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1454: Skipped 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1498: Skipped 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.419 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1532: Skipped 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1593: Skipped 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1649: Skipped 2024-01-17T16:13:20.420 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio.cc:1681: Skipped 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 42 tests from 2 test suites ran. (77284 ms total) 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 26 tests. 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 16 tests, listed below: 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-01-17T16:13:20.421 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-01-17T16:13:20.422 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-01-17T16:13:20.423 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-01-17T16:13:20.423 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-01-17T16:13:20.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:13:20.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:13:20.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_aio_pp 2024-01-17T16:13:20.431 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:13:20.431 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 57 tests from 4 test suites. 2024-01-17T16:13:20.431 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:13:20.431 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 32 tests from LibRadosAio 2024-01-17T16:13:20.431 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-01-17T16:13:23.418 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.TooBigPP (2987 ms) 2024-01-17T16:13:23.419 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-01-17T16:13:42.379 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.PoolQuotaPP (18961 ms) 2024-01-17T16:13:42.379 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-01-17T16:13:48.399 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.SimpleWritePP (6020 ms) 2024-01-17T16:13:48.400 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-01-17T16:13:52.405 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.WaitForSafePP (4006 ms) 2024-01-17T16:13:52.405 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-01-17T16:13:55.414 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripPP (3008 ms) 2024-01-17T16:13:55.414 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-01-17T16:13:58.423 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3009 ms) 2024-01-17T16:13:58.423 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-01-17T16:14:01.432 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripPP3 (3009 ms) 2024-01-17T16:14:01.433 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-01-17T16:14:04.440 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3009 ms) 2024-01-17T16:14:04.440 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-01-17T16:14:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.IsCompletePP (3008 ms) 2024-01-17T16:14:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-01-17T16:14:10.376 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.IsSafePP (2928 ms) 2024-01-17T16:14:10.376 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-01-17T16:14:13.386 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.ReturnValuePP (3009 ms) 2024-01-17T16:14:13.386 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.FlushPP 2024-01-17T16:14:17.399 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.FlushPP (4013 ms) 2024-01-17T16:14:17.399 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-01-17T16:14:22.457 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.FlushAsyncPP (5059 ms) 2024-01-17T16:14:22.458 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-01-17T16:14:25.467 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3010 ms) 2024-01-17T16:14:25.467 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-01-17T16:14:29.479 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (4012 ms) 2024-01-17T16:14:29.479 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-01-17T16:14:32.384 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (2905 ms) 2024-01-17T16:14:32.384 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-01-17T16:14:36.397 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (4013 ms) 2024-01-17T16:14:36.397 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-01-17T16:14:41.385 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (4987 ms) 2024-01-17T16:14:41.385 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-01-17T16:14:46.400 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.SimpleStatPP (5016 ms) 2024-01-17T16:14:46.400 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-01-17T16:14:51.383 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.OperateMtime (4983 ms) 2024-01-17T16:14:51.383 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-01-17T16:14:54.419 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.OperateMtime2 (3036 ms) 2024-01-17T16:14:54.420 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-01-17T16:15:00.385 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.StatRemovePP (5966 ms) 2024-01-17T16:15:00.385 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-01-17T16:15:06.405 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.ExecuteClassPP (6020 ms) 2024-01-17T16:15:06.405 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.OmapPP 2024-01-17T16:15:17.435 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.OmapPP (11030 ms) 2024-01-17T16:15:17.436 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-01-17T16:15:21.449 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.MultiWritePP (4014 ms) 2024-01-17T16:15:21.449 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-01-17T16:15:32.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.AioUnlockPP (11034 ms) 2024-01-17T16:15:32.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-01-17T16:15:37.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (5012 ms) 2024-01-17T16:15:37.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-01-17T16:15:42.513 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RacingRemovePP (5017 ms) 2024-01-17T16:15:42.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-01-17T16:15:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (5013 ms) 2024-01-17T16:15:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-01-17T16:15:58.560 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (11035 ms) 2024-01-17T16:15:58.561 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-01-17T16:16:01.061 INFO:tasks.workunit.client.0.smithi026.stdout:setting pool EIO 2024-01-17T16:16:10.708 INFO:tasks.workunit.client.0.smithi026.stdout:waiting for 1000 2024-01-17T16:16:11.709 INFO:tasks.workunit.client.0.smithi026.stdout:waiting for 1000 2024-01-17T16:16:12.709 INFO:tasks.workunit.client.0.smithi026.stdout:waiting for 1000 2024-01-17T16:16:13.709 INFO:tasks.workunit.client.0.smithi026.stdout:max_success 0, min_failed 1 2024-01-17T16:16:14.404 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAio.PoolEIOFlag (15843 ms) 2024-01-17T16:16:14.404 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAio.MultiReads 2024-01-17T16:16:14.404 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:2427: Skipped 2024-01-17T16:16:14.404 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:16:14.404 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-01-17T16:16:14.404 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 32 tests from LibRadosAio (173973 ms total) 2024-01-17T16:16:14.404 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:16:14.404 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosAioPP 2024-01-17T16:16:14.405 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-01-17T16:16:19.413 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (5010 ms) 2024-01-17T16:16:19.413 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-01-17T16:16:43.434 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (24021 ms) 2024-01-17T16:16:43.434 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-01-17T16:17:22.415 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAioPP.RmXattrPP (38981 ms) 2024-01-17T16:17:22.416 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-01-17T16:17:37.458 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (15042 ms) 2024-01-17T16:17:37.458 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosAioPP (83054 ms total) 2024-01-17T16:17:37.458 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:17:37.458 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosIoPP 2024-01-17T16:17:37.458 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-01-17T16:17:43.479 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.XattrListPP (6019 ms) 2024-01-17T16:17:43.479 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosIoPP (6019 ms total) 2024-01-17T16:17:43.479 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:17:43.479 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 20 tests from LibRadosAioEC 2024-01-17T16:17:43.479 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-01-17T16:17:43.479 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1384: Skipped 2024-01-17T16:17:43.479 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1419: Skipped 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1436: Skipped 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1467: Skipped 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-01-17T16:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1500: Skipped 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1605: Skipped 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1637: Skipped 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1705: Skipped 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-01-17T16:17:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1742: Skipped 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1780: Skipped 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1796: Skipped 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1824: Skipped 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-01-17T16:17:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1859: Skipped 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1904: Skipped 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1946: Skipped 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:1977: Skipped 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-01-17T16:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:2008: Skipped 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:2059: Skipped 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:2089: Skipped 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-01-17T16:17:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/aio_cxx.cc:2124: Skipped 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 57 tests from 4 test suites ran. (263046 ms total) 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 36 tests. 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 21 tests, listed below: 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-01-17T16:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-01-17T16:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-01-17T16:17:43.487 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:17:43.487 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:17:43.487 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_io 2024-01-17T16:17:43.493 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:17:43.493 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 24 tests from 2 test suites. 2024-01-17T16:17:43.493 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:17:43.494 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 14 tests from LibRadosIo 2024-01-17T16:17:45.482 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-01-17T16:17:48.317 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.SimpleWrite (2834 ms) 2024-01-17T16:17:48.317 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.TooBig 2024-01-17T16:17:48.317 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-01-17T16:17:48.317 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-01-17T16:17:52.050 INFO:tasks.workunit.client.0.smithi026.stdout:no timeout :/ 2024-01-17T16:17:52.050 INFO:tasks.workunit.client.0.smithi026.stdout:no timeout :/ 2024-01-17T16:17:52.050 INFO:tasks.workunit.client.0.smithi026.stdout:no timeout :/ 2024-01-17T16:17:52.050 INFO:tasks.workunit.client.0.smithi026.stdout:no timeout :/ 2024-01-17T16:17:52.050 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.ReadTimeout (3734 ms) 2024-01-17T16:17:52.050 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-01-17T16:17:55.625 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.RoundTrip (3575 ms) 2024-01-17T16:17:55.625 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.Checksum 2024-01-17T16:17:56.761 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.Checksum (1136 ms) 2024-01-17T16:17:56.762 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-01-17T16:17:56.839 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (78 ms) 2024-01-17T16:17:56.839 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-01-17T16:17:56.855 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (16 ms) 2024-01-17T16:17:56.855 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-01-17T16:17:56.872 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.AppendRoundTrip (17 ms) 2024-01-17T16:17:56.872 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-01-17T16:17:56.875 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.ZeroLenZero (3 ms) 2024-01-17T16:17:56.875 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.TruncTest 2024-01-17T16:17:56.891 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.TruncTest (17 ms) 2024-01-17T16:17:56.891 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-01-17T16:17:56.906 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.RemoveTest (15 ms) 2024-01-17T16:17:56.907 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-01-17T16:17:56.926 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (19 ms) 2024-01-17T16:17:56.926 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.RmXattr 2024-01-17T16:17:56.970 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.RmXattr (44 ms) 2024-01-17T16:17:56.970 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIo.XattrIter 2024-01-17T16:17:56.993 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIo.XattrIter (24 ms) 2024-01-17T16:17:57.048 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 14 tests from LibRadosIo (11512 ms total) 2024-01-17T16:17:57.048 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 10 tests from LibRadosIoEC 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:168: Skipped 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.049 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.051 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-01-17T16:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:176: Skipped 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 24 tests from 2 test suites ran. (13555 ms total) 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 14 tests. 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 10 tests, listed below: 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-01-17T16:17:57.053 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:17:57.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:17:57.055 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_io_pp 2024-01-17T16:17:57.064 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:17:57.064 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 37 tests from 2 test suites. 2024-01-17T16:17:57.064 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:17:57.065 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 20 tests from LibRadosIoPP 2024-01-17T16:17:57.065 INFO:tasks.workunit.client.0.smithi026.stdout:seed 33172 2024-01-17T16:17:59.069 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-01-17T16:17:59.069 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.TooBigPP (1 ms) 2024-01-17T16:17:59.069 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-01-17T16:18:13.726 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (14657 ms) 2024-01-17T16:18:13.726 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-01-17T16:18:13.834 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.ReadOpPP (108 ms) 2024-01-17T16:18:13.834 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-01-17T16:18:14.902 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (1068 ms) 2024-01-17T16:18:14.903 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-01-17T16:18:17.773 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.RoundTripPP (2871 ms) 2024-01-17T16:18:17.774 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-01-17T16:18:18.071 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (298 ms) 2024-01-17T16:18:18.071 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-01-17T16:18:19.159 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.Checksum (1088 ms) 2024-01-17T16:18:19.160 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-01-17T16:18:19.173 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (14 ms) 2024-01-17T16:18:19.173 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-01-17T16:18:19.288 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (115 ms) 2024-01-17T16:18:19.288 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-01-17T16:18:19.306 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (18 ms) 2024-01-17T16:18:19.306 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-01-17T16:18:19.316 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (10 ms) 2024-01-17T16:18:19.316 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-01-17T16:18:19.336 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (20 ms) 2024-01-17T16:18:19.336 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-01-17T16:18:19.353 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.TruncTestPP (17 ms) 2024-01-17T16:18:19.353 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-01-17T16:18:19.368 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (15 ms) 2024-01-17T16:18:19.368 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-01-17T16:18:19.386 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (18 ms) 2024-01-17T16:18:19.386 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-01-17T16:18:19.430 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.RmXattrPP (44 ms) 2024-01-17T16:18:19.430 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-01-17T16:18:19.456 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.XattrListPP (26 ms) 2024-01-17T16:18:19.456 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-01-17T16:18:20.581 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.CmpExtPP (1125 ms) 2024-01-17T16:18:20.581 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-01-17T16:18:21.158 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (577 ms) 2024-01-17T16:18:21.158 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-01-17T16:18:21.194 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (37 ms) 2024-01-17T16:18:21.456 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 20 tests from LibRadosIoPP (22127 ms total) 2024-01-17T16:18:21.456 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:18:21.456 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 17 tests from LibRadosIoECPP 2024-01-17T16:18:21.456 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:373: Skipped 2024-01-17T16:18:21.456 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.456 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-01-17T16:18:21.457 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.458 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.459 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-01-17T16:18:21.460 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-01-17T16:18:21.461 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-01-17T16:18:21.462 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.463 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:381: Skipped 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 17 tests from LibRadosIoECPP (0 ms total) 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:18:21.464 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 37 tests from 2 test suites ran. (24391 ms total) 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 20 tests. 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 17 tests, listed below: 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-01-17T16:18:21.465 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-01-17T16:18:21.466 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-01-17T16:18:21.466 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-01-17T16:18:21.466 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-01-17T16:18:21.466 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-01-17T16:18:21.466 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-01-17T16:18:21.466 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-01-17T16:18:21.466 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-01-17T16:18:21.466 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:18:21.466 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:18:21.467 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_asio 2024-01-17T16:18:21.487 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.488+0000 7f4d2ad68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:18:21.491 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.493+0000 7f4d2ad68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:18:21.491 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.493+0000 7f4d2ad68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:18:21.492 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 12 tests from 1 test suite. 2024-01-17T16:18:21.492 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:18:21.492 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 12 tests from AsioRados 2024-01-17T16:18:21.493 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.494+0000 7f4d2ad68640 1 Processor -- start 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.494+0000 7f4d2ad68640 1 -- start start 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.494+0000 7f4d2ad68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e56e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.494+0000 7f4d2ad68640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b4e3ef370 con 0x562b4e453a70 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.495+0000 7f4d1ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e56e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.495+0000 7f4d1ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e56e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60608/0 (socket says 172.21.15.26:60608) 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.495+0000 7f4d1ffff640 1 -- 172.21.15.26:0/300525407 learned_addr learned my addr 172.21.15.26:0/300525407 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.495+0000 7f4d1ffff640 1 -- 172.21.15.26:0/300525407 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b4e38fe90 con 0x562b4e453a70 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.495+0000 7f4d1ffff640 1 --2- 172.21.15.26:0/300525407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e56e6c0 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f76a6756f86fff server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.495+0000 7f4d1e7fc640 1 -- 172.21.15.26:0/300525407 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4d1802c800 con 0x562b4e453a70 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.495+0000 7f4d1e7fc640 1 -- 172.21.15.26:0/300525407 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4d1800a040 con 0x562b4e453a70 2024-01-17T16:18:21.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.495+0000 7f4d1e7fc640 1 -- 172.21.15.26:0/300525407 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4d1800a1b0 con 0x562b4e453a70 2024-01-17T16:18:21.496 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.496+0000 7f4d2ad68640 1 -- 172.21.15.26:0/300525407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 msgr2=0x562b4e56e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.496+0000 7f4d2ad68640 1 --2- 172.21.15.26:0/300525407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e56e6c0 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.496+0000 7f4d2ad68640 1 -- 172.21.15.26:0/300525407 shutdown_connections 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.496+0000 7f4d2ad68640 1 --2- 172.21.15.26:0/300525407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e56e6c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.496+0000 7f4d2ad68640 1 -- 172.21.15.26:0/300525407 >> 172.21.15.26:0/300525407 conn(0x562b4e362e00 msgr2=0x562b4e457880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.496+0000 7f4d2ad68640 1 -- 172.21.15.26:0/300525407 shutdown_connections 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.496+0000 7f4d2ad68640 1 -- 172.21.15.26:0/300525407 wait complete. 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.496+0000 7f4d2ad68640 1 Processor -- start 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.497+0000 7f4d2ad68640 1 -- start start 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.497+0000 7f4d2ad68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e4e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.497+0000 7f4d2ad68640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b4e3eac60 con 0x562b4e453a70 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.497+0000 7f4d1ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e4e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.497+0000 7f4d1ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e4e3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60612/0 (socket says 172.21.15.26:60612) 2024-01-17T16:18:21.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.497+0000 7f4d1ffff640 1 -- 172.21.15.26:0/919069899 learned_addr learned my addr 172.21.15.26:0/919069899 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-01-17T16:18:21.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.498+0000 7f4d1ffff640 1 -- 172.21.15.26:0/919069899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b4e383040 con 0x562b4e453a70 2024-01-17T16:18:21.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.498+0000 7f4d1ffff640 1 --2- 172.21.15.26:0/919069899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e4e3ac0 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:18:21.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.498+0000 7f4d1d7fa640 1 -- 172.21.15.26:0/919069899 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4d18038730 con 0x562b4e453a70 2024-01-17T16:18:21.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.498+0000 7f4d1d7fa640 1 -- 172.21.15.26:0/919069899 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4d18038890 con 0x562b4e453a70 2024-01-17T16:18:21.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.498+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b4e382aa0 con 0x562b4e453a70 2024-01-17T16:18:21.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.498+0000 7f4d1d7fa640 1 -- 172.21.15.26:0/919069899 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4d18038b30 con 0x562b4e453a70 2024-01-17T16:18:21.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.498+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b4e4d2940 con 0x562b4e453a70 2024-01-17T16:18:21.499 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.499+0000 7f4d1d7fa640 1 -- 172.21.15.26:0/919069899 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 44909+0+0 (crc 0 0 0) 0x7f4d18038ce0 con 0x562b4e453a70 2024-01-17T16:18:21.499 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.499+0000 7f4d1d7fa640 1 --2- 172.21.15.26:0/919069899 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d00036360 0x7f4d00038870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:18:21.499 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.499+0000 7f4d1d7fa640 1 -- 172.21.15.26:0/919069899 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(355..355 src has 1..355) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f4d1803e040 con 0x562b4e453a70 2024-01-17T16:18:21.499 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.499+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x562b4e3e3af0 con 0x562b4e453a70 2024-01-17T16:18:21.499 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.499+0000 7f4d1f7fe640 1 --2- 172.21.15.26:0/919069899 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d00036360 0x7f4d00038870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T16:18:21.499 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.499+0000 7f4d1d7fa640 1 -- 172.21.15.26:0/919069899 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=355) v2 ==== 24+0+0 (crc 0 0 0) 0x7f4d18035ea0 con 0x562b4e453a70 2024-01-17T16:18:21.499 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.500+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x562b4e3f4cf0 con 0x562b4e453a70 2024-01-17T16:18:21.500 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:21.500+0000 7f4d1f7fe640 1 --2- 172.21.15.26:0/919069899 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d00036360 0x7f4d00038870 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:18:22.456 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:22.457+0000 7f4d1d7fa640 1 -- 172.21.15.26:0/919069899 <== mon.0 v2:172.21.15.26:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v356) v1 ==== 43+0+0 (crc 0 0 0) 0x7f4d18009410 con 0x562b4e453a70 2024-01-17T16:18:22.457 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:22.457+0000 7f4d1d7fa640 1 -- 172.21.15.26:0/919069899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=356}) v3 -- 0x7f4d0003ac80 con 0x562b4e453a70 2024-01-17T16:18:22.457 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:22.458+0000 7f4d1d7fa640 1 -- 172.21.15.26:0/919069899 <== mon.0 v2:172.21.15.26:3300/0 8 ==== osd_map(356..356 src has 1..356) v4 ==== 651+0+0 (crc 0 0 0) 0x7f4d18031040 con 0x562b4e453a70 2024-01-17T16:18:22.457 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:22.458+0000 7f4d2ad68640 1 --2- 172.21.15.26:0/919069899 >> v2:172.21.15.26:6803/610003912 conn(0x562b4e4e7d60 0x562b4e582e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T16:18:22.457 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:22.458+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e4d3fb0 con 0x562b4e4e7d60 2024-01-17T16:18:22.457 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:22.459+0000 7f4d2484c640 1 --2- 172.21.15.26:0/919069899 >> v2:172.21.15.26:6803/610003912 conn(0x562b4e4e7d60 0x562b4e582e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-17T16:18:22.463 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:22.465+0000 7f4d2484c640 1 --2- 172.21.15.26:0/919069899 >> v2:172.21.15.26:6803/610003912 conn(0x562b4e4e7d60 0x562b4e582e10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T16:18:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:29.230+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 1 ==== osd_op_reply(2 exist [writefull 0~5] v358'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:29.229 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-01-17T16:18:29.230 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:29.230+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e4d1120 con 0x562b4e4e7d60 2024-01-17T16:18:29.230 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:29.230+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e4d19a0 con 0x562b4e4e7d60 2024-01-17T16:18:29.252 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:29.254+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v358'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:30.445 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:30.447+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:30.446 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncReadCallback (1217 ms) 2024-01-17T16:18:30.446 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-01-17T16:18:30.446 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:30.447+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e4e4000 con 0x562b4e4e7d60 2024-01-17T16:18:30.447 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:30.447+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e583350 con 0x562b4e4e7d60 2024-01-17T16:18:30.469 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:30.471+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v358'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:30.876 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:30.878+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:30.877 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncReadFuture (431 ms) 2024-01-17T16:18:30.877 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-01-17T16:18:30.877 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:30.878+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e4d1500 con 0x562b4e4e7d60 2024-01-17T16:18:30.877 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:30.878+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e5c41e0 con 0x562b4e4e7d60 2024-01-17T16:18:31.667 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:31.669+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 6 ==== osd_op_reply(7 exist [read 0~5 out=5b] v358'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:31.668 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:31.670+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 7 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:31.669 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncReadYield (793 ms) 2024-01-17T16:18:31.669 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-01-17T16:18:31.669 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:31.670+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e5846c0 con 0x562b4e4e7d60 2024-01-17T16:18:34.047 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.049+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 8 ==== osd_op_reply(9 exist [write 0~5] v362'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.047 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncWriteCallback (2378 ms) 2024-01-17T16:18:34.047 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-01-17T16:18:34.047 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.049+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e5846c0 con 0x562b4e4e7d60 2024-01-17T16:18:34.056 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.059+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 9 ==== osd_op_reply(10 exist [write 0~5] v363'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.056 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncWriteFuture (9 ms) 2024-01-17T16:18:34.056 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-01-17T16:18:34.056 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.059+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e5a6db0 con 0x562b4e4e7d60 2024-01-17T16:18:34.066 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.069+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 10 ==== osd_op_reply(11 exist [write 0~5] v363'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.066 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncWriteYield (10 ms) 2024-01-17T16:18:34.066 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-01-17T16:18:34.067 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.069+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e5836b0 con 0x562b4e4e7d60 2024-01-17T16:18:34.067 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.069+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e584000 con 0x562b4e4e7d60 2024-01-17T16:18:34.071 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.074+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.071 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.074+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v363'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.071 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (5 ms) 2024-01-17T16:18:34.071 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-01-17T16:18:34.072 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.074+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e583b60 con 0x562b4e4e7d60 2024-01-17T16:18:34.072 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.074+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e5a71f0 con 0x562b4e4e7d60 2024-01-17T16:18:34.077 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.080+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v363'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.077 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.080+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.077 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (6 ms) 2024-01-17T16:18:34.077 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-01-17T16:18:34.078 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.080+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e583b60 con 0x562b4e4e7d60 2024-01-17T16:18:34.078 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.080+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e5a6be0 con 0x562b4e4e7d60 2024-01-17T16:18:34.083 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.086+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.083 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.086+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v363'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.084 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncReadOperationYield (6 ms) 2024-01-17T16:18:34.084 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-01-17T16:18:34.084 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.086+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e583b60 con 0x562b4e4e7d60 2024-01-17T16:18:34.093 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.096+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 17 ==== osd_op_reply(18 exist [writefull 0~5] v363'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.093 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (10 ms) 2024-01-17T16:18:34.093 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-01-17T16:18:34.094 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.096+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e583b60 con 0x562b4e4e7d60 2024-01-17T16:18:34.101 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.104+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 18 ==== osd_op_reply(19 exist [writefull 0~5] v363'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.102 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (9 ms) 2024-01-17T16:18:34.102 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-01-17T16:18:34.102 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.105+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 --> v2:172.21.15.26:6803/610003912 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e356) v8 -- 0x562b4e583b60 con 0x562b4e4e7d60 2024-01-17T16:18:34.109 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2484c640 1 -- 172.21.15.26:0/919069899 <== osd.1 v2:172.21.15.26:6803/610003912 19 ==== osd_op_reply(20 exist [writefull 0~5] v363'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4d1000a430 con 0x562b4e4e7d60 2024-01-17T16:18:34.109 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (7 ms) 2024-01-17T16:18:34.110 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 >> v2:172.21.15.26:6803/610003912 conn(0x562b4e4e7d60 msgr2=0x562b4e582e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:18:34.110 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 --2- 172.21.15.26:0/919069899 >> v2:172.21.15.26:6803/610003912 conn(0x562b4e4e7d60 0x562b4e582e10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:18:34.110 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d00036360 msgr2=0x7f4d00038870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:18:34.110 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 --2- 172.21.15.26:0/919069899 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d00036360 0x7f4d00038870 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:18:34.110 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 msgr2=0x562b4e4e3ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T16:18:34.110 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 --2- 172.21.15.26:0/919069899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e4e3ac0 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 shutdown_connections 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 --2- 172.21.15.26:0/919069899 >> v2:172.21.15.26:6803/610003912 conn(0x562b4e4e7d60 0x562b4e582e10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 --2- 172.21.15.26:0/919069899 >> [v2:172.21.15.137:6800/2728392908,v1:172.21.15.137:6801/2728392908] conn(0x7f4d00036360 0x7f4d00038870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 --2- 172.21.15.26:0/919069899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562b4e453a70 0x562b4e4e3ac0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 >> 172.21.15.26:0/919069899 conn(0x562b4e362e00 msgr2=0x562b4e44c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 shutdown_connections 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.112+0000 7f4d2ad68640 1 -- 172.21.15.26:0/919069899 wait complete. 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 12 tests from AsioRados (4881 ms total) 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:18:34.111 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:18:34.112 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 12 tests from 1 test suite ran. (12618 ms total) 2024-01-17T16:18:34.112 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 12 tests. 2024-01-17T16:18:34.112 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:18:34.113 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:18:34.113 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_list 2024-01-17T16:18:34.138 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.141+0000 7f7c45e53940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:18:34.138 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.141+0000 7f7c45e53940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:18:34.138 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:18:34.141+0000 7f7c45e53940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:18:34.138 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 11 tests from 3 test suites. 2024-01-17T16:18:34.138 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:18:34.139 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 7 tests from LibRadosList 2024-01-17T16:18:35.432 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosList.ListObjects 2024-01-17T16:18:49.976 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosList.ListObjects (14544 ms) 2024-01-17T16:18:49.976 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-01-17T16:18:50.112 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (136 ms) 2024-01-17T16:18:50.112 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-01-17T16:18:50.168 INFO:tasks.workunit.client.0.smithi026.stdout:myset foo1,foo2,foo3 2024-01-17T16:18:50.226 INFO:tasks.workunit.client.0.smithi026.stdout:foo1 2024-01-17T16:18:50.226 INFO:tasks.workunit.client.0.smithi026.stdout:foo2 2024-01-17T16:18:50.226 INFO:tasks.workunit.client.0.smithi026.stdout:foo3 2024-01-17T16:18:50.226 INFO:tasks.workunit.client.0.smithi026.stdout:myset foo1,foo4,foo5 2024-01-17T16:18:50.281 INFO:tasks.workunit.client.0.smithi026.stdout:foo4 2024-01-17T16:18:50.281 INFO:tasks.workunit.client.0.smithi026.stdout:foo5 2024-01-17T16:18:50.281 INFO:tasks.workunit.client.0.smithi026.stdout:foo1 2024-01-17T16:18:50.281 INFO:tasks.workunit.client.0.smithi026.stdout:myset foo6,foo7 2024-01-17T16:18:50.336 INFO:tasks.workunit.client.0.smithi026.stdout:foo7 2024-01-17T16:18:50.337 INFO:tasks.workunit.client.0.smithi026.stdout:foo6 2024-01-17T16:18:50.337 INFO:tasks.workunit.client.0.smithi026.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-01-17T16:18:50.392 INFO:tasks.workunit.client.0.smithi026.stdout:ns1:foo4 2024-01-17T16:18:50.392 INFO:tasks.workunit.client.0.smithi026.stdout:ns1:foo5 2024-01-17T16:18:50.392 INFO:tasks.workunit.client.0.smithi026.stdout:ns2:foo7 2024-01-17T16:18:50.392 INFO:tasks.workunit.client.0.smithi026.stdout:ns2:foo6 2024-01-17T16:18:50.392 INFO:tasks.workunit.client.0.smithi026.stdout:ns1:foo1 2024-01-17T16:18:50.392 INFO:tasks.workunit.client.0.smithi026.stdout::foo1 2024-01-17T16:18:50.393 INFO:tasks.workunit.client.0.smithi026.stdout::foo2 2024-01-17T16:18:50.393 INFO:tasks.workunit.client.0.smithi026.stdout::foo3 2024-01-17T16:18:51.621 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosList.ListObjectsNS (1510 ms) 2024-01-17T16:18:51.621 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-01-17T16:18:52.930 INFO:tasks.workunit.client.0.smithi026.stdout:1 0 2024-01-17T16:18:52.930 INFO:tasks.workunit.client.0.smithi026.stdout:10 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:13 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:7 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:14 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:0 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:15 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:11 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:5 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:8 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:6 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:3 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:4 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:12 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:9 0 2024-01-17T16:18:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:2 0 2024-01-17T16:18:52.993 INFO:tasks.workunit.client.0.smithi026.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-01-17T16:18:53.163 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosList.ListObjectsStart (1542 ms) 2024-01-17T16:18:53.163 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-01-17T16:18:53.274 INFO:tasks.workunit.client.0.smithi026.stdout:x cursor=MIN 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-01-17T16:18:53.336 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-01-17T16:18:53.337 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-01-17T16:18:53.337 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-01-17T16:18:53.337 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-01-17T16:18:53.337 INFO:tasks.workunit.client.0.smithi026.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-01-17T16:18:53.395 INFO:tasks.workunit.client.0.smithi026.stdout:FIRST> seek to MIN oid=1 2024-01-17T16:18:53.454 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-01-17T16:18:53.454 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:02547ec2:::1:head 2024-01-17T16:18:53.520 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:02547ec2:::1:head -> 1 2024-01-17T16:18:53.520 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-01-17T16:18:53.520 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:52ea6a34:::10:head 2024-01-17T16:18:53.567 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:52ea6a34:::10:head -> 10 2024-01-17T16:18:53.567 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-01-17T16:18:53.567 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:566253c9:::13:head 2024-01-17T16:18:53.607 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:566253c9:::13:head -> 13 2024-01-17T16:18:53.607 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-01-17T16:18:53.607 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:5c6b0b28:::7:head 2024-01-17T16:18:53.650 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:5c6b0b28:::7:head -> 7 2024-01-17T16:18:53.650 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-01-17T16:18:53.650 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:62a1935d:::14:head 2024-01-17T16:18:53.688 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:62a1935d:::14:head -> 14 2024-01-17T16:18:53.688 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-01-17T16:18:53.688 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:6cac518f:::0:head 2024-01-17T16:18:53.723 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:6cac518f:::0:head -> 0 2024-01-17T16:18:53.723 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-01-17T16:18:53.723 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:863748b0:::15:head 2024-01-17T16:18:53.751 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:863748b0:::15:head -> 15 2024-01-17T16:18:53.751 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-01-17T16:18:53.751 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:89d3ae78:::11:head 2024-01-17T16:18:53.777 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:89d3ae78:::11:head -> 11 2024-01-17T16:18:53.777 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-01-17T16:18:53.777 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:b29083e3:::5:head 2024-01-17T16:18:53.795 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:b29083e3:::5:head -> 5 2024-01-17T16:18:53.795 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-01-17T16:18:53.795 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:bd63b0f1:::8:head 2024-01-17T16:18:53.811 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:bd63b0f1:::8:head -> 8 2024-01-17T16:18:53.811 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-01-17T16:18:53.811 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:c4fdafeb:::6:head 2024-01-17T16:18:53.825 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:c4fdafeb:::6:head -> 6 2024-01-17T16:18:53.826 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-01-17T16:18:53.826 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:cfc208b3:::3:head 2024-01-17T16:18:53.838 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:cfc208b3:::3:head -> 3 2024-01-17T16:18:53.838 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-01-17T16:18:53.838 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:d83876eb:::4:head 2024-01-17T16:18:53.847 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:d83876eb:::4:head -> 4 2024-01-17T16:18:53.847 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-01-17T16:18:53.847 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:de5d7c5f:::12:head 2024-01-17T16:18:53.855 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:de5d7c5f:::12:head -> 12 2024-01-17T16:18:53.855 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-01-17T16:18:53.856 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:e960b815:::9:head 2024-01-17T16:18:53.860 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:e960b815:::9:head -> 9 2024-01-17T16:18:53.860 INFO:tasks.workunit.client.0.smithi026.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-01-17T16:18:53.861 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:f905c69b:::2:head 2024-01-17T16:18:53.862 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:f905c69b:::2:head -> 2 2024-01-17T16:18:53.862 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:f905c69b:::2:head 2024-01-17T16:18:53.862 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-01-17T16:18:53.864 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:f905c69b:::2:head -> 2 2024-01-17T16:18:53.864 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=2 expected=2 2024-01-17T16:18:53.864 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:d83876eb:::4:head 2024-01-17T16:18:53.864 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-01-17T16:18:53.872 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:d83876eb:::4:head -> 4 2024-01-17T16:18:53.872 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=4 expected=4 2024-01-17T16:18:53.872 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:6cac518f:::0:head 2024-01-17T16:18:53.872 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-01-17T16:18:53.905 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:6cac518f:::0:head -> 0 2024-01-17T16:18:53.906 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=0 expected=0 2024-01-17T16:18:53.906 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:e960b815:::9:head 2024-01-17T16:18:53.906 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-01-17T16:18:53.910 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:e960b815:::9:head -> 9 2024-01-17T16:18:53.910 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=9 expected=9 2024-01-17T16:18:53.911 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:de5d7c5f:::12:head 2024-01-17T16:18:53.911 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-01-17T16:18:53.919 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:de5d7c5f:::12:head -> 12 2024-01-17T16:18:53.919 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=12 expected=12 2024-01-17T16:18:53.919 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:cfc208b3:::3:head 2024-01-17T16:18:53.919 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-01-17T16:18:53.931 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:cfc208b3:::3:head -> 3 2024-01-17T16:18:53.932 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=3 expected=3 2024-01-17T16:18:53.932 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:c4fdafeb:::6:head 2024-01-17T16:18:53.932 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-01-17T16:18:53.946 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:c4fdafeb:::6:head -> 6 2024-01-17T16:18:53.946 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=6 expected=6 2024-01-17T16:18:53.946 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:bd63b0f1:::8:head 2024-01-17T16:18:53.946 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-01-17T16:18:53.962 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:bd63b0f1:::8:head -> 8 2024-01-17T16:18:53.962 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=8 expected=8 2024-01-17T16:18:53.962 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:b29083e3:::5:head 2024-01-17T16:18:53.962 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-01-17T16:18:53.981 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:b29083e3:::5:head -> 5 2024-01-17T16:18:53.981 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=5 expected=5 2024-01-17T16:18:53.981 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:89d3ae78:::11:head 2024-01-17T16:18:53.981 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-01-17T16:18:54.007 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:89d3ae78:::11:head -> 11 2024-01-17T16:18:54.007 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=11 expected=11 2024-01-17T16:18:54.007 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:863748b0:::15:head 2024-01-17T16:18:54.007 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-01-17T16:18:54.039 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:863748b0:::15:head -> 15 2024-01-17T16:18:54.039 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=15 expected=15 2024-01-17T16:18:54.040 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:62a1935d:::14:head 2024-01-17T16:18:54.040 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-01-17T16:18:54.075 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:62a1935d:::14:head -> 14 2024-01-17T16:18:54.075 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=14 expected=14 2024-01-17T16:18:54.075 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:5c6b0b28:::7:head 2024-01-17T16:18:54.075 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-01-17T16:18:54.122 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:5c6b0b28:::7:head -> 7 2024-01-17T16:18:54.122 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=7 expected=7 2024-01-17T16:18:54.122 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:566253c9:::13:head 2024-01-17T16:18:54.122 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-01-17T16:18:54.161 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:566253c9:::13:head -> 13 2024-01-17T16:18:54.161 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=13 expected=13 2024-01-17T16:18:54.161 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:52ea6a34:::10:head 2024-01-17T16:18:54.161 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-01-17T16:18:54.199 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:52ea6a34:::10:head -> 10 2024-01-17T16:18:54.199 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=10 expected=10 2024-01-17T16:18:54.199 INFO:tasks.workunit.client.0.smithi026.stdout:: seek to 76:02547ec2:::1:head 2024-01-17T16:18:54.199 INFO:tasks.workunit.client.0.smithi026.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-01-17T16:18:54.254 INFO:tasks.workunit.client.0.smithi026.stdout:> 76:02547ec2:::1:head -> 1 2024-01-17T16:18:54.255 INFO:tasks.workunit.client.0.smithi026.stdout:: entry=1 expected=1 2024-01-17T16:18:54.415 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosList.ListObjectsCursor (1251 ms) 2024-01-17T16:18:54.415 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-01-17T16:18:54.748 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosList.EnumerateObjects (334 ms) 2024-01-17T16:18:54.749 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-01-17T16:18:54.856 INFO:tasks.workunit.client.0.smithi026.stdout:split 0/5 -> MIN 76:33333333::::head 2024-01-17T16:18:54.870 INFO:tasks.workunit.client.0.smithi026.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-01-17T16:18:54.882 INFO:tasks.workunit.client.0.smithi026.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-01-17T16:18:54.897 INFO:tasks.workunit.client.0.smithi026.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-01-17T16:18:54.910 INFO:tasks.workunit.client.0.smithi026.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-01-17T16:18:55.083 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (335 ms) 2024-01-17T16:18:55.432 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 7 tests from LibRadosList (19652 ms total) 2024-01-17T16:18:55.432 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:18:55.432 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 3 tests from LibRadosListEC 2024-01-17T16:18:55.432 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:70: Skipped 2024-01-17T16:18:55.432 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:84: Skipped 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:96: Skipped 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:84: Skipped 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:96: Skipped 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-01-17T16:18:55.433 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:84: Skipped 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:96: Skipped 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:78: Skipped 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosListNP 2024-01-17T16:18:55.434 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-01-17T16:19:03.449 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosListNP.ListObjectsError (8018 ms) 2024-01-17T16:19:03.449 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosListNP (8018 ms total) 2024-01-17T16:19:03.449 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:19:03.449 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:19:03.449 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 11 tests from 3 test suites ran. (29311 ms total) 2024-01-17T16:19:03.449 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 8 tests. 2024-01-17T16:19:03.449 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 3 tests, listed below: 2024-01-17T16:19:03.449 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-01-17T16:19:03.449 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-01-17T16:19:03.450 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-01-17T16:19:03.452 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:19:03.452 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:19:03.452 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_lock 2024-01-17T16:19:03.469 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:19:03.469 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 16 tests from 2 test suites. 2024-01-17T16:19:03.469 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:19:03.469 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosLock 2024-01-17T16:19:05.455 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-01-17T16:19:13.898 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLock.LockExclusive (8443 ms) 2024-01-17T16:19:13.899 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLock.LockShared 2024-01-17T16:19:13.921 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLock.LockShared (23 ms) 2024-01-17T16:19:13.921 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-01-17T16:19:18.663 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLock.LockExclusiveDur (4742 ms) 2024-01-17T16:19:18.663 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-01-17T16:19:19.934 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLock.LockSharedDur (1271 ms) 2024-01-17T16:19:19.934 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-01-17T16:19:19.963 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLock.LockMayRenew (29 ms) 2024-01-17T16:19:19.963 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLock.Unlock 2024-01-17T16:19:19.987 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLock.Unlock (25 ms) 2024-01-17T16:19:19.987 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLock.ListLockers 2024-01-17T16:19:20.021 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLock.ListLockers (33 ms) 2024-01-17T16:19:20.021 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLock.BreakLock 2024-01-17T16:19:20.041 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLock.BreakLock (21 ms) 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosLock (14587 ms total) 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosLockEC 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:168: Skipped 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-01-17T16:19:20.091 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:19:20.092 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.093 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:176: Skipped 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 16 tests from 2 test suites ran. (16621 ms total) 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 8 tests. 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 8 tests, listed below: 2024-01-17T16:19:20.094 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:19:20.095 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_lock_pp 2024-01-17T16:19:20.110 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:19:20.110 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 16 tests from 2 test suites. 2024-01-17T16:19:20.111 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:19:20.111 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosLockPP 2024-01-17T16:19:20.111 INFO:tasks.workunit.client.0.smithi026.stdout:seed 33287 2024-01-17T16:19:22.100 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-01-17T16:19:30.560 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (8460 ms) 2024-01-17T16:19:30.560 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-01-17T16:19:31.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLockPP.LockSharedPP (937 ms) 2024-01-17T16:19:31.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-01-17T16:19:38.069 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (6572 ms) 2024-01-17T16:19:38.069 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-01-17T16:19:40.389 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (2320 ms) 2024-01-17T16:19:40.389 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-01-17T16:19:40.413 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (24 ms) 2024-01-17T16:19:40.413 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-01-17T16:19:41.647 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLockPP.UnlockPP (1235 ms) 2024-01-17T16:19:41.648 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-01-17T16:19:41.684 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLockPP.ListLockersPP (37 ms) 2024-01-17T16:19:41.684 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-01-17T16:19:42.365 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosLockPP.BreakLockPP (680 ms) 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosLockPP (20265 ms total) 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosLockECPP 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:373: Skipped 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-01-17T16:19:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-01-17T16:19:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:381: Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:19:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 16 tests from 2 test suites ran. (22361 ms total) 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 8 tests. 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 8 tests, listed below: 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:19:42.478 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:19:42.479 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_misc 2024-01-17T16:19:42.505 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:19:42.508+0000 7fe9cb05c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:19:42.506 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:19:42.509+0000 7fe9cb05c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:19:42.506 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:19:42.509+0000 7fe9cb05c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:19:42.506 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 12 tests from 4 test suites. 2024-01-17T16:19:42.506 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:19:42.506 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosMiscVersion 2024-01-17T16:19:42.506 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-01-17T16:19:42.506 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-01-17T16:19:42.506 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-01-17T16:19:42.507 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:19:42.507 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-01-17T16:19:42.507 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-01-17T16:19:42.545 INFO:tasks.workunit.client.0.smithi026.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-01-17T16:19:42.545 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:19:42.549+0000 7fe9cb05c640 -1 failed for service _ceph-mon._tcp 2024-01-17T16:19:42.546 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:19:42.549+0000 7fe9cb05c640 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-01-17T16:19:42.546 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (40 ms) 2024-01-17T16:19:42.546 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-01-17T16:19:44.552 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2006 ms) 2024-01-17T16:19:44.552 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (2046 ms total) 2024-01-17T16:19:44.552 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:19:44.552 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosMiscPool 2024-01-17T16:19:44.552 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-01-17T16:19:46.436 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x7fe994005d20 2024-01-17T16:19:47.436 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x7fe9b4005d20 2024-01-17T16:19:48.436 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1723f00 2024-01-17T16:19:49.436 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e16f8710 2024-01-17T16:19:50.436 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e16f58f0 2024-01-17T16:19:51.436 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a3e830 2024-01-17T16:19:52.436 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a3f2e0 2024-01-17T16:19:53.437 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a3fd90 2024-01-17T16:19:54.437 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a407f0 2024-01-17T16:19:55.437 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a40e40 2024-01-17T16:19:56.437 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a414f0 2024-01-17T16:19:57.438 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a41f20 2024-01-17T16:19:58.438 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a40570 2024-01-17T16:19:59.438 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a42e60 2024-01-17T16:20:00.438 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a41ce0 2024-01-17T16:20:01.438 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a43da0 2024-01-17T16:20:02.438 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a42c10 2024-01-17T16:20:03.438 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a44d30 2024-01-17T16:20:04.438 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a43b60 2024-01-17T16:20:05.439 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a45c90 2024-01-17T16:20:06.439 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a44a60 2024-01-17T16:20:07.439 INFO:tasks.workunit.client.0.smithi026.stdout:started 0x55b0e1a46bd0 2024-01-17T16:20:07.439 INFO:tasks.workunit.client.0.smithi026.stdout: started 22 aios 2024-01-17T16:20:07.439 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x7fe994005d20 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x7fe9b4005d20 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1723f00 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e16f8710 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e16f58f0 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a3e830 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a3f2e0 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a3fd90 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a407f0 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a40e40 2024-01-17T16:20:07.440 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a414f0 2024-01-17T16:20:07.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a41f20 2024-01-17T16:20:07.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a40570 2024-01-17T16:20:07.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a42e60 2024-01-17T16:20:07.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a41ce0 2024-01-17T16:20:07.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a43da0 2024-01-17T16:20:07.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a42c10 2024-01-17T16:20:07.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a44d30 2024-01-17T16:20:07.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a43b60 2024-01-17T16:20:07.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a45c90 2024-01-17T16:20:07.442 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a44a60 2024-01-17T16:20:07.442 INFO:tasks.workunit.client.0.smithi026.stdout:waiting 0x55b0e1a46bd0 2024-01-17T16:20:09.360 INFO:tasks.workunit.client.0.smithi026.stdout:done. 2024-01-17T16:20:11.108 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (26557 ms) 2024-01-17T16:20:11.109 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosMiscPool (26557 ms total) 2024-01-17T16:20:11.109 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:20:11.109 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosMisc 2024-01-17T16:20:13.114 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-01-17T16:20:13.114 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-01-17T16:20:13.114 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMisc.Exec 2024-01-17T16:20:30.866 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMisc.Exec (17752 ms) 2024-01-17T16:20:30.866 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-01-17T16:20:53.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMisc.WriteSame (22609 ms) 2024-01-17T16:20:53.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-01-17T16:20:53.557 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMisc.CmpExt (83 ms) 2024-01-17T16:20:53.557 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMisc.Applications 2024-01-17T16:20:58.469 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMisc.Applications (4912 ms) 2024-01-17T16:20:58.469 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-01-17T16:20:58.469 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-01-17T16:20:58.469 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-01-17T16:20:58.469 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-01-17T16:20:58.470 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-01-17T16:21:22.550 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMisc.ShutdownRace (24081 ms) 2024-01-17T16:21:23.467 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 8 tests from LibRadosMisc (69437 ms total) 2024-01-17T16:21:23.467 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:21:23.467 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:21:23.467 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 12 tests from 4 test suites ran. (100962 ms total) 2024-01-17T16:21:23.467 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 12 tests. 2024-01-17T16:21:23.480 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:21:23.480 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:21:23.480 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_misc_pp 2024-01-17T16:21:23.510 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:21:23.512+0000 7efd6024d7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:21:23.510 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:21:23.512+0000 7efd6024d7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:21:23.510 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:21:23.513+0000 7efd6024d7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:21:23.511 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 31 tests from 7 test suites. 2024-01-17T16:21:23.511 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:21:23.511 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosMiscVersion 2024-01-17T16:21:23.511 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-01-17T16:21:23.511 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-01-17T16:21:23.511 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-01-17T16:21:23.511 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:21:23.511 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 22 tests from LibRadosMiscPP 2024-01-17T16:21:23.511 INFO:tasks.workunit.client.0.smithi026.stdout:seed 94955 2024-01-17T16:21:25.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-01-17T16:21:25.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-01-17T16:21:25.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-01-17T16:21:33.758 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.LongNamePP (8283 ms) 2024-01-17T16:21:33.758 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-01-17T16:21:37.068 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.LongLocatorPP (3309 ms) 2024-01-17T16:21:37.068 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-01-17T16:21:37.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (407 ms) 2024-01-17T16:21:37.475 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-01-17T16:21:37.502 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (28 ms) 2024-01-17T16:21:37.502 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-01-17T16:21:37.512 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.ExecPP (10 ms) 2024-01-17T16:21:37.512 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-01-17T16:21:37.521 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (9 ms) 2024-01-17T16:21:37.522 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-01-17T16:21:37.538 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.Operate1PP (17 ms) 2024-01-17T16:21:37.538 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-01-17T16:21:37.548 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.Operate2PP (9 ms) 2024-01-17T16:21:37.548 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-01-17T16:21:37.581 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (34 ms) 2024-01-17T16:21:37.581 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-01-17T16:21:37.593 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (11 ms) 2024-01-17T16:21:37.593 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-01-17T16:21:37.608 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (16 ms) 2024-01-17T16:21:37.609 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-01-17T16:21:37.640 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (32 ms) 2024-01-17T16:21:37.641 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-01-17T16:21:37.648 INFO:tasks.workunit.client.0.smithi026.stdout:osd_max_attr_size = 0 2024-01-17T16:21:37.648 INFO:tasks.workunit.client.0.smithi026.stdout:osd_max_attr_size == 0; skipping test 2024-01-17T16:21:47.903 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (10262 ms) 2024-01-17T16:21:47.903 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-01-17T16:21:47.903 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/misc_cxx.cc:386: Skipped 2024-01-17T16:21:47.903 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:21:47.904 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-01-17T16:21:47.904 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-01-17T16:21:47.904 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/misc_cxx.cc:549: Skipped 2024-01-17T16:21:47.904 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:21:47.904 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-01-17T16:21:47.904 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-01-17T16:21:47.930 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (28 ms) 2024-01-17T16:21:47.930 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-01-17T16:21:47.944 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (14 ms) 2024-01-17T16:21:47.944 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-01-17T16:21:52.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.Applications (4548 ms) 2024-01-17T16:21:52.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-01-17T16:21:52.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-01-17T16:21:52.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-01-17T16:21:52.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-01-17T16:21:52.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-01-17T16:21:52.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 22 tests from LibRadosMiscPP (27018 ms total) 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/misc_cxx.cc:476: Skipped 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/misc_cxx.cc:498: Skipped 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/misc_cxx.cc:504: Skipped 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:21:53.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-01-17T16:21:53.498 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/misc_cxx.cc:491: Skipped 2024-01-17T16:21:53.498 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:21:53.498 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-01-17T16:21:53.498 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:21:53.498 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-01-17T16:21:55.461 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-01-17T16:22:24.075 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosChecksum/0.Subset (28614 ms) 2024-01-17T16:22:24.075 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-01-17T16:22:24.100 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosChecksum/0.Chunked (25 ms) 2024-01-17T16:22:24.478 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosChecksum/0 (28639 ms total) 2024-01-17T16:22:24.479 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:22:24.479 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-01-17T16:22:26.472 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-01-17T16:22:32.031 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosChecksum/1.Subset (5558 ms) 2024-01-17T16:22:32.031 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-01-17T16:22:32.447 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosChecksum/1.Chunked (417 ms) 2024-01-17T16:22:32.500 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosChecksum/1 (5975 ms total) 2024-01-17T16:22:32.500 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:22:32.500 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-01-17T16:22:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-01-17T16:22:49.748 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosChecksum/2.Subset (15241 ms) 2024-01-17T16:22:49.748 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-01-17T16:22:49.883 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosChecksum/2.Chunked (135 ms) 2024-01-17T16:22:50.498 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosChecksum/2 (15376 ms total) 2024-01-17T16:22:50.498 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:22:50.498 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosMiscECPP 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:373: Skipped 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:381: Skipped 2024-01-17T16:22:50.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:50.500 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-01-17T16:22:50.500 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:22:50.500 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:22:50.500 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 31 tests from 7 test suites ran. (86987 ms total) 2024-01-17T16:22:50.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 27 tests. 2024-01-17T16:22:50.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 4 tests, listed below: 2024-01-17T16:22:50.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-01-17T16:22:50.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-01-17T16:22:50.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-01-17T16:22:50.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-01-17T16:22:50.501 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:22:50.501 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:22:50.501 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_tier_pp 2024-01-17T16:22:50.526 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:22:50.528+0000 7f1c82c4e940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:22:50.526 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:22:50.528+0000 7f1c82c4e940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:22:50.526 INFO:tasks.workunit.client.0.smithi026.stderr:2024-01-17T16:22:50.529+0000 7f1c82c4e940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T16:22:50.527 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 77 tests from 4 test suites. 2024-01-17T16:22:50.527 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:22:50.527 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 3 tests from LibRadosTierPP 2024-01-17T16:22:50.527 INFO:tasks.workunit.client.0.smithi026.stdout:seed 95027 2024-01-17T16:22:52.503 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:287: Skipped 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:2182: Skipped 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:2561: Skipped 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:52.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-01-17T16:22:53.507 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-01-17T16:22:53.508 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:22:53.508 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-01-17T16:22:55.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-01-17T16:22:55.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.492 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-01-17T16:22:55.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-01-17T16:22:55.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-01-17T16:22:55.498 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.500 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (1 ms) 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-01-17T16:22:55.501 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.502 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-01-17T16:22:55.503 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.504 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:223: Skipped 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:233: Skipped 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:55.505 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-01-17T16:22:56.484 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosTierECPP 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:373: Skipped 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:22:56.485 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-01-17T16:22:56.486 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:381: Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6267: Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-01-17T16:22:56.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.489 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-01-17T16:22:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.491 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (1 ms) 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-01-17T16:22:56.492 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6278: Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6288: Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-01-17T16:22:56.495 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/tier_cxx.cc:6272: Skipped 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 77 tests from 4 test suites ran. (5953 ms total) 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 0 tests. 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 77 tests, listed below: 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-01-17T16:22:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-01-17T16:22:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-01-17T16:22:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-01-17T16:22:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-01-17T16:22:56.500 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-01-17T16:22:56.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-01-17T16:22:56.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-01-17T16:22:56.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-01-17T16:22:56.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-01-17T16:22:56.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-01-17T16:22:56.501 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:22:56.501 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:22:56.501 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_pool 2024-01-17T16:22:56.501 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:22:56.502 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 9 tests from 1 test suite. 2024-01-17T16:22:56.502 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:22:56.502 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 9 tests from LibRadosPools 2024-01-17T16:22:56.502 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPools.PoolList 2024-01-17T16:22:59.528 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPools.PoolList (3030 ms) 2024-01-17T16:22:59.528 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-01-17T16:23:02.537 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPools.PoolLookup (3010 ms) 2024-01-17T16:23:02.537 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-01-17T16:23:05.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPools.PoolLookup2 (2943 ms) 2024-01-17T16:23:05.480 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-01-17T16:23:08.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3008 ms) 2024-01-17T16:23:08.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-01-17T16:23:11.504 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3016 ms) 2024-01-17T16:23:11.505 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-01-17T16:23:16.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPools.PoolDelete (4979 ms) 2024-01-17T16:23:16.483 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-01-17T16:23:21.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPools.PoolCreateDelete (5018 ms) 2024-01-17T16:23:21.501 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-01-17T16:23:26.486 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (4984 ms) 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/pool.cc:139: Skipped 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 9 tests from LibRadosPools (29988 ms total) 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 9 tests from 1 test suite ran. (29988 ms total) 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 8 tests. 2024-01-17T16:23:26.487 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 1 test, listed below: 2024-01-17T16:23:26.488 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-01-17T16:23:26.489 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:23:26.489 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:23:26.489 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_snapshots 2024-01-17T16:23:26.503 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:23:26.503 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 13 tests from 4 test suites. 2024-01-17T16:23:26.503 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:23:26.504 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosSnapshots 2024-01-17T16:23:28.492 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-01-17T16:23:51.494 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshots.SnapList (23002 ms) 2024-01-17T16:23:51.495 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-01-17T16:23:58.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshots.SnapRemove (7020 ms) 2024-01-17T16:23:58.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-01-17T16:24:09.496 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshots.Rollback (10982 ms) 2024-01-17T16:24:09.497 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-01-17T16:24:11.503 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2006 ms) 2024-01-17T16:24:12.507 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosSnapshots (43011 ms total) 2024-01-17T16:24:12.507 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:24:12.508 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-01-17T16:24:14.517 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-01-17T16:24:16.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-17T16:24:22.459 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-01-17T16:24:27.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~11s 2024-01-17T16:24:33.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~17s 2024-01-17T16:24:38.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~22s 2024-01-17T16:24:44.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~28s 2024-01-17T16:24:49.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~33s 2024-01-17T16:24:55.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~39s 2024-01-17T16:24:55.836 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (41318 ms) 2024-01-17T16:24:55.836 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-01-17T16:25:00.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~44s 2024-01-17T16:25:04.247 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (8411 ms) 2024-01-17T16:25:04.247 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-01-17T16:25:06.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~50s 2024-01-17T16:25:11.059 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (6813 ms) 2024-01-17T16:25:11.510 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (56542 ms total) 2024-01-17T16:25:11.510 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:25:11.510 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-01-17T16:25:11.510 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:168: Skipped 2024-01-17T16:25:11.510 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.510 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-01-17T16:25:11.510 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:25:11.510 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.511 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:176: Skipped 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-01-17T16:25:11.512 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:168: Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-01-17T16:25:11.513 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:176: Skipped 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 13 tests from 4 test suites ran. (105006 ms total) 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 7 tests. 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 6 tests, listed below: 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-01-17T16:25:11.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-01-17T16:25:11.515 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:25:11.515 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:25:11.515 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_snapshots_pp 2024-01-17T16:25:11.530 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:25:11.531 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 21 tests from 5 test suites. 2024-01-17T16:25:11.531 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:25:11.531 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-01-17T16:25:11.531 INFO:tasks.workunit.client.0.smithi026.stdout:seed 95283 2024-01-17T16:25:11.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~55s 2024-01-17T16:25:13.514 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-01-17T16:25:17.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~61s 2024-01-17T16:25:23.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~66s 2024-01-17T16:25:28.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~72s 2024-01-17T16:25:34.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~77s 2024-01-17T16:25:34.518 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (21005 ms) 2024-01-17T16:25:34.519 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-01-17T16:25:38.129 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (3610 ms) 2024-01-17T16:25:38.129 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-01-17T16:25:39.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~83s 2024-01-17T16:25:43.516 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (5387 ms) 2024-01-17T16:25:43.516 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-01-17T16:25:45.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~88s 2024-01-17T16:25:46.517 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (3002 ms) 2024-01-17T16:25:46.517 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-01-17T16:25:50.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~94s 2024-01-17T16:25:54.521 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (8004 ms) 2024-01-17T16:25:55.513 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from LibRadosSnapshotsPP (41008 ms total) 2024-01-17T16:25:55.513 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:25:55.513 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-01-17T16:25:56.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2024-01-17T16:25:57.530 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-01-17T16:26:01.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-01-17T16:26:07.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2024-01-17T16:26:12.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~116s 2024-01-17T16:26:12.869 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (15339 ms) 2024-01-17T16:26:12.869 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-01-17T16:26:12.870 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/snapshots_cxx.cc:156: Skipped 2024-01-17T16:26:12.870 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:12.870 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP (0 ms) 2024-01-17T16:26:12.870 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-01-17T16:26:12.870 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/snapshots_cxx.cc:242: Skipped 2024-01-17T16:26:12.870 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:12.870 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (0 ms) 2024-01-17T16:26:12.870 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-01-17T16:26:16.244 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3375 ms) 2024-01-17T16:26:16.244 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-01-17T16:26:18.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~121s 2024-01-17T16:26:21.785 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (5541 ms) 2024-01-17T16:26:21.785 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-01-17T16:26:21.785 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-01-17T16:26:21.785 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:26:21.785 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-01-17T16:26:21.785 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-01-17T16:26:23.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~127s 2024-01-17T16:26:25.519 INFO:tasks.workunit.client.0.smithi026.stdout:deleting snap 9 in pool LibRadosSnapshotsSelfManagedPP_smithi026-95283-7 2024-01-17T16:26:26.520 INFO:tasks.workunit.client.0.smithi026.stdout:waiting for snaps to purge 2024-01-17T16:26:29.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~132s 2024-01-17T16:26:34.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~138s 2024-01-17T16:26:40.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~143s 2024-01-17T16:26:41.533 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (19748 ms) 2024-01-17T16:26:42.525 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (44003 ms total) 2024-01-17T16:26:42.526 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:26:42.526 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-01-17T16:26:42.526 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-01-17T16:26:42.531 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (6 ms) 2024-01-17T16:26:42.531 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-01-17T16:26:45.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~149s 2024-01-17T16:26:47.561 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5029 ms) 2024-01-17T16:26:47.561 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5035 ms total) 2024-01-17T16:26:47.561 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:26:47.561 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-01-17T16:26:47.561 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:373: Skipped 2024-01-17T16:26:47.561 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.561 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-01-17T16:26:47.561 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:26:47.561 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-01-17T16:26:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:381: Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:373: Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:26:47.563 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:381: Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:26:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 21 tests from 5 test suites ran. (96029 ms total) 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 11 tests. 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 10 tests, listed below: 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-01-17T16:26:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-01-17T16:26:47.566 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:26:47.566 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:26:47.566 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_stat 2024-01-17T16:26:47.577 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:26:47.577 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 9 tests from 2 test suites. 2024-01-17T16:26:47.577 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:26:47.577 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from LibRadosStat 2024-01-17T16:26:49.547 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStat.Stat 2024-01-17T16:26:51.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~154s 2024-01-17T16:26:56.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~160s 2024-01-17T16:27:02.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2024-01-17T16:27:07.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~171s 2024-01-17T16:27:09.709 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStat.Stat (20163 ms) 2024-01-17T16:27:09.710 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStat.Stat2 2024-01-17T16:27:10.155 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStat.Stat2 (446 ms) 2024-01-17T16:27:10.155 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStat.StatNS 2024-01-17T16:27:10.199 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStat.StatNS (44 ms) 2024-01-17T16:27:10.200 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-01-17T16:27:10.200 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStat.ClusterStat (1 ms) 2024-01-17T16:27:10.200 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStat.PoolStat 2024-01-17T16:27:10.205 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStat.PoolStat (5 ms) 2024-01-17T16:27:10.544 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from LibRadosStat (20659 ms total) 2024-01-17T16:27:10.544 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:27:10.544 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosStatEC 2024-01-17T16:27:10.544 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:168: Skipped 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatEC.Stat 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatEC.Stat (1 ms) 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:27:10.545 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-01-17T16:27:10.546 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:176: Skipped 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosStatEC (1 ms total) 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:27:10.547 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 9 tests from 2 test suites ran. (22967 ms total) 2024-01-17T16:27:10.548 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 5 tests. 2024-01-17T16:27:10.548 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 4 tests, listed below: 2024-01-17T16:27:10.548 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-01-17T16:27:10.548 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-01-17T16:27:10.548 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-01-17T16:27:10.548 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-01-17T16:27:10.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:27:10.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:27:10.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_stat_pp 2024-01-17T16:27:10.565 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:27:10.565 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 9 tests from 2 test suites. 2024-01-17T16:27:10.565 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:27:10.565 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from LibRadosStatPP 2024-01-17T16:27:10.566 INFO:tasks.workunit.client.0.smithi026.stdout:seed 95418 2024-01-17T16:27:12.548 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-01-17T16:27:13.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~176s 2024-01-17T16:27:18.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~182s 2024-01-17T16:27:23.777 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStatPP.StatPP (11231 ms) 2024-01-17T16:27:23.777 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-01-17T16:27:24.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~187s 2024-01-17T16:27:27.921 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (4143 ms) 2024-01-17T16:27:27.921 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-01-17T16:27:27.921 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-01-17T16:27:27.921 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-01-17T16:27:29.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~193s 2024-01-17T16:27:35.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~198s 2024-01-17T16:27:35.309 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStatPP.PoolStatPP (7389 ms) 2024-01-17T16:27:35.310 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-01-17T16:27:37.790 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosStatPP.StatPPNS (2482 ms) 2024-01-17T16:27:38.540 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from LibRadosStatPP (25245 ms total) 2024-01-17T16:27:38.541 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:27:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosStatECPP 2024-01-17T16:27:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:373: Skipped 2024-01-17T16:27:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-01-17T16:27:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:27:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:27:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:27:38.542 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:381: Skipped 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-01-17T16:27:38.543 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:27:38.544 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:27:38.544 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 9 tests from 2 test suites ran. (27974 ms total) 2024-01-17T16:27:38.544 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 5 tests. 2024-01-17T16:27:38.544 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 4 tests, listed below: 2024-01-17T16:27:38.544 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-01-17T16:27:38.544 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-01-17T16:27:38.544 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-01-17T16:27:38.544 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-01-17T16:27:38.545 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:27:38.545 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:27:38.545 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_watch_notify 2024-01-17T16:27:38.562 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:27:38.562 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 11 tests from 2 test suites. 2024-01-17T16:27:38.562 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:27:38.562 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-01-17T16:27:40.536 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-01-17T16:27:40.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~204s 2024-01-17T16:27:46.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~209s 2024-01-17T16:27:48.249 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify_test_cb 2024-01-17T16:27:51.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (11028 ms) 2024-01-17T16:27:51.565 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-01-17T16:27:51.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~215s 2024-01-17T16:27:53.277 INFO:tasks.workunit.client.0.smithi026.stdout:waiting up to 300 for disconnect notification ... 2024-01-17T16:27:56.427 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_errcb cookie 94556542000368 err -107 2024-01-17T16:27:57.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~220s 2024-01-17T16:27:59.508 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (7943 ms) 2024-01-17T16:27:59.508 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-01-17T16:28:01.783 INFO:tasks.workunit.client.0.smithi026.stdout:waiting up to 300 for disconnect notification ... 2024-01-17T16:28:02.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~226s 2024-01-17T16:28:05.075 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_errcb cookie 94556542018864 err -107 2024-01-17T16:28:05.884 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (6376 ms) 2024-01-17T16:28:05.884 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-01-17T16:28:05.895 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_cb from 15572 notify_id 3152505995265 cookie 94556542032048 2024-01-17T16:28:05.903 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (20 ms) 2024-01-17T16:28:05.904 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-01-17T16:28:07.739 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_cb from 15572 notify_id 3152505995264 cookie 94556542032048 2024-01-17T16:28:07.752 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (1849 ms) 2024-01-17T16:28:07.752 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-01-17T16:28:07.768 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_cb from 15572 notify_id 3152505995265 cookie 94556542032048 2024-01-17T16:28:07.785 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.AioNotify (33 ms) 2024-01-17T16:28:07.785 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-01-17T16:28:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_cb from 15572 notify_id 3152505995264 cookie 94556542032048 2024-01-17T16:28:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_cb from 15572 notify_id 3152505995264 cookie 94556542053872 2024-01-17T16:28:07.832 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (47 ms) 2024-01-17T16:28:07.832 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-01-17T16:28:07.844 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_cb from 15572 notify_id 3152505995266 cookie 94556542032048 2024-01-17T16:28:08.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~231s 2024-01-17T16:28:10.844 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_cb from 15572 notify_id 3161095929859 cookie 94556542032048 2024-01-17T16:28:10.856 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3024 ms) 2024-01-17T16:28:10.856 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-01-17T16:28:10.875 INFO:tasks.workunit.client.0.smithi026.stdout:waiting up to 1024 for osd to time us out ... 2024-01-17T16:28:13.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~237s 2024-01-17T16:28:14.882 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_errcb cookie 94556542032048 err -107 2024-01-17T16:28:15.896 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_cb from 15572 notify_id 3161095929859 cookie 94556542032048 2024-01-17T16:28:15.908 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5051 ms) 2024-01-17T16:28:15.908 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-01-17T16:28:15.923 INFO:tasks.workunit.client.0.smithi026.stdout:waiting up to 30 for disconnect notification ... 2024-01-17T16:28:18.593 INFO:tasks.workunit.client.0.smithi026.stdout:watch_notify2_test_errcb cookie 94556542053872 err -107 2024-01-17T16:28:18.929 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (3022 ms) 2024-01-17T16:28:19.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~242s 2024-01-17T16:28:19.212 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 10 tests from LibRadosWatchNotify (38393 ms total) 2024-01-17T16:28:19.212 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:168: Skipped 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:182: Skipped 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:196: Skipped 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/TestCase.cc:176: Skipped 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-01-17T16:28:19.213 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:28:19.214 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:28:19.214 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 11 tests from 2 test suites ran. (40650 ms total) 2024-01-17T16:28:19.214 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 10 tests. 2024-01-17T16:28:19.214 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 1 test, listed below: 2024-01-17T16:28:19.214 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-01-17T16:28:19.214 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:28:19.214 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:28:19.214 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-01-17T16:28:19.237 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:28:19.237 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 16 tests from 2 test suites. 2024-01-17T16:28:19.237 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:28:19.237 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-01-17T16:28:19.237 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:373: Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:387: Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:400: Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.238 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-01-17T16:28:19.239 INFO:tasks.workunit.client.0.smithi026.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-720-gcecb6cb5/rpm/el9/BUILD/ceph-19.0.0-720-gcecb6cb5/src/test/librados/testcase_cxx.cc:381: Skipped 2024-01-17T16:28:19.239 INFO:tasks.workunit.client.0.smithi026.stdout:Not supported by crimson yet. Skipped 2024-01-17T16:28:19.239 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-01-17T16:28:19.239 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:28:19.239 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-01-17T16:28:21.219 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-01-17T16:28:24.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~248s 2024-01-17T16:28:30.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~253s 2024-01-17T16:28:35.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~259s 2024-01-17T16:28:41.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~264s 2024-01-17T16:28:46.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~270s 2024-01-17T16:28:52.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~275s 2024-01-17T16:28:52.543 INFO:tasks.workunit.client.0.smithi026.stdout:notify 2024-01-17T16:28:52.551 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (31333 ms) 2024-01-17T16:28:52.551 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-01-17T16:28:52.569 INFO:tasks.workunit.client.0.smithi026.stdout:notify 2024-01-17T16:28:52.577 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (26 ms) 2024-01-17T16:28:52.578 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-01-17T16:28:52.602 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (25 ms) 2024-01-17T16:28:52.602 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-01-17T16:28:52.627 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (24 ms) 2024-01-17T16:28:52.627 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-01-17T16:28:52.641 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507755856 notify_id 3251290243076 notifier_gid 15575 2024-01-17T16:28:52.647 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (21 ms) 2024-01-17T16:28:52.648 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-01-17T16:28:52.661 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507755856 notify_id 3251290243078 notifier_gid 15575 2024-01-17T16:28:52.667 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (20 ms) 2024-01-17T16:28:52.667 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-01-17T16:28:52.687 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507755856 notify_id 3251290243079 notifier_gid 15575 2024-01-17T16:28:52.696 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (28 ms) 2024-01-17T16:28:52.696 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-01-17T16:28:52.716 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507762240 notify_id 3251290243080 notifier_gid 15575 2024-01-17T16:28:52.726 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (31 ms) 2024-01-17T16:28:52.726 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-01-17T16:28:52.742 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507762112 notify_id 3251290243077 notifier_gid 15575 2024-01-17T16:28:52.748 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (22 ms) 2024-01-17T16:28:52.748 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-01-17T16:28:52.767 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507762112 notify_id 3251290243078 notifier_gid 15575 2024-01-17T16:28:52.776 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (28 ms) 2024-01-17T16:28:52.776 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-01-17T16:28:52.788 INFO:tasks.workunit.client.0.smithi026.stdout: trying... 2024-01-17T16:28:52.790 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507762112 notify_id 3251290243081 notifier_gid 15575 2024-01-17T16:28:53.790 INFO:tasks.workunit.client.0.smithi026.stdout: timed out 2024-01-17T16:28:53.796 INFO:tasks.workunit.client.0.smithi026.stdout: flushing 2024-01-17T16:28:55.791 INFO:tasks.workunit.client.0.smithi026.stdout: flushed 2024-01-17T16:28:55.791 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3014 ms) 2024-01-17T16:28:55.791 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-01-17T16:28:55.810 INFO:tasks.workunit.client.0.smithi026.stdout: trying... 2024-01-17T16:28:55.812 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507762112 notify_id 3251290243079 notifier_gid 15575 2024-01-17T16:28:57.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~281s 2024-01-17T16:28:57.737 INFO:tasks.workunit.client.0.smithi026.stdout: timed out 2024-01-17T16:28:57.846 INFO:tasks.workunit.client.0.smithi026.stdout: flushing 2024-01-17T16:28:58.813 INFO:tasks.workunit.client.0.smithi026.stdout: flushed 2024-01-17T16:28:58.827 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3022 ms) 2024-01-17T16:28:58.827 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-01-17T16:28:58.836 INFO:tasks.workunit.client.0.smithi026.stdout:List watches 2024-01-17T16:28:58.837 INFO:tasks.workunit.client.0.smithi026.stdout:notify2 2024-01-17T16:28:58.839 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507762112 notify_id 3251290243080 notifier_gid 15575 2024-01-17T16:29:01.844 INFO:tasks.workunit.client.0.smithi026.stdout:notify2 done 2024-01-17T16:29:01.844 INFO:tasks.workunit.client.0.smithi026.stdout:watch_check 2024-01-17T16:29:01.844 INFO:tasks.workunit.client.0.smithi026.stdout:unwatch2 2024-01-17T16:29:01.853 INFO:tasks.workunit.client.0.smithi026.stdout: flushing 2024-01-17T16:29:01.853 INFO:tasks.workunit.client.0.smithi026.stdout:done 2024-01-17T16:29:01.853 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3041 ms) 2024-01-17T16:29:01.853 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-01-17T16:29:01.874 INFO:tasks.workunit.client.0.smithi026.stdout:List watches 2024-01-17T16:29:01.874 INFO:tasks.workunit.client.0.smithi026.stdout:notify2 2024-01-17T16:29:01.877 INFO:tasks.workunit.client.0.smithi026.stdout:handle_notify cookie 94210507762112 notify_id 3264175144970 notifier_gid 15575 2024-01-17T16:29:03.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~286s 2024-01-17T16:29:04.880 INFO:tasks.workunit.client.0.smithi026.stdout:notify2 done 2024-01-17T16:29:04.881 INFO:tasks.workunit.client.0.smithi026.stdout:watch_check 2024-01-17T16:29:04.881 INFO:tasks.workunit.client.0.smithi026.stdout:unwatch2 2024-01-17T16:29:04.890 INFO:tasks.workunit.client.0.smithi026.stdout: flushing 2024-01-17T16:29:04.890 INFO:tasks.workunit.client.0.smithi026.stdout:done 2024-01-17T16:29:04.890 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3037 ms) 2024-01-17T16:29:05.223 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (43672 ms total) 2024-01-17T16:29:05.223 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-01-17T16:29:05.223 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2024-01-17T16:29:05.223 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 16 tests from 2 test suites ran. (45987 ms total) 2024-01-17T16:29:05.223 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 14 tests. 2024-01-17T16:29:05.223 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] 2 tests, listed below: 2024-01-17T16:29:05.224 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-01-17T16:29:05.224 INFO:tasks.workunit.client.0.smithi026.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-01-17T16:29:05.226 INFO:tasks.workunit.client.0.smithi026.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-17T16:29:05.226 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 0 -eq 1 ']' 2024-01-17T16:29:05.226 INFO:tasks.workunit.client.0.smithi026.stderr:+ ceph_test_rados_api_cmd 2024-01-17T16:29:05.246 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2024-01-17T16:29:05.246 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 4 tests from 1 test suite. 2024-01-17T16:29:05.246 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2024-01-17T16:29:05.246 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from LibRadosCmd 2024-01-17T16:29:05.246 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-01-17T16:29:05.289 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosCmd.MonDescribe (43 ms) 2024-01-17T16:29:05.289 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-01-17T16:29:05.322 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] LibRadosCmd.OSDCmd (34 ms) 2024-01-17T16:29:05.323 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-01-17T16:29:08.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~292s 2024-01-17T16:29:14.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~297s 2024-01-17T16:29:19.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~303s 2024-01-17T16:29:19.713 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-01-17T16:29:20.218 INFO:tasks.ceph.osd.1:Sent signal 15 2024-01-17T16:29:20.218 INFO:tasks.ceph.osd.2:Sent signal 15 2024-01-17T16:29:20.219 INFO:tasks.ceph.osd.3:Sent signal 15 2024-01-17T16:29:20.219 INFO:tasks.ceph.mon.a:Sent signal 15 2024-01-17T16:29:20.219 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-01-17T16:29:20.259 INFO:tasks.ceph.mon.a.smithi026.stderr:2024-01-17T16:29:20.263+0000 7fc2ea9fc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 29887) UID: 0 2024-01-17T16:29:20.260 INFO:tasks.ceph.mon.a.smithi026.stderr:2024-01-17T16:29:20.263+0000 7fc2ea9fc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-17T16:29:20.260 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T16:29:20.264+0000 7f9ffc1f7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 29617) UID: 0 2024-01-17T19:12:03.105 INFO:tasks.workunit.client.0.smithi026.stderr:++ cleanup 2024-01-17T19:12:03.106 INFO:tasks.workunit.client.0.smithi026.stderr:++ pkill -P 31879 2024-01-17T19:12:03.120 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-01-17T19:12:03.120 INFO:tasks.workunit.client.0.smithi026.stderr:Terminated 2024-01-17T19:12:03.120 INFO:tasks.workunit.client.0.smithi026.stderr:++ true 2024-01-17T19:12:03.120 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-01-17T19:12:03.121 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-17T19:12:03.409 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi026 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cecb6cb5cdba1d67db289980b0e46cfe0334a30f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson' 2024-01-17T19:12:03.626 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5817e3e23cd443d1b5cbc405a9c9e1d2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi026 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cecb6cb5cdba1d67db289980b0e46cfe0334a30f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson' 2024-01-17T19:12:03.628 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-17T19:12:03.638 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-17T19:12:03.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T19:12:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.762+0000 7f6e9422d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-01-17T19:12:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.765+0000 7f6e9422d640 1 Processor -- start 2024-01-17T19:12:03.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.766+0000 7f6e9422d640 1 -- start start 2024-01-17T19:12:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.766+0000 7f6e9422d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e8c097930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.766+0000 7f6e9422d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e8c098c60 2024-01-17T19:12:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.766+0000 7f6e9422d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.766+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e8c097930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.766+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e8c099070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:03.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.766+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e8c097930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:03.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.967+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e8c097930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:03.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.967+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e8c097930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:03.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:03.967+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e8c099070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:04.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:04.368+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e8c099070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:04.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:04.368+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e8c097930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:04.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:04.368+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e8c097930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:05.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:05.169+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e8c099070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:05.169+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e8c097930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:05.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:05.169+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e8c097930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:06.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.767+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e8c097930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.767+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e8c097930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.767+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e8c099070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.767+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.767+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e8c098c60 2024-01-17T19:12:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.767+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.767+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:06.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.767+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:06.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.767+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:06.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.968+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:06.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.968+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:06.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:06.968+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:07.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:07.369+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:07.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:07.369+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:07.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:07.369+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:08.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:08.170+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:08.170+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:08.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:08.170+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:09.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.768+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:09.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.768+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.768+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.768+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.768+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e8c098c60 2024-01-17T19:12:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.768+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:09.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.768+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.768+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:09.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.768+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:09.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.969+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:09.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.969+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:09.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:09.969+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:10.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:10.370+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:10.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:10.370+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:10.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:10.370+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:11.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:11.171+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:11.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:11.171+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:11.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:11.171+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:12.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.768+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:12.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.768+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:12.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.768+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:12.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.768+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:12.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.768+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e8c098c60 2024-01-17T19:12:12.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.768+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:12.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.768+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:12.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.768+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.768+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:12.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.969+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:12.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.969+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:12.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:12.969+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:13.370+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:13.370+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:13.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:13.370+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:14.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:14.171+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:14.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:14.171+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:14.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:14.171+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:15.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.768+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:15.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.768+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:15.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.768+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e8c098c60 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:15.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.768+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:15.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.768+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000b740 2024-01-17T19:12:15.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.768+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:15.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.768+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000b740 legacy=0x7f6e7000bbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:15.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.769+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:15.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.769+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:15.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.970+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000b740 legacy=0x7f6e7000bbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:15.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.970+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:15.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:15.970+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:16.371+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:16.371+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:16.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:16.371+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000b740 legacy=0x7f6e7000bbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:17.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:17.172+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000b740 legacy=0x7f6e7000bbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:17.172+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:17.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:17.172+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:18.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.769+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:18.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:18.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.769+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000b740 legacy=0x7f6e7000bbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:18.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:18.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.769+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e70007f50 2024-01-17T19:12:18.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.769+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:18.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.769+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70007f50 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:18.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.769+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:18.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.769+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:18.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.970+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70007f50 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:18.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.970+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:18.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:18.970+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:19.371+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:19.371+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70007f50 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:19.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:19.371+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:20.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:20.172+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70007f50 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:20.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:20.172+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:20.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:20.172+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:21.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.769+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.769+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70007f50 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.769+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000bbb0 2024-01-17T19:12:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.769+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.769+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000bbb0 legacy=0x7f6e70008360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:21.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.769+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:21.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.769+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.970+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.970+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000bbb0 legacy=0x7f6e70008360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:21.970+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:22.371+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:22.371+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000bbb0 legacy=0x7f6e70008360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:22.371+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:23.172+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000bbb0 legacy=0x7f6e70008360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:23.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:23.172+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:23.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:23.172+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:24.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.769+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:24.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:24.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.769+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000bbb0 legacy=0x7f6e70008360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:24.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:24.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.769+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e70008a70 2024-01-17T19:12:24.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.769+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:24.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.769+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:24.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.769+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:24.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.769+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:24.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.970+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:24.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.970+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:24.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:24.970+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:25.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:25.371+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:25.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:25.371+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:25.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:25.371+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:26.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:26.172+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:26.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:26.172+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:26.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:26.172+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.769+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:27.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.769+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.769+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e70008a70 2024-01-17T19:12:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.769+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.769+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.769+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:27.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.769+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.970+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.970+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:27.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:27.970+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:28.371+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:28.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:28.371+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:28.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:28.371+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:29.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:29.172+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:29.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:29.172+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:29.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:29.172+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.769+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.769+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008a70 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:30.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.769+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e70008360 2024-01-17T19:12:30.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.769+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:30.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.769+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e7000f7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:30.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.769+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:30.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.769+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:30.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.970+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e7000f7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:30.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.970+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:30.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:30.970+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:31.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:31.371+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:31.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:31.371+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e7000f7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:31.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:31.371+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:32.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:32.172+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e7000f7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:32.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:32.172+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:32.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:32.172+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:33.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.769+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:33.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:33.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.769+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e7000f7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:33.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:33.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.769+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e70008360 2024-01-17T19:12:33.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.769+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:33.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.769+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:33.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.769+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:33.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.769+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:33.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.970+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:33.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.970+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:33.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:33.970+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:34.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:34.371+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:34.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:34.371+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:34.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:34.371+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:35.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:35.172+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:35.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:35.172+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:35.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:35.172+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:36.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.769+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:36.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:36.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.769+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e70007800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:36.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.769+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:36.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.769+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e70008360 2024-01-17T19:12:36.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.769+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:36.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.769+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:36.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.769+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:36.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.769+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.970+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.970+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:36.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:36.970+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:37.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:37.371+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:37.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:37.371+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:37.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:37.371+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:38.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:38.172+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:38.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:38.172+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:38.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:38.172+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:39.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.770+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:39.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.770+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:39.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.770+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70008360 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:39.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.770+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:39.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.770+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000d7c0 2024-01-17T19:12:39.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.770+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:39.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.770+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e7000fbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:39.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.770+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:39.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.770+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.971+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e7000fbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.971+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:39.971+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:40.372+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e7000fbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:40.372+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:40.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:40.372+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:41.173+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:41.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:41.173+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e7000fbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:41.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:41.173+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:42.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.770+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:42.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.770+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:42.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.770+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e7000fbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:42.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.770+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:42.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.770+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000d7c0 2024-01-17T19:12:42.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.770+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:42.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.770+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:42.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.770+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:42.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.770+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.971+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.971+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:42.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:42.971+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:43.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:43.372+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:43.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:43.372+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:43.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:43.372+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:44.173+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:44.173+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:44.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:44.173+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:45.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.770+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:45.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.770+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:45.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.770+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000d7c0 legacy=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.770+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.770+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000dbd0 2024-01-17T19:12:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.770+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e8c097520 2024-01-17T19:12:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.770+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:45.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.770+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:45.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.770+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.971+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.971+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:45.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:45.971+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:46.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:46.372+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:46.372+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:46.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:46.372+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:47.173+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:47.173+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:47.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:47.173+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.771+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 msgr2=0x7f6e7000b030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.771+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e8c097520 0x7f6e7000b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.771+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000fff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:48.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.771+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.771+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000dbd0 2024-01-17T19:12:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.771+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000c7b0 2024-01-17T19:12:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.771+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.771+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:48.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.771+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:48.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.972+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:48.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.972+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:48.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:48.972+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:49.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:49.373+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:49.373+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:49.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:49.373+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:50.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:50.174+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:50.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:50.174+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:50.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:50.174+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:51.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.771+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.771+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.771+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.771+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:51.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.771+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000dbd0 2024-01-17T19:12:51.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.771+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000c7b0 2024-01-17T19:12:51.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.771+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:51.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.771+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:51.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.771+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:51.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.972+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:51.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.972+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:51.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:51.972+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:52.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:52.373+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:52.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:52.373+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:52.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:52.373+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:53.174+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:53.174+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:53.174+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:54.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.771+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 msgr2=0x7f6e700077e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:54.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.771+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000c7b0 0x7f6e700077e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:54.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.771+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:54.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.771+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 0x7f6e7000afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:54.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.771+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000dbd0 2024-01-17T19:12:54.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.771+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000d2d0 2024-01-17T19:12:54.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.771+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:54.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.771+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:54.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.771+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.972+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.972+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:54.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:54.972+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:55.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:55.373+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:55.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:55.373+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:55.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:55.373+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:56.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:56.174+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:56.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:56.174+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:56.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:56.174+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:12:57.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.772+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.772+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000d2d0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:12:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.772+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dbd0 legacy=0x7f6e7000cbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:12:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.772+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 0x7f6e70011000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:12:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.772+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e70011540 2024-01-17T19:12:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.772+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e700077e0 2024-01-17T19:12:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.772+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 msgr2=0x7f6e70011000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:57.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.772+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e70013960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:57.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.772+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 0x7f6e70011000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:12:57.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.973+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 msgr2=0x7f6e70011000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:57.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.973+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e70013960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:57.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:57.973+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 0x7f6e70011000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:12:58.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:58.374+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e70013960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:58.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:58.374+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 msgr2=0x7f6e70011000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:58.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:58.374+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 0x7f6e70011000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:12:59.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:59.175+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e70013960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:12:59.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:59.175+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 msgr2=0x7f6e70011000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:12:59.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:12:59.175+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 0x7f6e70011000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.772+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 msgr2=0x7f6e70011000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:00.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.772+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e700077e0 0x7f6e70011000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:00.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.772+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e70013960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:00.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.772+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:00.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.772+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e70011540 2024-01-17T19:13:00.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.772+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000cbc0 2024-01-17T19:13:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.772+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.772+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:00.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.772+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.973+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.973+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:00.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:00.973+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:01.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:01.374+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:01.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:01.374+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:01.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:01.374+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:02.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:02.175+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:02.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:02.175+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:02.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:02.175+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:03.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.772+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:03.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.772+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:03.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.772+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:03.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.772+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:03.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.772+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e70011540 2024-01-17T19:13:03.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.772+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000cbc0 2024-01-17T19:13:03.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.772+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:03.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.772+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:03.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.772+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:03.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.973+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:03.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.973+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:03.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:03.973+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:04.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:04.374+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:04.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:04.374+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:04.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:04.374+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:05.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:05.175+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:05.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:05.175+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:05.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:05.175+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.773+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70008fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.773+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70008fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.773+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70011540 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.773+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70011230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.773+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000f700 2024-01-17T19:13:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.773+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000cbc0 2024-01-17T19:13:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.773+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f700 legacy=0x7f6e7000fb10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.773+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70011230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.773+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70011230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:06.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.974+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f700 legacy=0x7f6e7000fb10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:06.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.974+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70011230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:06.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:06.974+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70011230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:07.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:07.375+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70011230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:07.375+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f700 legacy=0x7f6e7000fb10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:07.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:07.375+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70011230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:08.176+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70011230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:08.176+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f700 legacy=0x7f6e7000fb10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:08.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:08.176+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70011230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:09.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.773+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e70011230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.773+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e70011230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.773+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f700 legacy=0x7f6e7000fb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.773+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:09.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.773+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000dfe0 2024-01-17T19:13:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.773+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000cbc0 2024-01-17T19:13:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.773+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.773+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:09.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.773+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:09.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.974+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:09.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.974+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:09.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:09.974+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:10.375+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:10.375+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:10.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:10.375+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:11.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:11.176+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:11.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:11.176+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:11.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:11.176+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:12.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.773+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000afd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.773+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.773+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.773+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.773+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000eb00 2024-01-17T19:13:12.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.773+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000cbc0 2024-01-17T19:13:12.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.773+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:12.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.773+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:12.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.773+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:12.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.974+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:12.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.974+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:12.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:12.974+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:13.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:13.375+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:13.375+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:13.375+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:14.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:14.176+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:14.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:14.176+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:14.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:14.176+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:15.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.774+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.774+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000cbc0 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.774+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.774+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 0x7f6e7000dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.774+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000eb00 2024-01-17T19:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.774+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000e520 2024-01-17T19:13:15.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.774+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:15.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.774+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:15.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.774+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.975+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.975+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:15.975+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:16.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:16.376+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:16.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:16.376+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:16.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:16.376+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:17.177+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:17.177+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:17.177+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:18.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.774+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 msgr2=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:18.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.774+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e520 0x7f6e7000dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:18.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.774+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:18.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.774+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:18.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.774+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000eb00 2024-01-17T19:13:18.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.774+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000afd0 2024-01-17T19:13:18.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.774+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:18.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.774+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:18.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.774+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:18.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.975+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:18.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.975+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:18.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:18.975+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:19.376+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:19.376+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:19.376+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:20.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:20.177+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:20.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:20.177+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:20.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:20.177+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:21.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.774+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:21.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.774+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.774+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000eb00 legacy=0x7f6e7000dfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.774+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.774+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000e6f0 2024-01-17T19:13:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.774+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000afd0 2024-01-17T19:13:21.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.775+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e6f0 legacy=0x7f6e7000ff20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.775+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:21.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.775+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:21.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.976+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:21.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.976+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e6f0 legacy=0x7f6e7000ff20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:21.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:21.976+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:22.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:22.377+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e6f0 legacy=0x7f6e7000ff20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:22.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:22.377+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:22.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:22.377+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:23.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:23.178+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e6f0 legacy=0x7f6e7000ff20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:23.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:23.178+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:23.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:23.178+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:24.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.775+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 msgr2=0x7f6e70010630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:24.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000afd0 0x7f6e70010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:24.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.775+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e6f0 legacy=0x7f6e7000ff20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:24.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:24.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.775+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000f450 2024-01-17T19:13:24.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.775+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:13:24.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.775+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:24.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.775+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:24.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.775+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:24.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.976+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.976+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:24.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:24.976+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:25.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:25.377+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:25.377+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:25.377+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:26.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:26.178+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:26.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:26.178+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:26.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:26.178+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.775+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.775+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70015ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.775+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000e3f0 2024-01-17T19:13:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.775+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:13:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.775+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.775+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.775+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:27.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.976+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:27.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.976+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:27.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:27.976+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:28.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:28.377+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:28.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:28.377+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:28.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:28.377+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:29.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:29.178+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:29.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:29.178+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:29.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:29.178+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:30.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.774+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.774+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.774+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.774+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.774+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000f450 2024-01-17T19:13:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.774+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:13:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.774+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70012f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.774+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:30.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.774+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:30.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.975+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:30.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.975+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70012f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:30.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:30.975+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:31.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:31.376+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70012f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:31.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:31.376+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:31.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:31.376+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:32.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:32.177+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:32.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:32.177+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70012f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:32.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:32.177+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:33.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.775+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:33.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:33.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.775+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000f450 legacy=0x7f6e70012f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:33.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e7000f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:33.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.775+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000afd0 2024-01-17T19:13:33.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.775+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000e3f0 2024-01-17T19:13:33.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.775+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:33.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.775+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000afd0 legacy=0x7f6e7000fda0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:33.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.775+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e7000f860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:33.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.976+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000afd0 legacy=0x7f6e7000fda0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:33.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.976+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:33.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:33.976+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e7000f860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:34.377+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:34.377+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000afd0 legacy=0x7f6e7000fda0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:34.377+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e7000f860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:35.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:35.178+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000afd0 legacy=0x7f6e7000fda0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:35.178+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:35.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:35.178+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e7000f860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:36.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.775+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e7000f860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:36.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e7000f860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:36.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.775+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000afd0 legacy=0x7f6e7000fda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:36.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:36.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.775+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000e3f0 2024-01-17T19:13:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.775+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:13:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.775+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.775+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.775+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:36.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.976+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:36.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.976+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:36.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:36.976+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:37.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:37.377+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:37.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:37.377+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:37.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:37.377+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:38.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:38.178+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:38.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:38.178+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:38.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:38.178+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:39.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.775+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:39.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:39.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.775+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:39.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.775+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:39.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.775+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000e3f0 2024-01-17T19:13:39.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.775+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:13:39.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.775+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:39.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.775+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:39.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.775+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:39.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.976+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.976+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:39.976+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:40.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:40.377+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:40.377+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:40.377+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:41.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:41.178+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:41.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:41.178+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:41.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:41.178+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:42.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.776+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.776+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.776+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.776+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.776+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000e3f0 2024-01-17T19:13:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.776+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:13:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.776+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.776+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:42.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.776+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.977+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.977+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:42.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:42.977+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:43.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:43.378+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:43.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:43.378+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:43.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:43.378+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:44.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:44.179+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:44.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:44.179+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:44.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:44.179+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:45.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.776+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000ef10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:45.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.776+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:45.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.776+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000e3f0 legacy=0x7f6e7000f450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:45.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.776+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:45.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.776+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e70009fd0 2024-01-17T19:13:45.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.776+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:13:45.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.776+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70009fd0 legacy=0x7f6e7000a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:45.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.776+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:45.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.776+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:45.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.977+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:45.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.977+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70009fd0 legacy=0x7f6e7000a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:45.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:45.977+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:46.378+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:46.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:46.378+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70009fd0 legacy=0x7f6e7000a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:46.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:46.378+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:47.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:47.179+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:47.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:47.179+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70009fd0 legacy=0x7f6e7000a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:47.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:47.179+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:48.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.776+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:48.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.776+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:48.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.776+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70009fd0 legacy=0x7f6e7000a3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:48.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.776+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:48.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.776+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000aaf0 2024-01-17T19:13:48.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.776+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:13:48.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.776+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000aaf0 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:48.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.776+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000af00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:48.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.776+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:48.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.977+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000af00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:48.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.977+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000aaf0 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:48.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:48.977+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:49.378+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000af00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:49.378+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000aaf0 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:49.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:49.378+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:50.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:50.179+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000aaf0 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:50.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:50.179+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000af00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:50.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:50.179+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.777+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000af00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.777+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:51.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.777+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000aaf0 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:51.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.777+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:51.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.777+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000dfe0 2024-01-17T19:13:51.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.777+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000e3f0 2024-01-17T19:13:51.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.777+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e70013640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:51.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.777+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:51.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.777+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:51.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.978+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e70013640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:51.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.978+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:51.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:51.978+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:52.379+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e70013640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:52.379+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:52.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:52.379+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:53.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:53.180+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e70013640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:53.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:53.180+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:53.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:53.180+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.777+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.777+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.777+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000dfe0 legacy=0x7f6e70013640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.777+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.777+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e7000a510 2024-01-17T19:13:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.777+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000e3f0 2024-01-17T19:13:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.777+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.777+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:54.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.777+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.978+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.978+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:54.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:54.978+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:55.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:55.379+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:55.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:55.379+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:55.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:55.379+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:56.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:56.180+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:56.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:56.180+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:56.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:56.180+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:13:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.777+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 msgr2=0x7f6e70009fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.777+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000e3f0 0x7f6e70009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:13:57.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.777+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:13:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.777+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:13:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.777+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06d980 con 0x7f6e7000a510 2024-01-17T19:13:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.777+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:13:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.777+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000a920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.777+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:57.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.777+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:13:57.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.978+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000a920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:57.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.978+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:57.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:57.978+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:13:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:58.379+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000a920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:58.379+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:58.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:58.379+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:13:59.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:59.180+0000 7f6e91fc9640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000a920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:13:59.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:59.180+0000 7f6e917c8640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:13:59.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:13:59.180+0000 7f6e91fc9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:14:00.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.778+0000 7f6e837fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000a920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:14:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.778+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T19:14:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.778+0000 7f6e837fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e7000a510 legacy=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T19:14:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.778+0000 7f6e837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T19:14:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.778+0000 7f6e837fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c097e70 con 0x7f6e70009fd0 2024-01-17T19:14:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.778+0000 7f6e837fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c072a50 con 0x7f6e7000dfe0 2024-01-17T19:14:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.778+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70009fd0 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:14:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.778+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:14:00.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.778+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T19:14:00.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.979+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:14:00.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.979+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70009fd0 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:14:00.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:00.979+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T19:14:01.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:01.380+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70009fd0 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:14:01.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:01.380+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:14:01.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:01.380+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T19:14:02.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:02.181+0000 7f6e917c8640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 msgr2=0x7f6e7000e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-01-17T19:14:02.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:02.181+0000 7f6e91fc9640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f6e70009fd0 legacy=0x7f6e70010f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-01-17T19:14:02.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-01-17T19:14:02.181+0000 7f6e917c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6e7000dfe0 0x7f6e7000e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T19:14:03.684 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-01-17T19:14:03.685 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2774, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2606, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2372, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1627, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1618, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-01-17T19:14:03.695 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-17T19:14:03.696 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-17T19:14:03.696 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-17T19:14:03.696 INFO:teuthology.orchestra.run:waiting for 300 2024-01-17T19:14:03.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T19:14:03.698 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2774, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2606, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2372, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1627, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1618, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log' 2024-01-17T19:14:03.709 INFO:tasks.ceph.osd.0:Stopped 2024-01-17T19:14:03.709 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-17T19:14:03.710 INFO:teuthology.orchestra.run:waiting for 300 2024-01-17T19:14:03.803 INFO:tasks.ceph.osd.1:Stopped 2024-01-17T19:14:03.804 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-17T19:14:03.804 INFO:teuthology.orchestra.run:waiting for 300 2024-01-17T19:14:03.903 INFO:tasks.ceph.osd.2:Stopped 2024-01-17T19:14:03.903 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-17T19:14:03.903 INFO:teuthology.orchestra.run:waiting for 300 2024-01-17T19:14:03.991 INFO:tasks.ceph.osd.3:Stopped 2024-01-17T19:14:03.991 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-17T19:14:03.991 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-17T19:14:03.992 INFO:teuthology.orchestra.run:waiting for 300 2024-01-17T19:14:03.992 INFO:tasks.ceph.mgr.x:Stopped 2024-01-17T19:14:03.992 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-17T19:14:03.992 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-17T19:14:03.992 INFO:teuthology.orchestra.run:waiting for 300 2024-01-17T19:14:03.992 INFO:tasks.ceph.mon.a:Stopped 2024-01-17T19:14:03.993 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-17T19:14:03.993 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-01-17T19:14:04.026 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi026.front.sepia.ceph.com 2024-01-17T19:14:04.027 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-17T19:14:04.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi026.front.sepia.ceph.com 2024-01-17T19:14:04.163 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-17T19:14:04.235 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T19:14:04.236 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-17T19:14:04.395 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T19:14:04.395 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-17T19:14:04.457 INFO:tasks.ceph:Archiving mon data... 2024-01-17T19:14:04.459 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842/data/mon.a.tgz 2024-01-17T19:14:04.459 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-01-17T19:14:04.475 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.kac8Hj2tez 2024-01-17T19:14:04.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kac8Hj2tez 2024-01-17T19:14:04.653 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.kac8Hj2tez 2024-01-17T19:14:04.739 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.kac8Hj2tez is 370KB 2024-01-17T19:14:04.838 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.kac8Hj2tez 2024-01-17T19:14:04.853 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-17T19:14:04.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-17T19:14:04.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-17T19:14:04.974 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-17T19:14:04.992 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-17T19:14:04.992 INFO:tasks.ceph:Archiving crash dumps... 2024-01-17T19:14:04.994 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842/remote/smithi026/crash 2024-01-17T19:14:04.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-17T19:14:05.041 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842/remote/smithi137/crash 2024-01-17T19:14:05.042 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-17T19:14:05.094 INFO:tasks.ceph:Compressing logs... 2024-01-17T19:14:05.094 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-17T19:14:05.097 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-17T19:14:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29697.log 2024-01-17T19:14:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29817.log 2024-01-17T19:14:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29777.log 2024-01-17T19:14:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29697.log: /var/log/ceph/ceph-client.admin.29817.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.29697.log.gz 2024-01-17T19:14:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-17T19:14:05.132 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29777.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-17T19:14:05.132 INFO:teuthology.orchestra.run.smithi137.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.29817.log.gz 2024-01-17T19:14:05.132 INFO:teuthology.orchestra.run.smithi137.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.29777.log.gz 2024-01-17T19:14:05.132 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-17T19:14:05.132 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29737.log 2024-01-17T19:14:05.132 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.29737.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.29737.log.gz 2024-01-17T19:14:05.147 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-17T19:14:05.148 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33268.log 2024-01-17T19:14:05.148 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30152.log 2024-01-17T19:14:05.148 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95478.log 2024-01-17T19:14:05.148 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.30152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31880.log 2024-01-17T19:14:05.148 INFO:teuthology.orchestra.run.smithi026.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.30152.log.gz 2024-01-17T19:14:05.148 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33268.log.gz 2024-01-17T19:14:05.148 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log 2024-01-17T19:14:05.149 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31662.log 2024-01-17T19:14:05.149 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31880.log: /var/log/ceph/ceph-client.admin.33172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31468.log 2024-01-17T19:14:05.149 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31200.log 2024-01-17T19:14:05.149 INFO:teuthology.orchestra.run.smithi026.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31662.log.gz 2024-01-17T19:14:05.149 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95399.log 2024-01-17T19:14:05.149 INFO:teuthology.orchestra.run.smithi026.stderr: 90.5%gzip -5 86.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.31468.log.gz /var/log/ceph/ceph-client.admin.30976.log 2024-01-17T19:14:05.149 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-01-17T19:14:05.149 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31200.log: -- replaced with /var/log/ceph/ceph-client.admin.33172.log.gz 2024-01-17T19:14:05.150 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33287.log 2024-01-17T19:14:05.150 INFO:teuthology.orchestra.run.smithi026.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31200.log.gz 2024-01-17T19:14:05.150 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.30976.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27580.log 2024-01-17T19:14:05.150 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95399.log.gz 2024-01-17T19:14:05.150 INFO:teuthology.orchestra.run.smithi026.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30976.log.gz 2024-01-17T19:14:05.150 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95437.log 2024-01-17T19:14:05.150 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-17T19:14:05.150 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.tmp-client.admin.27580.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33287.log.gz 2024-01-17T19:14:05.151 INFO:teuthology.orchestra.run.smithi026.stderr: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27580.log.gz 2024-01-17T19:14:05.151 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31470.log 2024-01-17T19:14:05.151 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95065.log 2024-01-17T19:14:05.151 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31470.log: gzip -5 --verbose -- 90.7% -- replaced with /var/log/ceph/ceph-client.admin.95437.log.gz 2024-01-17T19:14:05.151 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.31467.log 2024-01-17T19:14:05.151 INFO:teuthology.orchestra.run.smithi026.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31470.log.gz 2024-01-17T19:14:05.151 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33306.log 2024-01-17T19:14:05.151 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31467.log: gzip -5 --verbose -- 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-17T19:14:05.152 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.30124.log 2024-01-17T19:14:05.152 INFO:teuthology.orchestra.run.smithi026.stderr: 87.0%/var/log/ceph/ceph-client.admin.33306.log: -- replaced with /var/log/ceph/ceph-client.admin.31467.log.gz 2024-01-17T19:14:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94955.log 2024-01-17T19:14:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.30124.log: gzip -5 84.8% -- replaced with /var/log/ceph/ceph-client.admin.30124.log.gz 2024-01-17T19:14:05.152 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.29968.log 2024-01-17T19:14:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.94955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29889.log 2024-01-17T19:14:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.29968.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95065.log.gz 2024-01-17T19:14:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31032.log 2024-01-17T19:14:05.153 INFO:teuthology.orchestra.run.smithi026.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.29968.log.gz 2024-01-17T19:14:05.153 INFO:teuthology.orchestra.run.smithi026.stderr: 92.4%/var/log/ceph/ceph-client.admin.29889.log: -- replaced with /var/log/ceph/ceph-client.admin.31880.log.gz 2024-01-17T19:14:05.153 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-17T19:14:05.153 INFO:teuthology.orchestra.run.smithi026.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29889.log.gz 2024-01-17T19:14:05.153 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31620.log 2024-01-17T19:14:05.153 INFO:teuthology.orchestra.run.smithi026.stderr: 85.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33230.log 2024-01-17T19:14:05.153 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.31032.log.gz 2024-01-17T19:14:05.153 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95283.log 2024-01-17T19:14:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:gzip 85.3% -- replaced with /var/log/ceph/ceph-client.admin.31620.log.gz 2024-01-17T19:14:05.154 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95664.log 2024-01-17T19:14:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95283.log: /var/log/ceph/ceph-client.admin.33230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31301.log 2024-01-17T19:14:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95664.log: 90.5% 95.8% -- replaced with /var/log/ceph/ceph-client.admin.95664.log.gz 2024-01-17T19:14:05.154 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95283.log.gz 2024-01-17T19:14:05.154 INFO:teuthology.orchestra.run.smithi026.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.33230.log.gz 2024-01-17T19:14:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33191.log 2024-01-17T19:14:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31158.log 2024-01-17T19:14:05.154 INFO:teuthology.orchestra.run.smithi026.stderr: 87.0%/var/log/ceph/ceph-client.admin.33191.log: -- replaced with /var/log/ceph/ceph-client.admin.31301.log.gz 2024-01-17T19:14:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31302.log 2024-01-17T19:14:05.155 INFO:teuthology.orchestra.run.smithi026.stderr: 90.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31578.log 2024-01-17T19:14:05.155 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33191.log.gz 2024-01-17T19:14:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31158.log: /var/log/ceph/ceph-client.admin.31302.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31158.log.gz 2024-01-17T19:14:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33138.log 2024-01-17T19:14:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31469.log 2024-01-17T19:14:05.155 INFO:teuthology.orchestra.run.smithi026.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.31302.log.gz 85.7% 2024-01-17T19:14:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33138.log: -- replaced with /var/log/ceph/ceph-client.admin.31578.log.gz 2024-01-17T19:14:05.155 INFO:teuthology.orchestra.run.smithi026.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.94955.log.gz 2024-01-17T19:14:05.156 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31116.log 2024-01-17T19:14:05.156 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5/var/log/ceph/ceph-client.admin.31469.log: --verbose -- /var/log/ceph/ceph-client.admin.95246.log 2024-01-17T19:14:05.156 INFO:teuthology.orchestra.run.smithi026.stderr: 90.3%/var/log/ceph/ceph-client.admin.31116.log: -- replaced with /var/log/ceph/ceph-client.admin.33138.log.gz 2024-01-17T19:14:05.156 INFO:teuthology.orchestra.run.smithi026.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31469.log.gz 2024-01-17T19:14:05.156 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-17T19:14:05.156 INFO:teuthology.orchestra.run.smithi026.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31116.log.gz 2024-01-17T19:14:05.156 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31299.log 2024-01-17T19:14:05.156 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95246.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31074.log 2024-01-17T19:14:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95457.log 2024-01-17T19:14:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31299.log: /var/log/ceph/ceph-client.admin.31074.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31299.log.gz 2024-01-17T19:14:05.157 INFO:teuthology.orchestra.run.smithi026.stderr: 90.0% 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31074.log.gz 2024-01-17T19:14:05.157 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95246.log.gz 2024-01-17T19:14:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-17T19:14:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95027.log 2024-01-17T19:14:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95457.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32364.log 2024-01-17T19:14:05.157 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95027.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95027.log.gz 2024-01-17T19:14:05.158 INFO:teuthology.orchestra.run.smithi026.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.95457.log.gz 2024-01-17T19:14:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31300.log 2024-01-17T19:14:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95418.log 2024-01-17T19:14:05.158 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31300.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31300.log.gz 2024-01-17T19:14:05.159 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.95418.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95418.log.gz 2024-01-17T19:14:05.159 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-17T19:14:05.159 INFO:teuthology.orchestra.run.smithi026.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.95478.log.gz 2024-01-17T19:14:05.159 INFO:teuthology.orchestra.run.smithi026.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.32364.log.gz 2024-01-17T19:14:05.323 INFO:teuthology.orchestra.run.smithi137.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-17T19:14:05.562 INFO:teuthology.orchestra.run.smithi026.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33306.log.gz 2024-01-17T19:14:06.582 INFO:teuthology.orchestra.run.smithi026.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-17T19:14:20.401 INFO:teuthology.orchestra.run.smithi026.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-17T19:14:24.895 INFO:teuthology.orchestra.run.smithi137.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-17T19:14:25.456 INFO:teuthology.orchestra.run.smithi137.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-17T19:14:25.459 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-01-17T19:14:25.459 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m20.346s 2024-01-17T19:14:25.459 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m38.672s 2024-01-17T19:14:25.460 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m1.579s 2024-01-17T19:14:25.812 INFO:teuthology.orchestra.run.smithi026.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-17T19:14:25.814 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-01-17T19:14:25.814 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m20.706s 2024-01-17T19:14:25.814 INFO:teuthology.orchestra.run.smithi026.stderr:user 0m36.589s 2024-01-17T19:14:25.815 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m1.325s 2024-01-17T19:14:25.815 INFO:tasks.ceph:Archiving logs... 2024-01-17T19:14:25.815 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842/remote/smithi026/log 2024-01-17T19:14:25.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-17T19:14:31.384 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842/remote/smithi137/log 2024-01-17T19:14:31.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-17T19:14:37.334 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2774, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2606, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2372, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1627, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1618, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-01-17T19:14:37.343 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-17T19:14:37.351 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2774, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2606, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2372, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1627, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1618, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-01-17T19:14:37.355 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-17T19:14:37.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-17T19:14:37.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-17T19:14:37.434 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-17T19:14:37.442 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-17T19:14:37.442 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-17T19:14:37.445 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-17T19:14:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-01-17T19:14:37.461 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-01-17T19:14:37.463 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-17T19:14:37.463 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-01-17T19:14:37.463 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 106 -357us[ -361us] +/- 79ms 2024-01-17T19:14:37.463 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv02.front.sepia.ceph.com 3 8 377 47 -228us[ -232us] +/- 56ms 2024-01-17T19:14:37.463 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 9 377 295 +610us[ +607us] +/- 71ms 2024-01-17T19:14:37.464 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T19:14:37.465 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-17T19:14:37.465 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-01-17T19:14:37.466 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 34 -339us[ -339us] +/- 80ms 2024-01-17T19:14:37.466 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv02.front.sepia.ceph.com 3 7 377 79 -255us[ -253us] +/- 56ms 2024-01-17T19:14:37.466 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 93 +582us[ +583us] +/- 74ms 2024-01-17T19:14:37.466 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-01-17T19:14:37.467 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-17T19:14:37.474 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-17T19:14:37.475 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-17T19:14:37.483 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-17T19:14:37.575 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-17T19:14:37.645 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-17T19:14:37.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T19:14:37.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-17T19:14:37.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T19:14:37.708 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-17T19:14:37.716 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-17T19:14:37.723 INFO:teuthology.task.internal:Duration was 11800.095268 seconds 2024-01-17T19:14:37.723 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-17T19:14:37.731 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-17T19:14:37.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-17T19:14:37.734 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-17T19:14:37.777 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-17T19:14:37.792 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-17T19:14:38.086 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-17T19:14:38.086 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2024-01-17T19:14:38.086 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-17T19:14:38.107 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T19:14:38.107 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-17T19:14:38.252 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-17T19:14:38.252 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-17T19:14:38.255 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-17T19:14:38.287 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-17T19:14:38.287 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-17T19:14:38.326 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-17T19:14:38.428 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-17T19:14:38.437 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-17T19:14:38.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-17T19:14:38.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-17T19:14:38.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-17T19:14:38.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-17T19:14:38.506 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-17T19:14:38.528 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2024-01-17T19:14:38.556 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-01-17T19:14:38.576 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-17T19:14:38.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T19:14:38.609 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-17T19:14:38.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T19:14:38.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-17T19:14:38.639 INFO:teuthology.task.internal:Transferring archived files... 2024-01-17T19:14:38.640 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842/remote/smithi026 2024-01-17T19:14:38.640 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-17T19:14:38.684 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842/remote/smithi137 2024-01-17T19:14:38.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-17T19:14:38.719 INFO:teuthology.task.internal:Removing archive directory... 2024-01-17T19:14:38.719 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-17T19:14:38.722 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-17T19:14:38.768 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-17T19:14:38.778 INFO:teuthology.task.internal:Not uploading archives. 2024-01-17T19:14:38.778 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-17T19:14:38.792 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-17T19:14:38.792 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-17T19:14:38.795 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-17T19:14:38.806 INFO:teuthology.orchestra.run.smithi026.stdout: 265291 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 17 19:14 /home/ubuntu/cephtest 2024-01-17T19:14:38.806 INFO:teuthology.orchestra.run.smithi026.stdout: 531647 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 17 16:10 /home/ubuntu/cephtest/mnt.0 2024-01-17T19:14:38.806 INFO:teuthology.orchestra.run.smithi026.stdout: 531648 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 17 16:12 /home/ubuntu/cephtest/mnt.0/client.0 2024-01-17T19:14:38.807 INFO:teuthology.orchestra.run.smithi026.stdout: 545684 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 17 16:12 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-17T19:14:38.807 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-01-17T19:14:38.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T19:14:38.811 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2774, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2606, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 2372, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1627, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_cecb6cb5cdba1d67db289980b0e46cfe0334a30f/qa/tasks/ceph_manager.py", line 1618, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-01-17T19:14:38.823 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-17T19:14:38.832 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-17T19:14:38.842 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-01-17T19:14:38.842 INFO:teuthology.nuke:Checking targets against current locks 2024-01-17T19:14:38.848 INFO:teuthology.orchestra.run.smithi137.stdout: 266028 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 17 19:14 /home/ubuntu/cephtest 2024-01-17T19:14:38.870 DEBUG:teuthology.nuke:shortname: smithi026 2024-01-17T19:14:38.871 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T19:14:38.895 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 15:48:24.837544', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9JHUYiSDs+eSJB6N1t8wuVYL+5hSY92TdMf7FvQqEhqcWBcU7htAr3e5uOAqTL8Yhx/VWVDzw/xRMP3kqmD3A='} 2024-01-17T19:14:38.898 DEBUG:teuthology.nuke:shortname: smithi137 2024-01-17T19:14:38.898 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T19:14:38.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-01-17_15:47:21-crimson-rados-wip-matanb-crimson-testing-17.1-crimson-only-distro-crimson-smithi/7518842', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 15:48:24.840012', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7QE6FHsWHdnD+uknp03lBjueOu1SCwS8NyzbAI3HVm4iE3fkdCMErhNAuToijZjx9u++5PGRc0taKSsUXGSdo='} 2024-01-17T19:14:38.955 INFO:teuthology.orchestra.console.smithi026:Power off 2024-01-17T19:14:38.955 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T19:14:38.971 INFO:teuthology.orchestra.console.smithi137:Power off 2024-01-17T19:14:38.971 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-17T19:14:38.980 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-01-17T19:14:38.980 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T19:14:38.993 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-01-17T19:14:38.993 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T19:14:39.004 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-01-17T19:14:39.015 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-17T19:14:43.005 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T19:14:43.015 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T19:14:43.118 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-01-17T19:14:43.126 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-17T19:14:47.123 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T19:14:47.133 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-17T19:14:47.235 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-01-17T19:14:47.244 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-01-17T19:14:47.337 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-01-17T19:14:47.346 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-01-17T19:14:47.453 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 11800.095267772675 failure_reason: 'Command failed (workunit test rados/test.sh) on smithi026 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cecb6cb5cdba1d67db289980b0e46cfe0334a30f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson''' flavor: crimson owner: scheduled_matan@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5817e3e23cd443d1b5cbc405a9c9e1d2 status: fail success: false 2024-01-17T19:14:47.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T19:14:47.605 INFO:teuthology.run:FAIL